2019-12-08T11:42:22.313 INFO:root:teuthology version: 1.0.0-8b630f9 2019-12-08T11:42:22.313 DEBUG:teuthology.run:Teuthology command: teuthology /tmp/teuthology-worker.yQl10P.tmp -- --verbose --lock --description rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} --name ofriedma-2019-12-08_11:30:09-rgw-wip-ofriedma-dynamic-disable-distro-basic-smithi --block --owner scheduled_ofriedma@teuthology --archive /home/teuthworker/archive/ofriedma-2019-12-08_11:30:09-rgw-wip-ofriedma-dynamic-disable-distro-basic-smithi/4581733 2019-12-08T11:42:22.359 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2019-12-08T11:42:22.411 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/ofriedma-2019-12-08_11:30:09-rgw-wip-ofriedma-dynamic-disable-distro-basic-smithi/4581733 branch: wip-ofriedma-dynamic-disable description: rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml} email: ofriedma@redhat.com first_in_suite: false job_id: '4581733' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi name: ofriedma-2019-12-08_11:30:09-rgw-wip-ofriedma-dynamic-disable-distro-basic-smithi nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: centos overrides: admin_socket: branch: wip-ofriedma-dynamic-disable ceph: conf: client: debug rgw: 20 rgw crypt require ssl: false rgw crypt s3 kms backend: testing rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= rgw lc debug interval: 10 global: mon client directed command retry: 5 ms inject socket failures: 5000 osd heartbeat grace: 40 osd_max_pg_log_entries: 10 osd_min_pg_log_entries: 10 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon osd crush smoke test: false osd: debug filestore: 20 debug journal: 20 debug ms: 1 debug osd: 25 osd fast shutdown: false osd objectstore: filestore osd shutdown pgref assert: true osd sloppy crc: true fs: xfs log-whitelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME sha1: 1351c819e1a9518cde4c8b12d645782009028360 valgrind: mds: - --tool=memcheck mon: - --tool=memcheck - --leak-check=full - --show-reachable=yes osd: - --tool=memcheck ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: osd objectstore: filestore osd sloppy crc: true filestore: true fs: xfs install: ceph: flavor: notcmalloc sha1: 1351c819e1a9518cde4c8b12d645782009028360 rgw: compression type: random ec-data-pool: true erasure_code_profile: crush-failure-domain: osd k: 3 m: 1 name: testprofile frontend: civetweb storage classes: LUKEWARM, FROZEN s3tests: slow_backend: true workunit: branch: wip-ofriedma-dynamic-disable sha1: 1351c819e1a9518cde4c8b12d645782009028360 owner: scheduled_ofriedma@teuthology priority: 30 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 sha1: 1351c819e1a9518cde4c8b12d645782009028360 suite: rgw suite_branch: wip-ofriedma-dynamic-disable suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_wip-ofriedma-dynamic-disable/qa suite_relpath: qa suite_repo: git://git.ceph.com/ceph-ci.git suite_sha1: 1351c819e1a9518cde4c8b12d645782009028360 tasks: - install: flavor: notcmalloc - ceph: null - openssl_keys: null - rgw: client.0: valgrind: - --tool=memcheck - --max-threads=1024 - workunit: clients: client.0: - cls/test_cls_lock.sh - cls/test_cls_log.sh - cls/test_cls_refcount.sh - cls/test_cls_rgw.sh - rgw/test_rgw_gc_log.sh - ragweed: client.0: default-branch: ceph-master rgw_server: client.0 stages: prepare,check - s3tests-java: client.0: force-branch: master force-repo: https://github.com/ceph/java_s3tests.git - s3tests: client.0: force-branch: ceph-master rgw_server: client.0 - swift: client.0: rgw_server: client.0 teuthology_branch: master tube: smithi verbose: false worker_log: /home/teuthworker/archive/worker_logs/worker.smithi.8221 2019-12-08T11:42:22.412 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_wip-ofriedma-dynamic-disable/qa; will attempt to use it 2019-12-08T11:42:22.412 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_wip-ofriedma-dynamic-disable/qa/tasks 2019-12-08T11:42:22.413 INFO:teuthology.run_tasks:Running task internal.check_packages... 2019-12-08T11:42:22.414 INFO:teuthology.task.internal:Checking packages... 2019-12-08T11:42:22.427 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'notcmalloc' and ceph hash '1351c819e1a9518cde4c8b12d645782009028360' 2019-12-08T11:42:22.428 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2019-12-08T11:42:22.428 INFO:teuthology.packaging:ref: None 2019-12-08T11:42:22.428 INFO:teuthology.packaging:tag: None 2019-12-08T11:42:22.428 INFO:teuthology.packaging:branch: wip-ofriedma-dynamic-disable 2019-12-08T11:42:22.428 INFO:teuthology.packaging:sha1: 1351c819e1a9518cde4c8b12d645782009028360 2019-12-08T11:42:22.428 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=notcmalloc&distros=centos%2F7%2Fx86_64&ref=wip-ofriedma-dynamic-disable 2019-12-08T11:42:22.578 INFO:teuthology.task.internal:Found packages for ceph version 15.0.0-7900.g1351c81 2019-12-08T11:42:22.578 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2019-12-08T11:42:22.587 INFO:teuthology.task.internal:no buildpackages task found 2019-12-08T11:42:22.587 INFO:teuthology.run_tasks:Running task internal.lock_machines... 2019-12-08T11:42:22.599 INFO:teuthology.task.internal.lock_machines:Locking machines... 2019-12-08T11:42:22.599 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2019-12-08T11:42:22.642 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-12-08T11:42:32.656 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-12-08T11:42:42.679 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-12-08T11:42:52.691 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 3)... 2019-12-08T11:43:02.707 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-12-08T11:43:12.725 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-12-08T11:43:22.746 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-12-08T11:43:32.761 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-12-08T11:43:42.776 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-12-08T11:43:52.792 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-12-08T11:44:02.809 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-12-08T11:44:12.818 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-12-08T11:44:22.835 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-12-08T11:44:32.855 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-12-08T11:44:42.876 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-12-08T11:44:52.894 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-12-08T11:45:02.915 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-12-08T11:45:12.933 INFO:teuthology.task.internal.lock_machines:waiting for more smithi machines to be free (need 2 + 2, have 2)... 2019-12-08T11:45:22.961 DEBUG:teuthology.lock.ops:lock_many request: {'count': 2, 'locked_by': 'scheduled_ofriedma@teuthology', 'description': '/home/teuthworker/archive/ofriedma-2019-12-08_11:30:09-rgw-wip-ofriedma-dynamic-disable-distro-basic-smithi/4581733', 'machine_type': 'smithi'} 2019-12-08T11:45:22.986 DEBUG:teuthology.lock.ops:locked ubuntu@smithi013.front.sepia.ceph.com, ubuntu@smithi079.front.sepia.ceph.com 2019-12-08T11:45:23.075 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=, signals=[15]) 2019-12-08T11:45:23.277 INFO:teuthology.provision.fog.smithi013:Scheduling deploy of centos 7.6 2019-12-08T11:45:23.280 INFO:teuthology.provision.fog.smithi079:Scheduling deploy of centos 7.6 2019-12-08T11:45:23.602 INFO:teuthology.orchestra.console:Power off smithi079 2019-12-08T11:45:23.603 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2019-12-08T11:45:23.631 INFO:teuthology.orchestra.console:Power off smithi013 2019-12-08T11:45:23.631 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi013.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2019-12-08T11:45:23.643 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-08T11:45:23.655 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi013.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-08T11:45:27.672 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-08T11:45:27.682 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi013.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-08T11:45:31.784 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-08T11:45:31.798 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi013.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-08T11:45:32.004 INFO:teuthology.orchestra.console:Power off for smithi079 completed 2019-12-08T11:45:32.008 INFO:teuthology.orchestra.console:Power off for smithi013 completed 2019-12-08T11:45:32.106 INFO:teuthology.orchestra.console:Power on smithi079 2019-12-08T11:45:32.106 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2019-12-08T11:45:32.128 INFO:teuthology.orchestra.console:Power on smithi013 2019-12-08T11:45:32.129 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi013.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power on 2019-12-08T11:45:32.141 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-08T11:45:32.163 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi013.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-08T11:45:36.176 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-08T11:45:36.189 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi013.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-08T11:45:40.293 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi079.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-08T11:45:40.307 DEBUG:teuthology.orchestra.console:pexpect command: ipmitool -H smithi013.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2019-12-08T11:45:40.509 INFO:teuthology.orchestra.console:Power on for smithi079 completed 2019-12-08T11:45:40.588 INFO:teuthology.orchestra.console:Power on for smithi013 completed 2019-12-08T11:45:40.611 INFO:teuthology.provision.fog.smithi079:Waiting for deploy to finish 2019-12-08T11:45:40.689 INFO:teuthology.provision.fog.smithi013:Waiting for deploy to finish 2019-12-08T11:47:56.780 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi013.front.sepia.ceph.com', 'timeout': 60} 2019-12-08T11:48:05.837 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi013.front.sepia.ceph.com', 'timeout': 60} 2019-12-08T11:48:14.892 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi013.front.sepia.ceph.com', 'timeout': 60} 2019-12-08T11:48:23.949 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi013.front.sepia.ceph.com', 'timeout': 60} 2019-12-08T11:48:26.998 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi079.front.sepia.ceph.com', 'timeout': 60} 2019-12-08T11:48:33.003 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi013.front.sepia.ceph.com', 'timeout': 60} 2019-12-08T11:48:36.073 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi079.front.sepia.ceph.com', 'timeout': 60} 2019-12-08T11:48:42.060 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi013.front.sepia.ceph.com', 'timeout': 60} 2019-12-08T11:48:45.134 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi079.front.sepia.ceph.com', 'timeout': 60} 2019-12-08T11:48:54.189 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi079.front.sepia.ceph.com', 'timeout': 60} 2019-12-08T11:49:03.245 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi079.front.sepia.ceph.com', 'timeout': 60} 2019-12-08T11:49:12.301 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi079.front.sepia.ceph.com', 'timeout': 60} 2019-12-08T11:49:21.353 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi079.front.sepia.ceph.com', 'timeout': 60} 2019-12-08T11:49:30.412 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi079.front.sepia.ceph.com', 'timeout': 60} 2019-12-08T11:49:48.070 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi013.front.sepia.ceph.com', 'timeout': 60} 2019-12-08T11:49:48.252 INFO:teuthology.orchestra.run.smithi013:> hostname 2019-12-08T11:49:48.859 INFO:teuthology.orchestra.run.smithi013.stdout:smithi013.front.sepia.ceph.com 2019-12-08T11:49:48.859 INFO:teuthology.orchestra.run.smithi013:> grep smithi013.front.sepia.ceph.com /etc/hosts 2019-12-08T11:49:48.949 INFO:teuthology.orchestra.run.smithi013.stdout:172.21.15.13 smithi013.front.sepia.ceph.com smithi013 2019-12-08T11:49:48.949 INFO:teuthology.orchestra.run.smithi013:> sudo hostname smithi013 2019-12-08T11:49:49.106 INFO:teuthology.orchestra.run.smithi013:> sudo sed -i -e 's/smithi013.front.sepia.ceph.com/smithi013/g' /etc/hosts 2019-12-08T11:49:49.203 INFO:teuthology.orchestra.run.smithi013:> sudo sed -i -e 's/172.21.15.13/172.21.15.13/g' /etc/hosts 2019-12-08T11:49:49.286 INFO:teuthology.orchestra.run.smithi013:> sudo sed -i -e 's/smithi013.front.sepia.ceph.com/smithi013/g' /etc/hostname 2019-12-08T11:49:49.360 INFO:teuthology.orchestra.run.smithi013:> sudo hostname smithi013 2019-12-08T11:49:49.430 INFO:teuthology.provision.fog.smithi013:Deploy complete! 2019-12-08T11:49:49.432 DEBUG:teuthology.parallel:result is None 2019-12-08T11:50:36.454 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi079.front.sepia.ceph.com', 'timeout': 60} 2019-12-08T11:50:36.642 INFO:teuthology.orchestra.run.smithi079:> hostname 2019-12-08T11:50:37.179 INFO:teuthology.orchestra.run.smithi079.stdout:smithi079 2019-12-08T11:50:37.179 INFO:teuthology.orchestra.run.smithi079:> grep smithi079 /etc/hosts 2019-12-08T11:50:37.257 INFO:teuthology.orchestra.run.smithi079.stdout:172.21.15.79 smithi079.front.sepia.ceph.com smithi079 2019-12-08T11:50:37.258 INFO:teuthology.orchestra.run.smithi079:> sudo hostname smithi079 2019-12-08T11:50:37.421 INFO:teuthology.orchestra.run.smithi079:> sudo sed -i -e 's/smithi079/smithi079/g' /etc/hosts 2019-12-08T11:50:37.529 INFO:teuthology.orchestra.run.smithi079:> sudo sed -i -e 's/172.21.15.79/172.21.15.79/g' /etc/hosts 2019-12-08T11:50:37.617 INFO:teuthology.orchestra.run.smithi079:> sudo sed -i -e 's/smithi079/smithi079/g' /etc/hostname 2019-12-08T11:50:37.692 INFO:teuthology.orchestra.run.smithi079:> sudo hostname smithi079 2019-12-08T11:50:37.758 INFO:teuthology.provision.fog.smithi079:Deploy complete! 2019-12-08T11:50:37.760 DEBUG:teuthology.parallel:result is None 2019-12-08T11:50:37.937 INFO:teuthology.lock.ops:Checking smithi079.front.sepia.ceph.com 2019-12-08T11:50:37.938 INFO:teuthology.lock.ops:New key found. Updating... 2019-12-08T11:50:37.952 INFO:teuthology.lock.ops:Checking smithi013.front.sepia.ceph.com 2019-12-08T11:50:37.953 INFO:teuthology.lock.ops:New key found. Updating... 2019-12-08T11:50:37.969 INFO:teuthology.lock.ops:Updating [smithi079.front.sepia.ceph.com]: set os type and version on server 2019-12-08T11:50:37.970 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-08T11:50:37.970 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi079.front.sepia.ceph.com', 'timeout': 60} 2019-12-08T11:50:38.050 INFO:teuthology.orchestra.run.smithi079:> true 2019-12-08T11:50:38.399 INFO:teuthology.orchestra.run.smithi079:> uname -m 2019-12-08T11:50:38.457 INFO:teuthology.orchestra.run.smithi079.stdout:x86_64 2019-12-08T11:50:38.457 INFO:teuthology.orchestra.run.smithi079:> cat /etc/os-release 2019-12-08T11:50:38.529 INFO:teuthology.orchestra.run.smithi079.stdout:NAME="CentOS Linux" 2019-12-08T11:50:38.529 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION="7 (Core)" 2019-12-08T11:50:38.529 INFO:teuthology.orchestra.run.smithi079.stdout:ID="centos" 2019-12-08T11:50:38.530 INFO:teuthology.orchestra.run.smithi079.stdout:ID_LIKE="rhel fedora" 2019-12-08T11:50:38.532 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_ID="7" 2019-12-08T11:50:38.532 INFO:teuthology.orchestra.run.smithi079.stdout:PRETTY_NAME="CentOS Linux 7 (Core)" 2019-12-08T11:50:38.532 INFO:teuthology.orchestra.run.smithi079.stdout:ANSI_COLOR="0;31" 2019-12-08T11:50:38.532 INFO:teuthology.orchestra.run.smithi079.stdout:CPE_NAME="cpe:/o:centos:centos:7" 2019-12-08T11:50:38.532 INFO:teuthology.orchestra.run.smithi079.stdout:HOME_URL="https://www.centos.org/" 2019-12-08T11:50:38.533 INFO:teuthology.orchestra.run.smithi079.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2019-12-08T11:50:38.533 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T11:50:38.533 INFO:teuthology.orchestra.run.smithi079.stdout:CENTOS_MANTISBT_PROJECT="CentOS-7" 2019-12-08T11:50:38.533 INFO:teuthology.orchestra.run.smithi079.stdout:CENTOS_MANTISBT_PROJECT_VERSION="7" 2019-12-08T11:50:38.533 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2019-12-08T11:50:38.533 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7" 2019-12-08T11:50:38.533 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T11:50:38.535 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server 2019-12-08T11:50:38.549 INFO:teuthology.lock.ops:Updating [smithi013.front.sepia.ceph.com]: set os type and version on server 2019-12-08T11:50:38.550 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-08T11:50:38.550 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi013.front.sepia.ceph.com', 'timeout': 60} 2019-12-08T11:50:38.640 INFO:teuthology.orchestra.run.smithi013:> true 2019-12-08T11:50:39.053 INFO:teuthology.orchestra.run.smithi013:> uname -m 2019-12-08T11:50:39.128 INFO:teuthology.orchestra.run.smithi013.stdout:x86_64 2019-12-08T11:50:39.129 INFO:teuthology.orchestra.run.smithi013:> cat /etc/os-release 2019-12-08T11:50:39.203 INFO:teuthology.orchestra.run.smithi013.stdout:NAME="CentOS Linux" 2019-12-08T11:50:39.203 INFO:teuthology.orchestra.run.smithi013.stdout:VERSION="7 (Core)" 2019-12-08T11:50:39.203 INFO:teuthology.orchestra.run.smithi013.stdout:ID="centos" 2019-12-08T11:50:39.203 INFO:teuthology.orchestra.run.smithi013.stdout:ID_LIKE="rhel fedora" 2019-12-08T11:50:39.203 INFO:teuthology.orchestra.run.smithi013.stdout:VERSION_ID="7" 2019-12-08T11:50:39.204 INFO:teuthology.orchestra.run.smithi013.stdout:PRETTY_NAME="CentOS Linux 7 (Core)" 2019-12-08T11:50:39.204 INFO:teuthology.orchestra.run.smithi013.stdout:ANSI_COLOR="0;31" 2019-12-08T11:50:39.204 INFO:teuthology.orchestra.run.smithi013.stdout:CPE_NAME="cpe:/o:centos:centos:7" 2019-12-08T11:50:39.204 INFO:teuthology.orchestra.run.smithi013.stdout:HOME_URL="https://www.centos.org/" 2019-12-08T11:50:39.204 INFO:teuthology.orchestra.run.smithi013.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2019-12-08T11:50:39.204 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T11:50:39.204 INFO:teuthology.orchestra.run.smithi013.stdout:CENTOS_MANTISBT_PROJECT="CentOS-7" 2019-12-08T11:50:39.205 INFO:teuthology.orchestra.run.smithi013.stdout:CENTOS_MANTISBT_PROJECT_VERSION="7" 2019-12-08T11:50:39.205 INFO:teuthology.orchestra.run.smithi013.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2019-12-08T11:50:39.205 INFO:teuthology.orchestra.run.smithi013.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7" 2019-12-08T11:50:39.205 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T11:50:39.206 INFO:teuthology.lock.ops:Updating smithi013.front.sepia.ceph.com on lock server 2019-12-08T11:50:39.221 INFO:teuthology.task.internal.lock_machines:2 smithi machines locked this try, 2/2 locked so far 2019-12-08T11:50:39.251 INFO:teuthology.task.internal.lock_machines:Locked targets: smithi013.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCs8CHTlkGGVUhK//xeIq/ZW6yThV7qdcRIBVUKV4O1J78xgmAW1sHJ1fJuRGHTyrJwYUID1fPeXF6S/PmOyJ3xV+SmEoCWULez987CTkznkBihsGvv2VCxvVgiOlT0dUx7O70x5sHvjhvWPdE7EJQQfaB9iOdq4Bbgnbnh04qNlPJ+JbcfszwgfXZEBhpJ3pJSVrkvgG+uX2LhSeHSjBaUkQ/xJ1EGHMD6r+Z/XzqJnOfqaEy2WUZNSd10Pmcs6Z0YMjzygfzV2LzI6agbraLpj5RHJc4z4McqbMxdMr1tQuaBTNTFmu78zKWLE8qA9g+ZcEAt19gkM+o2M3hI40p5 smithi079.front.sepia.ceph.com: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDK3FF9LXJUxI2LJnN2FGurplJHQTejs1aTDdq0n1HhR7SjH4kdcyQ5vI7akCyilK0+e4eOdRh+ugdWM5PjcUdkxEiJZUxTaoMzjn2LvIMUZQIaveaRj5qzBtXFaQ2xE1xvVfG+Obd4cwwGJwrpPFIdhkTP1jMGh5YuEkOCPR3Xm79jqZGtoRSaCh/YDy7HJguGy7vLKvcIPLqn35342GELG+IvmybsZbt2Y+qQsuLTi68WJ8DP7+yhc4e1pZQCquklFP+rKfsolL+61T4/fle1cDWQNTLAJxzOMfyHCaKU37aHh/5hFvOwLPfr1n2AYyZZAPODpNfMjwA30H7LRt35 2019-12-08T11:50:39.251 DEBUG:teuthology.report:Pushing job info to http://paddles.front.sepia.ceph.com/ 2019-12-08T11:50:39.295 INFO:teuthology.run_tasks:Running task internal.save_config... 2019-12-08T11:50:39.311 INFO:teuthology.task.internal:Saving configuration 2019-12-08T11:50:39.330 INFO:teuthology.run_tasks:Running task internal.check_lock... 2019-12-08T11:50:39.390 INFO:teuthology.task.internal.check_lock:Checking locks... 2019-12-08T11:50:39.405 DEBUG:teuthology.task.internal.check_lock:machine status is {u'is_vm': False, u'locked': True, u'locked_since': u'2019-12-08 11:45:22.976499', u'locked_by': u'scheduled_ofriedma@teuthology', u'up': True, u'mac_address': None, u'name': u'smithi079.front.sepia.ceph.com', u'os_version': u'7', u'machine_type': u'smithi', u'vm_host': None, u'os_type': u'centos', u'arch': u'x86_64', u'ssh_pub_key': u'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGVdNiW6a/FySXHYgBvbUNMEe5qu8XZl+EkkT+p+IL/T3qCzaxZyEyvyL5CKGMRif5P8fjLWDqeO9lrX5svYGOs=', u'description': u'/home/teuthworker/archive/ofriedma-2019-12-08_11:30:09-rgw-wip-ofriedma-dynamic-disable-distro-basic-smithi/4581733'} 2019-12-08T11:50:39.419 DEBUG:teuthology.task.internal.check_lock:machine status is {u'is_vm': False, u'locked': True, u'locked_since': u'2019-12-08 11:45:22.976518', u'locked_by': u'scheduled_ofriedma@teuthology', u'up': True, u'mac_address': None, u'name': u'smithi013.front.sepia.ceph.com', u'os_version': u'7', u'machine_type': u'smithi', u'vm_host': None, u'os_type': u'centos', u'arch': u'x86_64', u'ssh_pub_key': u'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFn8U+YgBbCCOl/pyhQ4fcq1iB9OB61P5rpAx8gsRSvk1v3I8Zr5fw3DCyjkPRHhvhefhndyJbPeYeb4MOOSIQs=', u'description': u'/home/teuthworker/archive/ofriedma-2019-12-08_11:30:09-rgw-wip-ofriedma-dynamic-disable-distro-basic-smithi/4581733'} 2019-12-08T11:50:39.420 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2019-12-08T11:50:39.428 INFO:teuthology.task.internal:roles: ubuntu@smithi079.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2019-12-08T11:50:39.428 INFO:teuthology.task.internal:roles: ubuntu@smithi013.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2019-12-08T11:50:39.428 INFO:teuthology.run_tasks:Running task console_log... 2019-12-08T11:50:39.502 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=, signals=[15]) 2019-12-08T11:50:39.502 INFO:teuthology.run_tasks:Running task internal.connect... 2019-12-08T11:50:39.513 INFO:teuthology.task.internal:Opening connections... 2019-12-08T11:50:39.513 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi013.front.sepia.ceph.com 2019-12-08T11:50:39.514 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi013.front.sepia.ceph.com', 'timeout': 60} 2019-12-08T11:50:39.614 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi079.front.sepia.ceph.com 2019-12-08T11:50:39.614 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi079.front.sepia.ceph.com', 'timeout': 60} 2019-12-08T11:50:39.715 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2019-12-08T11:50:39.724 INFO:teuthology.orchestra.run.smithi013:> uname -m 2019-12-08T11:50:39.968 INFO:teuthology.orchestra.run.smithi013.stdout:x86_64 2019-12-08T11:50:39.969 INFO:teuthology.orchestra.run.smithi013:> cat /etc/os-release 2019-12-08T11:50:40.045 INFO:teuthology.orchestra.run.smithi013.stdout:NAME="CentOS Linux" 2019-12-08T11:50:40.046 INFO:teuthology.orchestra.run.smithi013.stdout:VERSION="7 (Core)" 2019-12-08T11:50:40.046 INFO:teuthology.orchestra.run.smithi013.stdout:ID="centos" 2019-12-08T11:50:40.046 INFO:teuthology.orchestra.run.smithi013.stdout:ID_LIKE="rhel fedora" 2019-12-08T11:50:40.046 INFO:teuthology.orchestra.run.smithi013.stdout:VERSION_ID="7" 2019-12-08T11:50:40.046 INFO:teuthology.orchestra.run.smithi013.stdout:PRETTY_NAME="CentOS Linux 7 (Core)" 2019-12-08T11:50:40.047 INFO:teuthology.orchestra.run.smithi013.stdout:ANSI_COLOR="0;31" 2019-12-08T11:50:40.047 INFO:teuthology.orchestra.run.smithi013.stdout:CPE_NAME="cpe:/o:centos:centos:7" 2019-12-08T11:50:40.047 INFO:teuthology.orchestra.run.smithi013.stdout:HOME_URL="https://www.centos.org/" 2019-12-08T11:50:40.047 INFO:teuthology.orchestra.run.smithi013.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2019-12-08T11:50:40.047 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T11:50:40.047 INFO:teuthology.orchestra.run.smithi013.stdout:CENTOS_MANTISBT_PROJECT="CentOS-7" 2019-12-08T11:50:40.047 INFO:teuthology.orchestra.run.smithi013.stdout:CENTOS_MANTISBT_PROJECT_VERSION="7" 2019-12-08T11:50:40.048 INFO:teuthology.orchestra.run.smithi013.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2019-12-08T11:50:40.048 INFO:teuthology.orchestra.run.smithi013.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7" 2019-12-08T11:50:40.048 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T11:50:40.048 INFO:teuthology.lock.ops:Updating smithi013.front.sepia.ceph.com on lock server 2019-12-08T11:50:40.064 INFO:teuthology.orchestra.run.smithi079:> uname -m 2019-12-08T11:50:40.182 INFO:teuthology.orchestra.run.smithi079.stdout:x86_64 2019-12-08T11:50:40.183 INFO:teuthology.orchestra.run.smithi079:> cat /etc/os-release 2019-12-08T11:50:40.251 INFO:teuthology.orchestra.run.smithi079.stdout:NAME="CentOS Linux" 2019-12-08T11:50:40.251 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION="7 (Core)" 2019-12-08T11:50:40.251 INFO:teuthology.orchestra.run.smithi079.stdout:ID="centos" 2019-12-08T11:50:40.252 INFO:teuthology.orchestra.run.smithi079.stdout:ID_LIKE="rhel fedora" 2019-12-08T11:50:40.252 INFO:teuthology.orchestra.run.smithi079.stdout:VERSION_ID="7" 2019-12-08T11:50:40.252 INFO:teuthology.orchestra.run.smithi079.stdout:PRETTY_NAME="CentOS Linux 7 (Core)" 2019-12-08T11:50:40.252 INFO:teuthology.orchestra.run.smithi079.stdout:ANSI_COLOR="0;31" 2019-12-08T11:50:40.253 INFO:teuthology.orchestra.run.smithi079.stdout:CPE_NAME="cpe:/o:centos:centos:7" 2019-12-08T11:50:40.253 INFO:teuthology.orchestra.run.smithi079.stdout:HOME_URL="https://www.centos.org/" 2019-12-08T11:50:40.253 INFO:teuthology.orchestra.run.smithi079.stdout:BUG_REPORT_URL="https://bugs.centos.org/" 2019-12-08T11:50:40.253 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T11:50:40.254 INFO:teuthology.orchestra.run.smithi079.stdout:CENTOS_MANTISBT_PROJECT="CentOS-7" 2019-12-08T11:50:40.254 INFO:teuthology.orchestra.run.smithi079.stdout:CENTOS_MANTISBT_PROJECT_VERSION="7" 2019-12-08T11:50:40.254 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT="centos" 2019-12-08T11:50:40.254 INFO:teuthology.orchestra.run.smithi079.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="7" 2019-12-08T11:50:40.255 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T11:50:40.255 INFO:teuthology.lock.ops:Updating smithi079.front.sepia.ceph.com on lock server 2019-12-08T11:50:40.278 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2019-12-08T11:50:40.333 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2019-12-08T11:50:40.339 INFO:teuthology.task.internal:Checking for old test directory... 2019-12-08T11:50:40.340 INFO:teuthology.orchestra.run.smithi013:> test '!' -e /home/ubuntu/cephtest 2019-12-08T11:50:40.344 INFO:teuthology.orchestra.run.smithi079:> test '!' -e /home/ubuntu/cephtest 2019-12-08T11:50:40.429 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2019-12-08T11:50:40.517 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2019-12-08T11:50:40.517 INFO:teuthology.orchestra.run.smithi013:> test -z $(ls -A /var/lib/ceph) 2019-12-08T11:50:40.522 INFO:teuthology.orchestra.run.smithi079:> test -z $(ls -A /var/lib/ceph) 2019-12-08T11:50:40.625 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2019-12-08T11:50:40.673 INFO:teuthology.run_tasks:Running task kernel... 2019-12-08T11:50:40.691 DEBUG:teuthology.task.kernel:normalized config {'mon.a': {'sha1': 'distro', 'kdb': True}, 'mon.c': {'sha1': 'distro', 'kdb': True}, 'mon.b': {'sha1': 'distro', 'kdb': True}, 'osd.1': {'sha1': 'distro', 'kdb': True}, 'osd.0': {'sha1': 'distro', 'kdb': True}, 'client.1': {'sha1': 'distro', 'kdb': True}, 'osd.2': {'sha1': 'distro', 'kdb': True}, 'osd.5': {'sha1': 'distro', 'kdb': True}, 'osd.4': {'sha1': 'distro', 'kdb': True}, 'osd.7': {'sha1': 'distro', 'kdb': True}, 'osd.6': {'sha1': 'distro', 'kdb': True}, 'mgr.y': {'sha1': 'distro', 'kdb': True}, 'mgr.x': {'sha1': 'distro', 'kdb': True}, 'osd.3': {'sha1': 'distro', 'kdb': True}, 'client.0': {'sha1': 'distro', 'kdb': True}} 2019-12-08T11:50:40.691 INFO:teuthology.task.kernel:config {'mon.a': {'sha1': 'distro', 'kdb': True}, 'mon.b': {'sha1': 'distro', 'kdb': True}}, timeout 300 2019-12-08T11:50:40.691 INFO:teuthology.task.kernel:Removing old kernels from ubuntu@smithi013.front.sepia.ceph.com 2019-12-08T11:50:40.692 INFO:teuthology.orchestra.run.smithi013:> sudo package-cleanup -y --oldkernels 2019-12-08T11:50:41.599 INFO:teuthology.orchestra.run.smithi013.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-08T11:50:42.563 INFO:teuthology.orchestra.run.smithi013.stdout:http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/d0f1134f0f9a3fed89fb7177d07a42aa429e0e37c0d6b3e1c907d638a5cd1164-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found 2019-12-08T11:50:42.563 INFO:teuthology.orchestra.run.smithi013.stdout:Trying other mirror. 2019-12-08T11:50:42.563 INFO:teuthology.orchestra.run.smithi013.stdout:To address this issue please refer to the below wiki article 2019-12-08T11:50:42.563 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T11:50:42.564 INFO:teuthology.orchestra.run.smithi013.stdout:https://wiki.centos.org/yum-errors 2019-12-08T11:50:42.564 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T11:50:42.564 INFO:teuthology.orchestra.run.smithi013.stdout:If above article doesn't help to resolve this issue please use https://bugs.centos.org/. 2019-12-08T11:50:42.564 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T11:50:42.710 INFO:teuthology.orchestra.run.smithi013.stdout:http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/d0f1134f0f9a3fed89fb7177d07a42aa429e0e37c0d6b3e1c907d638a5cd1164-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found 2019-12-08T11:50:42.710 INFO:teuthology.orchestra.run.smithi013.stdout:Trying other mirror. 2019-12-08T11:50:42.802 INFO:teuthology.orchestra.run.smithi013.stdout:http://mirror.oss.ou.edu/epel/7/x86_64/repodata/d0f1134f0f9a3fed89fb7177d07a42aa429e0e37c0d6b3e1c907d638a5cd1164-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found 2019-12-08T11:50:42.802 INFO:teuthology.orchestra.run.smithi013.stdout:Trying other mirror. 2019-12-08T11:50:42.945 INFO:teuthology.orchestra.run.smithi013.stdout:http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/d0f1134f0f9a3fed89fb7177d07a42aa429e0e37c0d6b3e1c907d638a5cd1164-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found 2019-12-08T11:50:42.945 INFO:teuthology.orchestra.run.smithi013.stdout:Trying other mirror. 2019-12-08T11:50:43.097 INFO:teuthology.orchestra.run.smithi013.stdout:http://mirror.pnl.gov/epel/7/x86_64/repodata/d0f1134f0f9a3fed89fb7177d07a42aa429e0e37c0d6b3e1c907d638a5cd1164-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found 2019-12-08T11:50:43.098 INFO:teuthology.orchestra.run.smithi013.stdout:Trying other mirror. 2019-12-08T11:50:44.947 INFO:teuthology.orchestra.run.smithi013.stdout:No old kernels to remove 2019-12-08T11:50:44.964 INFO:teuthology.task.kernel:Removing old kernels from ubuntu@smithi079.front.sepia.ceph.com 2019-12-08T11:50:44.964 INFO:teuthology.orchestra.run.smithi079:> sudo package-cleanup -y --oldkernels 2019-12-08T11:50:45.818 INFO:teuthology.orchestra.run.smithi079.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-08T11:50:46.823 INFO:teuthology.orchestra.run.smithi079.stdout:http://ftp.linux.ncsu.edu/pub/epel/7/x86_64/repodata/d0f1134f0f9a3fed89fb7177d07a42aa429e0e37c0d6b3e1c907d638a5cd1164-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found 2019-12-08T11:50:46.824 INFO:teuthology.orchestra.run.smithi079.stdout:Trying other mirror. 2019-12-08T11:50:46.824 INFO:teuthology.orchestra.run.smithi079.stdout:To address this issue please refer to the below wiki article 2019-12-08T11:50:46.824 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T11:50:46.824 INFO:teuthology.orchestra.run.smithi079.stdout:https://wiki.centos.org/yum-errors 2019-12-08T11:50:46.824 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T11:50:46.824 INFO:teuthology.orchestra.run.smithi079.stdout:If above article doesn't help to resolve this issue please use https://bugs.centos.org/. 2019-12-08T11:50:46.825 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T11:50:46.969 INFO:teuthology.orchestra.run.smithi079.stdout:http://dl.fedoraproject.org/pub/epel/7/x86_64/repodata/d0f1134f0f9a3fed89fb7177d07a42aa429e0e37c0d6b3e1c907d638a5cd1164-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found 2019-12-08T11:50:46.970 INFO:teuthology.orchestra.run.smithi079.stdout:Trying other mirror. 2019-12-08T11:50:47.061 INFO:teuthology.orchestra.run.smithi079.stdout:http://mirror.oss.ou.edu/epel/7/x86_64/repodata/d0f1134f0f9a3fed89fb7177d07a42aa429e0e37c0d6b3e1c907d638a5cd1164-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found 2019-12-08T11:50:47.062 INFO:teuthology.orchestra.run.smithi079.stdout:Trying other mirror. 2019-12-08T11:50:47.204 INFO:teuthology.orchestra.run.smithi079.stdout:http://mirrors.cat.pdx.edu/epel/7/x86_64/repodata/d0f1134f0f9a3fed89fb7177d07a42aa429e0e37c0d6b3e1c907d638a5cd1164-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found 2019-12-08T11:50:47.204 INFO:teuthology.orchestra.run.smithi079.stdout:Trying other mirror. 2019-12-08T11:50:47.357 INFO:teuthology.orchestra.run.smithi079.stdout:http://mirror.pnl.gov/epel/7/x86_64/repodata/d0f1134f0f9a3fed89fb7177d07a42aa429e0e37c0d6b3e1c907d638a5cd1164-updateinfo.xml.bz2: [Errno 14] HTTP Error 404 - Not Found 2019-12-08T11:50:47.358 INFO:teuthology.orchestra.run.smithi079.stdout:Trying other mirror. 2019-12-08T11:50:49.051 INFO:teuthology.orchestra.run.smithi079.stdout:No old kernels to remove 2019-12-08T11:50:49.064 INFO:teuthology.orchestra.run.smithi079:> uname -r 2019-12-08T11:50:49.150 INFO:teuthology.orchestra.run.smithi079.stdout:3.10.0-1062.4.1.el7.x86_64 2019-12-08T11:50:49.151 INFO:teuthology.task.kernel:Running kernel on smithi079: 3.10.0-1062.4.1.el7.x86_64 2019-12-08T11:50:49.151 INFO:teuthology.orchestra.run.smithi079:> sudo yum install -y kernel 2019-12-08T11:50:49.334 INFO:teuthology.orchestra.run.smithi079.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-08T11:50:49.370 INFO:teuthology.orchestra.run.smithi079.stdout:Determining fastest mirrors 2019-12-08T11:50:49.536 INFO:teuthology.orchestra.run.smithi079.stdout: * base: mirrors.umflint.edu 2019-12-08T11:50:49.537 INFO:teuthology.orchestra.run.smithi079.stdout: * epel: ftp.linux.ncsu.edu 2019-12-08T11:50:49.537 INFO:teuthology.orchestra.run.smithi079.stdout: * extras: mirror.facebook.net 2019-12-08T11:50:49.537 INFO:teuthology.orchestra.run.smithi079.stdout: * updates: mirror.math.princeton.edu 2019-12-08T11:50:51.074 INFO:teuthology.orchestra.run.smithi079.stdout:Resolving Dependencies 2019-12-08T11:50:51.075 INFO:teuthology.orchestra.run.smithi079.stdout:--> Running transaction check 2019-12-08T11:50:51.075 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package kernel.x86_64 0:3.10.0-1062.9.1.el7 will be installed 2019-12-08T11:50:52.380 INFO:teuthology.orchestra.run.smithi079.stdout:--> Finished Dependency Resolution 2019-12-08T11:50:53.167 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T11:50:53.167 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies Resolved 2019-12-08T11:50:53.170 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T11:50:53.170 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2019-12-08T11:50:53.170 INFO:teuthology.orchestra.run.smithi079.stdout: Package Arch Version Repository Size 2019-12-08T11:50:53.170 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2019-12-08T11:50:53.170 INFO:teuthology.orchestra.run.smithi079.stdout:Installing: 2019-12-08T11:50:53.171 INFO:teuthology.orchestra.run.smithi079.stdout: kernel x86_64 3.10.0-1062.9.1.el7 updates 50 M 2019-12-08T11:50:53.171 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T11:50:53.171 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction Summary 2019-12-08T11:50:53.171 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2019-12-08T11:50:53.171 INFO:teuthology.orchestra.run.smithi079.stdout:Install 1 Package 2019-12-08T11:50:53.171 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T11:50:53.171 INFO:teuthology.orchestra.run.smithi079.stdout:Total download size: 50 M 2019-12-08T11:50:53.172 INFO:teuthology.orchestra.run.smithi079.stdout:Installed size: 64 M 2019-12-08T11:50:53.172 INFO:teuthology.orchestra.run.smithi079.stdout:Downloading packages: 2019-12-08T11:50:53.190 INFO:teuthology.orchestra.run.smithi079.stdout:Delta RPMs disabled because /usr/bin/applydeltarpm not installed. 2019-12-08T11:50:54.045 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction check 2019-12-08T11:50:54.239 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction test 2019-12-08T11:50:55.129 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction test succeeded 2019-12-08T11:50:55.129 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction 2019-12-08T11:51:30.489 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : kernel-3.10.0-1062.9.1.el7.x86_64 1/1 2019-12-08T11:51:30.958 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : kernel-3.10.0-1062.9.1.el7.x86_64 1/1 2019-12-08T11:51:30.958 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T11:51:30.958 INFO:teuthology.orchestra.run.smithi079.stdout:Installed: 2019-12-08T11:51:30.959 INFO:teuthology.orchestra.run.smithi079.stdout: kernel.x86_64 0:3.10.0-1062.9.1.el7 2019-12-08T11:51:30.959 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T11:51:30.959 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2019-12-08T11:51:31.008 INFO:teuthology.orchestra.run.smithi079:> rpm -q kernel --last | head -n 1 2019-12-08T11:51:31.397 INFO:teuthology.orchestra.run.smithi079.stdout:kernel-3.10.0-1062.9.1.el7.x86_64 Sun 08 Dec 2019 11:50:58 AM UTC 2019-12-08T11:51:31.400 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 3.10.0-1062.9.1.el7.x86_64 2019-12-08T11:51:31.400 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 3.10.0-1062.4.1.el7.x86_64 Expected: 3.10.0-1062.9.1.el7.x86_64 2019-12-08T11:51:31.400 INFO:teuthology.orchestra.run.smithi013:> uname -r 2019-12-08T11:51:31.498 INFO:teuthology.orchestra.run.smithi013.stdout:3.10.0-1062.4.1.el7.x86_64 2019-12-08T11:51:31.499 INFO:teuthology.task.kernel:Running kernel on smithi013: 3.10.0-1062.4.1.el7.x86_64 2019-12-08T11:51:31.499 INFO:teuthology.orchestra.run.smithi013:> sudo yum install -y kernel 2019-12-08T11:51:31.804 INFO:teuthology.orchestra.run.smithi013.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-08T11:51:31.851 INFO:teuthology.orchestra.run.smithi013.stdout:Determining fastest mirrors 2019-12-08T11:51:32.010 INFO:teuthology.orchestra.run.smithi013.stdout: * base: ftp.osuosl.org 2019-12-08T11:51:32.011 INFO:teuthology.orchestra.run.smithi013.stdout: * epel: ftp.linux.ncsu.edu 2019-12-08T11:51:32.011 INFO:teuthology.orchestra.run.smithi013.stdout: * extras: mirror.facebook.net 2019-12-08T11:51:32.012 INFO:teuthology.orchestra.run.smithi013.stdout: * updates: mirror.math.princeton.edu 2019-12-08T11:51:33.767 INFO:teuthology.orchestra.run.smithi013.stdout:Resolving Dependencies 2019-12-08T11:51:33.767 INFO:teuthology.orchestra.run.smithi013.stdout:--> Running transaction check 2019-12-08T11:51:33.768 INFO:teuthology.orchestra.run.smithi013.stdout:---> Package kernel.x86_64 0:3.10.0-1062.9.1.el7 will be installed 2019-12-08T11:51:35.114 INFO:teuthology.orchestra.run.smithi013.stdout:--> Finished Dependency Resolution 2019-12-08T11:51:35.958 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T11:51:35.958 INFO:teuthology.orchestra.run.smithi013.stdout:Dependencies Resolved 2019-12-08T11:51:35.973 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T11:51:35.973 INFO:teuthology.orchestra.run.smithi013.stdout:================================================================================ 2019-12-08T11:51:35.973 INFO:teuthology.orchestra.run.smithi013.stdout: Package Arch Version Repository Size 2019-12-08T11:51:35.973 INFO:teuthology.orchestra.run.smithi013.stdout:================================================================================ 2019-12-08T11:51:35.974 INFO:teuthology.orchestra.run.smithi013.stdout:Installing: 2019-12-08T11:51:35.974 INFO:teuthology.orchestra.run.smithi013.stdout: kernel x86_64 3.10.0-1062.9.1.el7 updates 50 M 2019-12-08T11:51:35.974 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T11:51:35.974 INFO:teuthology.orchestra.run.smithi013.stdout:Transaction Summary 2019-12-08T11:51:35.974 INFO:teuthology.orchestra.run.smithi013.stdout:================================================================================ 2019-12-08T11:51:35.974 INFO:teuthology.orchestra.run.smithi013.stdout:Install 1 Package 2019-12-08T11:51:35.974 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T11:51:35.975 INFO:teuthology.orchestra.run.smithi013.stdout:Total download size: 50 M 2019-12-08T11:51:35.975 INFO:teuthology.orchestra.run.smithi013.stdout:Installed size: 64 M 2019-12-08T11:51:35.975 INFO:teuthology.orchestra.run.smithi013.stdout:Downloading packages: 2019-12-08T11:51:35.985 INFO:teuthology.orchestra.run.smithi013.stdout:Delta RPMs disabled because /usr/bin/applydeltarpm not installed. 2019-12-08T11:51:36.940 INFO:teuthology.orchestra.run.smithi013.stdout:Running transaction check 2019-12-08T11:51:37.146 INFO:teuthology.orchestra.run.smithi013.stdout:Running transaction test 2019-12-08T11:51:37.875 INFO:teuthology.orchestra.run.smithi013.stdout:Transaction test succeeded 2019-12-08T11:51:37.876 INFO:teuthology.orchestra.run.smithi013.stdout:Running transaction 2019-12-08T11:52:16.294 INFO:teuthology.orchestra.run.smithi013.stdout: Installing : kernel-3.10.0-1062.9.1.el7.x86_64 1/1 2019-12-08T11:52:16.819 INFO:teuthology.orchestra.run.smithi013.stdout: Verifying : kernel-3.10.0-1062.9.1.el7.x86_64 1/1 2019-12-08T11:52:16.820 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T11:52:16.820 INFO:teuthology.orchestra.run.smithi013.stdout:Installed: 2019-12-08T11:52:16.820 INFO:teuthology.orchestra.run.smithi013.stdout: kernel.x86_64 0:3.10.0-1062.9.1.el7 2019-12-08T11:52:16.820 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T11:52:16.820 INFO:teuthology.orchestra.run.smithi013.stdout:Complete! 2019-12-08T11:52:16.871 INFO:teuthology.orchestra.run.smithi013:> rpm -q kernel --last | head -n 1 2019-12-08T11:52:17.286 INFO:teuthology.orchestra.run.smithi013.stdout:kernel-3.10.0-1062.9.1.el7.x86_64 Sun 08 Dec 2019 11:51:40 AM UTC 2019-12-08T11:52:17.288 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 3.10.0-1062.9.1.el7.x86_64 2019-12-08T11:52:17.288 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 3.10.0-1062.4.1.el7.x86_64 Expected: 3.10.0-1062.9.1.el7.x86_64 2019-12-08T11:52:17.288 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2019-12-08T11:52:17.289 DEBUG:teuthology.task.kernel:src is distro, skipping download 2019-12-08T11:52:17.289 DEBUG:teuthology.task.kernel:src is distro, skipping download 2019-12-08T11:52:17.289 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2019-12-08T11:52:17.289 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi079.front.sepia.ceph.com, path=None, version=distro) 2019-12-08T11:52:17.290 INFO:teuthology.orchestra.run.smithi079:> rpm -q kernel --last | head -n 1 2019-12-08T11:52:17.643 INFO:teuthology.orchestra.run.smithi079.stdout:kernel-3.10.0-1062.9.1.el7.x86_64 Sun 08 Dec 2019 11:50:58 AM UTC 2019-12-08T11:52:17.646 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 3.10.0-1062.9.1.el7.x86_64 2019-12-08T11:52:17.646 INFO:teuthology.orchestra.run.smithi079:> sudo rpm -qi grub2 2019-12-08T11:52:17.766 INFO:teuthology.orchestra.run.smithi079.stdout:Name : grub2 2019-12-08T11:52:17.766 INFO:teuthology.orchestra.run.smithi079.stdout:Epoch : 1 2019-12-08T11:52:17.766 INFO:teuthology.orchestra.run.smithi079.stdout:Version : 2.02 2019-12-08T11:52:17.767 INFO:teuthology.orchestra.run.smithi079.stdout:Release : 0.76.el7.centos 2019-12-08T11:52:17.767 INFO:teuthology.orchestra.run.smithi079.stdout:Architecture: x86_64 2019-12-08T11:52:17.767 INFO:teuthology.orchestra.run.smithi079.stdout:Install Date: Tue 05 Nov 2019 03:41:14 PM UTC 2019-12-08T11:52:17.767 INFO:teuthology.orchestra.run.smithi079.stdout:Group : System Environment/Base 2019-12-08T11:52:17.768 INFO:teuthology.orchestra.run.smithi079.stdout:Size : 0 2019-12-08T11:52:17.768 INFO:teuthology.orchestra.run.smithi079.stdout:License : GPLv3+ 2019-12-08T11:52:17.768 INFO:teuthology.orchestra.run.smithi079.stdout:Signature : RSA/SHA256, Mon 12 Nov 2018 02:28:06 PM UTC, Key ID 24c6a8a7f4a80eb5 2019-12-08T11:52:17.768 INFO:teuthology.orchestra.run.smithi079.stdout:Source RPM : grub2-2.02-0.76.el7.centos.src.rpm 2019-12-08T11:52:17.769 INFO:teuthology.orchestra.run.smithi079.stdout:Build Date : Fri 09 Nov 2018 12:58:43 AM UTC 2019-12-08T11:52:17.769 INFO:teuthology.orchestra.run.smithi079.stdout:Build Host : kbuilder.bsys.centos.org 2019-12-08T11:52:17.769 INFO:teuthology.orchestra.run.smithi079.stdout:Relocations : (not relocatable) 2019-12-08T11:52:17.769 INFO:teuthology.orchestra.run.smithi079.stdout:Packager : CentOS BuildSystem 2019-12-08T11:52:17.770 INFO:teuthology.orchestra.run.smithi079.stdout:Vendor : CentOS 2019-12-08T11:52:17.770 INFO:teuthology.orchestra.run.smithi079.stdout:URL : http://www.gnu.org/software/grub/ 2019-12-08T11:52:17.770 INFO:teuthology.orchestra.run.smithi079.stdout:Summary : Bootloader with support for Linux, Multiboot and more 2019-12-08T11:52:17.770 INFO:teuthology.orchestra.run.smithi079.stdout:Description : 2019-12-08T11:52:17.770 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T11:52:17.771 INFO:teuthology.orchestra.run.smithi079.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2019-12-08T11:52:17.771 INFO:teuthology.orchestra.run.smithi079.stdout:customizable bootloader with modular architecture. It supports a rich 2019-12-08T11:52:17.771 INFO:teuthology.orchestra.run.smithi079.stdout:variety of kernel formats, file systems, computer architectures and 2019-12-08T11:52:17.771 INFO:teuthology.orchestra.run.smithi079.stdout:hardware devices. 2019-12-08T11:52:17.773 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2019-12-08T11:52:17.773 INFO:teuthology.task.kernel:Updating grub on smithi079 to boot 3.10.0-1062.9.1.el7.x86_64 2019-12-08T11:52:17.774 INFO:teuthology.orchestra.run.smithi079:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2019-12-08T11:52:18.190 INFO:teuthology.orchestra.run.smithi079.stderr:Generating grub configuration file ... 2019-12-08T11:52:18.314 INFO:teuthology.orchestra.run.smithi079.stderr:Found linux image: /boot/vmlinuz-3.10.0-1062.9.1.el7.x86_64 2019-12-08T11:52:18.328 INFO:teuthology.orchestra.run.smithi079.stderr:Found initrd image: /boot/initramfs-3.10.0-1062.9.1.el7.x86_64.img 2019-12-08T11:52:18.562 INFO:teuthology.orchestra.run.smithi079.stderr:Found linux image: /boot/vmlinuz-3.10.0-1062.4.1.el7.x86_64 2019-12-08T11:52:18.589 INFO:teuthology.orchestra.run.smithi079.stderr:Found initrd image: /boot/initramfs-3.10.0-1062.4.1.el7.x86_64.img 2019-12-08T11:52:18.621 INFO:teuthology.orchestra.run.smithi079.stderr:Found linux image: /boot/vmlinuz-3.10.0-957.el7.x86_64 2019-12-08T11:52:18.648 INFO:teuthology.orchestra.run.smithi079.stderr:Found initrd image: /boot/initramfs-3.10.0-957.el7.x86_64.img 2019-12-08T11:52:18.676 INFO:teuthology.orchestra.run.smithi079.stderr:Found linux image: /boot/vmlinuz-0-rescue-a1739c9c60b14f0891126d2e603bb003 2019-12-08T11:52:18.685 INFO:teuthology.orchestra.run.smithi079.stderr:Found initrd image: /boot/initramfs-0-rescue-a1739c9c60b14f0891126d2e603bb003.img 2019-12-08T11:52:19.849 INFO:teuthology.orchestra.run.smithi079.stderr:done 2019-12-08T11:52:19.852 INFO:teuthology.orchestra.run.smithi079:> mktemp 2019-12-08T11:52:19.942 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/tmp.wcOC4GgRLc 2019-12-08T11:52:19.943 INFO:teuthology.orchestra.run.smithi079:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.wcOC4GgRLc 2019-12-08T11:52:20.065 INFO:teuthology.orchestra.run.smithi079:> sudo chmod 0666 /tmp/tmp.wcOC4GgRLc 2019-12-08T11:52:20.270 DEBUG:teuthology.orchestra.remote:smithi079:/tmp/tmp.wcOC4GgRLc is 6KB 2019-12-08T11:52:20.337 INFO:teuthology.orchestra.run.smithi079:> rm -fr /tmp/tmp.wcOC4GgRLc 2019-12-08T11:52:20.413 INFO:teuthology.orchestra.run.smithi079:> sudo grub2-set-default 0 2019-12-08T11:52:20.648 INFO:teuthology.orchestra.run.smithi079:> sudo shutdown -r now 2019-12-08T11:52:20.652 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2019-12-08T11:52:20.652 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi013.front.sepia.ceph.com, path=None, version=distro) 2019-12-08T11:52:20.652 INFO:teuthology.orchestra.run.smithi013:> rpm -q kernel --last | head -n 1 2019-12-08T11:52:21.025 INFO:teuthology.orchestra.run.smithi013.stdout:kernel-3.10.0-1062.9.1.el7.x86_64 Sun 08 Dec 2019 11:51:40 AM UTC 2019-12-08T11:52:21.027 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 3.10.0-1062.9.1.el7.x86_64 2019-12-08T11:52:21.028 INFO:teuthology.orchestra.run.smithi013:> sudo rpm -qi grub2 2019-12-08T11:52:21.182 INFO:teuthology.orchestra.run.smithi013.stdout:Name : grub2 2019-12-08T11:52:21.182 INFO:teuthology.orchestra.run.smithi013.stdout:Epoch : 1 2019-12-08T11:52:21.182 INFO:teuthology.orchestra.run.smithi013.stdout:Version : 2.02 2019-12-08T11:52:21.183 INFO:teuthology.orchestra.run.smithi013.stdout:Release : 0.76.el7.centos 2019-12-08T11:52:21.183 INFO:teuthology.orchestra.run.smithi013.stdout:Architecture: x86_64 2019-12-08T11:52:21.183 INFO:teuthology.orchestra.run.smithi013.stdout:Install Date: Tue 05 Nov 2019 03:41:14 PM UTC 2019-12-08T11:52:21.183 INFO:teuthology.orchestra.run.smithi013.stdout:Group : System Environment/Base 2019-12-08T11:52:21.183 INFO:teuthology.orchestra.run.smithi013.stdout:Size : 0 2019-12-08T11:52:21.183 INFO:teuthology.orchestra.run.smithi013.stdout:License : GPLv3+ 2019-12-08T11:52:21.183 INFO:teuthology.orchestra.run.smithi013.stdout:Signature : RSA/SHA256, Mon 12 Nov 2018 02:28:06 PM UTC, Key ID 24c6a8a7f4a80eb5 2019-12-08T11:52:21.184 INFO:teuthology.orchestra.run.smithi013.stdout:Source RPM : grub2-2.02-0.76.el7.centos.src.rpm 2019-12-08T11:52:21.184 INFO:teuthology.orchestra.run.smithi013.stdout:Build Date : Fri 09 Nov 2018 12:58:43 AM UTC 2019-12-08T11:52:21.184 INFO:teuthology.orchestra.run.smithi013.stdout:Build Host : kbuilder.bsys.centos.org 2019-12-08T11:52:21.184 INFO:teuthology.orchestra.run.smithi013.stdout:Relocations : (not relocatable) 2019-12-08T11:52:21.184 INFO:teuthology.orchestra.run.smithi013.stdout:Packager : CentOS BuildSystem 2019-12-08T11:52:21.184 INFO:teuthology.orchestra.run.smithi013.stdout:Vendor : CentOS 2019-12-08T11:52:21.184 INFO:teuthology.orchestra.run.smithi013.stdout:URL : http://www.gnu.org/software/grub/ 2019-12-08T11:52:21.184 INFO:teuthology.orchestra.run.smithi013.stdout:Summary : Bootloader with support for Linux, Multiboot and more 2019-12-08T11:52:21.185 INFO:teuthology.orchestra.run.smithi013.stdout:Description : 2019-12-08T11:52:21.185 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T11:52:21.185 INFO:teuthology.orchestra.run.smithi013.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2019-12-08T11:52:21.185 INFO:teuthology.orchestra.run.smithi013.stdout:customizable bootloader with modular architecture. It supports a rich 2019-12-08T11:52:21.185 INFO:teuthology.orchestra.run.smithi013.stdout:variety of kernel formats, file systems, computer architectures and 2019-12-08T11:52:21.185 INFO:teuthology.orchestra.run.smithi013.stdout:hardware devices. 2019-12-08T11:52:21.186 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2019-12-08T11:52:21.186 INFO:teuthology.task.kernel:Updating grub on smithi013 to boot 3.10.0-1062.9.1.el7.x86_64 2019-12-08T11:52:21.187 INFO:teuthology.orchestra.run.smithi013:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2019-12-08T11:52:21.793 INFO:teuthology.orchestra.run.smithi013.stderr:Generating grub configuration file ... 2019-12-08T11:52:21.961 INFO:teuthology.orchestra.run.smithi013.stderr:Found linux image: /boot/vmlinuz-3.10.0-1062.9.1.el7.x86_64 2019-12-08T11:52:21.979 INFO:teuthology.orchestra.run.smithi013.stderr:Found initrd image: /boot/initramfs-3.10.0-1062.9.1.el7.x86_64.img 2019-12-08T11:52:22.271 INFO:teuthology.orchestra.run.smithi013.stderr:Found linux image: /boot/vmlinuz-3.10.0-1062.4.1.el7.x86_64 2019-12-08T11:52:22.296 INFO:teuthology.orchestra.run.smithi013.stderr:Found initrd image: /boot/initramfs-3.10.0-1062.4.1.el7.x86_64.img 2019-12-08T11:52:22.337 INFO:teuthology.orchestra.run.smithi013.stderr:Found linux image: /boot/vmlinuz-3.10.0-957.el7.x86_64 2019-12-08T11:52:22.361 INFO:teuthology.orchestra.run.smithi013.stderr:Found initrd image: /boot/initramfs-3.10.0-957.el7.x86_64.img 2019-12-08T11:52:22.397 INFO:teuthology.orchestra.run.smithi013.stderr:Found linux image: /boot/vmlinuz-0-rescue-a1739c9c60b14f0891126d2e603bb003 2019-12-08T11:52:22.409 INFO:teuthology.orchestra.run.smithi013.stderr:Found initrd image: /boot/initramfs-0-rescue-a1739c9c60b14f0891126d2e603bb003.img 2019-12-08T11:52:23.616 INFO:teuthology.orchestra.run.smithi013.stderr:done 2019-12-08T11:52:23.620 INFO:teuthology.orchestra.run.smithi013:> mktemp 2019-12-08T11:52:23.689 INFO:teuthology.orchestra.run.smithi013.stdout:/tmp/tmp.HCcOhXuFcv 2019-12-08T11:52:23.690 INFO:teuthology.orchestra.run.smithi013:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.HCcOhXuFcv 2019-12-08T11:52:23.767 INFO:teuthology.orchestra.run.smithi013:> sudo chmod 0666 /tmp/tmp.HCcOhXuFcv 2019-12-08T11:52:23.924 DEBUG:teuthology.orchestra.remote:smithi013:/tmp/tmp.HCcOhXuFcv is 6KB 2019-12-08T11:52:23.992 INFO:teuthology.orchestra.run.smithi013:> rm -fr /tmp/tmp.HCcOhXuFcv 2019-12-08T11:52:24.056 INFO:teuthology.orchestra.run.smithi013:> sudo grub2-set-default 0 2019-12-08T11:52:24.294 INFO:teuthology.orchestra.run.smithi013:> sudo shutdown -r now 2019-12-08T11:52:24.297 INFO:teuthology.misc:Re-opening connections... 2019-12-08T11:52:24.297 INFO:teuthology.misc:trying to connect to ubuntu@smithi013.front.sepia.ceph.com 2019-12-08T11:52:24.299 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-08T11:52:24.300 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi013.front.sepia.ceph.com', 'timeout': 60} 2019-12-08T11:52:24.392 INFO:teuthology.orchestra.run.smithi013:> true 2019-12-08T11:52:24.756 DEBUG:teuthology.misc:waited 0.458656072617 2019-12-08T11:52:25.757 INFO:teuthology.misc:trying to connect to ubuntu@smithi079.front.sepia.ceph.com 2019-12-08T11:52:25.757 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-08T11:52:25.758 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi079.front.sepia.ceph.com', 'timeout': 60} 2019-12-08T11:53:25.816 DEBUG:teuthology.orchestra.remote:timed out 2019-12-08T11:53:25.817 DEBUG:teuthology.misc:waited 61.5190780163 2019-12-08T11:53:26.817 INFO:teuthology.misc:trying to connect to ubuntu@smithi079.front.sepia.ceph.com 2019-12-08T11:53:26.818 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-08T11:53:26.818 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi079.front.sepia.ceph.com', 'timeout': 60} 2019-12-08T11:53:29.880 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.79 2019-12-08T11:53:29.881 DEBUG:teuthology.misc:waited 65.583204031 2019-12-08T11:53:30.881 INFO:teuthology.misc:trying to connect to ubuntu@smithi079.front.sepia.ceph.com 2019-12-08T11:53:30.881 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-08T11:53:30.882 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi079.front.sepia.ceph.com', 'timeout': 60} 2019-12-08T11:53:32.956 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.79 2019-12-08T11:53:32.957 DEBUG:teuthology.misc:waited 68.6591181755 2019-12-08T11:53:33.958 INFO:teuthology.misc:trying to connect to ubuntu@smithi079.front.sepia.ceph.com 2019-12-08T11:53:33.958 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-08T11:53:33.959 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi079.front.sepia.ceph.com', 'timeout': 60} 2019-12-08T11:53:36.024 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.79 2019-12-08T11:53:36.025 DEBUG:teuthology.misc:waited 71.7272291183 2019-12-08T11:53:37.025 INFO:teuthology.misc:trying to connect to ubuntu@smithi079.front.sepia.ceph.com 2019-12-08T11:53:37.026 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-08T11:53:37.026 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi079.front.sepia.ceph.com', 'timeout': 60} 2019-12-08T11:54:08.445 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.79 2019-12-08T11:54:08.445 DEBUG:teuthology.misc:waited 104.147384167 2019-12-08T11:54:09.445 INFO:teuthology.misc:trying to connect to ubuntu@smithi079.front.sepia.ceph.com 2019-12-08T11:54:09.445 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-08T11:54:09.446 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi079.front.sepia.ceph.com', 'timeout': 60} 2019-12-08T11:54:09.447 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.79 2019-12-08T11:54:09.447 DEBUG:teuthology.misc:waited 105.1495502 2019-12-08T11:54:10.447 INFO:teuthology.misc:trying to connect to ubuntu@smithi079.front.sepia.ceph.com 2019-12-08T11:54:10.448 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-08T11:54:10.448 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi079.front.sepia.ceph.com', 'timeout': 60} 2019-12-08T11:54:10.449 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.79 2019-12-08T11:54:10.449 DEBUG:teuthology.misc:waited 106.151757002 2019-12-08T11:54:11.450 INFO:teuthology.misc:trying to connect to ubuntu@smithi079.front.sepia.ceph.com 2019-12-08T11:54:11.450 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-08T11:54:11.450 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi079.front.sepia.ceph.com', 'timeout': 60} 2019-12-08T11:54:11.451 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.79 2019-12-08T11:54:11.451 DEBUG:teuthology.misc:waited 107.153871059 2019-12-08T11:54:12.453 INFO:teuthology.misc:trying to connect to ubuntu@smithi079.front.sepia.ceph.com 2019-12-08T11:54:12.453 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-08T11:54:12.453 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi079.front.sepia.ceph.com', 'timeout': 60} 2019-12-08T11:54:12.456 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.79 2019-12-08T11:54:12.457 DEBUG:teuthology.misc:waited 108.159020185 2019-12-08T11:54:13.457 INFO:teuthology.misc:trying to connect to ubuntu@smithi079.front.sepia.ceph.com 2019-12-08T11:54:13.458 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-08T11:54:13.458 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi079.front.sepia.ceph.com', 'timeout': 60} 2019-12-08T11:54:13.459 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.79 2019-12-08T11:54:13.460 DEBUG:teuthology.misc:waited 109.162034988 2019-12-08T11:54:14.460 INFO:teuthology.misc:trying to connect to ubuntu@smithi079.front.sepia.ceph.com 2019-12-08T11:54:14.460 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-08T11:54:14.461 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi079.front.sepia.ceph.com', 'timeout': 60} 2019-12-08T11:54:14.542 INFO:teuthology.orchestra.run.smithi079:> true 2019-12-08T11:54:14.861 DEBUG:teuthology.misc:waited 110.563102007 2019-12-08T11:54:15.862 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2019-12-08T11:54:15.862 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "3.10.0-1062.9.1.el7.x86_64"... 2019-12-08T11:54:15.862 INFO:teuthology.orchestra.run.smithi079:> uname -r 2019-12-08T11:54:15.945 INFO:teuthology.orchestra.run.smithi079.stdout:3.10.0-1062.9.1.el7.x86_64 2019-12-08T11:54:15.945 DEBUG:teuthology.task.kernel:current kernel version is 3.10.0-1062.9.1.el7.x86_64 2019-12-08T11:54:15.946 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2019-12-08T11:54:15.946 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2019-12-08T11:54:15.946 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "3.10.0-1062.9.1.el7.x86_64"... 2019-12-08T11:54:15.946 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-08T11:54:15.947 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi013.front.sepia.ceph.com', 'timeout': 60} 2019-12-08T11:54:16.054 INFO:teuthology.orchestra.run.smithi013:> true 2019-12-08T11:54:16.479 INFO:teuthology.orchestra.run.smithi013:> uname -r 2019-12-08T11:54:16.551 INFO:teuthology.orchestra.run.smithi013.stdout:3.10.0-1062.9.1.el7.x86_64 2019-12-08T11:54:16.551 DEBUG:teuthology.task.kernel:current kernel version is 3.10.0-1062.9.1.el7.x86_64 2019-12-08T11:54:16.551 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2019-12-08T11:54:17.552 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2019-12-08T11:54:17.552 INFO:teuthology.orchestra.run.smithi079:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2019-12-08T11:54:17.636 INFO:teuthology.orchestra.run.smithi079.stdout:ttyS1 2019-12-08T11:54:17.648 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2019-12-08T11:54:17.648 INFO:teuthology.orchestra.run.smithi013:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2019-12-08T11:54:17.819 INFO:teuthology.orchestra.run.smithi013.stdout:ttyS1 2019-12-08T11:54:17.831 INFO:teuthology.run_tasks:Running task internal.base... 2019-12-08T11:54:17.926 INFO:teuthology.task.internal:Creating test directory... 2019-12-08T11:54:17.926 INFO:teuthology.orchestra.run.smithi013:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2019-12-08T11:54:17.930 INFO:teuthology.orchestra.run.smithi079:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2019-12-08T11:54:18.012 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2019-12-08T11:54:18.034 INFO:teuthology.run_tasks:Running task internal.archive... 2019-12-08T11:54:18.059 INFO:teuthology.task.internal:Creating archive directory... 2019-12-08T11:54:18.060 INFO:teuthology.orchestra.run.smithi013:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2019-12-08T11:54:18.066 INFO:teuthology.orchestra.run.smithi079:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2019-12-08T11:54:18.167 INFO:teuthology.run_tasks:Running task internal.coredump... 2019-12-08T11:54:18.184 INFO:teuthology.task.internal:Enabling coredump saving... 2019-12-08T11:54:18.184 INFO:teuthology.orchestra.run.smithi013:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2019-12-08T11:54:18.189 INFO:teuthology.orchestra.run.smithi079:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2019-12-08T11:54:18.247 INFO:teuthology.orchestra.run.smithi079.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2019-12-08T11:54:18.306 INFO:teuthology.orchestra.run.smithi013.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2019-12-08T11:54:18.309 INFO:teuthology.run_tasks:Running task internal.sudo... 2019-12-08T11:54:18.318 INFO:teuthology.task.internal:Configuring sudo... 2019-12-08T11:54:18.319 INFO:teuthology.orchestra.run.smithi013:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2019-12-08T11:54:18.323 INFO:teuthology.orchestra.run.smithi079:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2019-12-08T11:54:18.436 INFO:teuthology.run_tasks:Running task internal.syslog... 2019-12-08T11:54:18.449 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2019-12-08T11:54:18.450 INFO:teuthology.orchestra.run.smithi013:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2019-12-08T11:54:18.455 INFO:teuthology.orchestra.run.smithi079:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2019-12-08T11:54:18.534 INFO:teuthology.orchestra.run.smithi013:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2019-12-08T11:54:18.629 INFO:teuthology.orchestra.run.smithi013:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2019-12-08T11:54:18.748 INFO:teuthology.orchestra.run.smithi013:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2019-12-08T11:54:18.836 INFO:teuthology.orchestra.run.smithi013:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2019-12-08T11:54:18.926 INFO:teuthology.orchestra.run.smithi013:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2019-12-08T11:54:19.010 INFO:teuthology.orchestra.run.smithi079:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2019-12-08T11:54:19.077 INFO:teuthology.orchestra.run.smithi079:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2019-12-08T11:54:19.146 INFO:teuthology.orchestra.run.smithi079:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2019-12-08T11:54:19.202 INFO:teuthology.orchestra.run.smithi079:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2019-12-08T11:54:19.277 INFO:teuthology.orchestra.run.smithi079:> sudo sh -c 'cat > /etc/rsyslog.d/80-cephtest.conf' 2019-12-08T11:54:19.330 INFO:teuthology.orchestra.run.smithi013:> sudo service rsyslog restart 2019-12-08T11:54:19.335 INFO:teuthology.orchestra.run.smithi079:> sudo service rsyslog restart 2019-12-08T11:54:19.447 INFO:teuthology.orchestra.run.smithi079.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2019-12-08T11:54:19.478 INFO:teuthology.orchestra.run.smithi013.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2019-12-08T11:54:19.517 INFO:teuthology.run_tasks:Running task internal.timer... 2019-12-08T11:54:19.530 INFO:teuthology.task.internal:Starting timer... 2019-12-08T11:54:19.531 INFO:teuthology.run_tasks:Running task pcp... 2019-12-08T11:54:19.585 INFO:teuthology.run_tasks:Running task selinux... 2019-12-08T11:54:19.605 INFO:teuthology.orchestra.run.smithi013:> sudo service auditd rotate 2019-12-08T11:54:19.772 INFO:teuthology.orchestra.run.smithi013.stdout:Rotating logs: [ OK ] 2019-12-08T11:54:19.774 INFO:teuthology.orchestra.run.smithi079:> sudo service auditd rotate 2019-12-08T11:54:19.867 INFO:teuthology.orchestra.run.smithi079.stdout:Rotating logs: [ OK ] 2019-12-08T11:54:19.869 DEBUG:teuthology.task.selinux:Getting current SELinux state 2019-12-08T11:54:19.869 INFO:teuthology.orchestra.run.smithi013:> /usr/sbin/getenforce 2019-12-08T11:54:19.966 INFO:teuthology.orchestra.run.smithi013.stdout:Permissive 2019-12-08T11:54:19.967 INFO:teuthology.orchestra.run.smithi079:> /usr/sbin/getenforce 2019-12-08T11:54:20.011 INFO:teuthology.orchestra.run.smithi079.stdout:Permissive 2019-12-08T11:54:20.012 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi079.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi013.front.sepia.ceph.com': 'permissive'} 2019-12-08T11:54:20.012 INFO:teuthology.orchestra.run.smithi013:> sudo grep 'avc: .*denied' /var/log/audit/audit.log | grep -v '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\)' 2019-12-08T11:54:20.127 DEBUG:teuthology.orchestra.run:got remote process result: 1 2019-12-08T11:54:20.128 INFO:teuthology.orchestra.run.smithi079:> sudo grep 'avc: .*denied' /var/log/audit/audit.log | grep -v '\(comm="dmidecode"\|chronyd.service\|name="cephtest"\|scontext=system_u:system_r:nrpe_t:s0\|scontext=system_u:system_r:pcp_pmlogger_t\|scontext=system_u:system_r:pcp_pmcd_t:s0\|comm="rhsmd"\|scontext=system_u:system_r:syslogd_t:s0\|tcontext=system_u:system_r:nrpe_t:s0\|comm="updatedb"\|comm="smartd"\)' 2019-12-08T11:54:20.184 DEBUG:teuthology.orchestra.run:got remote process result: 1 2019-12-08T11:54:20.184 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2019-12-08T11:54:20.185 INFO:teuthology.orchestra.run.smithi013:> sudo /usr/sbin/setenforce permissive 2019-12-08T11:54:20.317 INFO:teuthology.orchestra.run.smithi079:> sudo /usr/sbin/setenforce permissive 2019-12-08T11:54:20.376 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2019-12-08T11:54:20.389 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master was just updated; assuming it is current 2019-12-08T11:54:20.390 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master to branch origin/master 2019-12-08T11:54:20.410 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}] 2019-12-08T11:54:20.412 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi013.front.sepia.ceph.com,smithi079.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/cephlab.yml 2019-12-08T11:54:20.823 INFO:teuthology.task.ansible.out:Using /home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/ansible.cfg as config file 2019-12-08T11:54:22.066 INFO:teuthology.task.ansible.out: [WARNING]: file /home/teuthworker/src/git.ceph.com_git_ceph-cm- ansible_master/roles/testnode/tasks/setup-opensuse.yml is empty and had no tasks to include 2019-12-08T11:54:24.761 INFO:teuthology.task.ansible.out: PLAY [all] ********************************************************************* 2019-12-08T11:54:24.785 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:54:24 +0000 (0:00:00.066) 0:00:00.066 ******* 2019-12-08T11:54:24.797 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:54:24 +0000 (0:00:00.011) 0:00:00.078 ******* 2019-12-08T11:54:28.295 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi013.front.sepia.ceph.com] 2019-12-08T11:54:28.383 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:54:28 +0000 (0:00:03.586) 0:00:03.664 ******* 2019-12-08T11:54:28.889 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the sudo group.] ******************************** 2019-12-08T11:54:28.891 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2019-12-08T11:54:28.926 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:54:28 +0000 (0:00:00.543) 0:00:04.207 ******* 2019-12-08T11:54:28.966 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi079.front.sepia.ceph.com] 2019-12-08T11:54:29.043 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:54:29 +0000 (0:00:00.116) 0:00:04.324 ******* 2019-12-08T11:54:29.324 INFO:teuthology.task.ansible.out: 2019-12-08T11:54:29.329 INFO:teuthology.task.ansible.out:TASK [ansible-managed : Create the sudo group.] ******************************** 2019-12-08T11:54:29.329 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2019-12-08T11:54:29.331 INFO:teuthology.task.ansible.out: 2019-12-08T11:54:29.369 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:54:29 +0000 (0:00:00.325) 0:00:04.650 ******* 2019-12-08T11:54:29.614 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2019-12-08T11:54:29.614 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2019-12-08T11:54:29.652 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:54:29 +0000 (0:00:00.283) 0:00:04.933 ******* 2019-12-08T11:54:29.689 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2019-12-08T11:54:29.691 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:54:29.731 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:54:29 +0000 (0:00:00.078) 0:00:05.011 ******* 2019-12-08T11:54:29.768 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the ansible user.] ****************************** 2019-12-08T11:54:29.769 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 1100, "groups": "sudo", "home": "/home/cm", "move_home": false, "name": "cm", "shell": "/bin/bash", "state": "present", "uid": 1100} 2019-12-08T11:54:29.811 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:54:29 +0000 (0:00:00.080) 0:00:05.092 ******* 2019-12-08T11:54:29.849 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Delete the ansible users password.] ******************** 2019-12-08T11:54:29.853 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:54:29.901 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:54:29 +0000 (0:00:00.084) 0:00:05.177 ******* 2019-12-08T11:54:30.202 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Ensure includedir is present in sudoers.] ************** 2019-12-08T11:54:30.203 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-08T11:54:30.255 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:54:30 +0000 (0:00:00.358) 0:00:05.536 ******* 2019-12-08T11:54:30.271 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-08T11:54:30.310 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:54:30 +0000 (0:00:00.055) 0:00:05.591 ******* 2019-12-08T11:54:31.797 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Create the cephlab_sudo sudoers.d file.] *************** 2019-12-08T11:54:31.798 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1575806070.33-219476054436608/source", "state": "file", "uid": 0} 2019-12-08T11:54:31.863 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:54:31 +0000 (0:00:01.553) 0:00:07.145 ******* 2019-12-08T11:54:31.874 INFO:teuthology.task.ansible.out:changed: [smithi013.front.sepia.ceph.com] => {"changed": true, "checksum": "6c8e8b7ecc895eb2094cafe75c34b58f183442a7", "dest": "/etc/sudoers.d/cephlab_sudo", "gid": 0, "group": "root", "md5sum": "c3657b9ef874d0ad278742c3210136a0", "mode": "0440", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 182, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1575806070.28-235525750978093/source", "state": "file", "uid": 0} 2019-12-08T11:54:31.914 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:54:31 +0000 (0:00:00.050) 0:00:07.195 ******* 2019-12-08T11:54:32.468 INFO:teuthology.task.ansible.out: TASK [ansible-managed : Add authorized keys for the ansible user.] ************* 2019-12-08T11:54:32.470 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-08T11:54:32.515 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmiHwkLkoJZiQs67KfE8jf0CdXjgbbpzKywUleMk4kWC7Wdn+92q/33DXpfS8xjg7opB9GTK3EW2C/RKBpf5RdaVG/5M7tRyUDLLbS3CURUoF6aNQI+8JIuFlsIfhO3Qw4uT7NlJCqsusrSbyLtGd/Im4CzwhvP1Enn6aUfyxv2yV4HoVjXbbIp2hlRXgcW8G/9q0TMuNfX4J6dpj9/PG8BbkKH/NReL2UMtjCGyRdIQvIwJRHMozjcE21824ZatA7nBeecX0MBRS6/A286uj6Z0PgmfJXYw0yw2Z2uSWR1ptIuMEiDBt96Pzn0dvfl7g/7bCi93MBQf/6sH9n4wkN root@typica001", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-08T11:54:32.821 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-08T11:54:32.881 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-08T11:54:33.092 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-08T11:54:33.237 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-08T11:54:33.405 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-08T11:54:33.617 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-08T11:54:33.713 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-08T11:54:33.949 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-08T11:54:34.055 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-08T11:54:34.282 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZttEdz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-08T11:54:34.377 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-08T11:54:34.633 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item=ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/cm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cm", "validate_certs": true} 2019-12-08T11:54:34.739 INFO:teuthology.task.ansible.out: PLAY [teuthology] ************************************************************** skipping: no hosts matched 2019-12-08T11:54:34.745 INFO:teuthology.task.ansible.out: PLAY [testnodes] *************************************************************** 2019-12-08T11:54:34.989 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:54:34 +0000 (0:00:03.074) 0:00:10.270 ******* 2019-12-08T11:54:35.023 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:54:35 +0000 (0:00:00.034) 0:00:10.305 ******* 2019-12-08T11:54:35.990 INFO:teuthology.task.ansible.out: TASK [Gathering Facts] ********************************************************* ok: [smithi013.front.sepia.ceph.com] 2019-12-08T11:54:36.058 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] 2019-12-08T11:54:36.121 INFO:teuthology.task.ansible.out: [WARNING]: Using run_once with the free strategy is not currently supported. This task will still be executed for every host in the inventory list. Sunday 08 December 2019 11:54:36 +0000 (0:00:01.096) 0:00:11.401 ******* 2019-12-08T11:54:36.210 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:54:36 +0000 (0:00:00.090) 0:00:11.492 ******* 2019-12-08T11:54:36.704 INFO:teuthology.task.ansible.out: TASK [users : Check keys_repo HEAD sha1] *************************************** 2019-12-08T11:54:36.705 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.231767", "end": "2019-12-08 11:54:36.679822", "rc": 0, "start": "2019-12-08 11:54:36.448055", "stderr": "", "stderr_lines": [], "stdout": "2c3c6d863a854d6a1e155fc475e8273d88b91491", "stdout_lines": ["2c3c6d863a854d6a1e155fc475e8273d88b91491"]} 2019-12-08T11:54:36.768 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:54:36 +0000 (0:00:00.555) 0:00:12.048 ******* 2019-12-08T11:54:36.774 INFO:teuthology.task.ansible.out:changed: [smithi013.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "git ls-remote https://github.com/ceph/keys HEAD | awk '{ print $1 }'", "delta": "0:00:00.236467", "end": "2019-12-08 11:54:36.689309", "rc": 0, "start": "2019-12-08 11:54:36.452842", "stderr": "", "stderr_lines": [], "stdout": "2c3c6d863a854d6a1e155fc475e8273d88b91491", "stdout_lines": ["2c3c6d863a854d6a1e155fc475e8273d88b91491"]} 2019-12-08T11:54:36.834 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:54:36 +0000 (0:00:00.067) 0:00:12.116 ******* 2019-12-08T11:54:37.085 INFO:teuthology.task.ansible.out: TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** changed: [smithi079.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.011248", "end": "2019-12-08 11:54:37.055725", "failed_when_result": false, "rc": 0, "start": "2019-12-08 11:54:37.044477", "stderr": "", "stderr_lines": [], "stdout": "7b088106a1031364e6869fc2888a0e2542579008", "stdout_lines": ["7b088106a1031364e6869fc2888a0e2542579008"]} 2019-12-08T11:54:37.125 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:54:37 +0000 (0:00:00.290) 0:00:12.406 ******* 2019-12-08T11:54:37.164 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** 2019-12-08T11:54:37.166 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} TASK [users : Check host's /keys-repo-sha1 sentinel file] ********************** changed: [smithi013.front.sepia.ceph.com] => {"changed": true, "cmd": ["cat", "/keys-repo-sha1"], "delta": "0:00:00.016262", "end": "2019-12-08 11:54:37.136726", "failed_when_result": false, "rc": 0, "start": "2019-12-08 11:54:37.120464", "stderr": "", "stderr_lines": [], "stdout": "7b088106a1031364e6869fc2888a0e2542579008", "stdout_lines": ["7b088106a1031364e6869fc2888a0e2542579008"]} 2019-12-08T11:54:37.223 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:54:37 +0000 (0:00:00.098) 0:00:12.504 ******* 2019-12-08T11:54:37.265 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:54:37 +0000 (0:00:00.041) 0:00:12.546 ******* 2019-12-08T11:54:37.273 INFO:teuthology.task.ansible.out: TASK [users : Determine if we can skip users and pubkeys updates] ************** skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:54:37.313 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:54:37 +0000 (0:00:00.047) 0:00:12.594 ******* 2019-12-08T11:54:37.319 INFO:teuthology.task.ansible.out: TASK [users : Merge extra_admin_users into managed_admin_users] **************** 2019-12-08T11:54:37.320 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:54:37.372 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:54:37 +0000 (0:00:00.059) 0:00:12.653 ******* 2019-12-08T11:54:37.388 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:54:37.439 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:54:37 +0000 (0:00:00.067) 0:00:12.720 ******* 2019-12-08T11:54:37.445 INFO:teuthology.task.ansible.out: TASK [users : Remove managed_admin_users from managed_users] ******************* 2019-12-08T11:54:37.447 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:54:37.486 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:54:37 +0000 (0:00:00.046) 0:00:12.767 ******* 2019-12-08T11:54:37.492 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:54:37.532 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:54:37 +0000 (0:00:00.045) 0:00:12.813 ******* 2019-12-08T11:54:37.539 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_users list] *********************************** 2019-12-08T11:54:37.542 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:54:37.581 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:54:37 +0000 (0:00:00.048) 0:00:12.862 ******* 2019-12-08T11:54:37.587 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:54:37.645 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:54:37 +0000 (0:00:00.064) 0:00:12.927 ******* 2019-12-08T11:54:37.655 INFO:teuthology.task.ansible.out: TASK [users : Filter the managed_admin_users list] ***************************** 2019-12-08T11:54:37.656 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:54:37.718 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:54:37 +0000 (0:00:00.072) 0:00:12.999 ******* 2019-12-08T11:54:37.725 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:54:37.778 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:54:37 +0000 (0:00:00.054) 0:00:13.054 ******* 2019-12-08T11:54:38.035 INFO:teuthology.task.ansible.out: TASK [users : Set UID_MIN to 1001] ********************************************* 2019-12-08T11:54:38.036 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-08T11:54:38.107 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:54:38 +0000 (0:00:00.334) 0:00:13.389 ******* 2019-12-08T11:54:38.115 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-08T11:54:38.158 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:54:38 +0000 (0:00:00.050) 0:00:13.439 ******* 2019-12-08T11:54:38.533 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2019-12-08T11:54:38.534 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2019-12-08T11:54:38.598 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1101, "groups": "sudo", "home": "/home/andrewschoen", "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "move_home": false, "name": "andrewschoen", "shell": "/bin/bash", "state": "present", "uid": 1101} 2019-12-08T11:54:38.876 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2019-12-08T11:54:38.966 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1102, "groups": "sudo", "home": "/home/zack", "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "move_home": false, "name": "zack", "shell": "/bin/bash", "state": "present", "uid": 1102} 2019-12-08T11:54:39.222 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2019-12-08T11:54:39.280 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1103, "groups": "sudo", "home": "/home/kdreyer", "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "move_home": false, "name": "kdreyer", "shell": "/bin/bash", "state": "present", "uid": 1103} 2019-12-08T11:54:39.541 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/adeza", "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "move_home": false, "name": "adeza", "shell": "/bin/bash", "state": "present", "uid": 1104} 2019-12-08T11:54:39.616 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1104, "groups": "sudo", "home": "/home/adeza", "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "move_home": false, "name": "adeza", "shell": "/bin/bash", "state": "present", "uid": 1104} 2019-12-08T11:54:39.851 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1105} 2019-12-08T11:54:39.938 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1105, "groups": "sudo", "home": "/home/dmick", "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "move_home": false, "name": "dmick", "shell": "/bin/bash", "state": "present", "uid": 1105} 2019-12-08T11:54:40.148 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1106} 2019-12-08T11:54:40.308 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1106, "groups": "sudo", "home": "/home/sage", "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "move_home": false, "name": "sage", "shell": "/bin/bash", "state": "present", "uid": 1106} 2019-12-08T11:54:40.460 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1107} 2019-12-08T11:54:40.670 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1107, "groups": "sudo", "home": "/home/dgalloway", "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "move_home": false, "name": "dgalloway", "shell": "/bin/bash", "state": "present", "uid": 1107} 2019-12-08T11:54:40.814 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1108} 2019-12-08T11:54:41.043 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1108, "groups": "sudo", "home": "/home/akraitma", "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "move_home": false, "name": "akraitma", "shell": "/bin/bash", "state": "present", "uid": 1108} 2019-12-08T11:54:41.138 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2019-12-08T11:54:41.388 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1109, "groups": "sudo", "home": "/home/trociny", "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "move_home": false, "name": "trociny", "shell": "/bin/bash", "state": "present", "uid": 1109} 2019-12-08T11:54:41.515 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2019-12-08T11:54:41.748 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1110, "groups": "sudo", "home": "/home/smithfarm", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "move_home": false, "name": "smithfarm", "shell": "/bin/bash", "state": "present", "uid": 1110} 2019-12-08T11:54:41.886 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2019-12-08T11:54:42.133 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1111, "groups": "sudo", "home": "/home/mbenjamin", "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "move_home": false, "name": "mbenjamin", "shell": "/bin/bash", "state": "present", "uid": 1111} 2019-12-08T11:54:42.234 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2019-12-08T11:54:42.513 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1112, "groups": "sudo", "home": "/home/aemerson", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "move_home": false, "name": "aemerson", "shell": "/bin/bash", "state": "present", "uid": 1112} 2019-12-08T11:54:42.598 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1114} 2019-12-08T11:54:42.878 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1114, "groups": "sudo", "home": "/home/amaredia", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "move_home": false, "name": "amaredia", "shell": "/bin/bash", "state": "present", "uid": 1114} 2019-12-08T11:54:42.954 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1115} 2019-12-08T11:54:43.245 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1115, "groups": "sudo", "home": "/home/tserlin", "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "move_home": false, "name": "tserlin", "shell": "/bin/bash", "state": "present", "uid": 1115} 2019-12-08T11:54:43.281 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1116} 2019-12-08T11:54:43.617 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1116, "groups": "sudo", "home": "/home/dis", "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "move_home": false, "name": "dis", "shell": "/bin/bash", "state": "present", "uid": 1116} 2019-12-08T11:54:43.689 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1117} 2019-12-08T11:54:43.982 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1117, "groups": "sudo", "home": "/home/gregf", "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "move_home": false, "name": "gregf", "shell": "/bin/bash", "state": "present", "uid": 1117} 2019-12-08T11:54:44.017 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1118} 2019-12-08T11:54:44.346 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1118, "groups": "sudo", "home": "/home/joshd", "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "move_home": false, "name": "joshd", "shell": "/bin/bash", "state": "present", "uid": 1118} 2019-12-08T11:54:44.404 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1119} 2019-12-08T11:54:44.713 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1119, "groups": "sudo", "home": "/home/davidz", "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "move_home": false, "name": "davidz", "shell": "/bin/bash", "state": "present", "uid": 1119} 2019-12-08T11:54:44.726 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/gmeno", "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "move_home": false, "name": "gmeno", "shell": "/bin/bash", "state": "present", "uid": 1120} 2019-12-08T11:54:45.088 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1121} 2019-12-08T11:54:45.112 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1120, "groups": "sudo", "home": "/home/gmeno", "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "move_home": false, "name": "gmeno", "shell": "/bin/bash", "state": "present", "uid": 1120} 2019-12-08T11:54:45.460 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1121, "groups": "sudo", "home": "/home/ivancich", "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "move_home": false, "name": "ivancich", "shell": "/bin/bash", "state": "present", "uid": 1121} 2019-12-08T11:54:45.461 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1122} 2019-12-08T11:54:45.785 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/zyan", "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "move_home": false, "name": "zyan", "shell": "/bin/bash", "state": "present", "uid": 1123} 2019-12-08T11:54:45.830 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1122, "groups": "sudo", "home": "/home/wusui", "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "move_home": false, "name": "wusui", "shell": "/bin/bash", "state": "present", "uid": 1122} 2019-12-08T11:54:46.119 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1124} 2019-12-08T11:54:46.173 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1123, "groups": "sudo", "home": "/home/zyan", "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "move_home": false, "name": "zyan", "shell": "/bin/bash", "state": "present", "uid": 1123} 2019-12-08T11:54:46.432 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1125} 2019-12-08T11:54:46.543 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1124, "groups": "sudo", "home": "/home/yuriw", "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "move_home": false, "name": "yuriw", "shell": "/bin/bash", "state": "present", "uid": 1124} 2019-12-08T11:54:46.773 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1126} 2019-12-08T11:54:46.920 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1125, "groups": "sudo", "home": "/home/tamil", "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "move_home": false, "name": "tamil", "shell": "/bin/bash", "state": "present", "uid": 1125} 2019-12-08T11:54:47.124 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1127} 2019-12-08T11:54:47.274 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1126, "groups": "sudo", "home": "/home/jowilkin", "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "move_home": false, "name": "jowilkin", "shell": "/bin/bash", "state": "present", "uid": 1126} 2019-12-08T11:54:47.469 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1128} 2019-12-08T11:54:47.619 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1127, "groups": "sudo", "home": "/home/bhubbard", "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "move_home": false, "name": "bhubbard", "shell": "/bin/bash", "state": "present", "uid": 1127} 2019-12-08T11:54:47.839 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1129} 2019-12-08T11:54:47.981 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1128, "groups": "sudo", "home": "/home/yehudasa", "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "move_home": false, "name": "yehudasa", "shell": "/bin/bash", "state": "present", "uid": 1128} 2019-12-08T11:54:48.175 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1130} 2019-12-08T11:54:48.345 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1129, "groups": "sudo", "home": "/home/dang", "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "move_home": false, "name": "dang", "shell": "/bin/bash", "state": "present", "uid": 1129} 2019-12-08T11:54:48.536 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1131} 2019-12-08T11:54:48.713 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1130, "groups": "sudo", "home": "/home/branto", "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "move_home": false, "name": "branto", "shell": "/bin/bash", "state": "present", "uid": 1130} 2019-12-08T11:54:48.893 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1132} 2019-12-08T11:54:49.097 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1131, "groups": "sudo", "home": "/home/xiaoxichen", "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "move_home": false, "name": "xiaoxichen", "shell": "/bin/bash", "state": "present", "uid": 1131} 2019-12-08T11:54:49.200 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1133} 2019-12-08T11:54:49.468 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1132, "groups": "sudo", "home": "/home/ffilz", "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "move_home": false, "name": "ffilz", "shell": "/bin/bash", "state": "present", "uid": 1132} 2019-12-08T11:54:49.491 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1134} 2019-12-08T11:54:49.825 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1133, "groups": "sudo", "home": "/home/joao", "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "move_home": false, "name": "joao", "shell": "/bin/bash", "state": "present", "uid": 1133} 2019-12-08T11:54:49.837 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1136} 2019-12-08T11:54:50.164 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1137} 2019-12-08T11:54:50.229 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1134, "groups": "sudo", "home": "/home/nhm", "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "move_home": false, "name": "nhm", "shell": "/bin/bash", "state": "present", "uid": 1134} 2019-12-08T11:54:50.514 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1138} 2019-12-08T11:54:50.600 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1136, "groups": "sudo", "home": "/home/nwatkins", "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "move_home": false, "name": "nwatkins", "shell": "/bin/bash", "state": "present", "uid": 1136} 2019-12-08T11:54:50.873 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1139} 2019-12-08T11:54:50.974 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1137, "groups": "sudo", "home": "/home/mkidd", "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "move_home": false, "name": "mkidd", "shell": "/bin/bash", "state": "present", "uid": 1137} 2019-12-08T11:54:51.183 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1140} 2019-12-08T11:54:51.321 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1138, "groups": "sudo", "home": "/home/jlopez", "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "move_home": false, "name": "jlopez", "shell": "/bin/bash", "state": "present", "uid": 1138} 2019-12-08T11:54:51.484 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1141} 2019-12-08T11:54:51.705 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1139, "groups": "sudo", "home": "/home/haomaiwang", "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "move_home": false, "name": "haomaiwang", "shell": "/bin/bash", "state": "present", "uid": 1139} 2019-12-08T11:54:51.810 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1142} 2019-12-08T11:54:52.069 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1140, "groups": "sudo", "home": "/home/jdillaman", "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "move_home": false, "name": "jdillaman", "shell": "/bin/bash", "state": "present", "uid": 1140} 2019-12-08T11:54:52.174 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1143} 2019-12-08T11:54:52.409 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1141, "groups": "sudo", "home": "/home/kchai", "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "move_home": false, "name": "kchai", "shell": "/bin/bash", "state": "present", "uid": 1141} 2019-12-08T11:54:52.474 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1144} 2019-12-08T11:54:52.765 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1142} 2019-12-08T11:54:52.799 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1146} 2019-12-08T11:54:53.120 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1147} 2019-12-08T11:54:53.122 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1143, "groups": "sudo", "home": "/home/dfuller", "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "move_home": false, "name": "dfuller", "shell": "/bin/bash", "state": "present", "uid": 1143} 2019-12-08T11:54:53.434 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1148} 2019-12-08T11:54:53.504 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1144, "groups": "sudo", "home": "/home/owasserm", "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "move_home": false, "name": "owasserm", "shell": "/bin/bash", "state": "present", "uid": 1144} 2019-12-08T11:54:53.780 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1150} 2019-12-08T11:54:53.876 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1146, "groups": "sudo", "home": "/home/vasu", "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "move_home": false, "name": "vasu", "shell": "/bin/bash", "state": "present", "uid": 1146} 2019-12-08T11:54:54.128 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1153} 2019-12-08T11:54:54.257 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1147, "groups": "sudo", "home": "/home/smohan", "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "move_home": false, "name": "smohan", "shell": "/bin/bash", "state": "present", "uid": 1147} 2019-12-08T11:54:54.470 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1155} 2019-12-08T11:54:54.608 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1148, "groups": "sudo", "home": "/home/abhi", "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "move_home": false, "name": "abhi", "shell": "/bin/bash", "state": "present", "uid": 1148} 2019-12-08T11:54:54.838 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1156} 2019-12-08T11:54:54.968 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1150, "groups": "sudo", "home": "/home/cbodley", "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "move_home": false, "name": "cbodley", "shell": "/bin/bash", "state": "present", "uid": 1150} 2019-12-08T11:54:55.177 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1157} 2019-12-08T11:54:55.360 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1153, "groups": "sudo", "home": "/home/mwatts", "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "move_home": false, "name": "mwatts", "shell": "/bin/bash", "state": "present", "uid": 1153} 2019-12-08T11:54:55.518 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1158} 2019-12-08T11:54:55.686 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1155} 2019-12-08T11:54:55.866 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1159} 2019-12-08T11:54:56.037 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1156, "groups": "sudo", "home": "/home/pdonnell", "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "move_home": false, "name": "pdonnell", "shell": "/bin/bash", "state": "present", "uid": 1156} 2019-12-08T11:54:56.212 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1161} 2019-12-08T11:54:56.388 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1157, "groups": "sudo", "home": "/home/jlayton", "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "move_home": false, "name": "jlayton", "shell": "/bin/bash", "state": "present", "uid": 1157} 2019-12-08T11:54:56.558 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1162} 2019-12-08T11:54:56.751 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1158, "groups": "sudo", "home": "/home/rzarzynski", "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "move_home": false, "name": "rzarzynski", "shell": "/bin/bash", "state": "present", "uid": 1158} 2019-12-08T11:54:56.903 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1163} 2019-12-08T11:54:57.074 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1159, "groups": "sudo", "home": "/home/rdias", "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "move_home": false, "name": "rdias", "shell": "/bin/bash", "state": "present", "uid": 1159} 2019-12-08T11:54:57.204 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1164} 2019-12-08T11:54:57.418 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1161, "groups": "sudo", "home": "/home/vshankar", "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "move_home": false, "name": "vshankar", "shell": "/bin/bash", "state": "present", "uid": 1161} 2019-12-08T11:54:57.516 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1165} 2019-12-08T11:54:57.773 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1162, "groups": "sudo", "home": "/home/akupczyk", "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "move_home": false, "name": "akupczyk", "shell": "/bin/bash", "state": "present", "uid": 1162} 2019-12-08T11:54:57.830 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1167} 2019-12-08T11:54:58.108 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1163, "groups": "sudo", "home": "/home/nojha", "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "move_home": false, "name": "nojha", "shell": "/bin/bash", "state": "present", "uid": 1163} 2019-12-08T11:54:58.194 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1168} 2019-12-08T11:54:58.467 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1169} 2019-12-08T11:54:58.490 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1164, "groups": "sudo", "home": "/home/ifed01", "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "move_home": false, "name": "ifed01", "shell": "/bin/bash", "state": "present", "uid": 1164} 2019-12-08T11:54:58.832 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1170} 2019-12-08T11:54:58.844 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1165, "groups": "sudo", "home": "/home/myoungwon", "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "move_home": false, "name": "myoungwon", "shell": "/bin/bash", "state": "present", "uid": 1165} 2019-12-08T11:54:59.189 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1171} 2019-12-08T11:54:59.202 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1167, "groups": "sudo", "home": "/home/gabrioux", "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "move_home": false, "name": "gabrioux", "shell": "/bin/bash", "state": "present", "uid": 1167} 2019-12-08T11:54:59.495 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1172} 2019-12-08T11:54:59.570 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1168, "groups": "sudo", "home": "/home/leseb", "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "move_home": false, "name": "leseb", "shell": "/bin/bash", "state": "present", "uid": 1168} 2019-12-08T11:54:59.831 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1174} 2019-12-08T11:54:59.930 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1169, "groups": "sudo", "home": "/home/hchen", "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "move_home": false, "name": "hchen", "shell": "/bin/bash", "state": "present", "uid": 1169} 2019-12-08T11:55:00.148 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1142} 2019-12-08T11:55:00.292 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1170, "groups": "sudo", "home": "/home/jcollin", "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "move_home": false, "name": "jcollin", "shell": "/bin/bash", "state": "present", "uid": 1170} 2019-12-08T11:55:00.488 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1177} 2019-12-08T11:55:00.661 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1171, "groups": "sudo", "home": "/home/xxg", "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "move_home": false, "name": "xxg", "shell": "/bin/bash", "state": "present", "uid": 1171} 2019-12-08T11:55:00.819 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1178} 2019-12-08T11:55:01.016 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1172, "groups": "sudo", "home": "/home/pcuzner", "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "move_home": false, "name": "pcuzner", "shell": "/bin/bash", "state": "present", "uid": 1172} 2019-12-08T11:55:01.165 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1179} 2019-12-08T11:55:01.383 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1174, "groups": "sudo", "home": "/home/mkogan", "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "move_home": false, "name": "mkogan", "shell": "/bin/bash", "state": "present", "uid": 1174} 2019-12-08T11:55:01.542 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1180} 2019-12-08T11:55:01.729 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1142, "groups": "sudo", "home": "/home/vumrao", "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "move_home": false, "name": "vumrao", "shell": "/bin/bash", "state": "present", "uid": 1142} 2019-12-08T11:55:01.730 INFO:teuthology.task.ansible.out: 2019-12-08T11:55:01.886 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1181} 2019-12-08T11:55:02.100 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1177, "groups": "sudo", "home": "/home/henrix", "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "move_home": false, "name": "henrix", "shell": "/bin/bash", "state": "present", "uid": 1177} 2019-12-08T11:55:02.209 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1182} 2019-12-08T11:55:02.449 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1178, "groups": "sudo", "home": "/home/pbs1108", "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "move_home": false, "name": "pbs1108", "shell": "/bin/bash", "state": "present", "uid": 1178} 2019-12-08T11:55:02.546 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1184} 2019-12-08T11:55:02.788 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1179, "groups": "sudo", "home": "/home/clacroix", "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "move_home": false, "name": "clacroix", "shell": "/bin/bash", "state": "present", "uid": 1179} 2019-12-08T11:55:02.880 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1185} 2019-12-08T11:55:03.140 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1180, "groups": "sudo", "home": "/home/epuertat", "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "move_home": false, "name": "epuertat", "shell": "/bin/bash", "state": "present", "uid": 1180} 2019-12-08T11:55:03.261 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1186} 2019-12-08T11:55:03.525 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1181, "groups": "sudo", "home": "/home/tdehler", "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "move_home": false, "name": "tdehler", "shell": "/bin/bash", "state": "present", "uid": 1181} 2019-12-08T11:55:03.612 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1187} 2019-12-08T11:55:03.887 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1182, "groups": "sudo", "home": "/home/laura", "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "move_home": false, "name": "laura", "shell": "/bin/bash", "state": "present", "uid": 1182} 2019-12-08T11:55:03.944 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1188} 2019-12-08T11:55:04.240 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1184, "groups": "sudo", "home": "/home/yaarit", "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "move_home": false, "name": "yaarit", "shell": "/bin/bash", "state": "present", "uid": 1184} 2019-12-08T11:55:04.298 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1189} 2019-12-08T11:55:04.562 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1185, "groups": "sudo", "home": "/home/rpavani1998", "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "move_home": false, "name": "rpavani1998", "shell": "/bin/bash", "state": "present", "uid": 1185} 2019-12-08T11:55:04.632 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1190} 2019-12-08T11:55:04.899 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1186, "groups": "sudo", "home": "/home/rishabh", "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "move_home": false, "name": "rishabh", "shell": "/bin/bash", "state": "present", "uid": 1186} 2019-12-08T11:55:04.954 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1191} 2019-12-08T11:55:05.243 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1187, "groups": "sudo", "home": "/home/skrah", "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "move_home": false, "name": "skrah", "shell": "/bin/bash", "state": "present", "uid": 1187} 2019-12-08T11:55:05.290 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1192} 2019-12-08T11:55:05.580 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1188, "groups": "sudo", "home": "/home/smanjara", "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "move_home": false, "name": "smanjara", "shell": "/bin/bash", "state": "present", "uid": 1188} 2019-12-08T11:55:05.635 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1193} 2019-12-08T11:55:05.915 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1189, "groups": "sudo", "home": "/home/bengland", "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "move_home": false, "name": "bengland", "shell": "/bin/bash", "state": "present", "uid": 1189} 2019-12-08T11:55:05.993 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1194} 2019-12-08T11:55:06.248 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1190, "groups": "sudo", "home": "/home/pnawracay", "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "move_home": false, "name": "pnawracay", "shell": "/bin/bash", "state": "present", "uid": 1190} 2019-12-08T11:55:06.304 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1195} 2019-12-08T11:55:06.594 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1191, "groups": "sudo", "home": "/home/alfonsomthd", "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "move_home": false, "name": "alfonsomthd", "shell": "/bin/bash", "state": "present", "uid": 1191} 2019-12-08T11:55:06.668 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1196} 2019-12-08T11:55:06.940 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1192, "groups": "sudo", "home": "/home/oliveiradan", "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "move_home": false, "name": "oliveiradan", "shell": "/bin/bash", "state": "present", "uid": 1192} 2019-12-08T11:55:06.996 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1197} 2019-12-08T11:55:07.258 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1193, "groups": "sudo", "home": "/home/swagner", "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "move_home": false, "name": "swagner", "shell": "/bin/bash", "state": "present", "uid": 1193} 2019-12-08T11:55:07.355 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1198} 2019-12-08T11:55:07.603 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1194, "groups": "sudo", "home": "/home/yuvalif", "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "move_home": false, "name": "yuvalif", "shell": "/bin/bash", "state": "present", "uid": 1194} 2019-12-08T11:55:07.710 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1199} 2019-12-08T11:55:07.940 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1195, "groups": "sudo", "home": "/home/kkeithle", "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "move_home": false, "name": "kkeithle", "shell": "/bin/bash", "state": "present", "uid": 1195} 2019-12-08T11:55:08.078 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1200} 2019-12-08T11:55:08.286 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1196, "groups": "sudo", "home": "/home/emmericp", "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "move_home": false, "name": "emmericp", "shell": "/bin/bash", "state": "present", "uid": 1196} 2019-12-08T11:55:08.413 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1201} 2019-12-08T11:55:08.639 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1197, "groups": "sudo", "home": "/home/mchangir", "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "move_home": false, "name": "mchangir", "shell": "/bin/bash", "state": "present", "uid": 1197} 2019-12-08T11:55:08.734 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1202} 2019-12-08T11:55:08.994 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1198, "groups": "sudo", "home": "/home/sidharthanup", "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "move_home": false, "name": "sidharthanup", "shell": "/bin/bash", "state": "present", "uid": 1198} 2019-12-08T11:55:09.059 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1203} 2019-12-08T11:55:09.359 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1199, "groups": "sudo", "home": "/home/varsha", "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "move_home": false, "name": "varsha", "shell": "/bin/bash", "state": "present", "uid": 1199} 2019-12-08T11:55:09.402 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1204} 2019-12-08T11:55:09.725 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1200, "groups": "sudo", "home": "/home/sjust", "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "move_home": false, "name": "sjust", "shell": "/bin/bash", "state": "present", "uid": 1200} 2019-12-08T11:55:09.738 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1205} 2019-12-08T11:55:10.089 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1201, "groups": "sudo", "home": "/home/ideepika", "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "move_home": false, "name": "ideepika", "shell": "/bin/bash", "state": "present", "uid": 1201} 2019-12-08T11:55:10.110 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1206} 2019-12-08T11:55:10.112 INFO:teuthology.task.ansible.out: 2019-12-08T11:55:10.434 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1202, "groups": "sudo", "home": "/home/gsalomon", "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "move_home": false, "name": "gsalomon", "shell": "/bin/bash", "state": "present", "uid": 1202} 2019-12-08T11:55:10.445 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1207} 2019-12-08T11:55:10.774 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1208} 2019-12-08T11:55:10.775 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1203, "groups": "sudo", "home": "/home/soumyakoduri", "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "move_home": false, "name": "soumyakoduri", "shell": "/bin/bash", "state": "present", "uid": 1203} 2019-12-08T11:55:11.076 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1204, "groups": "sudo", "home": "/home/kyr", "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "move_home": false, "name": "kyr", "shell": "/bin/bash", "state": "present", "uid": 1204} 2019-12-08T11:55:11.088 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1209} 2019-12-08T11:55:11.409 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1205, "groups": "sudo", "home": "/home/sseshasa", "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "move_home": false, "name": "sseshasa", "shell": "/bin/bash", "state": "present", "uid": 1205} 2019-12-08T11:55:11.421 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1210} 2019-12-08T11:55:11.767 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1206, "groups": "sudo", "home": "/home/rfriedma", "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "move_home": false, "name": "rfriedma", "shell": "/bin/bash", "state": "present", "uid": 1206} 2019-12-08T11:55:11.779 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1211} 2019-12-08T11:55:12.094 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1207, "groups": "sudo", "home": "/home/lmb", "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "move_home": false, "name": "lmb", "shell": "/bin/bash", "state": "present", "uid": 1207} 2019-12-08T11:55:12.138 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1212} 2019-12-08T11:55:12.438 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1208, "groups": "sudo", "home": "/home/ksirivad", "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "move_home": false, "name": "ksirivad", "shell": "/bin/bash", "state": "present", "uid": 1208} 2019-12-08T11:55:12.474 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1213} 2019-12-08T11:55:12.775 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1209, "groups": "sudo", "home": "/home/ofriedma", "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "move_home": false, "name": "ofriedma", "shell": "/bin/bash", "state": "present", "uid": 1209} 2019-12-08T11:55:12.830 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1214} 2019-12-08T11:55:13.119 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1210, "groups": "sudo", "home": "/home/h4iresis", "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "move_home": false, "name": "h4iresis", "shell": "/bin/bash", "state": "present", "uid": 1210} 2019-12-08T11:55:13.155 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1155} 2019-12-08T11:55:13.467 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1211, "groups": "sudo", "home": "/home/shyukri", "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "move_home": false, "name": "shyukri", "shell": "/bin/bash", "state": "present", "uid": 1211} 2019-12-08T11:55:13.535 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10102, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 10102} 2019-12-08T11:55:13.536 INFO:teuthology.task.ansible.out: 2019-12-08T11:55:13.846 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1212, "groups": "sudo", "home": "/home/scarvalhojr", "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "move_home": false, "name": "scarvalhojr", "shell": "/bin/bash", "state": "present", "uid": 1212} 2019-12-08T11:55:14.179 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1213, "groups": "sudo", "home": "/home/rakesh", "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "move_home": false, "name": "rakesh", "shell": "/bin/bash", "state": "present", "uid": 1213} 2019-12-08T11:55:14.233 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "name": "rraja", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2019-12-08T11:55:14.419 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:55:14 +0000 (0:00:36.261) 0:00:49.700 ******* 2019-12-08T11:55:14.446 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2019-12-08T11:55:14.492 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:55:14 +0000 (0:00:00.073) 0:00:49.774 ******* 2019-12-08T11:55:14.563 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2019-12-08T11:55:14.573 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "tr 2019-12-08T11:55:14.575 INFO:teuthology.task.ansible.out:ociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7 2019-12-08T11:55:14.580 INFO:teuthology.task.ansible.out:L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32 2019-12-08T11:55:14.581 INFO:teuthology.task.ansible.out:f606a33fb488ff621e11aa305ac979501030202658\n"}, {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b 2019-12-08T11:55:14.583 INFO:teuthology.task.ansible.out:09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJy 2019-12-08T11:55:14.585 INFO:teuthology.task.ansible.out:w 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 2019-12-08T11:55:14.587 INFO:teuthology.task.ansible.out: 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf853 2019-12-08T11:55:14.593 INFO:teuthology.task.ansible.out:2237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36b 2019-12-08T11:55:14.597 INFO:teuthology.task.ansible.out:deb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, 2019-12-08T11:55:14.599 INFO:teuthology.task.ansible.out: {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsL 2019-12-08T11:55:14.600 INFO:teuthology.task.ansible.out:gffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}]}, "changed": false} 2019-12-08T11:55:14.608 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2019-12-08T11:55:14.614 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1214, "groups": "sudo", "home": "/home/ryg-", "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "move_home": false, "name": "ryg-", "shell": "/bin/bash", "state": "present", "uid": 1214} 2019-12-08T11:55:14.679 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:55:14 +0000 (0:00:00.182) 0:00:49.959 ******* 2019-12-08T11:55:14.904 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 1155, "groups": "sudo", "home": "/home/prsrivas", "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "move_home": false, "name": "prsrivas", "shell": "/bin/bash", "state": "present", "uid": 1155} 2019-12-08T11:55:15.262 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "append": true, "changed": false, "comment": "", "group": 10102, "groups": "sudo", "home": "/home/zdover", "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "move_home": false, "name": "zdover", "shell": "/bin/bash", "state": "present", "uid": 10102} 2019-12-08T11:55:15.803 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* 2019-12-08T11:55:15.805 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com -> localhost] => {"after": "2c3c6d863a854d6a1e155fc475e8273d88b91491", "attempts": 1, "before": "2c3c6d863a854d6a1e155fc475e8273d88b91491", "changed": false, "remote_url_changed": false} 2019-12-08T11:55:15.867 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:55:15 +0000 (0:00:01.188) 0:00:51.148 ******* 2019-12-08T11:55:15.929 INFO:teuthology.task.ansible.out: TASK [users : Create all admin users with sudo access.] ************************ 2019-12-08T11:55:15.930 INFO:teuthology.task.ansible.out:changed: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": true, "comment": "", "create_home": true, "group": 10104, "groups": "sudo", "home": "/home/rraja", "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "name": "rraja", "shell": "/bin/bash", "state": "present", "system": false, "uid": 10103} 2019-12-08T11:55:16.075 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:55:16 +0000 (0:00:00.201) 0:00:51.350 ******* 2019-12-08T11:55:16.096 INFO:teuthology.task.ansible.out: TASK [users : Create all users without sudo access.] *************************** 2019-12-08T11:55:16.144 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:55:16 +0000 (0:00:00.075) 0:00:51.425 ******* 2019-12-08T11:55:16.195 INFO:teuthology.task.ansible.out: TASK [users : Merge managed_users and managed_admin users] ********************* 2019-12-08T11:55:16.199 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => {"ansible_facts": {"pubkey_users": [{"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, {"name": "tr 2019-12-08T11:55:16.201 INFO:teuthology.task.ansible.out:ociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7 2019-12-08T11:55:16.202 INFO:teuthology.task.ansible.out:L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32 2019-12-08T11:55:16.204 INFO:teuthology.task.ansible.out:f606a33fb488ff621e11aa305ac979501030202658\n"}, {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b 2019-12-08T11:55:16.205 INFO:teuthology.task.ansible.out:09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e 2019-12-08T11:55:16.206 INFO:teuthology.task.ansible.out:66b842a921169f20a00481a4cd3d9cb"}, {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa 2019-12-08T11:55:16.208 INFO:teuthology.task.ansible.out:8ea"}, {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 2019-12-08T11:55:16.211 INFO:teuthology.task.ansible.out:6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f8 2019-12-08T11:55:16.212 INFO:teuthology.task.ansible.out:48846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8a 2019-12-08T11:55:16.214 INFO:teuthology.task.ansible.out:a01123ab69cc6f3f11273528ce33e5a31"}, {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, {"name": "scarvalho 2019-12-08T11:55:16.215 INFO:teuthology.task.ansible.out:jr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}]}, "changed": false} 2019-12-08T11:55:16.261 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:55:16 +0000 (0:00:00.117) 0:00:51.542 ******* 2019-12-08T11:55:16.278 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-08T11:55:16.287 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2019-12-08T11:55:16.667 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2019-12-08T11:55:16.670 INFO:teuthology.task.ansible.out: 2019-12-08T11:55:17.022 INFO:teuthology.task.ansible.out: TASK [users : Clone the keys repo] ********************************************* ok: [smithi013.front.sepia.ceph.com -> localhost] => {"after": "2c3c6d863a854d6a1e155fc475e8273d88b91491", "attempts": 1, "before": "2c3c6d863a854d6a1e155fc475e8273d88b91491", "changed": false, "remote_url_changed": false} 2019-12-08T11:55:17.023 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-08T11:55:17.024 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2019-12-08T11:55:17.070 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:55:17 +0000 (0:00:00.809) 0:00:52.351 ******* 2019-12-08T11:55:17.371 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCWy2i6Iv6IWLh53Z44O4fQ0ctxR8odCAWIZAaSQXAxxC++RS+95Zr+BZ5wJwsBOyP1G4AAhl+9uwnn3NmDDG7fKGexPoQrTZZ27KdJ3bHpZRq5LJf9byWFwz4rDsqIqkGjI9sUkfa6nV7ci2BdEkIgLupTT2uXUzTb/njOjI7Fc+cQ7ac4QfJ+yeIcqxeje/YYDF3068V4z1yynk9q2KRXYdERKQghaWDNJlbdBhn/fmsam6okOtUnsXjE88qGPd+LVHWfK0EfYvYXiAoOaJDK8d4EXnJ4RKJceQPBk8ravuQtKVwnRIr8WtmILHuoztthfwqb2WvZ5iMDt6v7oQZ alfredo@papaya.local", "key_options": null, "keyfile": "/home/adeza/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adeza", "validate_certs": true} 2019-12-08T11:55:17.488 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDehvF7TbkfX9Ga4fNdq/j9GHu3c9cNk4iIHVs7e14j0h9DlV14aPyn/M0+z90PK+5p2uL9EvRzkbsPrfxpG3pxUa1pmVmKIPvBruA7ln8tExOVwO3XEsBG7b8VWUMlQmwRS9WEfkKAIHlr9cgIFGb1yrMW30RyL7keO1giotAq/wR9pMicyqYAbZOtI3MuPsDVTNxtyD3RwRUQicz6vNaK/RwfMCZVgdvoinrJ7VSyFVEiitzuQqMlrF935sfLvhuyxmwvJKfZI8QMEYcFbKd1cDnCk9n/PySNRY96gb41nb5pUk+0eaDu37jnmj7LLqoidD3UWUuHNnGBAAk+zNlD andrew.schoen@gmail.com", "key_options": null, "keyfile": "/home/andrewschoen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "andrewschoen", "validate_certs": true} 2019-12-08T11:55:17.692 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZtIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "va 2019-12-08T11:55:17.693 INFO:teuthology.task.ansible.out:lidate_certs": true} 2019-12-08T11:55:17.840 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDBwJCoMbbxQrI9jM5I/lX0MYDB57LzYXDJTXqmLfJ8E5IHwQbn708/EFXAHuJlCyoJAuA8FaU/Y5/l2LBlVXwp9v+8ftk/D6AcsuQ+Hi0ZLCTvW10OUIS2cwX/of//JJIu6roy3r3SWwUcQvwjaZYLm7QkC+1StsLNMHdgiVRFiibqml72Q53VTtSTt6z2aXjrHzhpZq0hBK/13aknzAjHvGprQnchKVzhA/7A5pArF3CXpnI7aCwKvvjU0AcvqqD8WNLMpF4hFSoTK7xluKB+5UAJ36wefIO2KFM/zMwUtl4/aDhDdPeSaQRWq/q7viKLVNS0X9j2PjSRTfYhJNZr zack@zack-cerzas-macbook-pro.local", "key_options": null, "keyfile": "/home/zack/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zack", "validate_certs": true} 2019-12-08T11:55:18.020 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2019-12-08T11:55:18.203 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4eHmz10szeHNS3dNejKokW85ksB+iR4HGOFsmQM11Ni68Nm5aqEKvkOZU8TpY92vpCQL0A68GlrXB845cACdyk6HUJYyNNNMC43l1FYWOwjMqQBSdj8W3VQDTA6eiG60mt5fgI8fyR38rKzIA1MnTBkSSjuh5kQVJ9bdEp3GuY5oc8vxDNBlGJ6LYnyEWt/pqL2J+mpjqnOjsC+EbE2exhP9O+mvzpQiyo/+dEN1COwX3//pNRXGfOSeOczHNsJE8Eu+j/n/BlW57++sJyFMkzS7bUxMSGM6quvjQZ7RT1c5JM6vLEiQyzQxoRgzY93h1yKlOstBi0NamtpqHQZGP kdreyer@mbp.ktdreyer.com", "key_options": null, "keyfile": "/home/kdreyer/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kdreyer", "validate_certs": true} 2019-12-08T11:55:18.362 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZtt 2019-12-08T11:55:18.363 INFO:teuthology.task.ansible.out:Edz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2019-12-08T11:55:18.537 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCWy2i6Iv6IWLh53Z44O4fQ0ctxR8odCAWIZAaSQXAxxC++RS+95Zr+BZ5wJwsBOyP1G4AAhl+9uwnn3NmDDG7fKGexPoQrTZZ27KdJ3bHpZRq5LJf9byWFwz4rDsqIqkGjI9sUkfa6nV7ci2BdEkIgLupTT2uXUzTb/njOjI7Fc+cQ7ac4QfJ+yeIcqxeje/YYDF3068V4z1yynk9q2KRXYdERKQghaWDNJlbdBhn/fmsam6okOtUnsXjE88qGPd+LVHWfK0EfYvYXiAoOaJDK8d4EXnJ4RKJceQPBk8ravuQtKVwnRIr8WtmILHuoztthfwqb2WvZ5iMDt6v7oQZ alfredo@papaya.local", "key_options": null, "keyfile": "/home/adeza/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "adeza", "validate_certs": true} 2019-12-08T11:55:18.686 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2019-12-08T11:55:18.877 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC305rmql/Qm8Si+DFvAs77hSUZakwiXhhAhSetS89bWq3AdPQTL1MUXJHFm3AMzwzb00tndvsl1AUmFseXLfAi87daNcKJdwEj/JvXgcHKzAXOpVRfArHh08JnOumQiP4EoLYvq7rL+3LjEFURKOWJLLnGxh4E+iiJAnxLTG3WuUcnz9kXVTwtmIs60+2yH+gZJkkB04mnivPYjX46sHigoKgtlE2JnQfOU1lBkeZaBeUhoZX2rIKwRyGELPPcUBwHk10izyk6tePLAw9bSWeS9uEaa/m+qa8neJDyR4/hWQNR9yRXp0YjKkiKoFog+qtsBt3xBNzTPsFLxZ5zugmp dmick@angus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/onMoOCUhkp+UiJAq+ye4P70sfeV+uMhgWKLfLBh/1SYq1xxb9bSmjBnETO/9KvukRhzlReBQ7y+BKRhm037P7LuTUY4r0Y8JB6BXkjjCY1yXZJC6kvB7xFsvyiDum5rrdeWMQ/Rhh7YJpze5KY1nHLkyU9X7Ewak0kLEyduJEKekbsOom6l0wZ2ZYrBEKFWJXUDk5icUuWWg3mhKaKnLNWVg1lUw8jzYTJYfjR9GUgzZWXtzkAaI3ugpLOlQ+KEls03/WAFcWA9F9ExqzIsJpvEks27LeFBGVE3PjVNKMqqBZQlZtIEz1iguWJaWMi5lDIfXkvVOFabtIpX/BZRf dmick@dmick-MacBookAir", "key_options": null, "keyfile": "/home/dmick/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dmick", "va 2019-12-08T11:55:18.878 INFO:teuthology.task.ansible.out:lidate_certs": true} 2019-12-08T11:55:19.015 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2019-12-08T11:55:19.038 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:19.227 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJ4z0gLwjexgyixdTuiwaxpPnq7w4FOKxHsQKKAHTlKRu11ynB+9APbtqaAYss8yDqHaHyewPdE+9JMYhZX8rUgcKv2H7jBCQ/Enfl0UyY643VQnuG8lr2Ipk6ELuL5NuuTb7Npo4zKyq/0649kPD46k/X/qLuKzhN49k50S3XJq5WwHi6CJvR8DzPOkjied0o1BHpfcCCIMorUcyfVxqmeu2m+uSE15ncQsd8BIvH4/YNoncUGYxqVhGB+FNUlWdhV0SPRW7V/gmyvFW5qdYX2QhNZAQHChdEH1E9AI7WiCFkyLRx39qYgXgqj8vOOnlwHgy/oJnpnu/Mlvj1uETX sage@montreal\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCVPfoCpv2/9uWCwEo4clWt3i1O8ZPpB2FcQbBLxY3iLQWZJDe74rNWPBj0cJVCytTHxYV0e5HxYyChOG60ca5odHlPNB+/Z4WLU9LVuHiCYsElivJlwvD+l9kzI+UMGJb3HCHqx2yIRGXpEkSMFR1+w5Oz9sInPD7JJmO8Hb9KkoeqZtkJL0aic/M5bDWBut6SSfYlmh8qnQYbkCDiXg/KtOcy1ZJXQ9ZLjsCbpSzeBNbdUOxEQ1+5vUe00vHpl0vOKtRrzgTne2ct1IxbSjdL16ZgHi5BQAREXc9UUG3z7NPOmnwkuKkkpyLmwcOusot5tYHrxks+5i6EoGEJrvJ3 sage@maetl", "key_options": null, "keyfile": "/home/sage/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sage", "validate_certs": true} 2019-12-08T11:55:19.409 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uT 2019-12-08T11:55:19.411 INFO:teuthology.task.ansible.out:fMorbnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2019-12-08T11:55:19.412 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:19.434 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:19.435 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:19.600 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBAN3MlkYQNsm1uB6uJQ7hWJ1Ro9Gusrhi/b/KshPMFh51VWBQn71LdCCjdrsE6FWs5FYE/hr7MITJe+si7aZCmuf8U9tc+oiYh3spXtRhJVIM80FOVRXUmt2XR8I+oNbpcFDayYu956Volafksk3oYjsO356swj7+Q+AUQVF4bDJRAAAAFQCkB2YZKItSDL7XfAl6ZmJ21vqUMwAAAIEAsZspNIUwssVJGO4r3M3BECWklWLEFviIjGVKdPWulN10eRCczZrH7vMOs8coHKDQqYdS2RejlojT03FjFAqeBiTeAlcmgHoev+vqTg2Yhqx3gROzNc6NmG887owCOU4j7LJQP6SX8I8EpSXCMNOZliv2ZokjX2DuRsuIDxQdc84AAACBAMAp++fcqmGS7x7ic2x4rhyiYmdqlMIl8lrM3GkVR6qGuIVBvOGl38ieJKcTBLeRgyC04uIMfk8P9lLvZw3UF97qH3V0imKfq8aYnBGxCv+IjtdOrR5k4hrUW+P0qipvU+4dgHlpqwTKB4MtD9uDxvhENWvqcCnOS5rI6dddaZT6 dgallowa@dgallowa.csb\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKT1KilDopHJzDZ90QJx4+7WVIC4WNdvpD6VrS83B3PFOplNyXZLfDSDRZ4wEzIKLwtR9vLWWInVBNFU00W/2dObSC+l9GDzKsHtO3KSVmAjHEk6ZAJ5Mc3eUPR0lAywpFD8+yg+kDDIkRtCtoHDq+kFvNQutdvrMuhNWOZLyQ2N2XrpRJVD2kiJvaml6nQoZXMtVQGPVcYbn3TRed/wxT/han2u6j/wiElv4r9ty+9zi3P1MoNiALD53sD7wMr/5Si6PX+5zWcXTNcQmTuGpiLwGw0RxCwr4gtwqKBaNae2d1bwnHanLc1KvQEw29O6aBca2f7GWxFY6QtQV/mNft dgalloway@w541\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEI+g74GcJe/03nDypMzDWqg93K1h13xQPFvCIN7ElNZ+ulY5av5KLnv/gmLbYGRPlgxC7LNZXE7YQPUo2DfA8awnDkAkE/nWvL4fQjUxmaiPthjIWsKvk9EvPIqzLjDbwsiLiRPE0Sxka0qBa1GHU1QYN6cw7l9nWF0dG/TsKw+QmuArBKMgm9Th/QVLq1ARHC/07M1n195QvBjdrKSzOUl+2L1tADHg++sEWDq/MJMiylyNdxp79Wz7aTIlR6l8NV+Ega9LUb6B6xmO7k+J+/hJF7gYOeFl+YqnZtt 2019-12-08T11:55:19.602 INFO:teuthology.task.ansible.out:Edz+o8FbLjhTjOF9QkBsGWlrawXtQln/cVCryV+LAt57L dgalloway@p50", "key_options": null, "keyfile": "/home/dgalloway/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dgalloway", "validate_certs": true} 2019-12-08T11:55:19.800 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2019-12-08T11:55:19.961 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDo3gswIiZ2xPWMUQNjV1Gd4gYSxVpJM8Jb5pH1lqvoKAsmhVI30qTYxIaezzDWfSYwdkNYQAC9eM5v7EMQrOI7eZtTzCH+gbF79GciGCLL2bDze1I8hJ+jUu4bv+wnmvKsHyyOVBBJPSJ+eGFCzsu7vOiK4iFX0zgCXYwvP+A4Y/+kVR1en39gMtD6Hrw8ACBhxt+C2G2zc1807NRj3pIw1GvQILa9Sm3VKdNSrHzGB+MBooUoRmmjjzZ/bRwHPWVj+sX+xkoX4P2zwUcfMgZ/f4GgSgHyEvS3oxqbSaZp0pidZyoCaLRgqVPiUgXQEm0HA5PDDULAthQOfxQveKB/ akraitma@aklap", "key_options": null, "keyfile": "/home/akraitma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akraitma", "validate_certs": true} 2019-12-08T11:55:20.230 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+ 2019-12-08T11:55:20.232 INFO:teuthology.task.ansible.out:2vtSoAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2019-12-08T11:55:20.336 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDSc2rWtLtZM0CBWwaxhSfd0T++ZTX9c8kQrYT0rsQlJ6Hxj4c3+ypwh4iivdtFpyz4clxWkb/wimi48PvjNyZdudB9BeQUBeFfLiro3LnFEbKhM1RwRI89s34mRwmC0LLUZwcdX80zc6/fKuPzvBzR1PiY9tWRyIpYErQAHa2jEOE2MpFDHnlbXdfXFh5Tw3OmC1qBlQvgcrivA9lVaVlf+hfwmOQwXFIG3PCJLNlXDshCSUGAfYKBRvQaKS8sOf9rQaflPrwqJ8hDgVVQkpp69yVsGtahbBmjs6QS6C8EkGUFQmvrIcrQ8+5mRlRAmK2DMTP3cAcsYcMOJ+9KwP+H mgolub@zhuzha", "key_options": null, "keyfile": "/home/trociny/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "trociny", "validate_certs": true} 2019-12-08T11:55:20.353 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:20.559 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2019-12-08T11:55:20.692 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANarZ+C62DPffRIhaCuCtXLChrfqwXgWqGHOLLkmPTtZ3/EE8ZiN+LY1ZcmP939AxXi8Oe+9LepwAdsoQKZctlC7XToyhjIk+rVSPyn3zl3BTC2AxfCKq2vqj65a1sc35Whrw7OaUa2fr5iHSazP6HuG01DhJ9l8HJsLKmiwWChZAAAAFQCNmunc7BNLWrqyrYwINTfscowkbQAAAIEAyYERcunZYJAZ9Eno18kM+ylq0jcQmnPqyIvssWXTttUZnaGQvbVxABeyr6ZKuUyZQfyetofquOGBKPBuzV/7posl5ShDuAcxbS1zhrmk9glTA1yFLvznDdWdLOWG06tjOc78G2AmldKHCdPsmgh2D7WyRr4QY4rcCvwKfZ6+eEYAAACBAJZrOlOlygfPZ4ZB0+EbdYACz1+L/iYNNAOBp51TRutNceLVrNJNOVdmCMLuF0A1go4kPSD/05aJOkOyW86gYLA5DXaW3961+kPInOFAe8OTyQYE7221ThYHRnCfVFjdknuCDomj69wk4SsR+ZPXvSXs1jSJWKhLfUSe9n4bmw7w anet2@secant.private.linuxbox.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC5CMht/crEocrHqGjf0sxE9AhNcW3XBxwlniJwaBJLhekLQEQJoxAy2xUUmPYb2/e7rdmTBxzQipUaAGWVk1FHANac4cbgXzNT+9cnF7EIRkPa/x9jaKNiU0ozMhu/GOoeDXMrHIDgVGWPF3Ag/r17ORpYnuFTjsqoCWyh+mqskV+lmAp04rv2tvqouHtEs6gLebKNtB8c6twhrBKF62Ie+rSr3r7hQaqiZitHbg/isbU5RMBl6H48wHAVSK2/uT 2019-12-08T11:55:20.699 INFO:teuthology.task.ansible.out:fMorbnuEYRG8HvlnPRvQHscJYKiZSt/G7XqZ3x/7c4czEF+OpdQbAgg46vh4fNVMxZk9KHwEkOE06ROuwgAejJ mbenjamin@duel", "key_options": null, "keyfile": "/home/mbenjamin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mbenjamin", "validate_certs": true} 2019-12-08T11:55:20.714 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:20.725 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:20.737 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:20.908 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "davidz", "validate_certs": true} 2019-12-08T11:55:21.114 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHk8c8wUTTYolOOmMlniNrsjfRyF9pCCnaEQ2DXR73P0hbFMme5Md5cF3PTtPIOHSNkWk/qg7s6gZD8LGyFmloO42RBgLsW1qM8RWTDbPy5EQdrjxL9byVzBBCDoQPIS2M+0XnhYa6CBj38Sw8XPlS41CebAJEOQeyLG2I6CAI0rTij6gsqDfALbIezd/eWvmbksKYM1Lb4Gvj+k/OL/xDZzIZHF/P+mK+trY45gsUHxKZamkeHyAT4f3kiNJA+UwzTWGhafy6UE7yGqhZjt9xOZSQGuwroL7EtAzntxayPRNxQPfGDV+fYYf0QBbTtHyJeikPUuw7aR1Z3KwuSmWD dis@zambezi", "key_options": null, "keyfile": "/home/dis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dis", "validate_certs": true} 2019-12-08T11:55:21.236 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvWnKfzTd574C4GXg1mr4pbJOInKv4qMRf0DwksTzqtXStlhT+PaO2C8p48U2Xjz5hmPK9J+iHA2xKwI6lKI194wUo3tW283euRyTCN7LlbV6tgD9k78hDaeA+53MHYmwbxjHEqAadqrLU+68LfmL7gaaUSToP/Ap+hdcDC7H9lulMcxkUeahEiDfG2s1mD8IUM6XVuqZM9WEARKpF1oSEBKhMMob9YJZPpJWipuAGkPvDA0yHK1lB58Yr2x0yaezVjQc7V2dwaY1gXR6AscU5WzlwWNNwXHqPdyyWRaGx/9Fk00yfzX4V7ZqTvKdMLKwB7EnamduTMPsaoKBUBJCh gmeno@gmeno-virtual-machine", "key_options": null, "keyfile": "/home/gmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gmeno", "validate_certs": true} 2019-12-08T11:55:21.476 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "key": "ssh-dss AAAAB3NzaC1kc3MAAACBANaS5gZUnIp5UL/PM3xOrQiNVxfona7sD1XEXGYvNUyoojPWWAvdQRwdA/Ay8JsAjKeWUt0IwfWaPfbEoXU1TKAI+yyv5WzQUZAKmBFuYM0CUQnKrk72Dp6n8P2tnYen0ect22xEiW2+Y0JZ3wfV3IB3BQPoVCC9FQ+P3LHhYii/AAAAFQCgSceiZFeNItwJ2rJeQgVVTQKljwAAAIEA0Gd2VNCbbQ48vAF+m/i/CeQHJ9Dom9IOBN3v8XnSlOhtNzY1pJ0NRzrFQURCCeVQJaywr0et5FCXIDVqTuR4qfCu5XXU1KHpn/AvHstOd93Y0XYMwSXfNszOtpH7w9SEm7uBfKnLQNF843/MHZL4ZIdfxk73YjfMjrYFcvJwvM0AAACBAI9Wi2wG9Rrdbrgk8tqbnKMxxJCYt/Vakn5mQSc/WHqMUn14+Kb7oBtfTsfPFNK952FzU09ptNQvNWTPNMniI8l8lQi2B+Z28XUlFLL76uxJXWko99xFpf/d1kFBL0M7GRGmvvrMfeTCI+WIqh2jBVqbl4o8kjNx4p0VWyoiWeFJ gregf@pudgy\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAwSe7szyqMTqKK3D/JsXIa1PtPf1p8Njk0sMDSsJPA0gBGysmSgstke9fglOgeNIbNOBNDOY3vltuNCgUiQgVWOYhUaVpj+ 2019-12-08T11:55:21.477 INFO:teuthology.task.ansible.out:2vtSoAWpXMQbNaWPGKhbxvJWMCLVckLENyoUZUBKLmTvRyKDjjq8CJ1TnfA2Xfo3a796EIOtD6essU3lAVIfIUILGD+HqptiHSB0spUJUVRxxlO2xw9rLYij1eUPRHrr9xWvDamr5JtKVtCLOL3M9QlltHieKlbJSCZq/EVxW9NAGA6IiqOhw2E1k59oGZUq4Qg+YLgYkB80Ms7nb1xpjQ8txvY+73xL/8i7Nqmr7ekKJfyTpRe03nCQ== gfarnum@mozart.thompsonian.net\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqJQfdAKaggPDgSpk8P6QjLeyQYOz183fVSKnqAa5EeaCJozS1dn8z+iphswT3YL6wqIMqVHMfkSUcEeTBwZmvydaghOMJEIQSP1PCzH0V2XprELrEcBC3QTvaElPjjEYgBVUvEw8sL/RIQ7mgt9vxD0NcCDspsz35fmU222KzFxD41PZ5XzHQ3Lumwdax7mcpqrw8Aa5/tgcEqAIu54HYRf1Qmk6+ueMAvpwkX3eiSEtkVvuV1Kxpc3/0mOfJ7cn+eyPX3qUbo4oY76hIYseoUIwEaVE/pNW+pjwDSy4gSOcuxYDEGKzCwZPZeQtRQWzRt3YNafxi5xsByobGLlZw== gfarnum@GF-Macbook.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1ik3LbyKsPiGwdh+vGrKSYLvhMg7OkqMwDNYU5LqWBSotogxyGQJUuD80ZavxmmdXC4qScddHtWOJjtyX1CTSDUe7INpSgGPGnmSExVFpcYRnmxHAB+9M/c9VorUkQ8IOKLmRO/BdYma3Rl9NzhHI73yd4zJlx1K4NuQnhnj0Z4yXO+k44RkBWDdMicBB5lBP0hETaH2Iq1u5Dai3u6N5N9bSPXv2PGKvvU395K0Wts2CxMhOBc7LAixysNzNWLrnG1ghS4jPVG2TIHOElP5lIXUv1Wlkool5rTUWgnVY/7loWkDus2JryDM7hLGFXqgT7HHcpI4gSITqRhWxzsUF gregf@fedoragreg.localdomain", "key_options": null, "keyfile": "/home/gregf/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gregf", "validate_certs": true} 2019-12-08T11:55:21.587 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2019-12-08T11:55:21.838 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDgS5EfJyOxBkl/TtJikfb38rm6muQo7MwYufkLSBw9W2jFzt/ZMbVXyVsdZM4I6hWfZm1/q60UcER4yoA1xwYGOTmbFXrLUqqKxKTnCdyejuQ3miB7aiuisWO4vjb2+ppBwL9Mx775DPeQJehFyFK0qgh33tZO/9LWWYy7NOZdA9L2ei1PgMWa0VBeijcDR5GQSXzh0Yi+h/Ezu8jevu+NkW2IUJF6zPGjd9M9lAy7KG2dQjqqCX4XWmUS+MHJS6f9bsC5i39GWy29FvX/qFEArOMzuYRIFWE8iza95KSBxptb+Hw8PFBjQ1kTh6nC5ZV2X3ETcoj8fToTcgW3dTRF jdurgin@new-angeles", "key_options": null, "keyfile": "/home/joshd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joshd", "validate_certs": true} 2019-12-08T11:55:21.945 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2019-12-08T11:55:22.204 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCyOWnAdvzh5zR2ts9e8g0wG4wZ0uNr0YJUCncAOTJB0L8xkQU76jWzX3BRNU5Wk8VtLvpJAQ61P7UXyzgGWSO9FHZjD3RDrc2V9uh/lqRKmx1COtDvcart/JwzwHlsWdrYdcXvEaAiFrZJ6x1jJAjIL6tvMO7bqBz4YNruKpGWsQ6p5P/M5iIEPMj1oKanLoULXqReC6eYFTw3LNAXjberPY5GxYwaKS0HuzySRvSblShyA85jawTSlEbsOSnMqqGu5vGJiC415UFQQ5qKBtzrgAjlUgMbaqGTnTmBYn7L751gIWRetgWqwuHgfIe2ZGM3mmh0DX8E03DUbEt4UxyR dzafman@TrustyTahr\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDDtSwGzH7V5jzppggL0+nYlBSM1HqGjkInwxutra5iEyFoBuV73MNSBk3HrvIVGN13+PCdHf4Oy8ywbhC/4yKbxS1NG76d/GU8ijZFuBlEwxwHZpcThpSTuYrNx7FJVp8Yjl45DtD5s8FMI/0YZZhLlIqT6QCTxlTIPXDb6zefEWvAVziE0bmhRpe4B6AOLOGTB9fivQr5YzxhfaSS5Vu4U1x5gmosouSJ+aMFrQWLqa/eoCy8t9PnxdMjlHjHCZ7Qv1JfpaAPw3qOK30GrVeXR/hPN3aFodTuIJpzdynjk5HO6/VKW5+mWBO7pmQqn9LNQEjADXbLh7PG//nOONbH dzafman@ubuntu16", "key_options": null, "keyfile": "/home/davidz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "davidz", "validate_certs": true} 2019-12-08T11:55:22.324 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCtmxLK2rSomB14d9/fkAshmsXQfd6cJ+vEb0MZDaUT+OLmr1vAq0+H5g9w3hApJ2UEOFSaiz6ywgBAFeBeu/KmUALOhJIKKk0imoTunYclqxVPBK6tG/2b+ME8VE1afoEpMem3Bzfkrq0pDt6DLFBDlt9rRIqtO/ZlqEayWkEwTXJ7pwj+oJS03Z3Y7q0Iqw8PToKqJWwy2OvW1I9Pi0Q8s4YV9I34rSO7Wv4w43AXpFHRlvJWIcI5g5WFI5tnjel+kUAWMZft9ynFoAP5iXdByq897r4jAF74hapaxLMsHBz4MyYmPZqS76Cx2e3kGqXeetPinfcZxC3ViboR7o/1 root@zhyan-desk1", "key_options": null, "keyfile": "/home/zyan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zyan", "validate_certs": true} 2019-12-08T11:55:22.563 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvWnKfzTd574C4GXg1mr4pbJOInKv4qMRf0DwksTzqtXStlhT+PaO2C8p48U2Xjz5hmPK9J+iHA2xKwI6lKI194wUo3tW283euRyTCN7LlbV6tgD9k78hDaeA+53MHYmwbxjHEqAadqrLU+68LfmL7gaaUSToP/Ap+hdcDC7H9lulMcxkUeahEiDfG2s1mD8IUM6XVuqZM9WEARKpF1oSEBKhMMob9YJZPpJWipuAGkPvDA0yHK1lB58Yr2x0yaezVjQc7V2dwaY1gXR6AscU5WzlwWNNwXHqPdyyWRaGx/9Fk00yfzX4V7ZqTvKdMLKwB7EnamduTMPsaoKBUBJCh gmeno@gmeno-virtual-machine", "key_options": null, "keyfile": "/home/gmeno/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gmeno", "validate_certs": true} 2019-12-08T11:55:22.660 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1 2019-12-08T11:55:22.662 INFO:teuthology.task.ansible.out:Z9CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2019-12-08T11:55:22.921 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDkIZyWnJXYv/z3EVeKHatjFUAdaomIMqzvFLrA9VskeM0Ctv8a83Wk3BbYvTFQWALjZjS2HVYzi5p6kTQ4qxXlcO7HxRw0j4otNauilvgIc4Lu5N4pUtYf0piEo+nrXz+WhELfmJ8t1Yx00uGEl9pOF04SOuXtpwwrCFAO6WMCcjDuYhoI2VBKO3W/OWcIuQ8ZY3j4iDdofFOUGyyoYVyOi/HILKjluYB+ues5+wBEkDuoi3MafCnIj8M0O5fU8/JoOTksOu779UN6blPiNdEgnwD00jA+RWYY6b12ZVkiF4rUVGCiiKKUwOOWkRhkA5OEcBgZ8cGWFgGfZM1GJA// ivancich@sleepy", "key_options": null, "keyfile": "/home/ivancich/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ivancich", "validate_certs": true} 2019-12-08T11:55:23.009 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkR 2019-12-08T11:55:23.010 INFO:teuthology.task.ansible.out:hoBYB0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2019-12-08T11:55:23.273 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsTZI+b02boZv8jVLHQoFlloD2WF/3xT+ZfZxzwddL7Q6eqo7j8i21LAbLAMWXYMyhiClrloDeHfCZ42gG5bqSThF8LoCw+GspF6SahTI0lmptGu69/OeHqqCpW1DnsWB3wWqfi90XbQJrpg3cdRaqOCmkGVJrqfFWzff8Zg9IuojIH/aO9drCTRGa1pHHCyEdW9ZNeYFwrMjfP+wJi/mC/ABAoXyDy0NWT0uIA+36abNg2/ptok90rdan0r72hjFEz/1hpupKWri+VXAepiyDMuSgJm9uJCXDFaNTn3jocdX+sbVtltThQ2OBxe1T60vRLbXx3lvhxxZ1fUkcP/FF wusui@ubuntu\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD2UzyfBk1nZ8SLCtW9UjorMeOo4u9AM/YL8ZI74GdprR+odERZR17/QfwT5vmLVNa51+CQt1HcGodlQYfR/8n/OUl/gJyVagBuU2zgmLPO3tOor5RBfms5MZ2VZ9Vm3+WrCO/vrAq/5HVyGbQsKiQHXkIRSL2NIgfKRTOVTNmuTSXtZNDgdWGIBmcOFQv+Im9CRopoI8ZtJLQj7xfxtGtUas7FbWTcf0o92+xvWuGWq5WQgmZ8MUIfvBLYLmicuVfsWjZ1YsC1PNhuhkwrW7MhaD71Ej3ll243tG1QD7eAmo+psIp8phlU5s/5FeA5y5OzDZ2T963oHGhq018TYO0b wusui@teuthology", "key_options": null, "keyfile": "/home/wusui/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "wusui", "validate_certs": true} 2019-12-08T11:55:23.398 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2019-12-08T11:55:23.648 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCtmxLK2rSomB14d9/fkAshmsXQfd6cJ+vEb0MZDaUT+OLmr1vAq0+H5g9w3hApJ2UEOFSaiz6ywgBAFeBeu/KmUALOhJIKKk0imoTunYclqxVPBK6tG/2b+ME8VE1afoEpMem3Bzfkrq0pDt6DLFBDlt9rRIqtO/ZlqEayWkEwTXJ7pwj+oJS03Z3Y7q0Iqw8PToKqJWwy2OvW1I9Pi0Q8s4YV9I34rSO7Wv4w43AXpFHRlvJWIcI5g5WFI5tnjel+kUAWMZft9ynFoAP5iXdByq897r4jAF74hapaxLMsHBz4MyYmPZqS76Cx2e3kGqXeetPinfcZxC3ViboR7o/1 root@zhyan-desk1", "key_options": null, "keyfile": "/home/zyan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zyan", "validate_certs": true} 2019-12-08T11:55:23.734 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2019-12-08T11:55:23.990 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCw3MhMNDYjkiQADoC1mg9ga0Yj174FHIFt4RQIC8qK+6cB0N3CM5R4JwP8pR4tYkVFWmnYRScYK5VVdC873Ac2BzYxmse97zLJTbUnYWTdY+OFi1FUozsy3PwtiNHSd48Z/PBvkinQIey2QlMKaW3/yz9Of/Yfm4prxg9lBsd6/tOOFj3AsqIQ1OVhMfgeVEkdCL7AAbEYyMxePZ3UFrDwj05HDLgmFzx1xsNJFOuBwLfU/QNHoXJQrcVy0rZq9fB5rg74iz1JZs0uDWocQQK4Nd3Rv+wRGBuew2fmkrS2bQWXzMoSL+/i7pbf74LKcbWAE0wXEImqQeREHxq4ZZ5J yuriweinstein@Yuris-MacBook-Pro.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJUmq7btpBMjjODHXp1888xoBuX+rhiZg3ufuo69RgDxUMymJn3CPJ/5NGXoZ3SGAWKk0w0Dx6K/VO4y92mAV+cO81y8wZR4J3fPV3IbWRjN0X3IFoAvJi5n9v5hpG7z3RZCGmQnOZ99m1i9dge/3S8NpuPLIvYkSo9z00d+mNP6D8rGnqOmEBfEhUQXLeH7rbPwaMWPgB/hrpiPCyLR/+sGC5bq9PAsKnocqZ12cnvCtYxpnA7et6nL15ftEpUrKYAmRDxotuoUcsllP66GSszjbrgN6OBNDSqpGt/+RSJJwzZEGQ073gJuMveKy9tvD/PyEttjvVKL2KsBuXGSuL ubuntu@yw\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDmXWgRRes8bzekTH2fTcxdAAquFn1SjPhws1 2019-12-08T11:55:23.991 INFO:teuthology.task.ansible.out:Z9CkxNaqKe25XnzPehqrhg9etouUwvORQHdDJdTlmhTSYtn588Omq+1bvniab0KzAYgGZsWdPma/3E9qF7ChXIMik9Umip0drzYTaexCuC/Nu46brTxlnL0vaxnnVjDwmHC0CEJs4qN4e2wSlsA0uBDRWjxWFMdTUgSzII5xasHypUYZ0y3MNdbfY+SVF69DEDH8EOQMGYm8JQXNJFloQvmvLUFqT/63FsdpzRVTph4A8hvI1f8i6ULb7fPQN5ZS62wdXd/KvrBXrCvhOi7R63RM60mkMRXm1XajTGmCKiikfiqgTr yuriw@Yuris-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC41kRr6B/RC32DrQKRByalH832H6BpCQF9XdTvgYi4+LJt+kAuIGLDF4xm4uApTmWRrLspWm0Kksc0ger03uNx5qJqMEUnJvjxJnSDC0/XyxWapVxIviFkvv0BjbhVNOOaMU55ywrZ9hHgMdaFwuMuCOaB7f9Tm6IUXm2k82OXueeIG23Kziq+IQBysWOjvNUy/LLpl7l4+xOkhNUupUiQCqHvFH98VUdYWkHeyamafGVZmYbFLrOXgmviKo0u8LPxcT7psKLk0yFG7fG0DSak6DDdKJqb+G/NqMSPxRSAI4FbXQ6UOZb32Ozr1Sql9yfOXEYWZuatn7W5F8DjSv3p yuriw@yuriw-RH", "key_options": null, "keyfile": "/home/yuriw/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuriw", "validate_certs": true} 2019-12-08T11:55:24.103 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwm 2019-12-08T11:55:24.104 INFO:teuthology.task.ansible.out:ih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2019-12-08T11:55:24.363 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxrS30JmTZbnBd73s9PGZYxCkWH3u4En9Q0bYJan45W+j+y5vMzaNUVsp8We1tphqPQ9B0ygi80OxbHWu5gyv4g+M/JFtrnxv3QgBCYWeBWfh652Vbdlk1thl6btFnHUhVMSn5tkdnFxyVDJHIROoVXkHRaCNAUUy7tB60IhPAMomNcCGu9R8+opONFLXKTIfkYQ1cGbysr90DMs8ASEkvxdv40hIWhK4ufvL7CFFtgXuoC0c1WedBFOkr5LDegzL13xN97K9o5J8CAU0MUKk6H8KNKbQuNq1zANwymMFY599GIlxwai8iluJgfOObDRdCDmKM2f9RAEUXQM7oYoH7 tamil@tamil-VirtualBox\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvwiWVhNLeOLg72cpVIwbUYnmFh+Cqf/mE7Rc/Xci91on3GPrq++dC8t2GhTB5Zyq46EE27SmUkiZpHRnz7xwiJKM/tTgNEkffXDK3j0pA2E22iqV9FpfSA9Zdi1Puq7CPT7/rix4rF3SPvMtg/R1fkyornLFdzhJiMExCKJXGwf+QsKk4NVnr+nO3EEkKOoP1wio1bceZ53rCt9Tyu8NawAB2nL2fvtBPQDAriQ8bLX69XLbOfhFI6GJo815/j6CQxNmvA0l5ABJc8+A71jZmndzumFRgqBuhiCM5ohsGR0JGahUQjFEA4quNTx8EWTGRsqhAYszzpqJzuN+Xb6tJ tamil@macbookair\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEPzEyDGI7poyXVPG70vgQpvlU/lTt6Vvv5CoHWJoSrHklDdJEqekhCB87BX4DTrqbb5xoM7yfxle/z9UzgVwSUWqsPdZHA4EbrNFRKFxi/gc2YrygVSjumTyzf9WJJ5vCZvTQexOj7rjWVnJkjXHKMXZXIAQN/bJf6J21t+4A3XLrl30/4XXyq664NONUNjBHxHtlbS2LM6Th/hK4B23oj2BugX2j/50vWgd9H36bPr8+JGskOi6MH2ndZv5pYtLznFzQmsbixjaN8kCuyQdlRCOndPEFoHFhDla2MeB+h3XQLDXW7J1TR2URFSfcNq5ndDS4i0b+t75Fjhb7AtLT tamil@ubuntu-delldesktop\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6tJ9y3solDCzFdXcczO8GJEwMqMYXWU5kuMz0rr/US6F72j0spSNmwGemMOZE9s7KtHgior/Ufw8/vMRkR 2019-12-08T11:55:24.365 INFO:teuthology.task.ansible.out:hoBYB0C5KT9utGNqrtDdvH98h43XnKZ3K/yaHv/T+u2EYWNgHtOXMtgIVFnGwSD7RzF6TbwSfurprTV6ZUyyOxRcmHnkmwpbNwiwIoXB03k2PITdYCC3lEBEY0OC+vAW/E3+bFbV3RSEA0Cm31jmMyZyPeYiXiEnPXUIClsoDj34NwJTIgctwIsqM4eYUBg3pHliWYKEWDs55HZYoj3W/6Jw7MASzyAYFSmP8rQu8iS7tO1iEBRGOXFNxHirGQ1WqUn tmuthamizhan@MacBook-Air.local", "key_options": null, "keyfile": "/home/tamil/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tamil", "validate_certs": true} 2019-12-08T11:55:24.447 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2019-12-08T11:55:24.754 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDYGVqKZgLx2LJ49x0kGo/Z5r8MVefSUCYhhrK/DK8ht+YK1AqLXErjAedgpVz0WuwirRjh5YkiXGMYiOdkMUYWGk5nwCHEKnnCpne7Xh1OOqge/QGHlUigWVH8VIHBsZ+wTW25mqOrgDSGB8+Qk7Dr2o1sLGUHcx7vITDWOrer4KjF2+H5TQH/7irUVORu6fzeGKtGyOrTwQ+ZT1+fuhfznDULFGyvKGdcXxxNOg+21Fssk2nCNTlgRCGjHSrfelfuMT7QEt+9puWd7MWXYQg7xx8jkJGMpEQRFxJTxnfUlUXf3x2lc9Q/SvKfpVMtc0N+bk2F9+euyvRvjtn4LJNx jowilkin@jowilkin.wilkins", "key_options": null, "keyfile": "/home/jowilkin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jowilkin", "validate_certs": true} 2019-12-08T11:55:24.807 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2019-12-08T11:55:25.127 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDP/yVttBEs7mpVfJL+reXb/BfB7DsLrA5ArVqEJjySi3NOz3e/wE8KRWbHD1UdraAU3P8b96GdAQxGOs4n0muOMejmaXWZCP3HkRL+rcd+03ZI1lb6ga9XjBARZfb2h+kg5jTJp/Ll6mwAYbSXvQ4MuDQzwGRDX5Q5Xme7OZ4Wb+vBmmkihHydySyP9YXbWWsBw4jvZCFSKMGsUVy/HIt1coZx/PyCG/K2Kl0nrE5ux2QqfdTIpzYo4c3y6uMIHDvt29lRmk3Gnh2//U5eN8mmRRKJlkvE8DKy3VYsl0JsP9pTWUZEYgV0EX251WTO0akQ2bKuszqd9Ai04RWnXUu5 brad@dhcp-1-165.bne.redhat.com", "key_options": null, "keyfile": "/home/bhubbard/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bhubbard", "validate_certs": true} 2019-12-08T11:55:25.159 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2019-12-08T11:55:25.518 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAyRDKb+InDsnW4E/S12Pr6rK3wDfUG3j+iw/NsCWwN5xpJEA1/NhVlRzY8/jejc6ddmnNKWbm/UcYVrbo7yClRTGu45g0Qm9lmfvgDgi1k8mwUCy+edbQ/R8FB9cIHHCnUuWzRmE2XGaeDiSVQgiYqq3mOPY/hwe3G7jwFalYPsbmY1jNqpzODmKFMRd1bOwdHEOMTfh0owHWqhhXakU8em30lYraQVYH24FplH2NUBArxmTuctyfweHxx7yH3ZFcXFUpUMSLuVDWb1A7fMiL6eW6wiwh+dD+q5iFNvuioZITP2EjIsb9nS+eM9bOJZuZ+5pln2EsHee27LjunbwgWw== yehudasa@fatty\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDF3PxJYgI3tS7SG+RnUvxMxr0/XwBAio0oiP4AC+o8rUYYyPd/RU27TR1kphbuJhQWVtaZ6kFSBQeNQUxv6rb8hmMzvlP1FDEoGkjaOHOuYEc2DFkkEAfaR2AlNKn3pUQgLE00TLHctCgd57Cn2Ppt8xEi/vTuo0gX3xjWOL4N9QDElCXKNdxdyyJ/RNb/Mid+YxgKKjf8ppmhYsQ+Qqu4YwPzLkfK1Qb3YtR6Hbjb4jxC7C1Z13h0vUgHe7qSmUCYNo9eC+lEgNmmnLb2sXJaUUJM8MEex6v+4muWM9hV0cq/Wplrx8fhMWMa978sxH8yVkE3Svqc/K4ZWN59l3xT yehudasa@yehudasa-XPS-L401X\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDvplQk8xkSXF03uSJh3H4zyZHRMjvgUJBgGN27Kb7gAlIQv306wPKIprOwp+jDhEcPnEWBMRJMUJuBi0vEiqmDHt8mg8ZYcs+Gi7MbUgBokILdJuSG89KAgq7gBCuIhYbSg35pfvXvIZswiXvySqMrJNB495GYj/FrcWEBfQMuedMSkIfNzqPV9yR5YRh8fnSs3fjCzV96vzu7O4AzgwICbM6XmqVLXPax/32Hq0dz7sAawlQFCJYPHzVzjwm 2019-12-08T11:55:25.519 INFO:teuthology.task.ansible.out:ih46TRJnXrxewsRhk9GwKfI4SWaFIRdOdadGFSLgdZ+2iGE7hTZ3sRgkLOj+4zKa+xTbtjjXfw5up7J3hAmrK15Tz yehuda@yehuda-940X3G\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfNxvAw6cb33jg36vw8kJu48/BttmFJ4BFeanYqwRgtWZrKpAAGHEgCiNeyIttMrI3t7Spcdyp6dy6n0P3WUFVgHWEYtGqXwXqDC9UXISkUJVVDZoEynpGC92RghhzH53+7jX1Ytpr30r/xb1ktryTPCoEJRqyrg2j1b167i6PV5tuJCA+77gW5LWBmMXJCprjnfnJ92Gp8ZewBB6gL1x+3RFkMxGsibL0Qw1CTKfyAHNYc/jos6YiL0b42Ha+NmKwvzZ1GgIleRMleisSOyKPUlPdR7UnmtEXa9bl3Gc/hc7Zt+v4iUypr2WL0X4Yl7rJNH/AAd/Z6jPkAX9nHYzh yehudasa@yehudasa-desktop", "key_options": null, "keyfile": "/home/yehudasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yehudasa", "validate_certs": true} 2019-12-08T11:55:25.529 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2019-12-08T11:55:25.867 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIDx37xbP0jYqopygG66LbSMRPoqpGUPzQZ3G8eqJCk2I dang@revan.aa.redhat.com-2015-07-17", "key_options": null, "keyfile": "/home/dang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dang", "validate_certs": true} 2019-12-08T11:55:25.910 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2019-12-08T11:55:26.238 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2YyDoeKdaCuJif79AxJAorqpUj33WHbHu/eIWpHju+iIF3f94K0qyEXgs4AwZin9pzfyd8N1aKNT8ZFPss6L0Xk68aO/6tdInq+1lTMMUC5v/LBqsIV2btPTFHrQWA0R10v05aZFvFaSqhHNsZaj98vQV7P+jiSs3yPWqCIWUTQ1VXnCeQnB4R5tob0gpMuonhkKq7vrJPhf6ge9Av+yjL7+8oP5LJqFJ5npDxkwZ0u3L0QQ9ftAT/e7Y7ESpwpgaI3Trl0EwAXFmiLjXEUA+FBbE7ko9kLqXqRjc1C0BdRG9sO0QKBGDBEx1W3w8rCPKgaDlVyqsBT1yvIjqqXDOQ== borix@dhcp-31-190.brq.redhat.com", "key_options": null, "keyfile": "/home/branto/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "branto", "validate_certs": true} 2019-12-08T11:55:26.285 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2 2019-12-08T11:55:26.286 INFO:teuthology.task.ansible.out:CfQvUxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2019-12-08T11:55:26.639 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2019-12-08T11:55:26.641 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDO00mus2XPX/EfUZ/YsKI84TnWj5TbZP7Fs01EkoOTPgNoYysVdf0PwhAooz1qPrv+HUsUMpQT6uNYfCHyqx9rScR+XUlyQuFe7Sjp/dn3y+b1PKa6G4HX7f1eejR3ZaLZXA4R/8oucAXqQS5pDr3Y7prwkrp9cyk8uawBXoDcAlA1SMIPZPrtO1+iZw20NDhixsG7NE5jMFfw3q8xTckZEqBbteybci7X1v4lEYXCVlbSbUhyZ2Af8HEj09JBDOL2bI3yLvj9a5Oj/HtKubyApzZpA7rgeoii2UZQGuSRI1VJktp9YC0zGk5S843xYW92utbALKyQ6DdB2F5gc0DX xiaoxchen@LM-SHC-16501223", "key_options": null, "keyfile": "/home/xiaoxichen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xiaoxichen", "validate_certs": true} 2019-12-08T11:55:27.012 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz7e2G3Ziaus2yMviKh9s65e+yaqy1+ezs5IC6US90/8WumNAWqC4Yr3ckvCc120r3VwpJWcvaAWCF+4IZeO43lSNLadbCnJONed5YklcUuIJvjC1eDbZTMLJ7h0ijgNXgAFmFq0AV2NHuE2L2VKXk2hsIqDVGjZLUpi7W+ic07xnScEoXXDSk5mhJ6bKmFsUYCC91g2roYs9Ui5fGd+ey28SFOADI7osDLpLkiTF2OzGel93o5qobNZwKR0AxGsBIta17mvf3I3307bGnvugDXpNB0FaS1QZhIzMO4G4LZL9zahCvv4wm5GmuO4F0+Ac7dwFu3KZKtHQe3g6WHuAv ffilz@redhat.com", "key_options": null, "keyfile": "/home/ffilz/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ffilz", "validate_certs": true} 2019-12-08T11:55:27.044 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2019-12-08T11:55:27.384 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpGZK2cWUtE85Bt7fl+kSeiC0lM/EN+H2X3ePGq3LiD4g5R5n6nJsLaJaIZXdJ96G0JSnj07G8Xu1CkVbGDHuVg2O9tnxLhz6tzDwFYNFrQIpALlQwOq8OiwGDDyFkMXQ3JqCCWvyD0HLysOJQIBIlb/o92ZCSAGOyNX1JjrhXF+mlBk1AUW11UeZOeGZQ34MKHapH7T/DuexCz5gfZI/jY9Rg3hr4jb1zGttvAF2eeLJCjqD/Vi4mowYB/Kn/PJhNixeA2sli2i8r6yO/bFmA/PWnfSl+EqD4mUJWb5ATeJ3hyW8qVLOogY6XVu4Sd1VgL7l1RYzXuxJV3Rb1Yw2T joao@sepia\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDV0jbKpbmXW1bhRIOBIdVV1L73qjls7s5pxiW2EMPvZLYzxLBE92e3Vf8bSMWlm1Lyb7a+u5BR85+2c+h2F59sgU1Saek5ebPpFU5qBn8AzYH18iMVSPciByOzwS0NXwWnksckWxUkQgP9bZP/1ORQ7jWZEOHZ5mEQ0oMkP0bfG1cpFrNTxOhDmwbCiQ8dp6KeZaMg4hErALr5Eh/EESxKIkuwQzk9bDbtjPRDu0F2dE0NCjs0k0BXmDA80GksxuOacRxE95K6/er11qst/VqA7o6BfhxJMTXWMdj8NhzIUNjZ8LqLTG6P/XGR24sA2d2WBhlEKRMZNqeEjzmi1REr joao@tagide", "key_options": null, "keyfile": "/home/joao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "joao", "validate_certs": true} 2019-12-08T11:55:27.444 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2019-12-08T11:55:27.743 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2019-12-08T11:55:27.744 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHhYb/mGgHbEntAN2iPFTV1k8MYDs+jtsJDPE9MWtUZXksdeG8cEfXDBGhiBsprjELsW4+czJBqqESugFMevEysTVKIo5lc95bf1nApxfiRyMnAxb5wQ2OeLY62x26TWJhPu6HMajV+gb8CKjxDobf1Ix4ELbYlL77SOH1VVDtVZ6HiwtYngXAPMONCdI99cuwJlBpv5RjDoLwljOoxEXIh+1Fsvth+iymp0rIPuJx91DzYYgWZFfCLPHRgDy0H7YRdQWUzhrxTyzuT27vsNh5L8HgdowzOu9f2HwGzlTlxli94IJLMBY2359xsqjSswZzAv+BiPDAZMUwJpYvRvSt nhm@clusterfaq.org\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1JAKymiRDyVar5P75cMycxz9u8VsLuNtf/0t1na4ofa4YmanKswPQQz1Am82pvyPqXlBbdIGVneyMrkEoFAk4nTtfmCl7WdtaxnH87Dr9BOLEp+lIPHy7jpS/dcVmKRPB1qCYZ5GNAZ9g+DrXdaeOJdUOpIK49BP1IK8Uw5eBWAx/ae6/12yz+d/6e9kBvO7OUamMSne6Ghe2pRoI8jFOdWMbQy3ofb5wSHZGPNDn0YTGbNWHlfEAcrFmGQSTwohca4SqCJ1NgKnYu4qPVmb3Gbpm+MpUPs8Gy++rQ8wVZ5xWZW/yReIbJCqqVY4vrQzVywQXRucIrB1VyvShuNW3 nhm@metropolis\nssh-dss AAAAB3NzaC1kc3MAAACBAM7BfQAinQmLlkTgt7IIg3nQyyaJRiWA4agfu/HncrcAmepGqPCwy451g1eLMD3AC4QptHnV80Y47YQTyX1VQixIQ6M9zHG6Bo7IXzyqFHFpqnDZN25DaMM4na5bf1CwC9RtR7VWubojatPylOpflkChUBuAGWnzwkz2cxl4Dc47AAAAFQD35l/Lg4eTqZ83eTgJ5lihzHS/awAAAIB/ZdMSE6M0zEvdNPsWY28bvQ0QXN7w1ncVXGachA1JOEFGYvsbHeoywLpSYoiPLV57/wZT2dUzG70u80IQGildZ1WgQNn7C9r2Z3ZUgKmRGyC+PpYEa6nv+U4CHdMViBRXxNrP0bj2 2019-12-08T11:55:27.746 INFO:teuthology.task.ansible.out:CfQvUxUxrHWtOu/da2W23cpSs6Wz8gtz2QAAAIEAvf4vx/32Sy+kbvqOCYz0wu0ItlECN0qOk3gAMvphYMI2sW2ez2+Tsua4eoPRXT10zFxiRTkHQd5FSIvNWXV2iqed6rpwTu5K8vJz2duMIyI+xWLHo4XudtZdNxggkf+RW9JvPOMLMp4sCzBXxpreHBsb1CynndKeYVrgMLybZ28= mark@Marks-MacBook-Air.local\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCfDOM2v4h6Dk4pMWPQxxHI5rhFtLjkme/4hAp6ki/kJ1XOSzBQdQmD2UPDKvfO9lKO7v12G2Wt+re+0giAcSkfej4+xqV53u7d2pTbMI5U3zohZt8AgESx22DAxj1wBZYuyGO2TRI7DRQMxC47E8EJgcmZBBnMKk1Rz8k71pTmg+CI2vjWx/2x2bup9Mqe4uMA8ubjg2qRlWEqPKIKcHZyrAPdIlpy2FSZ9SPa0mJpdl6aYcFNgonD8BO6A0u2RPO90KmEWrRWu69vRvbbTDiqE0CkJJlAlu3jeFVD8US9vymBHSI0BDFUbukuyG1tAujytqGBRLzxQDU9JOYMP45v nhm@mocha", "key_options": null, "keyfile": "/home/nhm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nhm", "validate_certs": true} 2019-12-08T11:55:28.079 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2019-12-08T11:55:28.118 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaetIvR7YgpCq142fBQtOYsJrOMW+Wxu1beNXPJ8qzT5MxD05sdKntVE0DPveUydaeI8/vHeNjXDKN8mt1eO7Lf/rDKHOW/Y/36bUfQAODru9sdNCEJfSPgq1y6+X1ISljvLBXOOl+nQXlx3n5OjThNQbmdthgCT2Fk4hEoK7gn4+ol6foTkTdUXIBam8LuPU6f1KIG6ae1oAVFWLeavAbvmxUTmVl04+hKJWSPnvZxWupaPuiHvsImaQ7GwBjKhzL1wSMly0+pa2zbVYZKkLBA7Fx6fzP7jcEieOOPM1YU0jR5JF+WVzeRFJ1V9n75yOw6S4ef/X/zwWx42cdfx3N nwatkins@martini\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDRivdSX6cbPrdMrjz1oYgn0hb8VQo+QU7wD+AcCQi/CH06ny+2QjSr7bfdpgQ81Wgwqt9+e3KcLD5qdt3tneC8sgSAR5QUQrWKhPejrqdV+3990k8k0KoKIOZ9MGFc1FBv5IpuT/2d535iHJb0ZEg8mFKqKDw71sBEoQT4WElatf5DeVC507hP7GnrhZgtTPcrVddOLkmmqTQtLE1zvo9Y/eel8O2JMImMd6mdVBIcFQ1alU1wV4jLdMpagoPelvVTVeNkGRnOgvvQac5RXtGSMP1R5PoGz+1FgRhDCtdTXRfOdtrlJPtUjYiGPpIoKIUymlvQGjUrrK3WiQIIkIfDtFFu48EN4drjgQpCEQ2D0NMKEmk74mjx3CJDOF1Nj/2Fa1kjECiz4EM7sR8dDG5cW5Y8XsDoomgugM+rsOH9kWFFClHUJmdlNGWLhJnu9UQHLYZjQw3zT0F+FXUsUxKJUVTUdxQx5HBO9QFsSe13NPDnX64+SQ2VVStt8oQAvFO+6260zbux0RVaJM5dTNwnIHD/uI3PeR1z2b+iKhyj/9VP2uBRpGydLw/etQu/lS2K30S+kZIDAp0sqwXH89bdq3AJBipcryrnW1Ov9K5Mfl1UlV95/MivrnOFISWN1F9XR1kuIIYdCkI7hq/FHZ9gd84AjTiERfxRv8VCIHBVEQ== nwatkins@redhat.com", "key_options": null, "keyfile": "/home/nwatkins/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nwatkins", "validate_certs": true} 2019-12-08T11:55:28.404 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2019-12-08T11:55:28.489 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDJD+2BHStkaMJ8RStIIz+yDJCGNT1wbwUnmuO71vNlFxzIyHGvCq3ktx2xTwZz/kj6ZayXYWIRH//BhK2/iK/v+u2WQMBURfMHbf0lDMmNfbHCDBjYvEYgFo4Jwvzq4WHus0AHh9TdVt+TpcxyGPhVbUJh8NZut+w4cRIKu2xGoZZGDeLgv9ijXvDPrCdBxtpvQnF99C0bCTdPM7MK1FSCQEaRmNUgzEj0H7R+gmWi0T4HUD8ZY7y0vWbYPqT3Z07My1u2BfRBYpXnv1655/b777TkSlzSasORhSTT0AkW25u90Rsj2JWr39+49/Ia9uOyFtZIirugEv2v7v/l0grN linuxkidd@zenbook", "key_options": null, "keyfile": "/home/mkidd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkidd", "validate_certs": true} 2019-12-08T11:55:28.751 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2019-12-08T11:55:28.805 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrRvNeBa+/GXxkSDmaim7U1wFpdBvgcK9/eP1I4fPS5xAWyxXI0s0ryX4Jwb7auhZdcqPjgUPQvIVVRridKJPz7l6jUlbIqdnZu4VHuaGG/DfIVxsSmw5aI5qI9Fg/s16JPwOUuzcLHsSSh8tFxY9L1yvs3ztQnKHW6nN5+zhPbW8UjmTNUksXXAeCM/OZn+IOOzzvfh0vVe/mghIW2JpOjHkZv4qwaWYcHg6+wWE4m8l84VIegDBiONknZXcQaRj82nHtfdnb2FSiV4+gKP18i90ai0iTKKXUkMJNFKp1T5MuF7UuJLA7l10FmgQJsZBS2Loa5oeqbHYeztNAfUxF JCLO@oh-mbp-jcl", "key_options": null, "keyfile": "/home/jlopez/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlopez", "validate_certs": true} 2019-12-08T11:55:29.077 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2019-12-08T11:55:29.163 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDFkUz8Wr2RPiY8+xf2hL4qMT+jA4mo1gmpIF8q7uVR03vX5NhzQVxVnXiyLCFv6susSMxpBafa7aLutqigXhDGJWUbsJII5yTnFYVer0QmudEsLmoDyvI1HCNk1IVY6aIESE50N3Ndx+agWasIU8TGKqJdDMPyiUtfrvsrGWi/91ZLX6aJSrFqBJtTpxDoNe4XL6QRPNv0wb8GF0az5graXkzVe3GkaQS9lyw8m2ougDvW1SLvoeE+lhUUGhJGkkCZKv1f+QNLhUHyQ3XkXqh4MrP3pPUKIuQ7nKiWDjCP6Db+ZcejjTRC19D2gLjhrw3Z2J7nn/loijlFzV5dp+BL haomaiwang@gmail.com", "key_options": null, "keyfile": "/home/haomaiwang/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "haomaiwang", "validate_certs": true} 2019-12-08T11:55:29.432 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDH/YT1mGZg50qDdngGQ4Ea+jfJGZ582J6pQbYkrvuGsyATMzNwk73sAbn7mgbpw7nkW/ol/vwahXHZ5heC056BFnqiZ7tjoDeotDx/1XxFtkbyIaVflUeD1vBww38v6IslLHcVhPilauPVZSfVzEHI7JB0a+9OwNrEH3+dt1B6vR+WRy2gHG/aEJffPMv4yv/0FgRWy3cEiUvGlLq0KVVTbsqqLQhw/u5k8bBIoibBtZLFAMTrjLYp9Dv8dxJROvmey6O2TuX6gCY1rLGTAArYULpXH73OLIqaksJKc3srgoJrTSZPO6bo3BQeLz4ODJ7uvTpvQIhacBpp/dq1ln7p owasserm@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCiqChxNdielMPBchs0u6bxWstqU9oeY2K9qf1PNwEIrwDYTrpDjsdoVnS750tOBjWY0wr9Gf9ATOJXi89151oao9GaUueQ1rTgmu7GtPlKsuBUVNMFzLEa0mqneqDA4AfknisFt/LnL8fLM4BddT25tmQ4oUGS7F17p4kXqwboK/DsJciCMWWc/5AT4NVwdnYFzIA6ta25/bB94kpktaZ6HDw7G8q/mK62Yza3EZfq8SP7p0sPL7oVsInQ9AutcVonmALgzPa9t1/MPGaXUIqARaWtwe4MSlNEIs4afLFyteBVeq+dgU01yeyjFivwVmuS+aPFTm6sjGGe8/gOsFDIJiVertOqi663m7q1WYGlVANfif7uL2+uJ9yrvOmrFh5s/CJMJBRG1SLfK1j/ivFwvPAQc/uMqEIRzrVZOsuNLPO4zHPWzmBAPUteb+2BqSdUFYMlBxb3lmhFFffroDqnOK1nbdAfmyKiosUizQgX2Gs2wjjtejuhS9dpYkNu+sBOujsxa2mZUouyWf4fXyWGVjthrCZaM+FyeSDpJrgwgRiSKNB8aRxB10ZNo9WZEy6eH2adp0Xf6v2KsKvryDndqBEkBI8zLbGrPVHGSEqiSBWc+NeAB06uSscJd0pHU3hDg0qW0EaxOXaial9qrBiwcFVKEr0g7LDURQ6KZsZy9w== owasserm@owasserm.redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2019-12-08T11:55:29.528 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA296in+8Sr9slF8hrzAV3dNz0q94Q4FlFaMYw08II5PQm6HOpabGOGOwOud/PPeh3lMUHhs45N5WnbgdfQdzz9lpDoNBcqxeACdMicdECMHtYWf2GuFUdTAnPBFVl8wFW5JcziQYJePUcAUJRXGGfdMLMppAi8VEuhMw/z3jz89UN+zf51Y9eT3rgAVSCR+Zn47kite4OB2S1aVMEcZBE0fPnh60i+rpN26s80fh3wG2N9JrPBEvst6LbL0aEixrlRUtoFHZuWNCIjntVMANa+idpuWSxN2dzfcoxpGLF1TFzqx0moznp0PnDs7ZAFFS1/EkeSCgBflyhPV6csG3VNw== jdillaman@ceph1.example.com", "key_options": null, "keyfile": "/home/jdillaman/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jdillaman", "validate_certs": true} 2019-12-08T11:55:29.755 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6 2019-12-08T11:55:29.757 INFO:teuthology.task.ansible.out:AKY1OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2019-12-08T11:55:29.861 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAuTvkaUtEaLbLcYA9Zw3MoHI5ZPudKf6CAbAZdhp4RMVujimR61TT6LdRF20g6F7pH7GrI/1WP2bu7a3sZyCZ1nCJCOhrTTS+2wwy7oGo/0yY4l+Bw6i7LGmJgqpO5dDxwADMlaHUwJ7Rf1Q+Pd7NmggkAVTmaN6qUGffz9hZsj7ibD/Z8/GFtQsCEMloTLtnz4NB6Gxe54UXEKz9pvjpXBhs0xWsJtDKaPFrbKRKswuH45XPuwJhGr249ZYtwQqcgXSWhOUcPTwf5Y6fj27aL2dx566DxQzqzNbcTcO96MguIy8Ufnc0kIOQQw9oHJZtg82zwM6+2mWr9J/K94Gv9w== kefu@save.node2", "key_options": null, "keyfile": "/home/kchai/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kchai", "validate_certs": true} 2019-12-08T11:55:30.087 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2Ruq 2019-12-08T11:55:30.088 INFO:teuthology.task.ansible.out:iZyKz2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2019-12-08T11:55:30.216 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2019-12-08T11:55:30.452 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2019-12-08T11:55:30.594 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC/r/Xf58szqJ3wLdTE+mRK1Z11f/+VABmx6804NO77ncdC5ZvD3Kx6WP/oje01iwWEVXNAgEOaXp6j+U10aPvBMaS30qf/IhUcrXwO1YcGzZ0pV6UZMxcTuJw6w1VXy/YtgW5BlIfSm78zabztES9BqCgjYYM2rml3L1teDF4WU1QiI97iW0R57yc0t/gqXGpxqSFQ+iNYAl0Q1MGUgYltLvPrhm9WI2WhR2/GivdVMEM5lViNlegxneAZRb9YZMCG2kmSP+9Zd2NR367OrlgzmgeY/9u+KGXQiyfaO330s+iksxVwwE3fDl+KnqXuHSJNccJV7iXzZKej2QAire4X dfuller@Douglass-MacBook-Pro.local", "key_options": null, "keyfile": "/home/dfuller/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "dfuller", "validate_certs": true} 2019-12-08T11:55:30.806 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2019-12-08T11:55:30.978 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDH/YT1mGZg50qDdngGQ4Ea+jfJGZ582J6pQbYkrvuGsyATMzNwk73sAbn7mgbpw7nkW/ol/vwahXHZ5heC056BFnqiZ7tjoDeotDx/1XxFtkbyIaVflUeD1vBww38v6IslLHcVhPilauPVZSfVzEHI7JB0a+9OwNrEH3+dt1B6vR+WRy2gHG/aEJffPMv4yv/0FgRWy3cEiUvGlLq0KVVTbsqqLQhw/u5k8bBIoibBtZLFAMTrjLYp9Dv8dxJROvmey6O2TuX6gCY1rLGTAArYULpXH73OLIqaksJKc3srgoJrTSZPO6bo3BQeLz4ODJ7uvTpvQIhacBpp/dq1ln7p owasserm@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCiqChxNdielMPBchs0u6bxWstqU9oeY2K9qf1PNwEIrwDYTrpDjsdoVnS750tOBjWY0wr9Gf9ATOJXi89151oao9GaUueQ1rTgmu7GtPlKsuBUVNMFzLEa0mqneqDA4AfknisFt/LnL8fLM4BddT25tmQ4oUGS7F17p4kXqwboK/DsJciCMWWc/5AT4NVwdnYFzIA6ta25/bB94kpktaZ6HDw7G8q/mK62Yza3EZfq8SP7p0sPL7oVsInQ9AutcVonmALgzPa9t1/MPGaXUIqARaWtwe4MSlNEIs4afLFyteBVeq+dgU01yeyjFivwVmuS+aPFTm6sjGGe8/gOsFDIJiVertOqi663m7q1WYGlVANfif7uL2+uJ9yrvOmrFh5s/CJMJBRG1SLfK1j/ivFwvPAQc/uMqEIRzrVZOsuNLPO4zHPWzmBAPUteb+2BqSdUFYMlBxb3lmhFFffroDqnOK1nbdAfmyKiosUizQgX2Gs2wjjtejuhS9dpYkNu+sBOujsxa2mZUouyWf4fXyWGVjthrCZaM+FyeSDpJrgwgRiSKNB8aRxB10ZNo9WZEy6eH2adp0Xf6v2KsKvryDndqBEkBI8zLbGrPVHGSEqiSBWc+NeAB06uSscJd0pHU3hDg0qW0EaxOXaial9qrBiwcFVKEr0g7LDURQ6KZsZy9w== owasserm@owasserm.redhat.com", "key_options": null, "keyfile": "/home/owasserm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "owasserm", "validate_certs": true} 2019-12-08T11:55:31.153 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2019-12-08T11:55:31.351 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDVFy1sjGvvHwS7Q6E61ykH4dUGfxW9+a7Xo3JMpTBT33/E8bTrYF6ZHSdH+uxScisV9Vll222NJCLXyx2s9EOcv4L88vWDTZGCaUb3iA5dweLm7EYi1NXT/p+jWDA7MAF1FQGSAQafTHpNRxLcrVPgsLDy35weV4xj7ShEU+w7EBDb75jlJXqy0luJLKNBrLzz/wDV9Oe6y3APwQBhtO7vGrVzrWEF/LWLe7U9ad3DQjvLM7+H+QVpNy+nt7us73K8vHDk1KrPlCCjrcN+fSGPD/ILlxrDrDeqmmBCtPMa7PSSjCyAV/EW0fsmArcHrHXKeKWTKXG9sDL0KBqos1kB vasu@vasuSrv\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQConeaJ2kvUOMy+jeKvXZTw655L3KK0ZG0HONIySFrRNkGa/M/hYf8oMNVh9SEax7vLNme0kwk7d71EhgtMGNsvHtQOkshWxM9P0XPk4HgB/OL+2LQ/7M3SwD4vuXPbqvrQS63YMoxcHBue5Ol5hXmM+qSoZajpUrfB2woqbp7aKsCpoK4Cgj4XfLHfh0n239ae38DU6GoAcL0GzMsxMdQhWzBwOO+ZHfowohc1pfY0+xGIMW1OlMN1eO7kuK2gGS/YRVOnLw9uu/2NErIjBzCihNN0PYWur2JE+KmU1x6VMaky49cKmAlc5WUqZ+FpV3gvnb3cLjBClnCkdjIcLeRR vasukulkarni@ovpn-116-227.phx2.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDKRFyOO7qitrq6Hk2NSl28h4laRTxA2zezy1wwjTqs6UL+oZjNRYQjeWD3dDNPZrUmc9JyI3j1EN11cCsKAp8YXz3ItB46M0BPeJ4TXCpg36vxs7/twSDMq/EoXA5sRBbUJFf+bthcNemwG1WsJoxRVzMezbWBTHvz5i4Hbh4sL3PBbac3FhT/3b5Q4tKdO6bXGXmNLAoALyVZZMfoSz9CWzvrO+g8Houb9iJiaXHp293y+ND9Wicl9wHPckO1VcocZ+ldByujgX1cz6m+pxmf6 2019-12-08T11:55:31.354 INFO:teuthology.task.ansible.out:AKY1OMJj5PjmpN0HrgpV2QLVA+ba9qBiDwi1g8sRHXkOETMZ2jq/2a/mmTtvrsF vasu@teuthology", "key_options": null, "keyfile": "/home/vasu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vasu", "validate_certs": true} 2019-12-08T11:55:31.497 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options" 2019-12-08T11:55:31.499 INFO:teuthology.task.ansible.out:: null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2019-12-08T11:55:31.726 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlOImwCV0AGu5L29ABaefV9Vqjv43WYJYFuLTxGQQdeQGcways6iNKGIX/nzf3UWkwgg25OVSpzB7zf6FjBx+HcQU+RJ7FLzeaz0s8ZxBXqWwtOYOvP9cXmAXA07hD5UAfxZKC1twBzL82bKJ2ZSmzfQmBjvpUOqRs7XwsQIClOW/ycY+jLgLRLFFDxzADsgnn6UEGlHeMETYocUbe89P3wbY5fHhqZmn6e5ncuAQMsiLRa9d+QhSdpD07Y/P65EzqRF4UOX+zpOc6gPlgHFir9pvf0bTbbBG/qKN9+KGqzZMRJGKenpHM6EMfLkf0QmrT4s4zd4ZnUQPq3HN3pul3 redhat@unused\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQD9n4ege98BNmvgUxogdcpptMILFfEisAQaiLUvSKpTsoy2gF7C6xSJXgDaziT5dW4ad2El4xmKQ/e6/e14Vx5i9pGbJz4NvL36Xmb3ent2PtY18i6d3CbnmGI8J7YH4YS9QvR7FC/KuvwLR6AdJ+uQShGhqG8kWJMjbqrtaxu8l1hq8ymBXw3O1Ht+xrZ/r3dEkAIVF3bMCSUnZpEbSsNoeiydEQl0ZCw+meXYmSw15vYVtKpYscZxqADqhSJJxIEHZA4E88dq6aYdV2AZ/s4cJK+tBl/ckBnclI3VGHSGn6oaHoO/fCHtKiENplDuKoLGQPO6xJ2Q/apHSGD7McY3 redhat@network\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDn/XgNfvqytLHgfBUdQIhJiWBlj+JrXqGZYvAZZJIWs32Ugm1/lCQTssGZrEj3+Qv81jLfkP6VQ8gXSWJkzUK4csxRxkZKXqcYLDE1csdmAFDOfWUFJwhMsCiiCyBiW9oapioLpvd40nw8k9qM4QuzaUhVonoGXMDDL1/dCgkbIjiQxxTJPHDEJFjtzul+VuhlhHqE6S1syoJG+UKo3Q1tOBCs8rwaPXEfCXFsyv+ZmcEv1+mpM8QRjdr1D1hfUfwb4CHtaa2AE6B5wL+zoY6+jsrTwZSwCfeIdgEZ8e3V2iXP5F7G6eXotu5r7mGYJClHZFLSfbNPN5J+EbRORl9/ wbhack3r@dhcp35-24.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDHYkp1nuRSYSAl6me1xuoTU30DW2YpAR6EH1c2adUC9tNtTZbMnab11aitQLAtZb9SKsRgnoB5KpH+zJ0VNKCuJU227r9vZwcVUruSGwA6X7LOrSkK0gFqNRZkVoKhC9oGHSU0zegYBDxx8VLxSV3CE56b+KEosEo6iJe7TkXy3wXHK6am0uhQPEdSHtdUdD683CGIffdF1RFmAFnzTPn96lC9rLe1mIGO+jVQx4zIo3i33RFQLy++4DtQw6Lrgp26Xr85HmQekjgyiya0VkR9Ypy7fgF2ucBGegnOgZDGCCY4G2Ruq 2019-12-08T11:55:31.727 INFO:teuthology.task.ansible.out:iZyKz2TZaOecDwrLkbYM7EGp8up5uLFRZsV shmohan@shmohan.remote.csb", "key_options": null, "keyfile": "/home/smohan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smohan", "validate_certs": true} 2019-12-08T11:55:31.826 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+z 2019-12-08T11:55:31.828 INFO:teuthology.task.ansible.out:mfjEfdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbB 2019-12-08T11:55:31.829 INFO:teuthology.task.ansible.out:mS+dTzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2019-12-08T11:55:32.111 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDZePxJmYerihzA0aQbMt7K7bctPEDcwPHiO8EVuJowp6zwhSmtDnYuFybKJsee4l8+rDKR6T5Ugdl5pLjSzQ+Ba00OSH7+qWC6shvVDYju5mIooJnc+kwx8RgapbGtDdl/yYskBb1KD5g/3+i/2aM+Igk+7nQR7Cny5+WnUEvHd7PHBbUXQSuu+mlUlnXCVMM8g8qlc1I3WQL5eQoIqGjSWRgZUIsn3P5oryYBzbuG9jqLwbaohJvZRJqkimQDe7zCFk6bB3z39pyOWUN+sldRvyL8FPyEmqog4IwpjcYyCuCnPhnb6fNq9yB65RUIde82Kkzx3LZrYOXTrdHgD/lr abhi@trusty", "key_options": null, "keyfile": "/home/abhi/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "abhi", "validate_certs": true} 2019-12-08T11:55:32.204 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2019-12-08T11:55:32.477 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDcsBe6CzgWh64iZAH8zbU6ra4yEiUBSsiUn0AHzyQurvjeRpL2Mut6B1WEi0kJG7BAM6b13JrhnD9BW9yIMIUIPpVTa2o4zaXP90+bvjGrgDeJbxv3T9/TGh13k+WWyampxm2lo90/+Paql/HObQyyIv7Wan0DOdIe2/Ue4ooWH0tu3kj+3unJTuw82oEDEn+9tGs0oleG2c8XN0gQyVl1DzR2Gqf9PCzXK7hInC3niY2huoSAZzVFEgsniKEWqTnVWYi49X2SsJhUyHCj+mqrTG3YnW30nha3EXOWIbQGblXVoTIOc+gNreqdGByOMICKSnQmPSG4DAl3c1Y4h4A71T3Q043IUv7v7S9tAEKq2h6oJ9I/a5z0u4kaL/+B7Cw7l4bitTdcZ0rcqSvOkKUNNgxujbucMSSc4Tsh5L0762xaziD9nQZl5bteb3VtsMAueqhu7L3sJy69+HGg7oF68t5TguErXfI2UNVGOn3eRj+zN/zSwLUXMoROlpM5yHXSzHvpsbgZiHBImM2CeG4qaPtqzFw7VH6NWJv4ypb0htOMWsbXmLshNTca1KXrrBcVozSJC8wKgEOxu4spk26G8x1IVTsi2ypyYX+irtAqZrrpIPdQ0Ss9NjKPhFNXAxJgLHj6TlH8UNh1gRfN/QTyzpFSe4EH6uOlnWuxcuM8ZQ== cbodley@redhat.com", "key_options": null, "keyfile": "/home/cbodley/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "cbodley", "validate_certs": true} 2019-12-08T11:55:32.563 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2019-12-08T11:55:32.863 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDrtHyRuOSEXAM6mwL4qoM+NM4hpIKhaRS+/Y6RDoFKszkXFw/jC9ZYh7q39rQpWQBKHVe4RyPN9yyGWydFwaR/BjZi14ippmYOqVG4f7b+k39NFbMJRcSxYC+NvkqxK7+zpsnIWC+RdJ+blZi+zCbaaAYcMDSvBZW19FsJSLrO7hh4R1cuzgV+Xrmwdc1/VH+HqPMu3tHGv7N0SfsklWI8Inr0aiL83QqqgKPcVxljSWZGYvvFyTQOrkNQeaLURJNER9WIIac9o57WOINw8kR+ojebcOUBsrxZH9j+gMjsJ752Rph03wdMUpFcnS6yfvI4Ial7x/sGms4FE+wL/vVF mdw@pika", "key_options": null, "keyfile": "/home/mwatts/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mwatts", "validate_certs": true} 2019-12-08T11:55:32.992 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2019-12-08T11:55:33.228 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options" 2019-12-08T11:55:33.229 INFO:teuthology.task.ansible.out:: null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2019-12-08T11:55:33.240 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2019-12-08T11:55:33.586 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2019-12-08T11:55:33.640 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQD3vdP9QHyNFUNPOdplezEbdYsQfcC91ncATI6Fl/xHifmUbcvjIRqZHkCY6FNWUpMeg9S3+wlHJtzjVqJJ/MlQML3EtwnzQkeWv8bjtuZ07OqULYIv0zEx63XUfSnrdFleJ8+KDSpn7krkYE44q85B88IL+ZBeq5eCXFJ1TtmsDcvsN8WqZNWMdUGqgH3Bb4D8+YKrEfGxoievyxZ1A1DnBHan2l8foTKYggRrnuSbTb59cFpxY3R7Arc5Cn9kDJT1nDVBA5SSGCfRMiNyBOUzQVYe/UjKTaCpngglXC3wYnjoGvGcpksHLQCxyuJPB6djC1tdF+3Jehdf8y8+2TBzWXiiPq2XwS58sER5GcLLLQv26pPL8hgu6CdI0sHxgcgQBgpjoLwUMHmv13CnN/AAcZY4RRDK2X5zd6wFSEhuuCoUqh/m7K219IxI6fVkLaApC851D/ua/pj9OMjiOaJ+D13cPrgfqxva4eK8FQZvqQm7aUK/TT216QNYmn7hkzNjMTkjv/L5yYQ5Ym92AHy44wHzLPrtDB5mk94vHOjG+KlAt9ofuLncMSAXWe+fOqxuIQ6VfbL2LUv0EGYhHe4XOVj98q5utsVQxQbXAZzNQaq9FWXs2A4xcVP7aWj0Fooi17LN/W0ng4Iijir5hyLr7k7M1G6resgiY7p83biNow== pdonnell@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQCpgLVt7Zphmf6nqD+9BC0N91jdmaY6ZpvrYWlzbhxXITQ6juIEtegnlZ+8ohdeEfHFBiyu1xOSQSM1X1ugvpPQE94UqQg7JVb0tuoUCNJHYnIuv8T4YgyP0/vEV48k2G0BBWlP+IJ5f1iDvZuLHWLR5JSgGqh5ELaaHr7Cbyb6JlImldb7SDIoPHMCZ+n6dLO8l5Zy7qWelw6aeA770xmPucBr6t/BVns2g77XgJz6zFd99yEaDy27i8jfzL7WqR9i93yVE9EsL7tuOjg6G9KUzxBF0bg9iVsJXypvcBuG0JwQ+SDKqYw/cN4iLy5qBa6Siqrfpc/LKU21VNmJ0e5eXNgKKbMBpBb8GVmkoLaSRcXw7LclWopjNDA+meUhDAwU7b97N7cqN8BYhBKQyiShXFHMKLuNo2fSuTRt/icfb9VisKNGBdvwgV0oOlrqbXMzZKmj9amb9b+3JDBTGB7ioCsj5x/Evf9srXRrQ9kikIr1aBbVXIWir/lasNWVydcmUYsNi8L7W0vXArLwp+GgOXJFeZUiD3z9LG4CouRxMSwoj3lgWeL2ZR8feH4D/SP/+QmBdU6+aG97au9qreeXi5X8QTR3LND0DwwEKczX+3s+Fa950Oieom/gXC57PVKVh90KVoAGw3HzJTlZrauOtLkYbTUAX6woOMhAtJ5oWuDDT4UrHQj37jRrrl2dETLwKwUJN2+2L07vnnOZ4ABcGWLsU6d3bXeUBlw3pdsYqPebDKUEpjL2kUOw+z 2019-12-08T11:55:33.642 INFO:teuthology.task.ansible.out:mfjEfdVx9BfrvExvDX+3MkxccCJ8FY7od1s5fGEFHsXnIiMnLO/HZb/JN+Aoe+/ExadIcYwJnWcCJyly2/532kGFUlzOliCwPxgJpjWCKQAv6LjWmxoPXiA4JI0bp6y7lMEjmV2Bp3mwphlsW/r8Ie5hg1UPh/ttHRp/VZgcV8e6nNmP/qc6k9b2DWTNFqtWqm1hXLOwq08HzUEeH9mTqvenyAbv2RFMOS18Y2K+4BKUzHwZujrz9qEh/kqtpFScEIXkOJ+HZz3mI6XfjWFIPS487yRGfUvW3+nSWhvHc8vJY21bFRKdjD84qCVlZ2BfOCGUZSKftVItEiqXMTRs3RZd5epfCVZbJuA0hG16jUseeHqqZqDtlbLkzkxtS6v3iGRnPh/Ke/94FHHCzvYY8cmMYAVaM6p/G3edWftbaEtN70Fo7VKxPrpPzuSRZ7Vxmnb+Zad95DxxAC/vtMy/vkBVIP6dyn4HGxqa1oECFMe4oXdhnxZQoPzvWxb8upcXeAeOMMbcIlMq5a+dCBPGFNKhNhrb+9uAEDHwjE7rZlMJVSvt9v1S4hll6jiYIap+7n4reSKrS45aO9U0xiKXJJDohh pdonnell@icewind\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQC8MdUJzIvTCn0fM+hv1HAO/Lwjy/C/V7stQRWGIxyrRHbniyX8iuaU3j7YNFglSQPJq+YRM9UnGauM9/0J9tHKLsMp+zRQYrtxU/ThiTUN8TRJY11mGUol4yLsqkTtm6oq5sl6o+LfuA4hzaYc3XLrFHRJuCUgbtPG71Q0C/y3U+itrDK4wXUxBa4YzZzcIMg+c88VXwoouPbiL0gW5PCXzMaNtKlOqBUKlE935MLn70wIEfN/EwAAbss0ga1moqeqmi9Nlvm20DNIVFmkAGtYoq6CHXtL/uehzai5Sueop8Vmd8+1U8gDTo6JpiagdD8ZNf0zAbRx587KAT5ZMnahJpO276j7RNa85ZFkNkEnBLqBHRkCkTCYq1GehYyRaR69uuKyczFiIoTfAQgPh7VlnpT9525b/4nFsBDOkWxxWAIJR61YiKemPV/n/e9SwhvVsMDb2B/RBriwR7Mi2SZ/lBHGB+z0OA+EE2rGZy4LFVOfUczqIdpltlNotXan4M4F361i+bX19KE+f2RLySn3+GiFv0CdLwslS/y4xysz+FWxw6B0Y/EkpiDU3CdWM61+THGGm/DVhfL/Pvca7k8PonHFYw/x5w1nBcADpkM9JF+m5eOnp+weTEzl58sS+3GnoAuL8YFJwMW1RmE50xM0o5E3SDc8XftUvaSZz8mhII3uwDDukbELfmkLbnIeipQKyjO+GEx0JBp4Itz82qGuao0Wi32U9wHzhSWnX4GQ0pKZnq9frSlyCNwHu/iMiKF8sA2bX3dvplFJ9nKWPefcU8bdl/upr5hYrd2GttjUSkWZa+UuF264yx3ztcN7jotRhEmmdEcHVzKQ26/NyRI4/9DQpDKY7zw4O2wFkXWg5L9kodXwWzgy4cyOr4dMD9LBVLOpHc0CAji5/+lfuYQbu1mwVdfOzCXDqByjt7zCbeN7KuUh403sJ8PTQVp642xA9i4AkPv5g+fqi5C0++1DbZP0lmLfKtTswHhoN+kAqZu2N4Mu6mNVNKyZgW5h1pZzNSGWYcZttyYmMCHhPketReL0LPJ+VUsqQCVohuta3aaSe44InA28GZsXzMj5B0el/84bnE7cN4b+rfGD25NT73JEt3RgPa9W9jqT1hwd/nf53BDKpp7DlHjR77WSWT4h4F7bhbM1RsGSqAfZjCUJT6Rq+IuM2XcrLDY8zIeArkqaZLXMzfGj6KJ7cQes05P5LYfY4osXiq68Gs/7gzF31PQRRGOYAoqMN7752sn0ZMcpnUj3mJutQcncRUN4+naTMjU36WWD7it0YuQBnb2IJ4iKjYLInw8pr2zKgWtgr1TSCM4xKp/v1/ZMmbB 2019-12-08T11:55:33.643 INFO:teuthology.task.ansible.out:mS+dTzNC7Mpkt8vdCNjzZ5KZ5 pdonnell@aglarond", "key_options": null, "keyfile": "/home/pdonnell/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pdonnell", "validate_certs": true} 2019-12-08T11:55:33.961 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com", "key_options": null, "keyfile": "/home/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2019-12-08T11:55:34.016 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDKzhyWb3PmU88m8BbgpEuBzYM6+x28z6aZwHSesiyfXMfF4Y7IZjtKaTxH0ph/O9GQCPhRCVhRd8TlgKWJGhts1E+VkQfHfT18CgmrPWzj3gifc2FJhL97vB1Pd3jksGnOPAikgYPHP46SVMTtyvXCkOUuo7E29WrkdpjawcqM1rfpw63OnzHf7Ar7Sqh/othB7ajyVQ92t+XWSEqj7K+NRfTaq5L5RBWbwarM885o8xdI5mimOZ0QjzKOhFDORrI+HEVlkutyB8E20nZgo7TUy+kYeLVhEqb3A6Pi2QbA9GFLT69kA/H9nebhj7Cuim9yrx4OKeZuIncG0UxSQF3QmWflAZHBs8L/jniTz4DJ5id5jR29tvGK2LeddCEMB1L2cHwWHlG0aX5jaNEJe+nG6H5Tcg3+M1RPM8twBkRQmS3UzAyX/MTH1kktyFUHn8CdBXe0WTuoFSvXLB6BCHWzDYZOt0tIV/xMtBwhy+XGYA4oZSsDU5m7VlSVLBGL8DbRX69Z8AGey2y3FoFu/roY6NmDhTxUedJ2ZfoKSwdZD6jjatdO1621nonBnJxrDgaXCWzT7HtnWcc3GwxZoBrqkvgpsx88f4lNi22OpYVPV6A4hECe04u6OJnHSWVk3ft3p5PaLNF8aEXbiIgzZKAwX3LxpvEDFH/t1sdihhpmjw== jlayton@synchrony.poochiereds.net", "key_options": null, "keyfile": "/home/jlayton/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jlayton", "validate_certs": true} 2019-12-08T11:55:34.316 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2019-12-08T11:55:34.357 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCijPApnekNl/dsY+fleKYstEzNkKflBEcCoKtjItUCDJCVLVFOsDBrV94EGvDWpr13aj9sSwpUzRbeu/vOW8ZT853HH6Dqg2+eoYwG6vDRprZb93nw6l4vtU59/M0yKkyi9CPp2+YUo31cCFzYWpq8bv2j1xBruDSUCUdn9nJrHiLFqA4QEwSpw+uVCjSKzQL+LjlKmE8Plfd+8mNCQeY/OFsjxAztwN+4M50SZCnOVCIwEXoYRNd82JOXMOaqZJazSWTO8Tml6+Nu0hyEcvHkHxWRDSM+6LmXNnjlVUPyDN2h1/VAYATpOZ2VhmRarDoftCp9Wzi7eQdL/CGiMyuD rzarzyns@redhat.com", "key_options": null, "keyfile": "/home/rzarzynski/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rzarzynski", "validate_certs": true} 2019-12-08T11:55:34.667 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEudQMGBPqfZBV8bXpdQOgVTDP6GFsr5oL4gdbHFMuJCGe0Sfq8LTaSEBQx0MH7tXc7JJ1fU51U7DSt0kfy/PFeV1Y5XnNATiZu/SzdO3jHe06/8CCr3DLnlEmzXASq+tqDJbY1eV011d/TX1jiC8Qd1VNbpdZYExEDsDzwJXnWdh6rjTL4anGjIgQWcmU0XdbUJXvRP4dGjVvZVHZnflAkxLPBbAx/8BBOuBmv6vP4hNs4poi4VLwR6S6Ha1fgMJmsn6StsCVuOvKBJFuGvaulHgHgdoDJ1ryUFikkXXCWoNx4IbwtpQIkSxWMuAovlwwk9G8ozSs+RrFzCavE0f omw@omw-dev", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2019-12-08T11:55:34.742 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdGthG4qx90VQ8mJ7TI/IFFzptkSqBHYZsFIVu06IQgHbnFBvjao6heGt4UlkWJkegPCDWpKVAe7wFuXDpPlj/VssRHB5LBnYHKGfkNAzMNiMjpEZsTdy+9w39CCujipz0AlOSfrUdANBZ11AnG9VgQSPEukX5487juob55lFM6J3x+v4opBF3rSlux3+thbr8V0w4oCHMD9/aHvVjFoBnxo4oirR4jc/jgC2fQCMiAJhFKJGhjkKFiNHxcB3npBuRnpy+59BcScOAzSXdJ7DGnwxQLjymnhqsAcWinjjJhOjaq6NaoeKv5I7zQLaVGaQdIyuuAK1Dnb7trpfQU7mR rdias@rdias-suse-laptop", "key_options": null, "keyfile": "/home/rdias/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rdias", "validate_certs": true} 2019-12-08T11:55:35.038 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user 2019-12-08T11:55:35.040 INFO:teuthology.task.ansible.out:": "gabrioux", "validate_certs": true} 2019-12-08T11:55:35.094 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEEjb7yrcY6I6XbMU0hCps1NqBuYmA6HDmMcS/l3i5wJRBitIXYVlv6pefUG9gdBYR5NneccLfVFURu+DC63MJa2ELJvVXsQ6YUOX39bJUT9KlZs8mH+nlTD7tlPmP17Ae3k8sT0H42Q+/5+b5YvdAU+03aPhzntmy38SyvLKrvowRk63wHgcE9p23LY9tY3+HSJu86cb/IdePk1GLjnrMeT9aM+5j2eETrmBjMArP+/2UIsT5eb8MBkQzJ299SCC2gfV/qIVkorFl9xdejctAwNwdT0SPTMxCHxaiK3wZ0e/5HHTbSgR5YlxOlKYq93XBVYIaFKPCePk1At1a3Pjh cephalopod@octopus\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDcrTZoKO5e5xs2PB2UuAruvGlJESTHNAtqipbC8yJtRg8WGVDLt//rGu36QNSbpbJYMZgqgKsXBYolJB1ckqLYLv5j8RAoVwbW4QqKaV95y7x0bbXs/YAPnRBhEO1nfpT8GHQusUZvTbz38FDaQwstsYoncmsyZwBrqus9ycFavpY4wfpKoWtzeiK5Wjq7ervThOs98ZJKXJXOOxeI7mDakE3Jv7q2tBNu/rU1kzxIl65kWURzgxox6EmIZXQK3FzKt0jjdKtApVYSlx4ODLPI4iyxOv+MbRe3Nnj6FDhfz8/FeP/U5wWxdYx2WslzZCOI1BJ0VDLu3xEpLlu4vPzp vshankar@h3ckers-pride", "key_options": null, "keyfile": "/home/vshankar/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vshankar", "validate_certs": true} 2019-12-08T11:55:35.405 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2019-12-08T11:55:35.459 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+CtnvyVRSkIvD15O/q7/vQmD4oE8q7Mo6oT3kqTXaEaQ7iDayC2biUC0PC4OztPlNJxPUcKK5DfWw4F79OKeheqUbZRhsCC3Ge2JGoXHmsf0kBYdioMGiAxm+f8M/v1KESSSxvEnU7o+oi6VtFchh4Dl/WZ54rqZc/oQrlGNTHulFAuyoIAlKkCe3N0GdHN54PB+26QbLXvOuqpWmjVFbcjgRC62mkZl3LuCBhviXS4Rl5/ZE0QIHubCwV5XVrsqvscLS64bi06W8RN2vL56Vn3N9TGV4d2dlbE1PaBBESoTQ7Q0iUN32OAZLo7nF/1fiPY3Xc8r35juya5k+KR9z adam@TP50", "key_options": null, "keyfile": "/home/akupczyk/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "akupczyk", "validate_certs": true} 2019-12-08T11:55:35.758 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2019-12-08T11:55:35.835 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDeUJcLeyfqIk3ErPoFqh9kOnvUPsk/2hfaYNC2wZLMOSTIs3zXM8xjki8eN6vle0dmmeeAdwF+e2hJ3tCFKsEUQRvMc7ugIBA7L8/DboShYu7ItyQ3QRvy9pi6jnA/tlHA1LHalvyhMw0yZ4kvPbrfNMhZzOKzvL6jX166rqLA5AuiIfdYMBpE5rYq11GVjm0uQKw4UJpBMooNJeovEfQlNBTSV+IJSTiGBpBD7SgsuW3USMeEF3fEgQOcnvYdv5Fbp/crloyLWYc0HTidkLxpjP7vqY7E4BuBJug0zIB7voR3MYq6rAeuWjByPvq6coDlUjnw/QlrvarCbjjSaHdaRXLj/Dj+QqJFviESBr64ZynhHL21Bl6rexW7AwYyPa73Erbus3dN0aVQQ/ApcDTGHT7KRlDQ2YYg05YM4swpVVnrIdV58FzLWkll+ypCK/+kdtk5eRSe/KzZA3s7z4d4WLgolFWs8Fky8Rx1xDGewvMJgFUWVUbcGC13RocbNSxXG80cbIx8L/sclX4lDfGouu2sUXhP19vq1rJ7gZa6XTPohXjPbFS+En2cdlGdKXhppdvjT4QWKNzgQoF7qgWHMqJnMFJ6beT/2zP34KoM3t0ulee04z88VSn8Th8aqvLlGbdrt5LrE90escSaIAR1vNKZ1hCFwGieSKoRtYJTCw== nojha@redhat.com", "key_options": null, "keyfile": "/home/nojha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "nojha", "validate_certs": true} 2019-12-08T11:55:36.114 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS 2019-12-08T11:55:36.116 INFO:teuthology.task.ansible.out:33Kkke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2019-12-08T11:55:36.212 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC+c7zV5QmZb0WsgA2UZogoDNaoHcngRVLA8+BYk/U10ZlvCckJSfIXWMlBnqguZgdm/jBwsw5mGVBgHxUSqFNybwIlU00kyPZU6VbyVP+ZNVUf0XIE1NlemldgPBxxcOzSHkHhWrUqA3IKiCllcQVDQzutfUnq+jDT6NkVn4/cyNzNlargt7FR2L8gvskh62jLTBbhEuHMBp3jLCvaHJOk708gXm9qZ5iLOGV0pu7xdg58KE0p8ILClQBTbvoqPgZE9LA3qaOk1NR1n22kuW8JRHaKfD2Hn0Yu/MfKct783Bxb3mxWBKXxmM4otdmsR/R14NH/hIPce9wSkOOnQAC9 ifed@37526", "key_options": null, "keyfile": "/home/ifed01/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ifed01", "validate_certs": true} 2019-12-08T11:55:36.457 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2019-12-08T11:55:36.571 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDoEudQMGBPqfZBV8bXpdQOgVTDP6GFsr5oL4gdbHFMuJCGe0Sfq8LTaSEBQx0MH7tXc7JJ1fU51U7DSt0kfy/PFeV1Y5XnNATiZu/SzdO3jHe06/8CCr3DLnlEmzXASq+tqDJbY1eV011d/TX1jiC8Qd1VNbpdZYExEDsDzwJXnWdh6rjTL4anGjIgQWcmU0XdbUJXvRP4dGjVvZVHZnflAkxLPBbAx/8BBOuBmv6vP4hNs4poi4VLwR6S6Ha1fgMJmsn6StsCVuOvKBJFuGvaulHgHgdoDJ1ryUFikkXXCWoNx4IbwtpQIkSxWMuAovlwwk9G8ozSs+RrFzCavE0f omw@omw-dev", "key_options": null, "keyfile": "/home/myoungwon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "myoungwon", "validate_certs": true} 2019-12-08T11:55:36.814 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2019-12-08T11:55:36.936 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAAEAQDZPRW12u7LvaiynB87ad5h/JFtYIVjkKIOym9Y5CAbvatHhZ9fB1WAnYIn2HqiSSPUXT8sFy8w0TmM+aH0/ZGcfXoe0CdTWLtUbXKNlPI5h7TO9rHXESP2iRBpnKs3vK8WnMY0/D5BeESrPfwVScucmzaDrjUqjdZKR/aEeqVvDpQsdaCaoqNg23t4nhQ54BEvK8O+14nQ26Rtmm40QHO1ze+0UK+7nUMMFwxvd1EKjVp21EgYAFEbyQ5Kbbl+fmS/11AGy/yTai0c4qd7ohBzZvx8+sY+c1novG9Q7LhtyxuuYwzYIrGBCkKH5+iC7nt2rGBP+mnTfIgdbJUiXX3cdrMESwOSZy6x6zgbXXME+yfM0myhomKmUkpeZAQInX2KYrnEuPD9kteyK9tZcG6gJSaiUdvlab49Alx5lM2hc62M4s4WKaIgroCoApd8FtNAlTQsdYuycntgNrbPy0LXQ5hw8K8hkvc6RbxISdj/RXWguQSVbJWdS9Pf5NwD3Tq7dsOghJWhx4vBkhW3IECVrPQWVyAmgQ9oj1PoL7/2LZ6h9P8F0KC1qmhm+pWdEPLugOlU6lzQX7RJcukYlsINThM1RGwbPE4h9XcMyHAnODiDF63TDfQ01oKbVXj9XpOGY5eP0EQxKJYjCfWW0Ot6nK2ZCt8OYvoRkWMGnLv11Nub3NNOgh5TB/4nDvEU1cIb/Ikb4BRzVIEbast/pqUJmXe+GQ+ho7mp8y8a+lIxu54BR+VN6isjwODCVt1DYohgixEoul7p5pXvTM+JUY2GD/ddTGwPvVAN66sWnT9bjZZunQwTHqasFCIHNyPhnEnYIIqCo9O1I/D8zRQG3SYNxT6ED9GPARrE/H0TvdOmKaT3e0F2GRJRSToNxol9dpJovUziojOhXyBUjlTqnMY2RVilX90MnzgqR3zGO0aSruTGyNT2Faymqxn6T/50mSdJ8EyWH23BaaXUUW/z3Cjov+yCQjLY48SOWwlxKXw3hGz8xTAxauBYI01ojsVLCpCUGFyKlWS5iFwiLFtr1KPYqeCoS6CoWjiOiFgGe+w3lPPfp2h4rc6auIx2DZ1ByYhWLeHnpkV7sG+q5ckBIRAYmiKyXSGdV4zbXITMWDm+3zu4oj5VPRCfjMlout8OZ4TQm5PUdKZZhSE1jULG9tPDFL7nWwM3z0HET+d9kQYcEO6QB+ma9gZHp1qZJbXvCIC5fQ9y9El++A6N3dBr+ED10Ye88PLoWPeumyAmc24BDdI0skGk89Q0IzoLqagK6HGhPAso8si9wr84CEi4ncpizVLDU2cFKCpef4Sa03HoMbwfTgERtyptKFRbMT+SpuZsnrhF635h9uqFnszowUXV guits@Elisheba", "key_options": null, "keyfile": "/home/gabrioux/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user 2019-12-08T11:55:36.938 INFO:teuthology.task.ansible.out:": "gabrioux", "validate_certs": true} 2019-12-08T11:55:37.170 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2019-12-08T11:55:37.330 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCpDFqu0Zg94mCjrA0FTB0vMiSBml1pqYCDKHhKBrfaza8u3bhtsmls9i+6U/vIwCEVk4GGPNhWduTJK0h9R5MS2eCf3GJcE0XHqRp/8msUCDPOVSZwC7hoYHZKunUIUaIUajOnR+L2slA/a9JaqataFH7zdrKbPdSKBzf5CXYrc0fK+Fz5OOsaI9KITbM0nESVpNCDzRqnA/aarF9MlN79vpTtvwQ+i0z2Km3cxqwV70GPMuFVo4CGf8pCGpbMrIg9OtoSC1svQ2vZzLkH2WrbDqTfYlOEYJJXaiBKcGhGnLZXfLIGSgvHjpv6xHo63yaMihocyg2MwTS8TZ/VtAaH seb@redhat.com", "key_options": null, "keyfile": "/home/leseb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "leseb", "validate_certs": true} 2019-12-08T11:55:37.525 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2019-12-08T11:55:37.691 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzjJ6nlPn/OXP3knQ6orVId2QLswql9gRetKYlicKDBrdFg0MES03EIuAonu0aUR4NEReR7P1iB8eNnezrHyAu5mxIJlZp0rz7ljcBcTLL+11IJU9I9OjBFwzXGqJ1KK4B4Qfw35oc2O6F5V0JP2nHhHgyny37udJLImhxHy3RNmDwc86JhEBCVR3ouYiZuxgxxbA9BXc6+Lkdu9hEMMCDlaEXwNmMyASVU9Wf3dKnMTSCdar2PANquWbpNQZ5cgoTm39xgust5CEyYJ53aOdrti0DYK7qyzxUXre6ckZGrH4oGv2XrDaxpACIiHXt+slvow51gsZnBRHeayMAxQzGQ== hchen@hchen.csb", "key_options": null, "keyfile": "/home/hchen/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "hchen", "validate_certs": true} 2019-12-08T11:55:37.881 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2019-12-08T11:55:38.082 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDCqZKc+/7iPLhapA/7SYmLxwyKEM95D6eFfsDBNKbEUey/B1OlqYSo+yKB/LdFDyUcd7shMDnhFFg47lNMANrsZdtE4iMPVAa1YhcrTgNbV3HSp9cthKixvU/gkt9Fnb6PEckRzr19wEwxtoNg3Fh/R6YCiSjPwqHmArtC1G2hzk560EJpozx6xylMR5IafatNDoZVw2YQ35fZvHbhHD6meQELducHJ1bKEEHxVIRSTcmXDpBz/vAvBoQOEPuH6PmC/oSwL9HVVIsazf65F4QfK98d+8NCK9TemgXyGDk3Sjz6xdm76yBhFzDQEAzO12U1YtS7Q7zGVsjmSDav2dd7 jcollin@earth\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC89dHSsgjgtIjJ3e/pcMthliQlX2vtdXL7pk62nD64230Fm1PfOVCnzn4LqDhBbGgJT+BrlwOPfzStpLgnUT3l67S834SJzhvSTTpQp2pznnQg1rZOiXjvNhbQwVYV4rphXWqay8weWvFIb5QfXE66mYA1etZtcOb1SMY2ofAjUiA8bAQS5aHpzcMVs4N1A9x5GJx/7/Bj1h8zPpSXikDYasJc3++UMGc45C/AAf725YwijK7xMnZNXv8uTBoGzO/Ko24R3VdvtfMVn4Hi4/FwuRd5bRYcJXR/nUdtA3IinqvlnTpFV2LbfgVTHiUMGhvewRTB+8S8ij4nnAlko3H3bhqZZTk/y7d4K/IerY0mozVIc2x8rMLfqhF9OKv1QFB9fskRZcF/ENHITnmLqCJPg9rgmyv1gCQ5Tbds1OI+IYQIowdiwtaViiTSIy7/CedbHqMz6aDnPsJFMs24lcUXe2d8uZ26RqMinMFGXg0zF7tifuVmxj7zG8DT7MFORDm5f/Hhkng05R5XZesStTBxpEU0MGuzWhENt3RuJdstqmY+wkDVW3XwjUvKG/gVYuJYfnBAsRZIZezw2wfvodhc8EmeHELvY1YtB3DGTBXKE1lsKGN7yV5+nl4UtR2IGzBn9GovWVi5ooB8UlSAeUmZix/eAA5teL8ldFrDht7+AQ== jcollin@teuthology\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeApVHu5er+R9h52RLSVYVhXFQSn/nMN38uWoDYPw2bqYBLNEAAMcPl+rnqHubELpXTGXjJYL4n2mjic+2rOLZpDgPLmOOm4PwgYstJjE1KLegKqVzXIa9HfASKMXaHSgwtC6P5vDQkm2MNl8vXuTAITF7VYdDS 2019-12-08T11:55:38.084 INFO:teuthology.task.ansible.out:33Kkke6ViJRZI7szYjbP7z9A1fy26THrvnuBT1Q18yy9vgk/sKo8vjLQfHSLvO90CJzouNEKqmkVpmJEqCPbE+s6Qr4+d2KY7L6Q6GAXxrqXK1jSDrrPsJguE6zZ1oWy/7XFMOr9ssduFWocnjQjPtQj3M+V+7FYAsf5uqQnzeMQTjO6AXYxTI7 jcollin@stratocaster\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDk/DYRp5E8Dla/4XHCF504X20W0u7CijZSCFWT1/5082NgnYeR90Prth3p+4xsw3YC9H5pEAS3XwcbdUb/NtWvZVIAIcMd7NOOEClSIj2Agk7NJxZ/4SfQRLrK3H2Qli/MVnrTxnEa9oeS4zqzv9dKRwFJDUFCoH2CpoumFVAp02uyzk7D/+XqFrXzMJUiSHXfl3YM2rt/vNmCtHtVp04UcG0Kyl2TXY37frRlSOkMMu0zbIC551gOyae6NGYhkYHa7u2SnngXcKM78b8MDvMv3QtuUN5P4WpH5qFRdlKNKsQGrzcQpBDY8AKQ+rX0K1ENhBwer49bihYNMKvjYmvTdLTNWgPCu7dt8JSgJQ8JMMhve0pjvFdpcKDLp0fvXDvJvZdLJM1ID/66kywJspHjShuqQNXRMfd1R9C4F20c+R9LY6eTGwrpLG1DNEez1VBHmOu5hQl03T2PfaThfLfMHRTw8JpGXGLMQarCCTm1PC6Z2Iw7KzorxP1eofGA5q8XoCbwGD01uQRZrwxPq0SHzTAkW2C2M8oEz+k4Mrx7+vGYzSS14hqxrzk91wuYhZCAKuGpqwm1ouJ4wxvWFewjbxLgucMfGSp09zJ2XSYRmtm7SAUifFob6Z9czHGTQerHCOTPuYqzlap2gCCVYtEvQyNB+4IqK/9FtEXTr28x0Q== jcollin@stratocaster", "key_options": null, "keyfile": "/home/jcollin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "jcollin", "validate_certs": true} 2019-12-08T11:55:38.220 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2019-12-08T11:55:38.430 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDdxi9xdXNBYctMHH1cuuyNcPC4I4xVAeD3HZsKH+QwIILiKOTHu/6HZg7Yo1WsuwYSA0MDc+5LCSGu7RsmOEVpcSQ4gtNoFVwsThDyI6yhsm9WQqqXwSPs7ZE+urqd/BDfQ/7oMqJm5bViQMP0vmBExHuIFagj+8f6nspkE2Z7lBbaw8bEbAJZFx74oReOAELsL+Pbtf9Iaqrap4Z3WysmhfP6Rm/q7mncBBmo/fl/bejhThr8fghTPJb81M+XLhMk/rAdVrGdKV9iSt6lLiWdvf0lpTZO4LdIfJSBXr1Xv+lHRtaGXID2ahH7zl/W6dM4baz+hU7ZrbP+vdKg/SVH xxg@xxg", "key_options": null, "keyfile": "/home/xxg/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "xxg", "validate_certs": true} 2019-12-08T11:55:38.574 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2019-12-08T11:55:38.807 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCsA63hT3ZAwQ9hsvfY+o2Gy15M1GRnRw1ZBSXEiCs9OJku7T9+LCvvH85Y/7V+mOGcsCZKqVTd5Vy3sHAvAF3M7CYJ+5IIDJKCYslC0wkKcX4jj26aMToAZPms8uvs527BNgKOcvwgIfPjs4WJG06fey5AhsuuL30etbAvbBudxRAKdZSTOsMveneKtXQu3Dx7y0rjfI/RBAhCAvisnMqYFUdajoJIl5gVXl6+8mauUOP5O0mvyvJH2jQveqZXTdsIPyp5mq1nA5psqvivWGz2bEJ+owI0GjfuYbyAi6i+BL4Bsd3GeoAs1G3Dicfr228VIUsT+R3xLBQUj3xIsVAZ pcuzner@redhat.com", "key_options": null, "keyfile": "/home/pcuzner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pcuzner", "validate_certs": true} 2019-12-08T11:55:38.907 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2019-12-08T11:55:39.151 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDaRX+aBLjb/h12ctmvoMvZro6NrrYDuxROF6QMVpEVucA7jHhwCC/j9dJAq0hOVBO8R3S0bvKQ6bmnCb/4y2J6tq18xKUFCrChNii5OQ+AgM5v1353oZ9SrHN8p9ajvS8w313o2OpXhpaPv3khVDjKZsDmeH8YL/Nx3WQKqIJC1mI4jrI0sZGGJLifEy3pPkO0W1KmguN9AwAWK6+kckAjMa3ElkfK/xuAqBYgNKQUxP9oMgTQRcgpWF8Nzb0npN3v+HOUIRrth1INSchkDKtWob2T+0Zqxwm+Vpi0iFWwqjcN/OVdaDGf34//A3M/tsiQ1g9SqhdhZJCfu5XLmM63 mkogan@mkP50.redhat.com", "key_options": null, "keyfile": "/home/mkogan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mkogan", "validate_certs": true} 2019-12-08T11:55:39.258 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2019-12-08T11:55:39.499 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC56FiAgzz9aF+qAMkw5aGoCyoSA8Lf2LPaz3QxTYEzmQt0ByXMmVw0cgUI4gDt7hMBX6LoxPALZ7C1aH8aPTpb6+hxHGfir2tqQmU49JOQiUvBP/Xtt1ilxMou9Wu/ZadEhIZxaP/TBncXNls9cbFs9bV7Q8J3CLCTGRa8kilEpZ7209c/xQI4yQ6q+Q3H4FkO0YHP+Tkn9mg1df+BKkXfSBycjAyOXPvljoetjw0FHEbJ7lTCcSG+hCb2LEACo2OK9eWC3GYwDPKZF1Ht9HfDvg4bHfY3OVOixYiZSim7dbj3+VHWWsiH64usGH1o6fn4vV16UhVJiiicPMWvllzH vikhyat.umrao@gmail.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9G/I5iaw5d4ssyJ4iTUxSvIBAX+P03VVHsNMHAB70rVGGwBnBJFqJNbukzxfnsqwzN6vSeuMy7I1zc2VVi4GtBQPK0iCbVQN+Njq0VCIxb4hLmjD3Vn8NgRp80955VJyYGT9+/JbZY1UCdPBuld6hsnTipkdo5U3huAHD4i1FpYKol+4DCZHAO5wNilCbests0+ZPtHYe53vnNDz685cx/f7RTtEarvU2fECxkurlBBNvuIl6SN8bo+NaJ01Li0xAD+2fpGz6Iu0WUEdWTkt78ubvA4If2k8XAKxkOKEvfyX+AtTzdHxWSQu7ixkbuksuK6A0bnankn+DdiP6Y293 vumrao@redhat", "key_options": null, "keyfile": "/home/vumrao/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "vumrao", "validate_certs": true} 2019-12-08T11:55:39.628 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2019-12-08T11:55:39.848 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDZDKRAePFqjugc2ljw4QmM6r7B2dPI39OBB+2HKONtDZI4q+uwgZ1yqnhrbJaU9ux0W5wNzJyp2VfOPhw/9G9jo+efJPg5IySnTonhi1zeCXNpBMY70dJZVCyGEDdWKehvFM9xFBOxBC/h7gOyKqEc28BKoy4cHfULzm4er8PU30MyFBngu8NaoKqyQ3GYAfWOAXF5lUdalbJwl3a+HBb8PjUhbGuznAZF1Ji4JgnNuEZdlNVOKwhEkAFZ1JwXvgLfrEJVQs5b2V9Sp2Vm5ZngsLg7b3RzV5I4B3Lj7QTTraV1zLJGiS5iRdjY7D4W5Uxi2k1X7vaOjySJWWadHyeicNNBhLSfHl6JJ3aMuA8oAAmtgo/8IkJ96GFtgM9j31Wg8wkeTyQrwSeqCuv1uDFr8rp+OvMClhHnDgUklJLWjjYPCDVYR5KV+iOiHL58WJg/b4h6NsoP91wO8P8EcSaiMdq7P77w5nJxDI0KKb//dC8aHtWnRRRlrIS+PNPqKJSNTaSwOTieXvzplhzKFzu2dr79qs+/67iaNE6HBvIX5jVHWCFV3wllyjsC8WYPh4kEVtg2SY00SDOOrMrqANV8DDtHFwwxQTEjz1z5ESuwy9UcUSQfP1/zsAp2OQzPutKs6UipHyBK3pLm6MjaeeaEWu8fmetCqALxYV3h17O+Yw== miguel@hermes.olymp", "key_options": null, "keyfile": "/home/henrix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "henrix", "validate_certs": true} 2019-12-08T11:55:39.982 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2019-12-08T11:55:40.184 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDNwmgnIsDDJmsmYzkTAEo3iLj7Jd5Ni2R5vD1Z0NRZ39zJMtbicZ0ec3nAMzFyHrmPnKNFltS1mhehbLbtKNKq1fSo2SMHs11z+N8Nl94F4AY8IhXZ8U9GAorEJFVIxHUNEDqwl55Ov6MfP60UI7rNgy2rUt8aOBmAJVhLEFmJJawJgyPhTrUZAT20OoILphrt81o5bTNfmx++Zs5Dc9VtgIh53hexwKgTvG6fxfKdra9m+J2GXpniOsZjPJq/A0je+t7H3UlxCSu0dRy2Un6l5ZAcoeg74SP50dFgGaxkTQqI6wle6NjtPIdssgrdYTgTcOg9M4jWqAr/5drTUSGh root@centos7-bspark", "key_options": null, "keyfile": "/home/pbs1108/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pbs1108", "validate_certs": true} 2019-12-08T11:55:40.326 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2019-12-08T11:55:40.551 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDnvVnbK2SNfL8hTmrA09L41RudKW/F7Ty0vvlHjrFjDkdWXVgrafFWGKQZ8dSR6FJ9JLU0X59xiEo4z31ini/Dt2XozFMIr7RdeB3xpiifuUUG5Lgsasd2ezniUoOEukL1a9KkCIxNgmKJuvtlHCt+ZTtyL513yjRICByZbnmBSSpUiett50X10vtvaNBu4LikUJKLc8gP0PHLbaGsU3uOUd655lkFWjWhgExlU8bHWiAZq18Ss63jDlSKFVSk903GKSNcHXMHNPYaXlrYw8NFzejoy/XjxEfmF/Lv3MeAUhHQWx25sh5aDv48mzo8FaIJsL1MrD0QxF1gllobWAfp clacroix@redhat.com", "key_options": null, "keyfile": "/home/clacroix/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "clacroix", "validate_certs": true} 2019-12-08T11:55:40.692 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2019-12-08T11:55:40.944 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABJQAAAQEAyiGmj+nOAD+il+FvXvZSpUOJQp6hKh6UPaAIQvQZkdeNRWN7wcDXMUlLj+TBFWa1OO+9xqFlnbgVMDR4qy5orUBYlMapUb1rutjbk64XeY58b6uguHwSoMd81QpCCIN4KOk3cldV8UiyX382baoZ9Je2hsOnnBGMsRtHuVHZ90Bj1rIITkwajq//KRs7kjb/qhjk0xkipDIcaSwKjzPlmmnYn69noODwDexpvLYlCF+LowSZEdrOUvVIigSFG7cLTDaU2tLhxSgbvWu8f0pwvjsyW7gOgM+VeRZ6uHC79F1qvgdgQSxflddIgrQpH0rzf6RNxQjR3SBkZ4V1BESa0w== epuertat@epuertat", "key_options": null, "keyfile": "/home/epuertat/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "epuertat", "validate_certs": true} 2019-12-08T11:55:41.024 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2019-12-08T11:55:41.285 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDRZyWiDO5JqWHJdUUBr8YReiKXxnL87juFAfkcmw2E9KmANVH2sn3K+OgUCQfBs1Wdg6AbcL2GyMm9alodUruzOm127/bH9OcGmu+8SNsMAYrAF9EzsKJa8Ba/I05rl5a87p1jbYG9Rpo7u3OvLx0LjgqydRYcmjwo/niifYNDTaN0K3v8s1mN4TorUZW/i3XBMBIBjlIiNGs/I7IZreR+1N4V8Nwrp2EWxDv7AwG3nvokL2RTHcsV0KgmAnciv8nXXjIf+uqOPuGA+F2qW/wz92bG8R0O4CjH+QZt4k6UoUIXFRW+LdOVAqmUrb4W0OJ8vsVeukW46SvPnYUTkZnF sonea@think", "key_options": null, "keyfile": "/home/tdehler/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tdehler", "validate_certs": true} 2019-12-08T11:55:41.327 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9/Io6M3q8yQqoPNPKAPJ6Fzq18DMfmNtxcD8GUWNo0xcMxd7XOlarvYc7INDQjkpzx6s+aqMme55pSUZuN5plW+nuFmRPqBaIxyeCnNjzCch0wbtEZe5dzT270FhzM1Tu4W0dw+WD6zrGjXayLNs2uxNp3UrWtMTBRzd0IfxJ1R2aJtiCE/HNxIZn+bhS/OmEPV1izz23MvKXD+nRaeJK6Aqrg1zbnpoNskz2fZ/AnmhnAMc4EHl/NUyW1mi4g81KcQMwE8poWmw1NpZje9gWFcISVClLvvhk/A6at/v90P7PisX+/ulTA/QYJYvGBjgbNtURYu/PWzYBOAEZQGfj shilpa@dhcp35-184.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDqRSG3i8QY7t9sp6I8vDZ7LVdk+DDrMhI1QmvU2z+YQhUGDBOvvO6YP0gUXPDyalyj0sJXiwLWPmkrOsbnR96YCUcIt7Ba6R0d0w85JxcJ1WyPcsg2UyOBwq4A+s7VAFZm6FEWzlaubixsNp04gKDqBjSjaqA1Kwx8/Tg39byay8Hn3VJeZ1SkRukvhykz2e6gl7ydfuJQVmEyO3pTrd5157ZqgvQRABT10wc3vR2m4eC65hU/v0ci7HMY9oVtGEdWVBapWMuiocrOPCRWF5zrMJwW4vzPOCHa/47hBEIWfOWJidUVzAawnM3nOe7PykvvDK/iP8B6JpxKTE74eLeh shilpa@fedora.lab.eng.blr.redhat.com", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2019-12-08T11:55:41.656 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEBD7CxJJfbLW4jtuLnTwkxVbhCfh/JL3Qj8oeLEkny1tE7QCeXn1bP5bScWSgLH34Wh4TAuH+8/g/koFwcCy1YuoGBdBV4KV7O9MTnFngdqNY6LKzCipm27tnWZEa10hrF8dRFTmhracd6kmmVGHgvGQPVAVONmix+2IZ83wdj8XJSQHeE3PHFLO39tU+ez/T76QaiBLDVo4ctHVt+N9bBbHV6Cr8fyiUUU6YEKMlcedvxGpnMK8oeOSNuDeh+DldcM9KYzNGEOM34jGRIvJp57dxQDQCtPPW5hvBXg7yMyrv6TcJzDd2LFD6AC/Qw9yrEQPXXyBCDkAlCqDR0+rH", "key_options": null, "keyfile": "/home/laura/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "laura", "validate_certs": true} 2019-12-08T11:55:41.678 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2019-12-08T11:55:41.994 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC2k8xsrsLxEqJx3rV6ZZwLH0OjYCDB2uIYzcAyrKEOKlVWO1ICKxkw+gZ9tSiPFNLfq13io9BIrAKJwlrdLCJLmlgCQwpwUQqzmRlRZEm+WmD0dl8LPeQSidyJkPkJgYBEshFPjDHIj10Ei1pJS5svI2l7G1wMWxlt2kHL8Og/4zdFTRctxwqZcvzLmRQcs8lSSpqTkhfeKfmrpR+je8XFbCJJ9m/nJbgyCiZKaGN8nf36pCQDEva4rvaSrK0a6YxL0RWN8W3lqtBPKIehxffr3lYDEkD9EUW5vf6AUKC0ioh4jkPo9WCjaoFsOauMOMVQPHehEAMufEO4Kym6nfrf yaarit@localhost.localdomain", "key_options": null, "keyfile": "/home/yaarit/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yaarit", "validate_certs": true} 2019-12-08T11:55:42.025 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2019-12-08T11:55:42.342 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDUznqo3VDmcKRL64P7sbjuxXCW/0ljFTc5zZoZ9UvtZvU2jrRQ2X9GyxcrcQnAWlF5YZHqeTDU5o8ixn5fq1MSmaPRBNDKKVQOfR/vFQV73LiKx4BFsC1/EdaPie/XqltaLDTtfqhxADJlz1H3a3ZlkeVHMROTqo/TidL1YUYlRH4qHxWWBuFuVS+EYfTegSZdjwp+DuJA0iN6X99+DfH2DhiHENjEmlbKN13+H+EPzm0K3ya2w8D6ANodB3AxMn2tGs8mLtG/P4kCjoDnoUVFzKTyUpTtgOjis47uSY4dL8mTbIK9kZAiFxnT5sMClu6KRStDjRIrxbTBQJ8wvlat admin1@rajula", "key_options": null, "keyfile": "/home/rpavani1998/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rpavani1998", "validate_certs": true} 2019-12-08T11:55:42.387 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC709gIxs1RgiA95ddp2uymzgV84VHJVVMj71FyTlz6pa0gtlaxF+r16p8dnNWjhyJRUXMwBKFOwHx95bcdfiRA+BfC04UnI8VvBxoED5Nt9EbKD5h78ZoNEeQJKoG1dsM/kWWlTd9WCsCyzjRz32+YNWul0LOhrfloHP+LHnfjf/uOnzd8iRHgnpWr5Z9uB0MBu4y/L6AmHnR+8pMZQq6Bfno8ZLwNCzx9v+4MqOz3jY7FYv7SJIftQH0fJygIfCz3bKyUEWk9a/JJacETuJGBnHgNAXUr/FtM1IFiMl2SsTixRgnosEz4pX8EIe5LJyw/Qudro8BPEC8aIGy0XAkerGmTt5iALMnzmeeanZCFm4rF/YiFoHLMS/B0uv42MD64hB3knrV8Bcq+mRjwVOYgecO+xoiBsU6FZeXaBk5IsjmYTwataGv3ILEmNpss0WeqHxF9nd7oTLnw51cZfcaerOnJ5IZJZTXwLNVr7K176BunHggAhjvtvwdeKhphqt9f3ilLr6gzksEoAR4JBOYJJtd8sEqHwBtti+YbMGwH9Y+Z+SujlQBQIsom60xj5OzrwjsIi5JAtOhbc1Mq2fptSXRsR8ZBT8aUFqZ8R7ixEqq2F47OAznbhSQKidzwUNkWNI3WAKi38Oi4aya1k3iqtL04bGf8R/xD5Vq/2J+UlQ== vant alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2019-12-08T11:55:42.710 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC4NYxUHx8HMgbVIHadruN1kAJS5be0aZA9rvGtYDfwD5siKNfXFRyLG3thkjxtEi7DPYMxgbpFOXW9EQKh5sQ0ohsADZOi8FSIAfQlOQ+7HAEp7DjBtjxoqB31jJ1e293YtO+nqAhcOMyGfDx+71w5sS2EFqy7PscA9gD9aV2iMxIR/JD1LxXabiqj12jU5AOxr7ZQ1+gM9aroQuDpNxY4U8jBTxx5OtIYRkeI/aN2gQj1mXGMKGo0ItFn4lsXGLxGxMpa9K2UFw2dWQVTw9VNm79nixrCX+lC2nyaJPsRYZipXF1ID2NRk7oJ79dJ/uRBBXpunihlEC3aF+nOgEPH ridave@redhat.com", "key_options": null, "keyfile": "/home/rishabh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rishabh", "validate_certs": true} 2019-12-08T11:55:42.764 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2019-12-08T11:55:43.081 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCeAhoTum3/VmRbxSyw5gwgcPF1EWFK5mEPX3PZyo3xPsUAJazALfge3aEuCrZBbsjOCoj3GfFhr/ziEF+OWvhBoPK5hQzP0V8tE9cWJwvHmD72vGE36o1hFO0ONE4DEuu5KRDqQJUgeyQWXsP26uHTwIcvMpy8egZOfyshqF+lQVXzsAex7Ninmidsf/sRNLhzT1kLrKT+ZMSbZ7Rqh46TMlmLD1LzJZNcb6PGVwlfQZmV6T7m0COu/skeSxMcy8hqMvHFNvvfFSqkfMw0KBGLDxMQr4L+e7sXwQDnEZHdzoh0iS3xDp/Onr1FSmPyEjz51e1sMHBsqklHWidSZVLt/+giB4o6Wdgzc0um/QxW2Ne2qjtDlViOgRE9Fzcw/cRu/Xsn8qtXTxYyxXswjkA8qX7WR22OYgjYChw9siUsKkuD2yAbPMVl+cZWDeBhQnPMbDMVaghS4SAVt5GK16jij4+r3IE9vGHBmGwJYJ/OrtcxBrUrDopwsGLcU+WHdv0FXuiw+YbfnzpthC8rVj4oeJ2IUOQ5JB0ub7NmbR4QWjc33JfD+AeCB75x6io07V2riRjMD9gLC5nwytJNG7Yytf6xI2i/CprW7HhsDs2ykOVcDSBMnL1oGW6FeHaDRW39r6BXSt1jjZQ2E6pDEBTDO41tPEL9EVvv9TK87GTylQ==", "key_options": null, "keyfile": "/home/skrah/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "skrah", "validate_certs": true} 2019-12-08T11:55:43.103 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2019-12-08T11:55:43.413 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2019-12-08T11:55:43.421 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC9/Io6M3q8yQqoPNPKAPJ6Fzq18DMfmNtxcD8GUWNo0xcMxd7XOlarvYc7INDQjkpzx6s+aqMme55pSUZuN5plW+nuFmRPqBaIxyeCnNjzCch0wbtEZe5dzT270FhzM1Tu4W0dw+WD6zrGjXayLNs2uxNp3UrWtMTBRzd0IfxJ1R2aJtiCE/HNxIZn+bhS/OmEPV1izz23MvKXD+nRaeJK6Aqrg1zbnpoNskz2fZ/AnmhnAMc4EHl/NUyW1mi4g81KcQMwE8poWmw1NpZje9gWFcISVClLvvhk/A6at/v90P7PisX+/ulTA/QYJYvGBjgbNtURYu/PWzYBOAEZQGfj shilpa@dhcp35-184.lab.eng.blr.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDqRSG3i8QY7t9sp6I8vDZ7LVdk+DDrMhI1QmvU2z+YQhUGDBOvvO6YP0gUXPDyalyj0sJXiwLWPmkrOsbnR96YCUcIt7Ba6R0d0w85JxcJ1WyPcsg2UyOBwq4A+s7VAFZm6FEWzlaubixsNp04gKDqBjSjaqA1Kwx8/Tg39byay8Hn3VJeZ1SkRukvhykz2e6gl7ydfuJQVmEyO3pTrd5157ZqgvQRABT10wc3vR2m4eC65hU/v0ci7HMY9oVtGEdWVBapWMuiocrOPCRWF5zrMJwW4vzPOCHa/47hBEIWfOWJidUVzAawnM3nOe7PykvvDK/iP8B6JpxKTE74eLeh shilpa@fedora.lab.eng.blr.redhat.com", "key_options": null, "keyfile": "/home/smanjara/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smanjara", "validate_certs": true} 2019-12-08T11:55:43.780 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2019-12-08T11:55:43.792 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDpp2NWr5T6s+jzHiz/FfCKzN7ZBnUSzyE7ieuntzjeGotyupAAjVBoSpCJgNDybm+WkE4dShv5mttPJ2/q1UZCLRj3nN+y3NG333aLZuyugR0ht5qtvGVegg58PwQ8CMobR7ca7bl5UdEy0UIrM3d/qpDOuPkuE4MIJcrtZGICE8NAVnmHNOB9Sm4ovAYkewTuMAv40j2Dl4F9dD6bg+OJfBOJ9+Zj+MpowYlAILtEB9Dc20zB8GGUEtr9yfOVroblTYhvTxGYRaE7aVBe83DNwkWGbDc/qUNR6bpA04w/P+LclYVsVKRoHOs1EXHSwNMFromA8RsKS+rajwu5uRg5 ben@dhcp-185-182.bos.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC93wGgyyQmTxa7f+BZcYPUapTH2N1mnV1ikl9nzJzHhgrtJ6pv00LhtH1HqGhvoqnqZjBD5XRAKyjMRcMBT5MYcXXep5RqZ9sJ6Xz8rHkBjfl/OOQUeZ/ZyG/Ksr1jpGraN2xtrjQQzbqN1YvirCqfLk2exPvVeEk4CGnNybwKwCWob1uKV46ASrYeQK8pfHxrW7pTo+xdErHOvb7uumZm89/YisUJGicO1qSHBeuw1MxjhnD+fIcxHKWY5NNJ4qScW6a5AABk1JJsoHkh9IGCVaf/zJv8D3gil5SiM8LIBKaNa1fn6oObPl/Ky/wkiIo2gmUZawvAVA8iJnX9eUPl ben@bene-laptop", "key_options": null, "keyfile": "/home/bengland/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "bengland", "validate_certs": true} 2019-12-08T11:55:44.126 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2019-12-08T11:55:44.168 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC3YhI4am/T6s4rJRvbC/jAvrNcDhE/zaJiVDAjEuA1W/5Xt9ObX52eAnp+tOOtelXrX8ylYF/z5wGNQLjYrWepXhuqaEGxeVayCHzts6LMpmvyZ6sYnAw9HFO9rzrTawm70DuvWqY2Zt4KA6fM+lfXk3Qdpi5RCPDKk1jpXwSCyUtUKSWTDRtYtvvJTcO3H/xCJxQq/F9sU8yqgQcqFPfMNrV4a8gNj9KACqjt4IEIfuxKlKhlMA4yu1VTmGcNuhQS+geJzsEGuxZUQb0Io+q4o0b+40BQtazKgOdTcQbgNtqh3wZpjJsvB4AM+GNPjZY3mCsd+WPGg6dqfU08Voo2b7BfSwyCn14fQHnj1nSwRIea2juFY6AMfVJjstM5iIz7lOH2c3ydWWhzvSmMeoQ47zBXlg8JytWmDrXiyd21BSIpTL0Tn8P95wHYka8U9KRV0ZY7Jr2w/ThPdy2C+Cdir+P+OEL1sKHSnmEyQEeONa9P5yH1Rd1kM/FNESAIRiMLGspzXQeWoJhHswVaKoSBW/7f4b9VENxda8qAQi6ob8A71cAjbpRrkUmd5EBCSFMNs7lscus0/deUVvlpsrMjDAJa8S9gqhGHNU0YvF1WBIz3paLRAHDm9DWrHc5lreizJzX5ul4P/Z4ITjpO+9ZxKOcyi8wnJ8Og+QUYLpqOIw==", "key_options": null, "keyfile": "/home/pnawracay/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "pnawracay", "validate_certs": true} 2019-12-08T11:55:44.498 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2019-12-08T11:55:44.510 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC709gIxs1RgiA95ddp2uymzgV84VHJVVMj71FyTlz6pa0gtlaxF+r16p8dnNWjhyJRUXMwBKFOwHx95bcdfiRA+BfC04UnI8VvBxoED5Nt9EbKD5h78ZoNEeQJKoG1dsM/kWWlTd9WCsCyzjRz32+YNWul0LOhrfloHP+LHnfjf/uOnzd8iRHgnpWr5Z9uB0MBu4y/L6AmHnR+8pMZQq6Bfno8ZLwNCzx9v+4MqOz3jY7FYv7SJIftQH0fJygIfCz3bKyUEWk9a/JJacETuJGBnHgNAXUr/FtM1IFiMl2SsTixRgnosEz4pX8EIe5LJyw/Qudro8BPEC8aIGy0XAkerGmTt5iALMnzmeeanZCFm4rF/YiFoHLMS/B0uv42MD64hB3knrV8Bcq+mRjwVOYgecO+xoiBsU6FZeXaBk5IsjmYTwataGv3ILEmNpss0WeqHxF9nd7oTLnw51cZfcaerOnJ5IZJZTXwLNVr7K176BunHggAhjvtvwdeKhphqt9f3ilLr6gzksEoAR4JBOYJJtd8sEqHwBtti+YbMGwH9Y+Z+SujlQBQIsom60xj5OzrwjsIi5JAtOhbc1Mq2fptSXRsR8ZBT8aUFqZ8R7ixEqq2F47OAznbhSQKidzwUNkWNI3WAKi38Oi4aya1k3iqtL04bGf8R/xD5Vq/2J+UlQ== vant alfonsomthd", "key_options": null, "keyfile": "/home/alfonsomthd/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "alfonsomthd", "validate_certs": true} 2019-12-08T11:55:44.851 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCoL9+aMxLtUG3aRIuT4kbjc1CPuQ+wbS30ocuJ2YIExlKMSxVr+LYqbjcz0T4f8gAKG539dZQgD9BAsHM8yfOVEvei0KsQHn87pzgYGR3DtaMx5IEG5xNyARPu+VuEoe8qlL3cAPwTiaU78datD5Cz9GEClhL1Fhn/Z8o7BMbs5xlcUIQ/J+s9/sKMcqmmBJy5IHQIEUHCl4SFwsev5g5ADlnLNNxjpalExuBCEeoSma9F3b2YEJHvpA5JhCIMZpVfXbgh2UhUsyfAQN6KgOIQ/XlKBMQDtizf2vZ4b8hW4ELcvKSADfTsyyqEs/Ql8jEJu32GFKf2mYPbgTS6E7FZfQz77X+5OBhojFAstB8LSSrH80FrG1gCbVZLnW0jXcSehKnU0oNmUWOKxxaT1b00fo/iZ4P8O1uJRY17/uaVCPNKdGTZzIlzyC16wsFFBxBl0d7HfojQY6qfww7AQJhvDkV2sP0/MIJzwriWOzZEmfr8Osqery5vFiYcSvMbdMZDfMEYd3z7Va2RiTIeyXuEYp5hzf8eyJRP/f2FEw8/BBrm5JCxeSWUx7qwgPHrJoWAVxCIg/M3YS/vfVSFc8Hh88sgc2upq0OqYr0uq6EFzUZi4aoOkOVYn9u/uc/p1AR0KbiQOkERMUDWTyADxrHaL0nQmGy+XyiJQjhq5ckZ+w== doliveira@suse.com", "key_options": null, "keyfile": "/home/oliveiradan/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "oliveiradan", "validate_certs": true} 2019-12-08T11:55:44.872 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2019-12-08T11:55:45.200 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.lo 2019-12-08T11:55:45.202 INFO:teuthology.task.ansible.out:caldomain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2019-12-08T11:55:45.255 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDh9bzZJulXGES+l9Xh6Aq15RZ8uQCGuDNhlNQtDblE1ISKJ/DqGYXp6wUW54+oVNA7eZiXz+fi3mq5pPEtZZOfd3ixEDzDJ4E3cVXoDZCqeWEmea6KvybeY10YxvB56TEI8U2KKAd56PRl20klXpLCjzXNqG7n0aXFcpCMbXDu369VX6lOk24K/7++7Wc5SttcvVu19sT2kqzsB/S1Y5cxiE6RM6wVtqBoksp/kRCIA16ruNwx3GUabDfbEoUGXlkkUP7+TZgAbHtBsYy6mCQhwi0S2+WG+HhHDUPjHhV+MdN9ffibCtOEGo52itVLVky09VeBocuA6H22JDGXPBgjcgf2NsZIqcKqGHhUkXmH92fhRSFOBLKHstrBq8jWRP/mNrgj8cQksDsakQYQbDg5dyabp+M0/iL2Q3YVq7erZI8aZMA7ZF3WgoQNYZg5E7oejM8URIlFP3x1ne2ClRC9a74phSCxeU/NVamGN3G3dImzEXGOSNyRggHJ4jGrIGc7tLPCzmI5OkomcB5OxReqf0r1TNXuUAqw8M4EoWt+0xoAmH5zVlUHf+psUCJIEV/4pbgtoJiSNq+LVY4jyDEFbvTAL7MqyXorMV7Tqlj+/3d7RXfhW9lR/SHb1Z3jcHvz4ZzYMzKWeJEjz+Y0NwIdFDhcPmUOYtEDmuRRrgYiSQ== sebstian.wagner@it-novum.com", "key_options": null, "keyfile": "/home/swagner/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "swagner", "validate_certs": true} 2019-12-08T11:55:45.561 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfb 2019-12-08T11:55:45.563 INFO:teuthology.task.ansible.out:smXq2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2019-12-08T11:55:45.594 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDzYzqIDimPjMOUOUz1A122eV52fl3mgGgNBRYRlOWl/lOxM5oOat5FPkJlnXTVyQFl0MlnYgIv9fTnjHVTM0wFmFUItlUl151ZmK5XExiGpGVsqG3UWNyKJxZpk9Uh2a0T/5CKzzwXnv2fJMNxzfqgopYDrgq4TFEZcdvgWJ39dcRTXST/rGJQ8wOq9z7UNzKU5VOGxvgi6f/nGevGIHrSaTcY3Uu8BW8kXUrf9vfl+ZSxVjuNHXF/VmrJH5Ne8mVu7DzPMrl8ZZjxsfJKT/eQqF9kjqht5586OSPKIwg/LEOyYj7Wyyf3QbDAIp5bCygQfmBBl+kIxphJYq3EwUZT ylifshit@dhcp-4-102.tlv.redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDFgwQYD9amVSYq6JzjHyGmKBJATQCM9xsf6QnF3yb0Lvry2nzY9F61evVXQ95TmF/AqasRx5p2WansIvegG5ag5mytvRwFXtHzPs4o/J+XjA9o4+A5l6j9cOFLIDD/TwrwlUjgMa2PhqUztSpI1op906391RLrJAyflfDghJxeVl6dJab6TEsslV0W+yaCS3BBxMXXrCbxCB5Ms3KCRKDz0DqbhFc+Nw05L1O1pC98HBFRIp1SaXlMcT3++CRQ3wugpOMkDMNLbycl+vdMBFY3UZ28rRowS3Ta7V5EARZVVH7KxU5cL+8Hr/8DE1/ITOmrluaEZ1KwYgoxZbZ3w7Ptw0FK6aiCZ49YtqKT1WakoVfO8m7pCdxkqUOA91loMQtxvCwZ/Vfoxaut16gklmPz8N11xvo1H5XB8/ZrvK5yKdl3JDl+wwtfE/fwo4E/fte+rPRisoWBRsmsx8EGxs75sXnb6n3VjZ65vYEKsNMLg+5EAaevWLLeqF0a42UWGJrHdb4VKX/OAplHrOk7kA/VwArow8f9n+iaRp2hgDU9OhQiFVRhgqwahlmCFFXkcP4/4WlxMCuZrsaNMZgMjVhfsp7cskKOezSfZZey2MB2fREMS1wg0j40CdYRn4jTNEBr/LVszsoM7t7AwXUpnqXeYIe+gePx1PJb5XSzSPZ9Pw== yuvalif@yahoo.com", "key_options": null, "keyfile": "/home/yuvalif/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "yuvalif", "validate_certs": true} 2019-12-08T11:55:45.902 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz1UnJy64hXJKl1OsqRPlZ84m/fyHE8/Hqimy5s8sWcvRs2tL5oK30zFataqv1BC7r46+9t1eGUIRAuBg6QPuJnJCnPzS8yTVJ6DqSDGE2NAnpcMK5fSb+qgQ2adHFkjzZ4eKZbnDJMjYBtpUEp1Ve2ncdq5YCy6hGLIstkGq331ULBc/Lm3ZHBwy5I51S8eldkuP975otBYSPZaaN25QDncZzrW36zb3VwoGUAANEfHC1kLgTTFjx0bdsAGYCduXzyyXls8qSv9gbzcRzZZoH5B7tj8VDBoHszPnqGjGqwtWaelifYE/Svp+8fJKLlzRUM+XGNZoNcRl1/1XVhYV/ deepika@deepika", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2019-12-08T11:55:45.957 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDXa9uTf3q+7tGnHzSxv0WbgpRKrBIYjAZ5x3V74vQUSD1aAbmyvOqgPnts7XttLYImjjRqiisyC03L3KgR4b3SOeyL3KFxrk3KkHAJ/AJH+Y/UafyDhHNl3gRNg0B9rjsa7h2dSlcrFKnAX0pDY1HapuNPrzYWrXsEbo7C6wteFh7PyPmTkHu0NzIIPC4FcLl8SGaww/HeBh8v91IymgFSgXG0jNC063FEExWdti54yNLGh3gpW0FytsiRN9eEOKUOgcveT1tejz9ORv8evO4Y9SCQ/lsyOKQKNcG5C7J8nsbwSjqQ2cf6i2aYFZ0Oq1UXuhJ8APJCoiKgLJy7AiYf kkeithle@dhcp-100-19-89.bos.redhat.com", "key_options": null, "keyfile": "/home/kkeithle/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kkeithle", "validate_certs": true} 2019-12-08T11:55:46.237 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2019-12-08T11:55:46.303 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "key": "ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIBYa5uEOlFv1s9K9D1SbcaApLwX3LBwASSnRXDHI7MtU paul.emmerich@croit.io", "key_options": null, "keyfile": "/home/emmericp/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "emmericp", "validate_certs": true} 2019-12-08T11:55:46.589 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1q3k4RvLLCaG874GDJjja4eYqFwrMjsTU+aRzambaVuCmAJT3KQMGuwMjTuCIN7R1Fqr+/dxUClamsfsGqPMe0ASHT9X/0AyNgEkr6na1Fvk9NAwAFelwtiRIHhclzYf6KY8QHZN/eBy43prVKDXd30b15gwQyVqU0/xmny0GrYCN24k3N/R3divt2GVqptYgEwS2KEyFT5EMnJWjdIVG9mBOHrgec2VF/rc6w3BZ0s56iKdpOeCgk5ISYTcom+Xrf+fSDHirlviZv05tBP8ESmampUT/EnwF8Mdaln5XJvZPhrq2JpUisi9fVeR+zlzg6gRGubvokdA3AERrhCQ9 skoduri@rgw_vm", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2019-12-08T11:55:46.676 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCj28V9sMybkAzhkiaNiDDr8TfNVyr5DNdbOqszdGEVLy1Rxh/UYnxUclsR9n8lt9VnCft3M4NDTnVwlxOHE8+0oolJE9HP+DQomsgj3abP04EGJyOA0X8E7eIFQNLRbMFCD0yX/SNNlYPsS5fPTFhIa/gbBPmDBE07kULts66Tvc0Yo/2yIfwV1DV34bcWWVGi01XybIHBl9qbvlfBKAUrFEcv3ZdpHNhuZw6IkZY8xoYxo8iF+toLYeGX+gFxqCZUUOO+NBVmb0hVL1LI6bU66IrMOQDkFurqpvoraBTJqwZgXvMPceFUkcVIH4Nm7cK1X2WyMtnSw2XBpLMT8C4V mchangir@indraprastha", "key_options": null, "keyfile": "/home/mchangir/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "mchangir", "validate_certs": true} 2019-12-08T11:55:46.954 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2019-12-08T11:55:47.033 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC1OVCo0wMITAp8PNUqsTRPFz0SuBL0r1RzKFJUoxQm7gsP9qttZUQRlfiuZ7YRzkuGLOEBngPuIcV995o0lZ0+LVHA8jxWEJamb6sM9YgnonbGKDHfl4lT8LJd4YtjcWnMGvUUdPiPgIkfrpxXtx+RzJ7eCTmgRjAJziZrRh3AqXuKty+s9MDnmK8EQ2smpLdkMtZG5W3U2PiVaGgq2FIIOAoqr58xGqFgZ4tIpvWFpNxVsDZXIg2NdC+ouuKQvuJRWq9eERRHwq26CR+kDFNZeYSyhYKxNBqauLCsAoXNFCJzrdX5Oi9Ox4lJTsEtYX+SMziVipQS54F7MnRAUccukQ86IbXz8C5Ok2EzNo6smwRZ6UPKRvebWjIvfbeR/iwPRnrWcNgjGcaTR6yhlRJh8pBkW84nyY/bJa4WXsoNLgutdsYkjl18KKhbBldjdf0ovfL7FVgqYfAo/wpQYJJeMebP5QAczxvZIegjHRrAvbs/nbQTmuAkes3WL1hhBjSTwyIbWCzAuBJk8MNTmeZkVBvub7XoIyIySppfoJC/1a+ZsxGkzAlgrIxXPYrrBzTtXd/9YRiIgCYx3UtfdbPkE6hT6GblH6ST6QESfWyyvfGxwlOmu+F+icRyVVJbgM9T/PD2W6I04u2/1mcfoHwaQGdwvbbBkbjWzm+zwNSisQ== sanupkri@redhat.com", "key_options": null, "keyfile": "/home/sidharthanup/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sidharthanup", "validate_certs": true} 2019-12-08T11:55:47.280 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2019-12-08T11:55:47.402 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCkeYXWjU7wVdODC32U40QRFgFH7ZEuEsOeWWaKx3Y5EBuAcwkTHiF9Bq/2mrDu+c9W46S8L38Ogc9GZ0DcCXtN/Z4z8iKOIIi5U1GzvwdbKuiAPCd8bdYP0vo0MOIRgylJo5hcnB5BCwCXRN1hmci1ES5UbSeQg0rydMiyYXHZ64AT47+qVUpn/mVP6PVw00pPqt16l9YxhbPFG74Y/WnY4FyrqXGQJfv0tcP7+UR7GQdFiI4QQV3ZUSRHRLWGcmoiiOmGimLhtzEmP4Jzy4gF4wg9q8jyX54NjfxDRZs+YuaoqqWKz/HSz5ic7W2RGKHrRby2N9wNu19nmC1NzIn3 varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCW58OUR3pniaYgvr9xAExeNm4eMxgaJfFbEfEYPztTWv/xxqqihBYCeFltfgWbu7ERTy+hVNo1PJWyyczjl5Ivc3FdRmhykosygs7X74PPh02c7Em4MsSTr7SSPNN20rkJbWqiYMMOBbqbiZ7JXiSUNVilLHgZqZBEQc5Rf5I1PyBLHHJ2ZruPKnDPHCRLdwJ+MdXy2haKmGrQLhtzIKaDzh8VkfojL454k0aHCIh34Z0oBdP9757mNuYJUVEkKZF5t2oML84lWGMgwZxUWN2yO9ALTti4tNH1fXA6NipS9ztE+3hEJe1fWXEoUQDX9JNu4qEHTeCz0secQMkyZVDZSQk8yDUQxQ76yiett37sQB1WQR/3fclcahmqQ4dUS7M3Onyz6k6zia896PBK6G48TBUbFa1rw5Hx7WfNZluDMkv4YxkQvfz7XVzZx2/lhs45Kjh1UR9n7LaW/NID98vokcvASw1N6Bk/6pOd/45iPyEJemwovnQLs6ecwlMIikM= varsha@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDcQ8xMjwVf+KiFIQARcbFT+wg4NHysBRrFxk3Bx5X2k2hGKcEYR2tY/ApHZYfJ6me3LUvJEXg2c/6xa6ibVTUp/90l4y0cF6RmF5uB45J0xuBYoFJd8xJkVrhDIlZix4aFfb7TrmJEqjleBrkTwam7Q9aE3lss16nVOxU4hiViYiCANJ45wobK6tz7y5btfzrHE/iYpwniDvzLwK7EpkEK336VVd6f9wV0vG+ErEFxnNVxheXLLm05LuvdVQvFqJcTFrc7/GZ54yKg5IgwVwXqSAyOXIhgduUqk+oN1ciA7jnSqdiOKQPS/VmYkbhw2YP85l8wGVreIYUmOG19QEyVLB82oB9KS1LezM2KCH61XW22+85dHf4PvuL9DULhGt6wBCvpO10OHxw0JvHXbEgBPhiyd9j2yJmcQozbRPth/sMUvLKNXOGabZhhkPBYL7xZICHc+UwxrXs0h/j9jOjLyHzBAWMomF2lzgbvtzjcbxJ1a5oclJ6IW8yHJllkOh0= varsha@localhost.lo 2019-12-08T11:55:47.403 INFO:teuthology.task.ansible.out:caldomain", "key_options": null, "keyfile": "/home/varsha/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "varsha", "validate_certs": true} 2019-12-08T11:55:47.633 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2019-12-08T11:55:47.831 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6RDgqwA0GrvE6KqRaGCgYnFhnxdi9ehjIWvfaMa1oq0CqYxUAee2bNbp/X2Bd18Vqk8iH9fpE0+qrLgAH/8BpD+MtgGikCFMORvazeUtOCF/OCDO0AMg1jvl8aTdvrQU8ZTDPXa65Avpkc9vwugcoplnwrW7lKx++XqCWsSlfHgEdyMV3wrt/ZDFwI2AS2bZBpWM6ViG1KSjXjgTi/T3hSZPY+buYvWjzoEjQO0946iI3iiKKCGohEpCUnG02oJXcS0vvgl8dWE71451lbainEKJ4hbDhfDmy57s6VXfVUANsczwiPWiSC/ZmMlDaCCBeKHO0Gz0xXaDXd9j4SA7P sam@Pondermatic\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCYylAUS12hF6XndDQ3CkrUddKmXNSd8pOlHwO+pWaDTJPKxwtPL6sM3aOtaAPLrGkv1zD2k3iZaxmDwfPYGaXOyb0KS5ZCddtOyNXj5JLrjxh2niqFPP8SIkdHLOP+0Hv1/tB0Jz75RV+tNIT1SJTm7OZ8wZNy0qYycITSooJ14iEgyZ7rOa3EEzbtIVpHS4+YqIuIJdV2oV5egCrJyRv4sPUrS8ERXD4QZSOlHE+W4Tf+WVrEfsHOdDLRlAXJUzhuqgWtVouiYcW5ex294z28eA+12lKaPQpE0cft/NJ6FLs41yqh4ZN588bl8Ada+yTXEaHWioQEEJMlca2jIgrP sjust@rex004.front.sepia.ceph.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC08RrDQ2M7Zjcpx7RL9e+tjv48kBgDNyTenX1QdxW22JA2JR3D3ThA/ej9HtiPWcIVz16oZ4tzrCEVwaCMfb 2019-12-08T11:55:47.832 INFO:teuthology.task.ansible.out:smXq2z08ZXYqwiBuoXJVshU7lIKVqAtadT4F6Q9eQvxEo4zWdBib1W0/cqNLlYzU/DuwlUqYnWBDLGxc4fD5Kxrz366oWUDB/ULCpl77TMqfTKlStCgGXot0zLqiscqzq1W7XsuA7A5vQw/JTq7MvIME+SkUuGWX0WKwTMIRZKNWBGmlf51bNru3GmmAnKBUFsJv9H4G0FPqGY/aH02rr5dAgTTmfKt+XbWRfMTMpjJqVRGX03+1mQNoYQ3kNDz0wl sjust@office\nssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA5UMPySf/h9r2/OryRXrO9Qq9k5J9Dn9nvJYyaYCE82H/qkBJGboAJgyIXfbsGYO5uPM25d3fGRH4magzAQm2hGWNbbt1YWn9HaIyKCCXo9JX600/dv3OZbHyGGmgXPa4Anl16j1c2vxRRt2+ArjlyyhP7cAcRkilUGdagK9u6ALrwnz9hhXYV+BmXrxMm7zZCmdWHcWz+YxoA65es4+w+aLvVZWmUCZLF8uZrcpPSw+oK3SfZE8JPRc5vWulXbWEEfIoHb9AszPIpSyzbfPWXelmc3XlG0KD66t7w+AnNlQPt3JVePRCfFHPYeTj9B0k8sxPyUqTQIl5pu6GppRMOQ== sam@Deepthought", "key_options": null, "keyfile": "/home/sjust/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sjust", "validate_certs": true} 2019-12-08T11:55:48.012 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2019-12-08T11:55:48.222 INFO:teuthology.task.ansible.out:changed: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCz1UnJy64hXJKl1OsqRPlZ84m/fyHE8/Hqimy5s8sWcvRs2tL5oK30zFataqv1BC7r46+9t1eGUIRAuBg6QPuJnJCnPzS8yTVJ6DqSDGE2NAnpcMK5fSb+qgQ2adHFkjzZ4eKZbnDJMjYBtpUEp1Ve2ncdq5YCy6hGLIstkGq331ULBc/Lm3ZHBwy5I51S8eldkuP975otBYSPZaaN25QDncZzrW36zb3VwoGUAANEfHC1kLgTTFjx0bdsAGYCduXzyyXls8qSv9gbzcRzZZoH5B7tj8VDBoHszPnqGjGqwtWaelifYE/Svp+8fJKLlzRUM+XGNZoNcRl1/1XVhYV/ deepika@deepika", "key_options": null, "keyfile": "/home/ideepika/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ideepika", "validate_certs": true} 2019-12-08T11:55:48.361 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2019-12-08T11:55:48.621 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDC0h+TpaUkm2V6Hbf7aPCTys/nsm51CmY9s+bdwEXAiSAWpq/7Xi2LlN0mZgsrAYBHbr5L+Pz8x0YdigvWysUK6U9XRSPM28cbWmh8F25re9HEk8ARESkMZKTv/hKFs1v7kTHbT9hNNynbQGQOqEaazjr0shcli+Byvop27riX3QDDSsd5xfCjjyDz9fiA9YESlF0kbXyFUKPsoaBhRv9FUhtH6DxlygxtxTsKyKgeoiKw2sCfeUMckcJKnGCMtkXW4U8h7NL/fPZFyBaMDRi/TtoBKaVGLaWqF7RuukfjoMCwhuIDmuTG3WhanH4HJrfNenPZkpZUBhzWwZcleao8SD3mXXfZ9gcZb8QB2ymEtTqrAEyDoNWO4q8ljNP3WJXIgF0h0Sjmx/CV/i0ArEYlBMwBD7DFVnPJqCqSyypuQdDGsDNQZxaRCiYg7nIslFOpDr+0PLp78m+CHyYbSFLTvVVJoJ1k0YhMnDPHM29nt7fMGx6Qrigwnuk0yKg1bfgJ/t0TOqEw0bqGKIvHnyoP/n0ObazEsiPl5pRr2ehs/Rqf35Iwhc1i02Hhz/3Sqwc1eAgqm4/OVghxqUJGpRocua5Gf/vO32wwoyGxh2sl7y6K2pNDA3glhKYbZeIh1fjnaTjikgleqIQkCBxbTeAE7n5+T6TcFtnII6RSxYv3tQ== gal.salomon@gmail.com", "key_options": null, "keyfile": "/home/gsalomon/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "gsalomon", "validate_certs": true} 2019-12-08T11:55:48.695 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2019-12-08T11:55:48.987 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC1q3k4RvLLCaG874GDJjja4eYqFwrMjsTU+aRzambaVuCmAJT3KQMGuwMjTuCIN7R1Fqr+/dxUClamsfsGqPMe0ASHT9X/0AyNgEkr6na1Fvk9NAwAFelwtiRIHhclzYf6KY8QHZN/eBy43prVKDXd30b15gwQyVqU0/xmny0GrYCN24k3N/R3divt2GVqptYgEwS2KEyFT5EMnJWjdIVG9mBOHrgec2VF/rc6w3BZ0s56iKdpOeCgk5ISYTcom+Xrf+fSDHirlviZv05tBP8ESmampUT/EnwF8Mdaln5XJvZPhrq2JpUisi9fVeR+zlzg6gRGubvokdA3AERrhCQ9 skoduri@rgw_vm", "key_options": null, "keyfile": "/home/soumyakoduri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "soumyakoduri", "validate_certs": true} 2019-12-08T11:55:49.057 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2019-12-08T11:55:49.350 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDPeuSTD7kv8yQX6dW+7Vpq1mqrcr8JGubPYa1DpGTV/gE50d5L42UspUN2FXmICDMiV1h4Q9WQAFma3168f1I5I94qFkV+/56szCMoILClm7IW/EV4t8fTxoyOpEa9l4qSU3qgJpDbY04CkiyVJFuQj24Zq3gD/70jYgGpy8RfA0BihSR6F+A0WZLh/fESjqfor3/pFWhUCRnPEqrZsXyuB8lRgDTyGp4s1cHyUqmFMuCPDRMtok0rSVpaRZj2Zj8lboah19UI/L89ptQgEdqsOKzlkxiT+1GdyIY+jpPCM0a3yZz75l3Qiu0k6q7qUV8T0hm1GZiBguvST1KMcwnt kyrylo.shatskyy@suse.com", "key_options": null, "keyfile": "/home/kyr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "kyr", "validate_certs": true} 2019-12-08T11:55:49.435 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} 2019-12-08T11:55:49.718 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDeERrQ0NVXhuTYzI08rlKRbHZVFXSv1YC7sGq6aCWRbTCv7Ad/t/3OJz3vfcd2TjBMvABfrYCFgTFWIaJBaeA3BXUUU9y9TwnzuxKv4C46WJYoalVGyLEpWpcGbJ5v+leA6Je/+lunenplb7TBKGE/YTgggEXyX7KnunYlv+Jdm33TmAZTcHrLk5QR/6FdRGKmdlLna0dXZc3v04+AI8W+p9ghAv1+e8ENxJDTF8p0MawBiKWcSj2mysOhQ2Cj91qZ0qTnLLeu0CPf4rBO+qjYIshiCuTLhYt2UazlzME4nCCsVqK7Nz9olA/lgvJLRaPxgQQ7iCMmIZilS6B4Y3oL sseshasa@localhost.localdomain\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCo0zniUEXuQ4JJuuRtfnEK8WHqr97AmXEniGPY5U23MTxhMuP8CSkGWkUHdmXw0H1tDKbYgk97M6TspJropNGKljla2H1/3e2T1BOI1L2WfcsOh6VPYeyOj2ssMJeEDdQgd0J3g+4oj2QS+guPlT24UhO0CBhRZ6waVlJMgagDYyDLCLGI4ASoBYx0AOaoyjnEQtRd/gyejzv7jntkHc9YNBPsJ37X6hTYNA/s2ORJE7QMXd6xI60mTBuCdD3JcPYoUSvyCUa7rIrDc70lAcW5XtxewvMBogTZJLoFG/d6Ugij49h4AfwrtoUCtLyJOWJX6PTfomXely8Ym6KpN/3981+m70dhcHPDJ66QCWMd1LAgftVXTIsebA+Bxfg4Vsbrv7j1lJXzmMfsOl+1wVPe+Y9h28GyeIlalW3laURZGV7dhexGZ8YNxPuzxtAlWtfw+kddbjw0j4ODtgVXrj4SDxqmTTYYuMBkrQ3H33sOgPLx8DyA6e4pckb6lOOEvb41Yi5tyP7BIJlYN2PpNVDkSQd/t5Q0di4Ct+3vqLRCkPuJiJAUyaBGT4HM7yQc25+Y0B3sXNON7BjeaBXB7OwKZMp9w1jwbJt4JL/aGOw3HVljVyVgu+pIuQ2ISd9VBcmAJK5EGdWe5Q57h5fJkD+TVrXgeNTaufdclh5vWOH1qQ== sseshasa@teuthology", "key_options": null, "keyfile": "/home/sseshasa/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "sseshasa", "validate_certs": true} 2019-12-08T11:55:49.804 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2019-12-08T11:55:50.054 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDIC6uqbIg9XaTlDZd7KCX7FXSzfGFMEWXhx42ktz3ehOPLviA/yNpVd+LmYHSgzd5Szd3mMxleisiE+JdSq/q5YyPAF6eD6+wfynkpMv5aWNHGI0yVfKbCwdOX8bY6yqhyVwMDo14uoFvdDcM4Lj+vz8F75VJHUU5ihJNOW24EllobTLzR4XI6AcM+mjbXRnBLLVoBSuDaU2D0kWqMn8rDCJKdUJnoiy9oxIok8eMLfGkGsL55oOx9BflMSz/0jM9X5GLQahYiECbXjvCIarCkUFE8txNoXM9Djmg8QqhAQDhY0hzJTauFJJaD8Ax1uFQlXONed7tv7a7Tb3dH+/jb rfriedma@dhcp-4-239.tlv.redhat.com", "key_options": null, "keyfile": "/home/rfriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rfriedma", "validate_certs": true} 2019-12-08T11:55:50.120 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2019-12-08T11:55:50.411 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQDIXHA8BwV4OnqlaHHyYofsp5X+wanose+aneJVx2Or05PcWA9c7xFEOerkvEn9LvivSRd9G9o/S8SvnGH91tG2bbOAidVZ69FGul9OKa/BCJYUP0vVBX09/Td3n7+R2lVlvu5XiyC5SUzCjaQEZLOpjq23rqaqdCDXE6wFnxfpkmcsccbG/xUiOEBeBGI92lntdx99Sn6CxWWA27lMMaYkCRvX6ziRZEm6O44N2nMm+qYm0jmMyGv1iyQkJxtt0YaLPp+X9t2trUEzEjgBCXqqzEzBjB7T4rbzhAuvU3NRHiAoWXSnrY5AQOTTvC/wpaZV/gF2NDNThjMcpcEdNstleOctXtN4XTTJQewbG+t7I9knR00TPpsoUvUtpbcoFOluGgWTDTFa6GCmDPppx23nZgulOniZUVTI2CbScSpc8sfp1JE7Q6vLECY9lJ+GpVCbDAbIEE9WHXSkJ/6L9yf+ZoHbpqCkEFDcWLfz3B5NFoJ5gne8B8uzd6ptKVtJrP8pMvoOyydyvQlmkgh8tNDsOnp6kaUNG0NHmtfGlCTkbM7oKsKbf87Cv1HgYuZl/HP7go5sOX02LfBfbvWrawZzOaZ3dewEq74w5hVMKEHrmJPstIpcHSxZpq33f2j4Z/uKW9tJat6rgSWK1I+T3tCd++76apxbOYl5TDOaoxCyjQ== lars@marowsky-bree.de", "key_options": null, "keyfile": "/home/lmb/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "lmb", "validate_certs": true} 2019-12-08T11:55:50.455 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2019-12-08T11:55:50.813 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsrivas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_key 2019-12-08T11:55:50.815 INFO:teuthology.task.ansible.out:s", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} 2019-12-08T11:55:50.835 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDMDUcToIhs8tiIozgPudiYyD2upEX+VvsiJRti7zrA/1HPIDARYt2+xyWCASm5x5vdohRM7wnBLUlbBVnvr6ZUQvfShNDsS1Uu7hEfYF38MtW+dVwvGlm14J4m1gbjzqVlZvO6bg6rfGo7Qer0bKUlxtqbisQ/kCg/lVWR04CNxdRtZxEpaQ21y4C5jAlrpFTzxQSuiCLEyY3EAKdZUaZElFEcXlna0ysCP8inlzhF402PkSdl9DkkPpg3IR2dUEGqsblWSdLVk19EFavjtGAAnsvaBWWm2rCLNC5RmhGQaS/Z52Aes1nBuT4cI6qLjbEMqAzLwxiOR7l4IPMpK5EcuRK+FaqQG0wMAjxPc95CmxDzi58ZRJ5ERV8vgps73F1AJXWU9Lb1P77BTsLXqiwko2mvPf6e0LwCxQuxYJWc+xvO7Ji011B+nm5eLCCC/LcDtTPjkimTh7nkvUNi/yTKCXi9KwLISAHHd335KnfrL28rU3GahMXs4NjOxuN8eKM= ksirivad@ksirivad", "key_options": null, "keyfile": "/home/ksirivad/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ksirivad", "validate_certs": true} 2019-12-08T11:55:51.193 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC0POsA+0NyxecLo3Y821G6W3+jJPKFMuLSIl4FSLi25vuyuM5+mFGmCNWv8gg93eQhG9Y3SOygqmkaxzxDtBS/V6VNC2f8hZsVw9B+HbnfggvCNQSgjJ5rhvf6IHfx/aHq4IHF+stqdcoWhwR/68wIhGNqtP7Nhqnzk2aN1kG9bU2iVk4CH8XGIwqwET3aWNuCMcHi2AhrvDBpZu7bzo/6ARUJDqEfTEC/XIkzv8/mEkJ5igcycARVy6dChuCwfZc8rhfwQpekwx1Y9/WBFdNQlYkN4fVe8yIqT5VsQ3AcRv21GJk8L7mwB4hF9dVAi4p1cSyxatR3kDifsFc8VQk9 toor@localhost.localdomain", "key_options": null, "keyfile": "/home/ofriedma/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ofriedma", "validate_certs": true} 2019-12-08T11:55:51.194 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlnlBzRdWRqns/9VrYuF9tLILUjeGd9z8Tf/dPZmxAt3nnZqpTvI2xXemQpyt/2lsD0U24EuTc1Y/dBsgqvXtZOw51TZE8RK26hvCCaKGfcKONjvR7goHAmkYPHK9+F6m7fgYkRzA0+ZW4HcWNh/xxhhL2G1EGfz5bzIoGQJHSdzc6VeVIsY7HiYEMTxvxdsgV72Kjq97BdmHm56RBzoH24oN0UzNZS8Syx5SuWj9dA3IyFBPwjLlozSk6U2Ofd7qaXuQKl807eD9g6RhRldzHPS+i0EK3EM6Jvho5Y08k1KqV4gIEwMdzDbD3SH0xq+nUPFKcDTUFNp+tkg10GxqN zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} 2019-12-08T11:55:51.529 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDc/8sWrMq+bqKBPmDPplUgdMoY2SQL+57jRSh27PAoYW9rNVR/UgK7EA9oxFLfoi9wJ9+VKU4opeoohOXLWQXXatLvfXjGE3fRYIonQfwJqKrasqQJTGWzRZ9t1/2Cb0VHkoAvipCJzWmgB46X6q73XW5Td1H3b+AINd6E4Rsm1QjBOhk0DMjCdfwrVUZIfGdsEo+5u/AwioHwH+NDJvXTWT8ZigeZBNHJSY/EQn1+15ut0QB2rvXkJasvvDlVbEsPQtM4C3VX1ronmAnKMvCp1O4EtAXaoKSOx7XEN++UAvVn7czDCWk/UFgpzZOqTcQJwg82XtS4sZP23CpNe0G9 h4iresis@fedora", "key_options": null, "keyfile": "/home/h4iresis/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "h4iresis", "validate_certs": true} 2019-12-08T11:55:51.552 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2019-12-08T11:55:51.707 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:55:51 +0000 (0:00:34.636) 0:01:26.988 ******* 2019-12-08T11:55:51.771 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-12-08T11:55:51.773 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:51.783 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:51.795 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:51.818 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "skip_reason": "Conditional result was False"} skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:51.840 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:51.851 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:51.862 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:51.873 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-08T11:55:51.875 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCqhWVTosH12864VGY5S3/k0yKc59GbV0m2WxD28gAf+uvJ1/y8gekD2wDzBv0DWqEekYLV7L68gpapDXyGosQeZ6n5OO/NZFZmW+Xq1P7P1QHJil6kVpwk927lzX440pwNf3+PRvTbLzlbuVFWJRpiykv+juJyIFjzXLJRF67wB2qgZVm5cRs/GOi4fnvTaou/Ae51mvsO8M3JL5cphApFKD/AO/X+3pHBhLjvaW33cYsp0Z4Rce1nm8wxSmvuJRF+HAfjBlknhDl5ZaJGA96RYA+g9WbAXimFprg4xeiRp7liPExQwtVgackJweoC4MahC1glmjC3eOh9dvrrxLnALOLMOkyCSK/tOF/iq2PJaLViObanPI8mnNkMLbdJyzUBf8hRGdSLcw98qxaf0sSZ+vz4VQS6e9CwX7ikkNNsTeYXjnJ+1yU3mfCW1CXJDr7kBDVG2OTLefCpMY8WBAYDiEaK0RW83cBcFIKfecKYd0qStHRaOsvmyWdFYgBh2vM1UWjro5WXlb+7aJPrUp8ZruapkUXUwhjHA7FwGA4ysE0tsOVVFm0Dw8tvyVVkVNm/9EObG28dWctioZ2+ZEzTWgMJU26Q+wOJ/U4qZyIvpMRUgPZc5nM9J8kcmvNWtb6DV9k/6p8h28kiOxPkxLtPP+3TlBCHjq//mhEnJZ/d8w== shshyukriev@suse.com", "key_options": null, "keyfile": "/home/shyukri/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "shyukri", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:52.242 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} 2019-12-08T11:55:52.269 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:52.302 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxDJtmmcnrbA4AUsmBBZq/M4xNdIbOT+cQQxhUKeCu8F9mht+RznwyaaJbVIlD+UNv9LMhRyzI5oktSalokNltlrtPQMoP52PXH7KFFGnVnexCHAk4nGvEhuZCniO5T+ENm2wFR47lFEQK7lyJJLp5PFiSM7vM1MK6UkMvRmCTRildjaYLyf3EEvBXifbsGmR0tBIXtml6KITCAaT6l0E94055oEGN2G5NhZIvfLcojt5liEkXEHQNdfkUDXM0Go43JZzgsSWDXC/7RYLrAJwz5mq4qCa9YZL/3Spjso37+1oLq7lOQ0TDJUAQXmnW0So/NkzECx4MolVcylhTzmgj sergio@milestones", "key_options": null, "keyfile": "/home/scarvalhojr/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "scarvalhojr", "validate_certs": true} 2019-12-08T11:55:52.585 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemerson", "validate_certs": true} 2019-12-08T11:55:52.656 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-08T11:55:52.658 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDEOigBGMeElb3uHXX36HxLtPJMG+iG/6D7NDFCVR6AyYsmimBQb6SlSIR6SaFULb6HT/IFVk0Jf/z0HoipAP7Xu+wvP/J6LFoMdguxylh1ov8raqxQJrGLl9n64EI+qWINwEM0MKMUnDQ3tmMKBl78LKQVQTYBx1+9cXsT6DE1yhgmV79XIvOOb+v53agSi/kLJF2i9K04kpi1OejXg95Ub2eLMY69Jm8PnLy1Jq8DhC8pz7nrfzbKtOC7HbytTAO1XTlb90lVhqC/1yTMAUc/rpJwoSEHc2epGeZWdMsJhqhX2EqMwcV53M3qcFSGreGNJ/Ncd4/JHxz7q0IU411t rakesh@localhost.localdomain", "key_options": null, "keyfile": "/home/rakesh/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rakesh", "validate_certs": true} 2019-12-08T11:55:52.939 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2019-12-08T11:55:53.030 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-08T11:55:53.031 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCvRwrsN62CReT0/kOeFEXGA3THhzJ+hwZVpUzo7VMRZeSo6LgNlVGdrQchMHnlwBvuwaVNJlBAkQr+5J5BB3ikrmbcnLHfPutXBBBB6uDfSwwbqjzUY7elTbz9ul6AkegR9K65O44ouD9+WC76D+Tp0maqnP1w0O3h1GVxDHe34LpEwBvZJ+/BSYmBpwRZqeXFRADORPzdtW08PSiRErGHb8j+j5i+br37JfOOh+A/9dHwQw9alBVL2DijwvrPMa7dV5yX00dlMSTL2LLo9IdI4aFPmie8oic0eanFbQDq210ilOR65IGeshKHEKOq0KFFz0nSK9OdO03OkSEN/0d5 ryg@tapir", "key_options": null, "keyfile": "/home/ryg-/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ryg-", "validate_certs": true} 2019-12-08T11:55:53.286 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-12-08T11:55:53.288 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2019-12-08T11:55:53.316 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:53.324 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:53.336 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:53.348 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:53.371 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:53.371 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:53.393 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:53.395 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC0zCoXv2Kkxjqv5FOlJZ2PRA9tStdXAVGZJbSLOhAWeqHQL6O2l8MO5GFzHz4FA/g7lbNzLKaCbG1wYGuL9FOt0o36/eHykgENu00SlFunIQn+T/WNaGxrZqnfbdS9TdImFAnVY4vuzrBhFTb6qcqTLhw1WVz+l/iOv5CoY+7NnILWcj8dHNcPzU1ihlFAbvQgQcMtt1130zqc6L8o+SDm2YQF2nuOWxj0LbD6YpRn3AqWsTN5QbqzdeaJiUt6kdywisPdoiSWLuivRKhNLNhnWO+B4DnchwfApy8ovJShHZAsrSoc+a+RQDmOiLXmc5wAvNnREHbqod8/0bQ9vSXaVQCt1gnnK8Bf7GQElg3Z3aep4D4w6rBB+LBsHFbTfrzWAHkXxJeGiQTlJGz0IYHi1weWrzY6x5rEA0gYDu0FVLOLrsYDtuTQpjcTwpmaHCsxz6wU3wCNmTsV/AZhniFHJhHXacCmDp1JfsI2kP9FjcJJE0SygnZ/SzKe0DHamnyT1OgdQaG/KX2eRv/vXUPg2ukKiA1fyFnFeEsWK6rUO0YgCswqjrM4vU0leZ1b8vK9aM4IDJM3TJqdMLfOa0rPntekNOqXUn213CP+Yiz9l1TH4zX3P/Kv6Vv1gTeGcX0lMaYhowng+97j3LLqGcSUPMklrKen/xrsACFxN9fxaQ== prsrivas@redhat.com\nssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQCks+XmOepYEdSBP6U0T+r+fZowSS7UHY5W8AUtAkvXiKlTG518luG2wtSALIsB5+jyjC44ITwV9X/vvsDaXQnp1hFanwWeuU1jDdy+MvywvxI9q4naWlDpxrfq4i/AioSvdoIo02uUFYPKTCHrm7wBjTwpWbCD0gbC9/OGAHM88Md3F0qbgFEr3BERvNGe0coCjWRMS8+GTZXS22WW1/NxNzpdCUjO/9j4QydpW7UF1kqVhnPVZozmh4wl0rk8tgb9Zx3vCUBG1Q5eO/q+HsW54eXLa9FcuQcoJnNdV2hMXRHHZHTgaPKZ/ildukzZHo0i/Dq1mi5N3s5A7aDYxOWWlRXazwL8zu/UQVrxVRni8vDTFk5682lskF1WifzADaqicUWzasdK0PC4G7JmHPi+XHskeOt5i4ywEnFRXnYtMOIu0CNO82Rg4CdUAD58YXCGoQ4r9TG4LlwKg75ouNHB/ToJidSg9NBwclP+MICcTpWItxVXpBj/YkeLcntHtVTFNHORxIwIwWng94wVEDCfyXelyAR6VfwcPlWWrbzhbEO9DH40GuluQi38ySWi/HpnrVriJMLzEQA9OPrLsME1LDgPGkF2GloPL8nnnLWB9L+YEBNNAVoSo0PHBsjIibdZ/SZm7zUgYGp4fuG+m1+SDOjcfD6GSXOTQwQou+knEQ== prsri 2019-12-08T11:55:53.396 INFO:teuthology.task.ansible.out:vas@redhat.com", "key_options": null, "keyfile": "/home/prsrivas/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "prsrivas", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:53.406 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:53.418 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:53.429 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:53.441 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:53.450 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:53.454 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:53.478 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:53.479 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:53.491 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:53.505 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:53.517 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:53.529 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:53.546 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:53.558 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:53.570 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:53.582 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:53.594 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:53.595 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:53.606 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:53.618 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:53.633 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:53.645 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:53.646 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:53.657 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:53.669 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:53.680 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:53.693 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:53.703 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:53.714 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:53.715 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:53.726 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:53.737 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:53.748 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-08T11:55:53.750 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDlnlBzRdWRqns/9VrYuF9tLILUjeGd9z8Tf/dPZmxAt3nnZqpTvI2xXemQpyt/2lsD0U24EuTc1Y/dBsgqvXtZOw51TZE8RK26hvCCaKGfcKONjvR7goHAmkYPHK9+F6m7fgYkRzA0+ZW4HcWNh/xxhhL2G1EGfz5bzIoGQJHSdzc6VeVIsY7HiYEMTxvxdsgV72Kjq97BdmHm56RBzoH24oN0UzNZS8Syx5SuWj9dA3IyFBPwjLlozSk6U2Ofd7qaXuQKl807eD9g6RhRldzHPS+i0EK3EM6Jvho5Y08k1KqV4gIEwMdzDbD3SH0xq+nUPFKcDTUFNp+tkg10GxqN zac.dover@gmail.com", "key_options": null, "keyfile": "/home/zdover/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "zdover", "validate_certs": true} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:53.761 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:53.772 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:53.792 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:53.804 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:53.816 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:53.816 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:53.827 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:53.838 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:53.854 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:53.865 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:53.876 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:53.887 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:53.900 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:53.912 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:53.924 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:53.942 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:53.947 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:53.959 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:53.973 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:53.991 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:54.002 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:54.024 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:54.025 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:54.037 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:54.048 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:54.060 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:54.072 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:54.086 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:54.087 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:54.108 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:54.109 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:54.115 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:54.122 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** changed: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": true, "comment": null, "exclusive": false, "follow": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAACAQC4zwWf+kMEDgaSOrX7AlD+UCOgf4/fRiorQVJqC8GfMNynfiFVZaThngwIrwtQROfXHbzspi+AcRvDLewY25mXyuxVgOfSbuSIEqiUNvzcVq9IItI1J58xeDBpIktAsoHHS6JENV56fAT6krzRAQLnSa1k2b0pyKuPBzFSeNgiaQMhjrCLAaCi9yLsdKpnWgXhyfrdqvN2r/Ctts/zlTPqtRYdvdIL/p/l+vg7Q8S3OhuAGtimaEq3RE70xadaPbGhsLISMTrbfYXbxw84KKZpNYwO4zmQ2ztcvC9D7A/8ov3+A5Jq42G+pq7ORuix2NoTWtADMiwvNe1HyzS/7cX/BuXLFssRY1bzRvp+x2ExZ7b+bFx+TE/RduRh0eyDNLg7SyL83aeTr2Usa+mPoCAMKed9XtYbRnUu7ox4wmfeAgx6jM9uG5uQfauJ1XpDddrVBG8KYBvSd0BM2cyRdcAXqwxg9AVPZcdE7sbBk44CGVhw+ziZ3e3cLBTO4y44KRQre+1Bhe/Ze8OTQWLFugl/XagFlJE/L6fGUIPuFojmQvlw5dBZwtUURnxsu8yHm3iIsj4y8nR1zHMj+zuMk6rF3ZW0epPAECAdq4gG8X2wv3HTq0vLBkKpi1KMAmntEtcVwF0fzMt5XYqRd4jceFgonAAipJNDknHgi6yaUzBYmQ== rraja@redhat.com", "key_options": null, "keyfile": "/home/rraja/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "rraja", "validate_certs": true} 2019-12-08T11:55:54.133 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-12-08T11:55:54.134 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:54.144 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:54.189 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys using the keys repo] ********************** 2019-12-08T11:55:54.229 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-12-08T11:55:54.230 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:54.232 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:54.233 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:54.234 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:54.280 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:55:54 +0000 (0:00:02.573) 0:01:29.561 ******* 2019-12-08T11:55:54.287 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:54.289 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:54.290 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:54.292 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:54.293 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:54.367 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:55:54 +0000 (0:00:00.086) 0:01:29.648 ******* 2019-12-08T11:55:54.374 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9', u'name': u'andrewschoen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "andrewschoen", "ovpn": "andrewschoen@home hYDlX2i7X8t0JHpK2smvFA 2a6e753fb3c401ad75e1273ae5e18e4abc0404149dbdc3675bb317a63a4469e9"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:54.375 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n', u'name': u'zack'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zack", "ovpn": "zack@ceph0 1CeZnO8st4CuhLpH/DJNVw 7230fda728e34998da4401284fc3e5c8939bfdd52482f8cb675d8acf6fcd12b4\nzack@mba.local mzf7/v4tv3uVExt16N/w/Q 13dcf7082b974315dfab1c76885dfc094d7ccaf01ae2e7898a20005602be2caa\n"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:54.377 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd', u'name': u'kdreyer'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kdreyer", "ovpn": "kdreyer@redhat.com yUBHWOGnPts8xuDSon5ODg 38feb4fec9f1ba3de74ed074d745ed46a8e5b3ac1d44e50005a04cf07f0462cd"}, "skip_reason": "Conditional result was False"} skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47', u'name': u'adeza'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "adeza", "ovpn": "alfredo@papaya.local V5VkRT2Du88WwQrYeK196w 4dff4d9bdc4d9ab60532814c338abe4534cb45a9ca729bdbc2411ad513516b47"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:54.378 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n', u'name': u'dmick'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dmick", "ovpn": "dmick@angus z8fyazJ0pc56I/XTlHAOrQ db682b1b89c790bf26a2e12dbea03f4495f8ea5f248e29b2f5c5dc072acb3c93\ndmick@home o9fblAdxhBToEJxbutv2mw 1704b16322c3984ed565b48cce52877eadade26b4093443b349b70f846f0eac6\ndmick@dell r6meTomZVVH/WVOmVf2aSQ 8ac1a9d0452166af59894c6b57ed07a12b42042aa6d2618df2bec9c962684072\ndmick@dmick-MacBookAir EFN6/5V1I5YNm72XjlApUg f2335a3fa49a0296233ab5faba28e7bbf309a89c193169dbe3c411e4219827a4\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d249450ef0b0374849e721b0c53a70\n', u'name': u'sage'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sage", "ovpn": "sage@autriche 2Uhfc/1jXje4W7G4s0sJEQ 09631754d059fab96e16be441b3b8f7e63b37a260677897a2669cf7a2501d2d3\nsage@gnit YuLp2iihT6cCqY+GmW9IVQ dc79b19c45b9be1b4e69cd7debeb5b87aaa8cd0050353f798913da22c233875a\nsage@maetl wpsQIdtAb+z+ietqr+90Zw 42c518015b7cd440e7c8afd65fcca5769e31e9ef8f8a67d109a3de38187087e6\nsage@lowride tak6ngfj0ohW6upHRUMq7g 450919c617f452e874ef2a8cfa5ca18f47d2 2019-12-08T11:55:54.380 INFO:teuthology.task.ansible.out:49450ef0b0374849e721b0c53a70\n"}, "skip_reason": "Conditional result was False"} skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n', u'name': u'dgalloway'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dgalloway", "ovpn": "dgallowa@laptop POebac0SJIVkSCyi0LE4yg 52fc0cb34f3332a5f3cff117a20f00e8ea89a051736cb543a689a96dd9528ae5\ndgalloway@p50 7PHdbcNE/YjcHOm5NbNfpQ 7075211c35997b01797c2f15083aedf13888fc4c54080130342dccc76469fb40\n"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:54.392 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045', u'name': u'akraitma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akraitma", "ovpn": "akraitma@aklap 2zvxeeQ+bQ4UhKBE9Kz2DQ ff4a9dbab841ee62e7328d8cd0d285c68c22a1de6e23ea24f470b3dcb1a27045"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:54.395 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e', u'name': u'trociny'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "trociny", "ovpn": "mgolub@mirantis.com +WMPxNCgiMwhNJAJHNCV2g 4cd6749ac740ea6dfb50d4f602920ac75e979286439bd510540a8a551728104e"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:54.404 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** 2019-12-08T11:55:54.404 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:54.448 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:55:54 +0000 (0:00:00.079) 0:01:29.727 ******* 2019-12-08T11:55:54.789 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-12-08T11:55:54.793 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007', u'name': u'smithfarm', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "name": "smithfarm", "ovpn": "smithfarm@wilbur vEk7281ao7DkpXE2Cn3rpw 20058c04c4991caf38b9517faedb75c8562e8d8669808b6be9f70da6a5b64007"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQC6jqQtqO7pnW39mpSQQC4L2FuxPOx/5j34lp2PrwuTWJoDwtUVCZhpNwSs5UAj3wdXGXCzWYWxu9d9Gh0UEBkiC+2ZHtLvWrwS1TDVRy5g5jYVm9vX3kL5dhoC2vYPyQoQkxeMX3BYlhLwkSjCAnjaceJJZyOT7KsqbpanvJxvudMzeyCosntnMuxyPzjH9CkVKqycddZnscdHMkDIZ3TjNhnL8GKK/QCPB60tkCO6HWN/g4HxidRjrp2VjQgIa5MWN9LBR6mGspZI6+rR1ygLhbl1scr1cCCumh65r+zmCC/ZY33YCfRXdmQZo+ShsBa+KbcvakEx0Bqgx7DsMoiR ncutler@pantograf", "key_options": null, "keyfile": "/home/smithfarm/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "smithfarm", "validate_certs": true} skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf59 2019-12-08T11:55:54.794 INFO:teuthology.task.ansible.out:2607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n', u'name': u'mbenjamin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mbenjamin", "ovpn": "mbenjamin@ferret N7Ln6KHUAYT/iiP4Swkb0A 244b90574d7e294f6f80949ef5e640bab103c2c34e1902a69cdcf592607d950c\nmbenjamin@duel PRRFsQiomHSJX8sVgRHblA f3009adb7502a6c5554e1157d36c63d84f40fe5074a01d7d0280e5c48da374dc\nmbenjamin@rael 8ixfNNx3j2m2+nGhXkHsnQ 62fda7ec724f0fdb3f05add4c3739e07a5c7eeb2380d5f1f7eeeb13db35e16a8\nmbenjamin@shatner hJ1oEl5wSZaKPJC1Ugss8g 9c9161b53da4d842308f80e5b490a0c1539076f129bd0e34ee2253272dd55c21\n"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:54.836 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi079.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2019-12-08T11:55:55.143 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2019-12-08T11:55:55.165 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-12-08T11:55:55.167 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01', u'name': u'aemerson', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "name": "aemerson", "ovpn": "aemerson@seasalt enqtMOCQ0a24hizRK46SZg 42f36c9c14c1eb7c468e41cf4c5649e30037f0aaf5eefbd6c07be9637224ca01"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCxUDk9jEQOSrRwe0WMGBPw28fzgOhvqMgcG90SvuUjR20Rx3KUfy9JMxPJPesjBQz0xgH5adOVg2JQeLrt3uSJdIFNpqox8BBrS1u/bWT2dorQjLnFEhrtA8Ae/h2kwLQ8w3yYNWB/PxDSuMRnyH4G8EWtVydzQcV/QnNZ9Y6eBcHaI5C2yVnFl7Fi4zBYc2eeL8o8gWqmM6DobBCvVrxD0pCNAsLhOW6IA140BNGT9F/hQZYje9RQRWbFKh/iKiUhqFYCzLcxFfYXkw2HZMJA2p/bLmuc8ZbgYaIiU6b90kpfDB37Xw0S6toIj9E8h+E3nkNnwraCQcbralhz/bdz aemerson@seasalt", "key_options": null, "keyfile": "/home/aemerson/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "aemerson", "validate_certs": true} 2019-12-08T11:55:55.499 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi079.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2019-12-08T11:55:55.522 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-12-08T11:55:55.524 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78', u'name': u'amaredia', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "name": "amaredia", "ovpn": "ali@freerunner yQjRpRVG7D5KN2HAUjI30g 9d677a34ae98477e6cc8ba1d975d81dcae43a102013b265c63f3ea91e7dacd78"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCc1ZbHNXuJn7gxyt7QJ579gEM13MuFdTzsrnedYuRIW2Zlm4rCFr8Oj5SGs5DWBIJnd3W4O2v7PjuVQMxU/zbwnj7mdwBmLFe1cSzOJv2eP1R2uaU5z5C7KNmyPLU++pGKClzb6v5wcEQUq2K35xnuXUU9B935dK+Fm7bK7+HAxj+1vpVeycbPFyPhf6mwbx8dZv4uvZGV2+CGBuyIB/5U2AMJZy9LWim3AR35bip4ftXvSKlAON+RHhnS0toG/6uwp0XlFuGn5H8snaca7L6hGtB4xg1PqA5aMf33Jiv2NVLQo8emHU9J/HeNVS7ksoSZ6InynpLZ6b9uXa9OM9XL ali@parkour", "key_options": null, "keyfile": "/home/amaredia/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "amaredia", "validate_certs": true} 2019-12-08T11:55:55.821 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-08T11:55:55.822 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2019-12-08T11:55:55.895 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** 2019-12-08T11:55:55.896 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5', u'name': u'tserlin', u'key': u'ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet'}) => {"ansible_loop_var": "item", "changed": false, "comment": null, "exclusive": false, "follow": false, "item": {"key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "name": "tserlin", "ovpn": "tserlin@annarbor DlKe+OWBPcFAQtWMUAHnwg 6b268bd737ffa5dd38865575ccd444b92cb912c70f5b82dac41f9c50505df4a5"}, "key": "ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEA2ok6CBUpOVGv2RFws44GtEP5SVxOi4Vie0WSZYLpD55rTfmOtsItN1d1EciVNTUyWuyzMeQGWC4JAd3/2l3gR/5ZwSvd7b/7TCNYxjAMEubRand0GxEoiKhpkJMMmJqcT0KefP8pr31MASWPuERj1+0/IbjJExsvrJaUjqeIfZ+DWR8dC2VYdcH3hsp6AE3mqKX/9693sxe8ROt6qY4WkpZcO4M90unOVa2CnJsYqKaaIC4z3fmKuHZpJZjiJMrg8rtuN4r7bnKWPEVGcahj+i74JWwKR5+2gntLpxw2chIBmf4qFu6HDplddig4V3I/2NLB8soBpgc+m8O7YyYl0w== thomas@easystreet", "key_options": null, "keyfile": "/home/tserlin/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "tserlin", "validate_certs": true} 2019-12-08T11:55:55.920 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28', u'name': u'dis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dis", "ovpn": "dis@zambezi wXYUFvWPBlkCFz+mC4RD6A 11c464dfb2a27986e029f1915732a4f237baba4eade02bb045c8f0d13dfada28"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:55.933 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n', u'name': u'gregf'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gregf", "ovpn": "gregf@kai YhNrPfedhZjbvGjOfmotOA 440cf8595a87cd307790bbf79c3668455a0405945e2b271d873325de222cd72f\ngregf@pudgy VZrk8nWzg7pYLOrZru8dBg c1d1a0e469a134ccf5f5a5525631a6b83efa6970beec3b23809eb0daa3dca47f\ngfarnum@WorkMini2 +bAqcTdU7Ok9bGMcB3A84w 3cff1326561a23cf81dd6495373cb83ed149cee026c6374d72c19b483f4f1f07\ngfarnum@Macbook bxVtolCC9SY3QNlpx3cE1w aff8d28bfb4d693253511d29e8d399196e964fc096594ec705748a5469d44654\ngregf@fedoragreg Jdn8I/sFGcr5Aa/dici6lw 50f88afc35c05ef8454742226f7baf2cd20cb1e2d4d0c9f4a393013877736bfa\n"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:55.943 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n', u'name': u'joshd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joshd", "ovpn": "jdurgin@glarthnir ElGaAgbs5VZujuzsQMfCmA 2a156febba037d02d1099bc11d1e697d34300b2c420f2df664b5b0de1248f983\njdurgin@new-angeles jqa015PRJcHSp5WHcwJjUg 42113e1156382fde866d691f30584f6b30c3dfc21317ae89b4267efb177d982c\n"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:55.955 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n', u'name': u'davidz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "davidz", "ovpn": "dzafman@ubuntu-laptop-vm NY9y9tqLY1beEcXDwMavsQ c869d42fae1890574577a8014d97d1247f1a13cb6337037d2714f1d236fc65d2\ndzafman@ubuntu16 2a0rAy5QmNFSEcATNz2h9A b7c11fbb0911fc4ac0216a1a8eac8359a9e8f43d69126db6b45cbeabd358c2b4\ndzafman@ubuntu-1804 PN1pkeGHGloB0K+IZrfB0g f1c01b447b9ec3fc048c32f606a33fb488ff621e11aa305ac979501030202658\n"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:55.956 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc', u'name': u'gmeno'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gmeno", "ovpn": "gmeno@gmeno-virtual-machine FKFu8B2pMqotpmEVAO1few 8229574e499eaf767a408909f5afdf2e2a0bb8f3e61b18d63a651f7102c68dbc"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:55.968 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1', u'name': u'ivancich'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ivancich", "ovpn": "ivancich@ann.arbor Kt2vxZ3Ge609mHfjx0W4Cw aaa55a9e2b5276b62a21cd3c401b365c5c2693e39efccb2f9edefafefa1dc8b1"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:55.980 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n', u'name': u'wusui'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "wusui", "ovpn": "wusui@ubuntu /nElLTGqxiOr/hD6eziF5A 2e244e2b62fa42dadf3a3a1dbcc29475410cee6550b0c6b3603c135853937551\nwusui@thinkpad tu2DxDcllIdwb5ewldgT0g 1590a7d9f1377b0094e9ba4277e7bcbe6374791f0b3d3df93026345c058c93f5\n"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:55.991 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304', u'name': u'zyan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zyan", "ovpn": "zyan@redhat OP16IkReCatMfA4Mf3pkdQ b0262be71ef008e2f7d585e34431dc2757c1e22ac1aa844863be533bf873d304"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:56.003 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n', u'name': u'yuriw'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuriw", "ovpn": "yuriweinstein@Yuris-MacBook-Pro.local wKA8mCcsdsk/CE+1d9GiPw caaf5bf5eb31ef269e3d0bc34d45dd761c0bb0907172eea6e754434de4603db7\nyuriw@home 02TZyR3JHJMxEQob80ICNA 85b4aa0f69f6d469dae0bb3dca4baaf222e164927ed7eed2082caae8f4717e48\nyuriweinstein@xenon1 C9eVdLb/i18lMcMG20rGPw eaddd0e831a77de3f35cb19e307bd6f9aeb0cc03eff1ae58490d7db33ced4311\nyuriw@yuriw-RH 5ivdxgFO4eIkbXVhl8xkvw 59212d29b8b42d9fe457c1b2c43d774e1d25807be10dcc1252d4aec63b97a467\n"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:56.004 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n', u'name': u'tamil'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tamil", "ovpn": "tmuthamizhan@mac /1CBLC6rxqzJzPspffZV0g 4d1dfff2e097a7fc2a83ea73eccad2f0e453a6338e18c87b4d89bf370733e29c\ntamil@tamil-VirtualBox M22QdmhkSPj9aEcTiuIVfg 8e76e06b14de99318441c75a96e635a92f5bddc54a40b45276191f6829c6b239\n"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:56.015 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n', u'name': u'jowilkin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jowilkin", "ovpn": "jowilkin@jowilkin 2r8xOv/eCTcHr+HSsMkPYg 0ac416d2dc139628144dfa0822af8cc0a455f5f5f3e4d1b9713c14115c062218\njohn@osd-host 7zjDTxAYhCmTX+Az4SJaoA 7d924233fdef168e2c5c01258aa349de108629ef2ff90d17c0b96acf22dac7c2\njohn@admin-host 7cpk7iJ1Hg2vk4bPDovKmA 05765178f27af6dc4e43e47f52d773aac3bc1b3f1dd998bdbf479b951bfd2efb\n"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:56.038 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4', u'name': u'bhubbard'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bhubbard", "ovpn": "brad@dhcp-1-165.bne.redhat.com 4oShQI9+vYtX5gA47np/Sw 3fc7df5afa772752d8eee15c01d550cc1dcc88b6e940abc9f9f8f26102d239d4"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:56.049 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n', u'name': u'yehudasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yehudasa", "ovpn": "yehudasa@yehuda-2 NGXHeO0lAvRFfYLalffzEw 0d3489b09f48ad5fa9d1ec5944d9c8020daf852488f389f3d44fe63d3f651f34\nyehuda@yehuda-940X3G shisK5LjI6fr3ZBJy/xX8A 49522899bd26130086ce668079f0062d987d85dfa5767dd5c34e5953db97997a\nyehudasa@yehudasa-desktop OT1MhoO0WihhvkKztqW0Uw 12a4d6b54390b9df7f5af3bd6b533f3c1fee0c7b9fbb79f0a87bcb28b182c7d4\n"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:56.050 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4', u'name': u'dang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dang", "ovpn": "dang@sidious w0CNW2g9K1WiRenVGYWNUA 4f59d761bfab3659115da2b3b80a486266f77b09d8527983217d15648b4f92b4"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:56.071 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb', u'name': u'branto'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "branto", "ovpn": "branto@work ganye+HpG3dkMEik6WtTng 018f3f9b9d49dcefa701ea304a8e58f002c46f0650edae220a0a7ab1bce36aeb"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:56.073 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6', u'name': u'xiaoxichen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xiaoxichen", "ovpn": "xiaoxichen@ebay RvJJ7BhIehpoPtggrwnskQ 862ecfe7e15dfab86d61df86856bfe06cbb99f240f6f03851f7f9e1a255327d6"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:56.084 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e', u'name': u'ffilz'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ffilz", "ovpn": "ffilz@redhat.com 6YdvqxkKfmDWGD2s0wA7Ww 4ce64d08686e34e559ccec2498df433b155b70c9ebccaec616b6b34f0f0c246e"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:56.097 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n', u'name': u'joao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "joao", "ovpn": "joao@magrathea eSS2/gvK7ALE6L9bITfuMA c3caaeecee3f43e39b7a81fad50e0d874359c70a9c41b77c661511c71f733909\njoao@timesink 9S3oER36HheVupjRpnLz6A 9dbc964184244e9da269942dc73ec9ebba6594bcccfdc0eb09562b58b4542162\njoao@tagide uUDVmZ1S5lp/Hx8eKTfDCw ee37985d0a51360f08266e0de208ea85616777a325d498d7c895a80d4723f844\n"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:56.109 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n', u'name': u'nhm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nhm", "ovpn": "nh@latte JCH9icAtDPj951rgbPKJyw 9a3d30ec1ec9467ccdc8bdbbfacffd7396fb38e046199ae37b2b7b69dbf37480\nnhm@espresso +YYZPT29wYzY5ooaRzabCQ 1ee041dd58b9ec6eb678c47632ece7cf6c24e23bcbac28a77a82af05ba6cc148\nnhm@mocha HgOGOfkBEzJihFsKmPRfKQ 2e17f3ba0b90df7a36f19a7c8f64d2aa8f966b2794c94caa110d313e927a1c1b\n"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:56.110 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313', u'name': u'nwatkins'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nwatkins", "ovpn": "nwatkins@daq unHfXkUpAHOnzeptznuLLA 33b2003c30d0cc7a6b194e76be92c7b5d270c2d2a4b4a8b6e673f0f0dc1db313"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:56.121 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22', u'name': u'mkidd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkidd", "ovpn": "linuxkidd@zenbook oYp1WWV0JwpikHCWCV52Lg 9aca455b601bf3a365d31068154150ac63dd76f32cef29a55f9685dd1a88aa22"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:56.132 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af', u'name': u'jlopez'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlopez", "ovpn": "JCLO@oh-mbp-jcl vZhmBh/1LjLFEu+atRec6w 1f13f591373b4dc798a9b701fabf1eb99bf4aa58f87b6420d6c916716f0965af"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:56.145 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb', u'name': u'haomaiwang'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "haomaiwang", "ovpn": "yuyuyu101@desktop XAUS/1Geh1T2WY//5mRahw fda03bdaf79c2f39ac3ba6cd9c3a1cb2e66b842a921169f20a00481a4cd3d9cb"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:56.157 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608', u'name': u'jdillaman'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jdillaman", "ovpn": "jdillaman@ceph1 kQ96pIpKTocwIj9H1Udb1g 6c087451af94ac18c144712bcc9329799d86f6d90376839dcd6fa41cd73e3608"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:56.158 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi079.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2019-12-08T11:55:56.160 INFO:teuthology.task.ansible.out: TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3', u'name': u'kchai'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kchai", "ovpn": "kefu@gen8 HVoNrB5C8+bYxuqIfByeEQ 4dddde1890af2d6df367d3d832cc3b9b660160a1db69f0135e0d09364b2cb9b3"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:56.170 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@vumrao VaMHdnIGTl6y9LIkurxfjQ 71de53c4a0f212b8f919437d7d433d24a33d7a33bc6fe5df5d047e24499994b2"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:56.191 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n', u'name': u'dfuller'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "dfuller", "ovpn": "dfuller@laptop 6U0lNVidRy7Ye/5q6cGN1A aea3d019f68a95094c99385aff099818224455a829615cfc774587e4519398a7\ndfuller@rex001 6Z8bfQDgPXVSGMeeQHoItg 3abd41920b72683fbba7f25be88ff992fcd753119c4d2086c12daaf20798e684\n"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:56.193 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n', u'name': u'owasserm'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "owasserm", "ovpn": "owasserm@owasserm.redhat.com hsdVTbVub6eRnhlO9B02rQ 7c9baf41670ff9ab612f75d4be42d0aaf0d7ecaa3c8928032b61f1be91725890\n"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:56.203 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n', u'name': u'vasu'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vasu", "ovpn": "vasu@ceph1 +1D1qNUAk8h7OF9LF9qkrQ 963aa256fb99bc4b77e7085f57cf910a04c7f143603f81252331411eb8e37ec3\nvakulkar@vakulkar.sjc.csb O8ac1k0Dh3xkIFX8NFyIZw 471538eeb22384b58921e4f11af272c00c0a953dc7fe8d95ba057e65d141fbd2\nvasu@vasuSrv waJqYAARY/LnfuP1x/KQzQ 68915d3a1eb3dd00a562c149791cec5f43a96f5fd0b851ec855ec3f5dab496b4\n"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:56.214 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37', u'name': u'smohan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smohan", "ovpn": "shmohan@laptop 7wwHLZZNa4ShUV1imXDDjw 0aca19a8ff6dbeee2821dd75a329a05b8052170204b2b242ced9b1a68ca8df37"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:56.228 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114', u'name': u'abhi'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "abhi", "ovpn": "abhi@trusty SKarQTpBigBobP9sLjdLiw 868a74ed21b46f7f64255897d824f4e3eb21f8dde844bbdaa386681c942d8114"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:56.230 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611', u'name': u'cbodley'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "cbodley", "ovpn": "cbodley@redhat.com W4gFS4oU8PtUOrdHuBYwXQ af7dafd992687f5d85a79866838a78e5070a4934fb0a935e8094adb31ec28611"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:56.240 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195', u'name': u'mwatts'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mwatts", "ovpn": "mdw@degu IPiZqcFT2BLuf2h3+tw58g 7af390a631ec11bddd7d1ac506d29af65e1e01e19f7dc931b4f459030cb7a195"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:56.258 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "pritha@dhcp35-190.lab.eng.blr.redhat.com GCk3PIYzUNZ6/xrsKoq8VQ acbfc4279970b44c3d008990e0cf1bb5eb280299218441a0f25fda988bc555f6"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:56.269 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea', u'name': u'pdonnell'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pdonnell", "ovpn": "pdonnell@redhat.com Q9j56CPPXipXScmKi57PlQ fb616603b6d27cf65bfa1da83fc0ca39399861ad1c02bfed37ce9be17cdfa8ea"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:56.270 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868', u'name': u'jlayton'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jlayton", "ovpn": "jlayton@redhat aNfzMdXOhhmWRb25hwXJIg f51fee42c5268f7b8e00d57092dc522b0a07b31154ea52cf542da9cac5885868"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:56.281 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f', u'name': u'rzarzynski'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rzarzynski", "ovpn": "rzarzyns@redhat.com h4UkibgFG40ygfpfKTMBrg e20ca28c60144dbabc97953cd4c273c1b92cd45ebcddd0f0299679d7a5c87d7f"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:56.293 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e', u'name': u'rdias'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rdias", "ovpn": "rdias@rdias-suse-laptop 0bh54sdB69mh95n5rWME5g 452e3338e48d04d4e816f4f1cb54d637746a7acc1ffe5e8ed4c1506c8e07a72e"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:56.304 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953', u'name': u'vshankar'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vshankar", "ovpn": "vshankar@h3ckers-pride r39frQXXj1GUJZwq1GS7fw 1170ef4c918c5ff15334d10f666441b0dfe0bb869a5e15218fdfad2e8cc4e953"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:56.315 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58', u'name': u'akupczyk'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "akupczyk", "ovpn": "adam@TP50 C0YuBT9bYaNhdDmjbF56xg 5d298b33b9dbaef364b037561aa5c5de374405bb8afead5280db5b212506ea58"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:56.327 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e', u'name': u'nojha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "nojha", "ovpn": "nojha@localhost YQTw/h6ZMgdJn7EPBmbEnw 253574eae62759c4c5d3bc4bf949c59948a0488e4dfe4c91ee754a3b5494847e"}, "skip_reason": "Conditional result was False"} skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43', u'name': u'ifed01'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ifed01", "ovpn": "ifed01@LocalSUSE1 6g6hX1bzTGBTCnDevAn0+w f18c9354f6de3f371c3b51521b62375e474802ac21adb3d71e09d8d5bf9d0c43"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:56.339 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4', u'name': u'myoungwon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "myoungwon", "ovpn": "myoungwon@omw-dev 78twXwYRU+MeH+yZ9Rw9Zg 2dd66fa122e5cf3b8bfa835cefac7c6e4e66d70643a3819813104c2057e597e4"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:56.350 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2', u'name': u'gabrioux'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gabrioux", "ovpn": "gabrioux@elisheba 80kx1htp39RsFrlGONcp+A a95579ef6f90694cd6fd390302adf8532237a8ea65bd5544d9b561654d712ba2"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:56.352 INFO:teuthology.task.ansible.out: 2019-12-08T11:55:56.362 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f', u'name': u'leseb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "leseb", "ovpn": "leseb@mbp cCx1v5/FfaQ/IQHujqtG9Q 6121d11f9abfa6b1b36330eafaa2196249a9c92f989be25c9fac1558292c920f"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:56.364 INFO:teuthology.task.ansible.out: 2019-12-08T11:55:56.374 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca', u'name': u'hchen'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "hchen", "ovpn": "hchen@host12 hUr3k0rugStZMjvIxIvCOg 9d57e14d49901f18b24ee4076ae7e6a2f9eb6fd9fbce786660c448486c966fca"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:56.387 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n', u'name': u'jcollin'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "jcollin", "ovpn": "jcollin@earth +H4Hk4WcNuqdQj7ch/Nulw 8426545e6457c9e1e8adca2af5ddf836fbcfb433cdc5359fd135afdf4e0f7d2a\njcollin@stratocaster jbjV3FsrsTJwyKUA3Y8VVQ 0439745f795fef1399636bd550040d45445d1607b471284c5c9b9dbccc86a987\n"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:56.397 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc', u'name': u'xxg'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "xxg", "ovpn": "xxg@zte Y2d/Ov201XMivDNwo4nUoQ 5e5da8d579793601699af628300430c1e5dd469c8bcff7c3ee11d23ec004bdcc"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:56.409 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53', u'name': u'pcuzner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pcuzner", "ovpn": "pcuzner@rh460p oK28wU5DSabvEL4VjDRhEg a449ed81d7e2970f418263fb3ce10dd711d03925a0990ddf298f826aae1caa53"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:56.410 INFO:teuthology.task.ansible.out: 2019-12-08T11:55:56.421 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2', u'name': u'mkogan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mkogan", "ovpn": "mkogan@mkP50 f/LENRJbsyepmvZA23F7Fg b908f1c0237a7ee56b73dc42f2df79b49ca83d6f4573f5229e7cfe6b4ad7b6a2"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:56.423 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed', u'name': u'vumrao'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "vumrao", "ovpn": "vumrao@redhat TMNqzMvbJS8Va/8nT9QUQw ab386c2bd7c6796d5413e4d841a16dda2504cca6d95df831a652a30d2e5655ed"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:56.447 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736', u'name': u'henrix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "henrix", "ovpn": "henrix@hermes iPPDBfnLzP5Pe5FuTcJBmw b26aefb8a61451066f984e074f708ea9ca6b2c5d7cca35996c08b0b2bb2c2736"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:56.448 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26', u'name': u'pbs1108'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pbs1108", "ovpn": "pbs1108@bspark_cli0 nSCINdeTLTLEO5JP/GIwRQ 76372ad6f7ad731556ff13605c3729eacaf59dcf7f9ac82dd9a8501bd95d3b26"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:56.471 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315', u'name': u'clacroix'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "clacroix", "ovpn": "clacroix@redhat.com ZGY9sgvjT0BuJRi9zrULzg c3311aba4025aa42cd78c999dcee4e2c16415a3ac44ac8c95b77838459ef3315"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:56.472 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006', u'name': u'epuertat'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "epuertat", "ovpn": "epuertat@private BnUoirwxGRWXtLxulJU5xA da2cfc4995bed82ef85db3633edad0a7eb2c32ba559a48259b10be94a8fdf006"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:56.483 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461', u'name': u'tdehler'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "tdehler", "ovpn": "tdehler@think 7e0WC4Vh86XWZviZ9WBMgw 4dc8477db6e4f40312e6b2b9db293dc009e49e518015ace20431c0fb69025461"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:56.488 INFO:teuthology.task.ansible.out: 2019-12-08T11:55:56.503 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305', u'name': u'laura'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "laura", "ovpn": "laura@flab 2DGHIAxD39eNKOPkn3M67w ab1ae304abed3824a68b5c0ecf4f92fca76a4f8b9fcbcc0ca43388a85b7f9305"}, "skip_reason": "Conditional result was False"} TASK [users : Remove revoked users] ******************************************** ok: [smithi079.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce', u'name': u'yaarit'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yaarit", "ovpn": "yaarit@centos TBuWjkAsj1GB/V9eWc/R1Q 7bd86a857dec48dc25850ecf0c00486d9a89c2ff5f88b2f28c3e36bdeb139fce"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:56.515 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3', u'name': u'rpavani1998'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rpavani1998", "ovpn": "admin1@rajula 31GbDo9d1YnW5BQ8u3utvw a2da13cb840f848846023c85442ba7bcce97dc186056a0ecc036a220d7eb7fc3"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:56.526 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4', u'name': u'rishabh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rishabh", "ovpn": "rishabh@p50 zdJ4XsBdVugwMrqJOSBi3Q c78bb28ba5cf2bf9c8edb80fe57814d60cd2ffdbd874cf9a271e5adf171bb0c4"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:56.548 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2', u'name': u'skrah'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "skrah", "ovpn": "skrah@thinkpad IboPmnUdsLqqRXlHQ1RT5w bf85db9e916dceaf84a1e6ea33c59eb4adb424cb4e727ce0a903a3498b799ed2"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:56.551 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8', u'name': u'smanjara'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "smanjara", "ovpn": "smanjara@fedora 5oorMoVYD3sT0nmOTBDh9w 83be007f68694c9463ef46e4ce223221d639d78f11d5b68449598de77e8e0ce8"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:56.575 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41', u'name': u'bengland'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "bengland", "ovpn": "bengland@bene-laptop ud1gWgoNggJTS7LQtPTZTA d3ebd084ce385cb450ce2f83c02dc66a1637dedbc7a8b191dab68acfc935af41"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:56.576 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d', u'name': u'pnawracay'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "pnawracay", "ovpn": "pnawracay@flab LIurEXLa7xbr+jzf2wRJVg 04062ba385602b385fd17f14de3a0cad83c685b8078fd2f18cc9ad77a4f4762d"}, "skip_reason": "Conditional result was False"} skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8', u'name': u'alfonsomthd'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "alfonsomthd", "ovpn": "alfonsomthd@localhost eUvx+7UEx5IYGmS0lNIscQ 2f1bfd4874280b9f525a46e93e767504df80a9b09a83a2fea387dcd6e34bc0f8"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:56.597 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e', u'name': u'oliveiradan'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "oliveiradan", "ovpn": "oliveiradan@opensuse-dev twDqMYwYsdYmbgyCpUnElw ec3ee80ddc747c3ca5e1455a122279f8e1e642c5c09aa9c2ca7fec142f55089e"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:56.609 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba', u'name': u'swagner'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "swagner", "ovpn": "swagner@ubuntu 64V1h0Se0FmBQNH7KLibbQ ad7c91e9e2f7f3999492d5e41fbbc993327d37929bd09606227367d75e5556ba"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:56.620 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e', u'name': u'yuvalif'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "yuvalif", "ovpn": "ylifshit@localhost dyc2NU2pMz8NF8/uR2kMxA 3a6f1f9e55b5116f74d01ffbabdc339054088d257a16cf9fafcfe05b27fa678e"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:56.636 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852', u'name': u'kkeithle'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kkeithle", "ovpn": "kkeithle@kkeithle.usersys.redhat.com FPnVevv1sp5hlWoJeDCe/g e5a1fa7ccf678b91ed570983d5420c98f109d507442c8e4dcd50803e0d71c852"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:56.648 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130', u'name': u'emmericp'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "emmericp", "ovpn": "paul.emmerich@croit.io RN4hOorvA7irUg/3ViM9KQ 3bd06194186d2624cadf255fa1c38ddf7dded0a6d83dc6001cd55fcc0a899130"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:56.660 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0', u'name': u'mchangir'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "mchangir", "ovpn": "mchangir@indraprastha 1p71eDTdLMzkySFg0d5qEg bc4fda0ac9ef5cfbfab0cd9e5ed956c75b6280a04043c90c288e62b416b42da0"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:56.670 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286', u'name': u'sidharthanup'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sidharthanup", "ovpn": "sidharthanup@strawberryfields IZq91vqA+RG1Rtn3JFZb6Q a2873481cac9b8b4a0bd8bebe0248b3dccb370dd18b56a4dae713ca1fb0c4286"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:56.672 INFO:teuthology.task.ansible.out: 2019-12-08T11:55:56.675 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31', u'name': u'varsha'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "varsha", "ovpn": "varsha@local AGrJViO6wZF253aFeh/r5w f1248029ccdc45fd6e8fddb09ab3f8aa01123ab69cc6f3f11273528ce33e5a31"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:56.680 INFO:teuthology.task.ansible.out: 2019-12-08T11:55:56.688 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n', u'name': u'sjust'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sjust", "ovpn": "sjust@pondermatic sCd6606QpID1PnHn0AxFag 46da7d4c77cb1238f83a34f99e774707110f997d88f3a0fd240aac9b7b7bbc85\nsjust@rex004 YS0in6YtQJHx5aUo7ZHi8Q bdd5977d05171a365539b19fae283ec2e3c7389516664692b9bbbaf98c7b61f4\nsjust@office w19UilyC/xu7uCzv0DnWRg ab20efc114b769bf4c2cf313eb30db09c2e2f8234992f120cfc3d1b8b347ed3c\nsam@deepthought 44sCi+GEfY0zjKo5M/4FiQ ed1eedd14ca68116a2000477fa078f8f736d0a15640723c32204bb30f14cb888\n"}, "skip_reason": 2019-12-08T11:55:56.690 INFO:teuthology.task.ansible.out:"Conditional result was False"} 2019-12-08T11:55:56.700 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc', u'name': u'ideepika'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ideepika", "ovpn": "deepika@thinkpad HXRUSerxILmV0ejAD/Zt1g 29b44e741567e7a2e7b664d6533247d79851fc302051c9ba34103c63a2fcfacc"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:56.716 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46', u'name': u'gsalomon'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "gsalomon", "ovpn": "gsalomon@home BrlCVxStNlEZGf5yYYAz1w 4b0c8d5b57dae1328c16d3017b59b632ccdfebe4135209fa97748c70ff00cc46"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:56.728 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de', u'name': u'soumyakoduri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "soumyakoduri", "ovpn": "skoduri@rgw_vm fAskaxmJYtm4TDcModIkrQ 884b57c3b5d56493da361dc9f1cc4e06e766628fcb0f916090f2096edc5ce7de"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:56.740 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a', u'name': u'kyr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "kyr", "ovpn": "kyr@suse Xu4+Yi98Il4ETOAav6okqA 03bc46e5fac6346cd82ff681f756860f98e0c61168633ce23325efde11a1964a"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:56.742 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849', u'name': u'sseshasa'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "sseshasa", "ovpn": "sseshasa@thinkpad jyB1pr0I3qsDknkTnJTMjg 72ac1456e344c22fd940d0ba0e035aa3819ef7cd3891e53308aa92ba2dec8849"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:56.753 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189', u'name': u'rfriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rfriedma", "ovpn": "rfriedma@rflap.redhat.com 5+OUPoyz8K0M0kcymdQOjA 40ce705001f31d7156c965228938cd4b02ae1a2c43dac1bbcd1b538e70312189"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:56.765 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b', u'name': u'lmb'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "lmb", "ovpn": "lmb@hermes LMS8kAikL0iqw2S6IbXa3Q f57a493b31e7ed02a2563dd4295278d4842dc698b4c635d011a8d2b4b1fd5c2b"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:56.778 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc', u'name': u'ksirivad'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ksirivad", "ovpn": "ksirivad@ksirivad prZzE08FqnY6hFtGk0Q6XQ 2ef0878b0050cf28775813fe0991f9a746c07e61920280ce29ee69088eda5efc"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:56.794 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4', u'name': u'ofriedma'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ofriedma", "ovpn": "ofriedma@myhost IIifKuFYfX5EqO3mhV8lAg 82cb23a98361f3624b2f1f4e0f694f9439ae7735b171ba5e3bb5f0744f5ddfc4"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:56.816 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52', u'name': u'h4iresis'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "h4iresis", "ovpn": "h4iresis@fedora NyMdx+dAfmujNSDB63kI+g bcf6c36594585e0fbf9f037bf1a13fe63db4b82a52ff1349349fac748b5c4e52"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:56.824 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5', u'name': u'shyukri'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "shyukri", "ovpn": "shyukri@t480 KEbvWFIOWqkHsLgffi6GMQ fcd405d0cf6b2c7ba53397c4ed1156e852317fb02bcd6f0e98e5eb3c1c3aa4b5"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:56.849 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e', u'name': u'scarvalhojr'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "scarvalhojr", "ovpn": "scarvalhojr@milestones utvFbB+X1G75M589jLfFXQ 9c62bf416c9204b25028ba0e5bd45f754c4aa8f84a85b9d5ded02aa83f03e82e"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:56.852 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi079.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} TASK [users : Update authorized_keys for each user with literal keys] ********** skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b', u'name': u'rakesh'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rakesh", "ovpn": "rakesh@fedora CXsWP7Wzu2C+bTN6mIeMiw 2f4f492cd085f1f46d1d5018aeb7705ba855c4481e230a8188b8f5ea9994b91b"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:56.884 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486', u'name': u'ryg-'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "ryg-", "ovpn": "ryg@wombat 7WbRbRXPcrQ2++Bww59JKg 1186db58c70662d55cae6d75e54022d1392708d3cf742b10ce5ff9d67dd8486"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:56.886 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3', u'name': u'prsrivas'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "prsrivas", "ovpn": "prsrivas@t480 dvGwTZM2FivQPrMGmkY53g 80afabbb654af66ec01463d0e0425be5643eaca10bbf756f2b8313645d2b8da3"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:56.897 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42', u'name': u'zdover'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "zdover", "ovpn": "zdover@slim_thinkpad H/78rBqDIJ5AAjMT6sTmKg 49fb166c553d14549491280458269f987bea97295dbf525ffb7c35336175ee42"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:56.914 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'ovpn': u'rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b', u'name': u'rraja'}) => {"ansible_loop_var": "item", "changed": false, "item": {"name": "rraja", "ovpn": "rraja@thinkpadp50 8S3Lez75woSBdYiLqQxf2g c9d1666dfc7a3b762700cd250f775a506c397b0f0e6a86289ba555a3546e532b"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:56.988 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:55:56 +0000 (0:00:02.539) 0:01:32.267 ******* 2019-12-08T11:55:57.018 INFO:teuthology.task.ansible.out: TASK [users : Filter the revoked_users list] *********************************** 2019-12-08T11:55:57.020 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:55:57.077 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:55:57 +0000 (0:00:00.090) 0:01:32.358 ******* 2019-12-08T11:55:57.154 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-08T11:55:57.154 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2019-12-08T11:55:57.486 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item=zcerza) => {"ansible_loop_var": "item", "changed": false, "item": "zcerza", "name": "zcerza", "state": "absent"} 2019-12-08T11:55:57.498 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2019-12-08T11:55:57.846 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item=aschoen) => {"ansible_loop_var": "item", "changed": false, "item": "aschoen", "name": "aschoen", "state": "absent"} 2019-12-08T11:55:57.847 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2019-12-08T11:55:58.165 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2019-12-08T11:55:58.200 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item=andrew) => {"ansible_loop_var": "item", "changed": false, "item": "andrew", "name": "andrew", "state": "absent"} 2019-12-08T11:55:58.517 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2019-12-08T11:55:58.558 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item=sweil) => {"ansible_loop_var": "item", "changed": false, "item": "sweil", "name": "sweil", "state": "absent"} 2019-12-08T11:55:58.833 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2019-12-08T11:55:58.908 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item=brad) => {"ansible_loop_var": "item", "changed": false, "item": "brad", "name": "brad", "state": "absent"} 2019-12-08T11:55:59.174 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2019-12-08T11:55:59.259 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item=kefu) => {"ansible_loop_var": "item", "changed": false, "item": "kefu", "name": "kefu", "state": "absent"} 2019-12-08T11:55:59.489 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2019-12-08T11:55:59.595 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item=shylesh) => {"ansible_loop_var": "item", "changed": false, "item": "shylesh", "name": "shylesh", "state": "absent"} 2019-12-08T11:55:59.817 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2019-12-08T11:55:59.943 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item=trhoden) => {"ansible_loop_var": "item", "changed": false, "item": "trhoden", "name": "trhoden", "state": "absent"} 2019-12-08T11:56:00.150 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2019-12-08T11:56:00.323 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item=nishtha) => {"ansible_loop_var": "item", "changed": false, "item": "nishtha", "name": "nishtha", "state": "absent"} 2019-12-08T11:56:00.471 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2019-12-08T11:56:00.683 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item=yguang) => {"ansible_loop_var": "item", "changed": false, "item": "yguang", "name": "yguang", "state": "absent"} 2019-12-08T11:56:00.840 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2019-12-08T11:56:01.019 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item=sdieffen) => {"ansible_loop_var": "item", "changed": false, "item": "sdieffen", "name": "sdieffen", "state": "absent"} 2019-12-08T11:56:01.161 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2019-12-08T11:56:01.379 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item=brian) => {"ansible_loop_var": "item", "changed": false, "item": "brian", "name": "brian", "state": "absent"} 2019-12-08T11:56:01.529 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2019-12-08T11:56:01.726 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item=pmcgarry) => {"ansible_loop_var": "item", "changed": false, "item": "pmcgarry", "name": "pmcgarry", "state": "absent"} 2019-12-08T11:56:02.076 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item=karnan) => {"ansible_loop_var": "item", "changed": false, "item": "karnan", "name": "karnan", "state": "absent"} 2019-12-08T11:56:02.140 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "jj", "name": "jj", "remove": false, "state": "absent"} 2019-12-08T11:56:02.416 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item=ryneli) => {"ansible_loop_var": "item", "changed": false, "item": "ryneli", "name": "ryneli", "state": "absent"} 2019-12-08T11:56:02.716 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "amarangone", "name": "amarangone", "remove": false, "state": "absent"} 2019-12-08T11:56:02.770 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item=dlambrig) => {"ansible_loop_var": "item", "changed": false, "item": "dlambrig", "name": "dlambrig", "state": "absent"} 2019-12-08T11:56:03.135 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item=icolle) => {"ansible_loop_var": "item", "changed": false, "item": "icolle", "name": "icolle", "state": "absent"} 2019-12-08T11:56:03.308 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "oprypin", "name": "oprypin", "remove": false, "state": "absent"} 2019-12-08T11:56:03.481 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item=soumya) => {"ansible_loop_var": "item", "changed": false, "item": "soumya", "name": "soumya", "state": "absent"} 2019-12-08T11:56:03.825 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item=jspray) => {"ansible_loop_var": "item", "changed": false, "item": "jspray", "name": "jspray", "state": "absent"} 2019-12-08T11:56:03.846 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "adamyanova", "name": "adamyanova", "remove": false, "state": "absent"} 2019-12-08T11:56:04.164 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item=loic) => {"ansible_loop_var": "item", "changed": false, "item": "loic", "name": "loic", "state": "absent"} 2019-12-08T11:56:04.407 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "sbillah", "name": "sbillah", "remove": false, "state": "absent"} 2019-12-08T11:56:04.513 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item=erwan) => {"ansible_loop_var": "item", "changed": false, "item": "erwan", "name": "erwan", "state": "absent"} 2019-12-08T11:56:05.010 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "onyb", "name": "onyb", "remove": false, "state": "absent"} 2019-12-08T11:56:05.107 INFO:teuthology.task.ansible.out:changed: [smithi013.front.sepia.ceph.com] => (item=jj) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "jj", "name": "jj", "remove": false, "state": "absent"} 2019-12-08T11:56:05.598 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "jwilliamson", "name": "jwilliamson", "remove": false, "state": "absent"} 2019-12-08T11:56:05.716 INFO:teuthology.task.ansible.out:changed: [smithi013.front.sepia.ceph.com] => (item=amarangone) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "amarangone", "name": "amarangone", "remove": false, "state": "absent"} 2019-12-08T11:56:06.140 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "kmroz", "name": "kmroz", "remove": false, "state": "absent"} 2019-12-08T11:56:06.299 INFO:teuthology.task.ansible.out:changed: [smithi013.front.sepia.ceph.com] => (item=oprypin) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "oprypin", "name": "oprypin", "remove": false, "state": "absent"} 2019-12-08T11:56:06.708 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "shehbazj", "name": "shehbazj", "remove": false, "state": "absent"} 2019-12-08T11:56:06.858 INFO:teuthology.task.ansible.out:changed: [smithi013.front.sepia.ceph.com] => (item=adamyanova) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "adamyanova", "name": "adamyanova", "remove": false, "state": "absent"} 2019-12-08T11:56:07.318 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "remove": false, "state": "absent"} 2019-12-08T11:56:07.445 INFO:teuthology.task.ansible.out:changed: [smithi013.front.sepia.ceph.com] => (item=sbillah) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "sbillah", "name": "sbillah", "remove": false, "state": "absent"} 2019-12-08T11:56:07.893 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "asheplyakov", "name": "asheplyakov", "remove": false, "state": "absent"} 2019-12-08T11:56:08.075 INFO:teuthology.task.ansible.out:changed: [smithi013.front.sepia.ceph.com] => (item=onyb) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "onyb", "name": "onyb", "remove": false, "state": "absent"} 2019-12-08T11:56:08.424 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "liupan", "name": "liupan", "remove": false, "state": "absent"} 2019-12-08T11:56:08.652 INFO:teuthology.task.ansible.out:changed: [smithi013.front.sepia.ceph.com] => (item=jwilliamson) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "jwilliamson", "name": "jwilliamson", "remove": false, "state": "absent"} 2019-12-08T11:56:08.762 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2019-12-08T11:56:09.102 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2019-12-08T11:56:09.198 INFO:teuthology.task.ansible.out:changed: [smithi013.front.sepia.ceph.com] => (item=kmroz) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "kmroz", "name": "kmroz", "remove": false, "state": "absent"} 2019-12-08T11:56:09.413 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2019-12-08T11:56:09.764 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2019-12-08T11:56:09.776 INFO:teuthology.task.ansible.out:changed: [smithi013.front.sepia.ceph.com] => (item=shehbazj) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "shehbazj", "name": "shehbazj", "remove": false, "state": "absent"} 2019-12-08T11:56:10.112 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2019-12-08T11:56:10.420 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2019-12-08T11:56:10.486 INFO:teuthology.task.ansible.out:changed: [smithi013.front.sepia.ceph.com] => (item=abhishekvrshny) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "abhishekvrshny", "name": "abhishekvrshny", "remove": false, "state": "absent"} 2019-12-08T11:56:10.708 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2019-12-08T11:56:10.710 INFO:teuthology.task.ansible.out: 2019-12-08T11:56:11.082 INFO:teuthology.task.ansible.out:changed: [smithi013.front.sepia.ceph.com] => (item=asheplyakov) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "asheplyakov", "name": "asheplyakov", "remove": false, "state": "absent"} 2019-12-08T11:56:11.322 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "fche", "name": "fche", "remove": false, "state": "absent"} 2019-12-08T11:56:11.382 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:11 +0000 (0:00:14.304) 0:01:46.663 ******* 2019-12-08T11:56:11.611 INFO:teuthology.task.ansible.out:changed: [smithi013.front.sepia.ceph.com] => (item=liupan) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "liupan", "name": "liupan", "remove": false, "state": "absent"} 2019-12-08T11:56:11.938 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item=nlevine) => {"ansible_loop_var": "item", "changed": false, "item": "nlevine", "name": "nlevine", "state": "absent"} 2019-12-08T11:56:12.276 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item=tbrekke) => {"ansible_loop_var": "item", "changed": false, "item": "tbrekke", "name": "tbrekke", "state": "absent"} 2019-12-08T11:56:12.494 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2019-12-08T11:56:12.496 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => {"changed": true, "checksum": "8a303ebcf60c08d57f11c57c9682a02d84685d0b", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "c2805c19b557daad4717860e2c7029bc", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1575806171.41-208053431968335/source", "state": "file", "uid": 0} 2019-12-08T11:56:12.533 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:12 +0000 (0:00:01.151) 0:01:47.815 ******* 2019-12-08T11:56:12.567 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** ok: [smithi079.front.sepia.ceph.com] => { "msg": "Host smithi079.front.sepia.ceph.com is running CentOS 7.6 (Core)" } 2019-12-08T11:56:12.604 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:12 +0000 (0:00:00.070) 0:01:47.885 ******* 2019-12-08T11:56:12.621 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-08T11:56:12.622 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item=taco) => {"ansible_loop_var": "item", "changed": false, "item": "taco", "name": "taco", "state": "absent"} 2019-12-08T11:56:12.644 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2019-12-08T11:56:12.645 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2019-12-08T11:56:12.683 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:12 +0000 (0:00:00.078) 0:01:47.964 ******* 2019-12-08T11:56:12.709 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:56:12.748 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:12 +0000 (0:00:00.064) 0:01:48.029 ******* 2019-12-08T11:56:12.962 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-08T11:56:12.964 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item=louis) => {"ansible_loop_var": "item", "changed": false, "item": "louis", "name": "louis", "state": "absent"} 2019-12-08T11:56:13.194 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** 2019-12-08T11:56:13.195 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.116654", "end": "2019-12-08 11:56:13.168012", "rc": 0, "start": "2019-12-08 11:56:13.051358", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2019-12-08T11:56:13.234 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:13 +0000 (0:00:00.485) 0:01:48.515 ******* 2019-12-08T11:56:13.260 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2019-12-08T11:56:13.262 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:56:13.334 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:13 +0000 (0:00:00.100) 0:01:48.616 ******* 2019-12-08T11:56:13.340 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-08T11:56:13.341 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item=amarango) => {"ansible_loop_var": "item", "changed": false, "item": "amarango", "name": "amarango", "state": "absent"} 2019-12-08T11:56:13.363 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2019-12-08T11:56:13.365 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:56:13.403 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:13 +0000 (0:00:00.068) 0:01:48.684 ******* 2019-12-08T11:56:13.429 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** 2019-12-08T11:56:13.430 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:56:13.476 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:13 +0000 (0:00:00.073) 0:01:48.758 ******* 2019-12-08T11:56:13.519 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2019-12-08T11:56:13.521 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:56:13.562 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:13 +0000 (0:00:00.086) 0:01:48.844 ******* 2019-12-08T11:56:13.589 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2019-12-08T11:56:13.591 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:56:13.628 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:13 +0000 (0:00:00.065) 0:01:48.909 ******* 2019-12-08T11:56:13.644 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-08T11:56:13.645 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item=oobe) => {"ansible_loop_var": "item", "changed": false, "item": "oobe", "name": "oobe", "state": "absent"} 2019-12-08T11:56:13.670 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:56:13.704 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:13 +0000 (0:00:00.076) 0:01:48.985 ******* 2019-12-08T11:56:13.740 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2019-12-08T11:56:13.742 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi079.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-08T11:56:13.779 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:13 +0000 (0:00:00.074) 0:01:49.060 ******* 2019-12-08T11:56:13.805 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2019-12-08T11:56:13.807 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:56:13.846 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:13 +0000 (0:00:00.066) 0:01:49.127 ******* 2019-12-08T11:56:13.872 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2019-12-08T11:56:13.873 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:56:13.912 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:13 +0000 (0:00:00.065) 0:01:49.193 ******* 2019-12-08T11:56:13.938 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2019-12-08T11:56:13.939 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-08T11:56:13.982 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:13 +0000 (0:00:00.070) 0:01:49.263 ******* 2019-12-08T11:56:13.992 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** ok: [smithi013.front.sepia.ceph.com] => (item=rturk) => {"ansible_loop_var": "item", "changed": false, "item": "rturk", "name": "rturk", "state": "absent"} 2019-12-08T11:56:14.014 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:56:14.052 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:14 +0000 (0:00:00.069) 0:01:49.333 ******* 2019-12-08T11:56:14.084 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2019-12-08T11:56:14.086 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-08T11:56:14.121 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:14 +0000 (0:00:00.069) 0:01:49.402 ******* 2019-12-08T11:56:14.158 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2019-12-08T11:56:14.159 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:56:14.199 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:14 +0000 (0:00:00.077) 0:01:49.480 ******* 2019-12-08T11:56:14.252 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:56:14.291 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:14 +0000 (0:00:00.088) 0:01:49.568 ******* 2019-12-08T11:56:14.325 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2019-12-08T11:56:14.326 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:56:14.376 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:14 +0000 (0:00:00.089) 0:01:49.658 ******* 2019-12-08T11:56:14.403 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** 2019-12-08T11:56:14.405 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:56:14.441 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:14 +0000 (0:00:00.064) 0:01:49.723 ******* 2019-12-08T11:56:14.479 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* skipping: [smithi079.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-08T11:56:14.524 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:14 +0000 (0:00:00.082) 0:01:49.805 ******* 2019-12-08T11:56:14.550 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2019-12-08T11:56:14.552 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:56:14.587 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:14 +0000 (0:00:00.063) 0:01:49.868 ******* 2019-12-08T11:56:14.624 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:56:14.625 INFO:teuthology.task.ansible.out: TASK [users : Remove revoked users] ******************************************** 2019-12-08T11:56:14.627 INFO:teuthology.task.ansible.out:changed: [smithi013.front.sepia.ceph.com] => (item=fche) => {"ansible_loop_var": "item", "changed": true, "force": false, "item": "fche", "name": "fche", "remove": false, "state": "absent"} 2019-12-08T11:56:14.661 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:14 +0000 (0:00:00.074) 0:01:49.943 ******* 2019-12-08T11:56:14.691 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2019-12-08T11:56:14.693 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:56:14.729 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:14 +0000 (0:00:00.067) 0:01:50.011 ******* 2019-12-08T11:56:14.764 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:14 +0000 (0:00:00.034) 0:01:50.045 ******* 2019-12-08T11:56:14.792 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2019-12-08T11:56:14.794 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:56:14.831 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:14 +0000 (0:00:00.067) 0:01:50.112 ******* 2019-12-08T11:56:14.869 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:56:14.920 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:14 +0000 (0:00:00.086) 0:01:50.199 ******* 2019-12-08T11:56:14.946 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2019-12-08T11:56:14.952 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:56:14.990 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:14 +0000 (0:00:00.072) 0:01:50.272 ******* 2019-12-08T11:56:15.027 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2019-12-08T11:56:15.028 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-08T11:56:15.081 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:15 +0000 (0:00:00.090) 0:01:50.362 ******* 2019-12-08T11:56:15.109 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2019-12-08T11:56:15.155 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:15 +0000 (0:00:00.073) 0:01:50.436 ******* 2019-12-08T11:56:15.182 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2019-12-08T11:56:15.184 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:56:15.220 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:15 +0000 (0:00:00.064) 0:01:50.501 ******* 2019-12-08T11:56:15.578 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** 2019-12-08T11:56:15.579 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-08T11:56:15.617 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:15 +0000 (0:00:00.396) 0:01:50.898 ******* 2019-12-08T11:56:15.618 INFO:teuthology.task.ansible.out: 2019-12-08T11:56:15.932 INFO:teuthology.task.ansible.out: TASK [users : Write /keys-repo-sha1 sentinel file] ***************************** 2019-12-08T11:56:15.934 INFO:teuthology.task.ansible.out:changed: [smithi013.front.sepia.ceph.com] => {"changed": true, "checksum": "8a303ebcf60c08d57f11c57c9682a02d84685d0b", "dest": "/keys-repo-sha1", "gid": 0, "group": "root", "md5sum": "c2805c19b557daad4717860e2c7029bc", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:etc_runtime_t:s0", "size": 40, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1575806174.75-150915149348811/source", "state": "file", "uid": 0} 2019-12-08T11:56:15.970 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:15 +0000 (0:00:00.353) 0:01:51.251 ******* 2019-12-08T11:56:15.996 INFO:teuthology.task.ansible.out: TASK [common : Log the OS name, version and release] *************************** 2019-12-08T11:56:15.998 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => { "msg": "Host smithi013.front.sepia.ceph.com is running CentOS 7.6 (Core)" } 2019-12-08T11:56:16.036 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:16 +0000 (0:00:00.066) 0:01:51.318 ******* 2019-12-08T11:56:16.074 INFO:teuthology.task.ansible.out: TASK [common : Including major version specific variables.] ******************** 2019-12-08T11:56:16.076 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/empty.yml"} 2019-12-08T11:56:16.118 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:16 +0000 (0:00:00.081) 0:01:51.399 ******* 2019-12-08T11:56:16.145 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 6)] *********************** 2019-12-08T11:56:16.147 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:56:16.202 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:16 +0000 (0:00:00.083) 0:01:51.483 ******* 2019-12-08T11:56:16.679 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone (RHEL/CentOS 7)] *********************** ok: [smithi013.front.sepia.ceph.com] => {"changed": false, "cmd": "timedatectl | grep -E \"Time ?zone\" | sed -e \"s/.*: \\(.*\\) (.*/\\1/\"", "delta": "0:00:00.120606", "end": "2019-12-08 11:56:16.638186", "rc": 0, "start": "2019-12-08 11:56:16.517580", "stderr": "", "stderr_lines": [], "stdout": "Etc/UTC", "stdout_lines": ["Etc/UTC"]} 2019-12-08T11:56:16.746 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:16 +0000 (0:00:00.544) 0:01:52.027 ******* 2019-12-08T11:56:16.772 INFO:teuthology.task.ansible.out: TASK [common : Reboot RHEL7 to workaround systemd bug] ************************* 2019-12-08T11:56:16.774 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:56:16.814 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:16 +0000 (0:00:00.068) 0:01:52.096 ******* 2019-12-08T11:56:16.841 INFO:teuthology.task.ansible.out: TASK [common : Wait for reboot in case of systemd workaround] ****************** 2019-12-08T11:56:16.842 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:56:16.883 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:16 +0000 (0:00:00.068) 0:01:52.165 ******* 2019-12-08T11:56:16.889 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2019-12-08T11:56:16.890 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "1d6dcd385d1b7c9c2b757c62b841c887e90d7f66", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 293, "state": "file", "uid": 0} 2019-12-08T11:56:16.917 INFO:teuthology.task.ansible.out: TASK [common : Set /etc/localtime (RHEL/CentOS 6)] ***************************** skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:56:16.961 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:16 +0000 (0:00:00.077) 0:01:52.242 ******* 2019-12-08T11:56:16.998 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone (RHEL/CentOS >= 7)] **************************** 2019-12-08T11:56:16.999 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:56:17.053 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:17 +0000 (0:00:00.092) 0:01:52.334 ******* 2019-12-08T11:56:17.091 INFO:teuthology.task.ansible.out: TASK [common : Install yum on Fedora 22 and later] ***************************** 2019-12-08T11:56:17.092 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:56:17.129 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:17 +0000 (0:00:00.076) 0:01:52.410 ******* 2019-12-08T11:56:17.166 INFO:teuthology.task.ansible.out: TASK [common : Set entitlements_path] ****************************************** 2019-12-08T11:56:17.167 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:56:17.203 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:17 +0000 (0:00:00.073) 0:01:52.484 ******* 2019-12-08T11:56:17.240 INFO:teuthology.task.ansible.out: TASK [common : Include Red Hat encrypted variables.] *************************** 2019-12-08T11:56:17.242 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item=None) => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} skipping: [smithi013.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-08T11:56:17.279 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:17 +0000 (0:00:00.076) 0:01:52.560 ******* 2019-12-08T11:56:17.316 INFO:teuthology.task.ansible.out: TASK [common : Set have_entitlements] ****************************************** 2019-12-08T11:56:17.317 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:56:17.362 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:17 +0000 (0:00:00.083) 0:01:52.644 ******* 2019-12-08T11:56:17.389 INFO:teuthology.task.ansible.out: TASK [common : Install CA Cert from Satellite Server] ************************** 2019-12-08T11:56:17.391 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:56:17.427 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:17 +0000 (0:00:00.064) 0:01:52.708 ******* 2019-12-08T11:56:17.465 INFO:teuthology.task.ansible.out: TASK [common : Determine if node is registered with subscription-manager.] ***** 2019-12-08T11:56:17.466 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-08T11:56:17.520 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:17 +0000 (0:00:00.093) 0:01:52.801 ******* 2019-12-08T11:56:17.552 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we're already registered] **************** 2019-12-08T11:56:17.554 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:56:17.596 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:17 +0000 (0:00:00.076) 0:01:52.878 ******* 2019-12-08T11:56:17.625 INFO:teuthology.task.ansible.out: TASK [common : Register with subscription-manager.] **************************** 2019-12-08T11:56:17.626 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-08T11:56:17.671 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:17 +0000 (0:00:00.074) 0:01:52.952 ******* 2019-12-08T11:56:17.710 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered if we just registered] ********************** 2019-12-08T11:56:17.712 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:56:17.753 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:17 +0000 (0:00:00.082) 0:01:53.035 ******* 2019-12-08T11:56:17.761 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2019-12-08T11:56:17.763 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "d9691278f687ee76cfe8a3de60fcbd4f1f79a8c6", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 327, "state": "file", "uid": 0} 2019-12-08T11:56:17.806 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:17 +0000 (0:00:00.052) 0:01:53.087 ******* 2019-12-08T11:56:17.813 INFO:teuthology.task.ansible.out: TASK [common : List CDN releases available to system] ************************** 2019-12-08T11:56:17.814 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:56:17.857 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:17 +0000 (0:00:00.048) 0:01:53.136 ******* 2019-12-08T11:56:17.882 INFO:teuthology.task.ansible.out: TASK [common : Unregister Beta/Alpha/RC system with subscription-manager] ****** 2019-12-08T11:56:17.887 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:56:17.921 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:17 +0000 (0:00:00.066) 0:01:53.203 ******* 2019-12-08T11:56:17.962 INFO:teuthology.task.ansible.out: TASK [common : Set rhsm_registered to false if Beta/Alpha/RC release] ********** skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:56:18.000 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:17 +0000 (0:00:00.078) 0:01:53.281 ******* 2019-12-08T11:56:18.029 INFO:teuthology.task.ansible.out: TASK [common : Configure internal beta repos in /etc/yum.repos.d/] ************* 2019-12-08T11:56:18.030 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-08T11:56:18.069 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:18 +0000 (0:00:00.068) 0:01:53.350 ******* 2019-12-08T11:56:18.095 INFO:teuthology.task.ansible.out: TASK [common : Clean yum cache] ************************************************ 2019-12-08T11:56:18.096 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:56:18.135 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:18 +0000 (0:00:00.066) 0:01:53.416 ******* 2019-12-08T11:56:18.198 INFO:teuthology.task.ansible.out: TASK [common : Get list of enabled RHSM repos] ********************************* skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:56:18.240 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:18 +0000 (0:00:00.104) 0:01:53.521 ******* 2019-12-08T11:56:18.282 INFO:teuthology.task.ansible.out: TASK [common : Store list of enabled repos] ************************************ 2019-12-08T11:56:18.283 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:56:18.321 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:18 +0000 (0:00:00.081) 0:01:53.602 ******* 2019-12-08T11:56:18.359 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos false if entitlements are missing or if we unregistered] *** 2019-12-08T11:56:18.361 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:56:18.400 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:18 +0000 (0:00:00.079) 0:01:53.682 ******* 2019-12-08T11:56:18.431 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if rhsm_repos differs from repo_list] **** 2019-12-08T11:56:18.432 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:56:18.475 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:18 +0000 (0:00:00.074) 0:01:53.756 ******* 2019-12-08T11:56:18.503 INFO:teuthology.task.ansible.out: TASK [common : Set replace_repos true if newly-subscribed] ********************* 2019-12-08T11:56:18.505 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:56:18.565 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:18 +0000 (0:00:00.090) 0:01:53.846 ******* 2019-12-08T11:56:18.595 INFO:teuthology.task.ansible.out: TASK [common : Disable all rhsm repos] ***************************************** 2019-12-08T11:56:18.595 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": false} 2019-12-08T11:56:18.635 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:18 +0000 (0:00:00.069) 0:01:53.916 ******* 2019-12-08T11:56:18.662 INFO:teuthology.task.ansible.out: TASK [common : Enable necessary rhsm repos] ************************************ 2019-12-08T11:56:18.702 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:18 +0000 (0:00:00.067) 0:01:53.983 ******* 2019-12-08T11:56:18.736 INFO:teuthology.task.ansible.out: TASK [common : Remove old apt-mirror repository definition.] ******************* 2019-12-08T11:56:18.738 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:56:18.779 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:18 +0000 (0:00:00.077) 0:01:54.061 ******* 2019-12-08T11:56:18.993 INFO:teuthology.task.ansible.out: 2019-12-08T11:56:18.994 INFO:teuthology.task.ansible.out:TASK [common : Configure local epel mirrorlists] ******************************* 2019-12-08T11:56:18.996 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": true, "checksum": "73c387451a4fa299c9cb53e25b182ae50e8b8563", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "md5sum": "6467980f3cbb5aa63a3cfe239626f53e", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 418, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1575806177.84-45372772106308/source", "state": "file", "uid": 0} 2019-12-08T11:56:19.185 INFO:teuthology.task.ansible.out: TASK [common : Increase the yum timeout.] ************************************** ok: [smithi013.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-08T11:56:19.253 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:19 +0000 (0:00:00.473) 0:01:54.534 ******* 2019-12-08T11:56:20.119 INFO:teuthology.task.ansible.out: TASK [common : Configure local epel mirrorlists] ******************************* changed: [smithi079.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": true, "checksum": "9d25e11bf71dfd21a39ace708c03408897a4f263", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "md5sum": "0848bb8607c5b0c5706d8e1930fa7d55", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 474, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1575806178.98-268532711506631/source", "state": "file", "uid": 0} 2019-12-08T11:56:20.168 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:20 +0000 (0:00:00.914) 0:01:55.449 ******* 2019-12-08T11:56:20.282 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2019-12-08T11:56:20.283 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "1d6dcd385d1b7c9c2b757c62b841c887e90d7f66", "dest": "/etc/yum.repos.d/epel.repo", "gid": 0, "group": "root", "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 293, "state": "file", "uid": 0} 2019-12-08T11:56:20.845 INFO:teuthology.task.ansible.out: TASK [common : Temporarily comment mirrorlist so we can update yum cache] ****** 2019-12-08T11:56:20.846 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "msg": "1 replacements made", "warnings": ["Module remote_tmp /root/.ansible/tmp did not exist and was created with a mode of 0700, this may cause issues when running as another user. To avoid this, create the remote_tmp dir with the correct permissions manually"]} 2019-12-08T11:56:21.176 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "msg": "1 replacements made"} 2019-12-08T11:56:21.178 INFO:teuthology.task.ansible.out: [WARNING]: Module remote_tmp /root/.ansible/tmp did not exist and was created with a mode of 0700, this may cause issues when running as another user. To avoid this, create the remote_tmp dir with the correct permissions manually 2019-12-08T11:56:21.218 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:21 +0000 (0:00:01.049) 0:01:56.499 ******* 2019-12-08T11:56:21.245 INFO:teuthology.task.ansible.out: TASK [common : Configure epel repos in /etc/yum.repos.d/] ********************** 2019-12-08T11:56:21.246 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "d9691278f687ee76cfe8a3de60fcbd4f1f79a8c6", "dest": "/etc/yum.repos.d/epel-testing.repo", "gid": 0, "group": "root", "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/epel-testing.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 327, "state": "file", "uid": 0} 2019-12-08T11:56:21.291 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:21 +0000 (0:00:00.072) 0:01:56.572 ******* 2019-12-08T11:56:22.472 INFO:teuthology.task.ansible.out: 2019-12-08T11:56:22.474 INFO:teuthology.task.ansible.out:TASK [common : Configure local epel mirrorlists] ******************************* changed: [smithi013.front.sepia.ceph.com] => (item=epel-mirrorlist) => {"ansible_loop_var": "item", "changed": true, "checksum": "73c387451a4fa299c9cb53e25b182ae50e8b8563", "dest": "/etc/yum.repos.d/epel-mirrorlist", "gid": 0, "group": "root", "item": "epel-mirrorlist", "md5sum": "6467980f3cbb5aa63a3cfe239626f53e", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 418, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1575806181.33-80839477388659/source", "state": "file", "uid": 0} 2019-12-08T11:56:23.692 INFO:teuthology.task.ansible.out:changed: [smithi013.front.sepia.ceph.com] => (item=epel-testing-mirrorlist) => {"ansible_loop_var": "item", "changed": true, "checksum": "9d25e11bf71dfd21a39ace708c03408897a4f263", "dest": "/etc/yum.repos.d/epel-testing-mirrorlist", "gid": 0, "group": "root", "item": "epel-testing-mirrorlist", "md5sum": "0848bb8607c5b0c5706d8e1930fa7d55", "mode": "0644", "owner": "root", "secontext": "system_u:object_r:system_conf_t:s0", "size": 474, "src": "/home/ubuntu/.ansible/tmp/ansible-tmp-1575806182.51-43830799271779/source", "state": "file", "uid": 0} 2019-12-08T11:56:23.749 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:23 +0000 (0:00:02.458) 0:01:59.031 ******* 2019-12-08T11:56:24.114 INFO:teuthology.task.ansible.out: TASK [common : Temporarily comment mirrorlist so we can update yum cache] ****** 2019-12-08T11:56:24.115 INFO:teuthology.task.ansible.out:changed: [smithi013.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "msg": "1 replacements made", "warnings": ["Module remote_tmp /root/.ansible/tmp did not exist and was created with a mode of 0700, this may cause issues when running as another user. To avoid this, create the remote_tmp dir with the correct permissions manually"]} 2019-12-08T11:56:24.420 INFO:teuthology.task.ansible.out:changed: [smithi013.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "msg": "1 replacements made"} 2019-12-08T11:56:24.481 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:24 +0000 (0:00:00.731) 0:01:59.762 ******* 2019-12-08T11:56:33.784 INFO:teuthology.task.ansible.out: TASK [common : Update yum cache] *********************************************** 2019-12-08T11:56:33.786 INFO:teuthology.task.ansible.out: [WARNING]: Consider using the file module with state=absent rather than running 'rm'. If you need to use command because file is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. changed: [smithi079.front.sepia.ceph.com] => {"changed": true, "cmd": "rm -rf /var/cache/yum/*; yum clean all; yum makecache", "delta": "0:00:12.228534", "end": "2019-12-08 11:56:33.751923", "rc": 0, "start": "2019-12-08 11:56:21.523389", "stderr": "", "stderr_lines": [], "stdout": "Loaded plugins: fastestmirror, langpacks, priorities\nCleaning repos: base centos7-fcgi-ceph epel extras lab-extras updates\nLoaded plugins: fastestmirror, langpacks, priorities\nDetermining fastest mirrors\n * base: mirrors.umflint.edu\n * extras: mirror.wdc1.us.leaseweb.net\n * updates: mirror.math.princeton.edu\nMetadata Cache Created", "stdout_lines": ["Loaded plugins: fastestmirror, langpacks, priorities", "Cleaning repos: base centos7-fcgi-ceph epel extras lab-extras updates", "Loaded plugins: fastestmirror, langpacks, priorities", "Determining fastest mirrors", " * base: mirrors.umflint.edu", " * extras: mirror.wdc1.us.leaseweb.net", " * updates: mirror.math.princeton.edu", "Metadata Cache Created"]} 2019-12-08T11:56:33.823 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:33 +0000 (0:00:09.341) 0:02:09.104 ******* 2019-12-08T11:56:34.176 INFO:teuthology.task.ansible.out: TASK [common : Uncomment mirrorlist] ******************************************* 2019-12-08T11:56:34.178 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "msg": "1 replacements made"} 2019-12-08T11:56:34.473 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "msg": "1 replacements made"} 2019-12-08T11:56:34.543 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:34 +0000 (0:00:00.720) 0:02:09.824 ******* 2019-12-08T11:56:34.581 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2019-12-08T11:56:34.583 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:56:34.641 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:34 +0000 (0:00:00.097) 0:02:09.922 ******* 2019-12-08T11:56:34.671 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone in /etc/timezone] ****************************** 2019-12-08T11:56:34.672 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:56:34.712 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:34 +0000 (0:00:00.071) 0:02:09.993 ******* 2019-12-08T11:56:34.739 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2019-12-08T11:56:34.740 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:56:34.776 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:34 +0000 (0:00:00.063) 0:02:10.057 ******* 2019-12-08T11:56:34.814 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2019-12-08T11:56:34.815 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:56:34.852 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:34 +0000 (0:00:00.076) 0:02:10.133 ******* 2019-12-08T11:56:34.882 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2019-12-08T11:56:34.884 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:56:34.920 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:34 +0000 (0:00:00.067) 0:02:10.201 ******* 2019-12-08T11:56:34.947 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2019-12-08T11:56:34.949 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:56:34.989 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:34 +0000 (0:00:00.069) 0:02:10.270 ******* 2019-12-08T11:56:35.016 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2019-12-08T11:56:35.017 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:56:35.056 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:35 +0000 (0:00:00.066) 0:02:10.337 ******* 2019-12-08T11:56:35.082 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2019-12-08T11:56:35.084 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:56:35.122 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:35 +0000 (0:00:00.066) 0:02:10.403 ******* 2019-12-08T11:56:36.528 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2019-12-08T11:56:36.530 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:01.112964", "end": "2019-12-08 11:56:36.500472", "rc": 0, "start": "2019-12-08 11:56:35.387508", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-08T11:56:36.570 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:36 +0000 (0:00:01.447) 0:02:11.851 ******* 2019-12-08T11:56:37.371 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2019-12-08T11:56:37.373 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["krb5-workstation-1.15.1-37.el7_7.2.x86_64 providing krb5-workstation is already installed"]} 2019-12-08T11:56:37.414 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:37 +0000 (0:00:00.844) 0:02:12.695 ******* 2019-12-08T11:56:37.441 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2019-12-08T11:56:37.443 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:56:37.479 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:37 +0000 (0:00:00.064) 0:02:12.760 ******* 2019-12-08T11:56:37.507 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2019-12-08T11:56:37.509 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:56:37.563 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:37 +0000 (0:00:00.084) 0:02:12.845 ******* 2019-12-08T11:56:37.605 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:56:37.645 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:37 +0000 (0:00:00.081) 0:02:12.926 ******* 2019-12-08T11:56:37.665 INFO:teuthology.task.ansible.out: TASK [common : Update yum cache] *********************************************** 2019-12-08T11:56:37.666 INFO:teuthology.task.ansible.out:changed: [smithi013.front.sepia.ceph.com] => {"changed": true, "cmd": "rm -rf /var/cache/yum/*; yum clean all; yum makecache", "delta": "0:00:12.863461", "end": "2019-12-08 11:56:37.633491", "rc": 0, "start": "2019-12-08 11:56:24.770030", "stderr": "", "stderr_lines": [], "stdout": "Loaded plugins: fastestmirror, langpacks, priorities\nCleaning repos: base centos7-fcgi-ceph epel extras lab-extras updates\nLoaded plugins: fastestmirror, langpacks, priorities\nDetermining fastest mirrors\n * base: mirrors.umflint.edu\n * extras: mirror.wdc1.us.leaseweb.net\n * updates: mirror.math.princeton.edu\nMetadata Cache Created", "stdout_lines": ["Loaded plugins: fastestmirror, langpacks, priorities", "Cleaning repos: base centos7-fcgi-ceph epel extras lab-extras updates", "Loaded plugins: fastestmirror, langpacks, priorities", "Determining fastest mirrors", " * base: mirrors.umflint.edu", " * extras: mirror.wdc1.us.leaseweb.net", " * updates: mirror.math.princeton.edu", "Metadata Cache Created"]} 2019-12-08T11:56:37.707 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:37 +0000 (0:00:00.062) 0:02:12.988 ******* 2019-12-08T11:56:37.713 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2019-12-08T11:56:37.715 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:56:37.760 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:37 +0000 (0:00:00.046) 0:02:13.035 ******* 2019-12-08T11:56:38.058 INFO:teuthology.task.ansible.out: TASK [common : Uncomment mirrorlist] ******************************************* 2019-12-08T11:56:38.552 INFO:teuthology.task.ansible.out:changed: [smithi013.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-mirrorlist', u'name': u'Extra Packages for Enterprise Linux', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': u'1', u'baseurl': u'http://dl.fedoraproject.org/pub/epel/7/$basearch'}, 'key': u'epel'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/7/$basearch", "enabled": "1", "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-mirrorlist", "name": "Extra Packages for Enterprise Linux"}}, "msg": "1 replacements made"} changed: [smithi013.front.sepia.ceph.com] => (item={'value': {u'mirrorlist': u'file:///etc/yum.repos.d/epel-testing-mirrorlist', u'name': u'Extra Packages for Enterprise Linux - Testing', u'failovermethod': u'priority', u'gpgcheck': 0, u'enabled': 0, u'baseurl': u'http://dl.fedoraproject.org/pub/epel/testing/7/$basearch'}, 'key': u'epel-testing'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "epel-testing", "value": {"baseurl": "http://dl.fedoraproject.org/pub/epel/testing/7/$basearch", "enabled": 0, "failovermethod": "priority", "gpgcheck": 0, "mirrorlist": "file:///etc/yum.repos.d/epel-testing-mirrorlist", "name": "Extra Packages for Enterprise Linux - Testing"}}, "msg": "1 replacements made"} Sunday 08 December 2019 11:56:38 +0000 (0:00:00.679) 0:02:13.714 ******* TASK [common : Get the current timezone] *************************************** skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} Sunday 08 December 2019 11:56:38 +0000 (0:00:00.066) 0:02:13.780 ******* TASK [common : Set the timezone in /etc/timezone] ****************************** skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:56:38.585 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:38 +0000 (0:00:00.085) 0:02:13.866 ******* 2019-12-08T11:56:38.613 INFO:teuthology.task.ansible.out: TASK [common : Inform the OS of the new timezone] ****************************** 2019-12-08T11:56:38.615 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:56:38.651 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:38 +0000 (0:00:00.066) 0:02:13.933 ******* 2019-12-08T11:56:38.721 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2019-12-08T11:56:38.722 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2019-12-08T11:56:38.867 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:38 +0000 (0:00:00.215) 0:02:14.148 ******* 2019-12-08T11:56:38.872 INFO:teuthology.task.ansible.out: TASK [common : Get the current timezone] *************************************** 2019-12-08T11:56:38.874 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:56:38.912 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:38 +0000 (0:00:00.045) 0:02:14.193 ******* 2019-12-08T11:56:38.949 INFO:teuthology.task.ansible.out: TASK [common : Set the timezone] *********************************************** 2019-12-08T11:56:38.950 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:56:38.989 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:38 +0000 (0:00:00.075) 0:02:14.269 ******* 2019-12-08T11:56:39.019 INFO:teuthology.task.ansible.out: TASK [common : Add base OpenSUSE Leap repo] ************************************ 2019-12-08T11:56:39.021 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:56:39.065 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:39 +0000 (0:00:00.077) 0:02:14.346 ******* 2019-12-08T11:56:39.093 INFO:teuthology.task.ansible.out: TASK [common : Add updates OpenSUSE Leap repo] ********************************* 2019-12-08T11:56:39.095 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:56:39.131 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:39 +0000 (0:00:00.066) 0:02:14.413 ******* 2019-12-08T11:56:39.161 INFO:teuthology.task.ansible.out: TASK [common : Refresh repos] ************************************************** 2019-12-08T11:56:39.163 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:56:39.220 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:39 +0000 (0:00:00.088) 0:02:14.502 ******* 2019-12-08T11:56:40.526 INFO:teuthology.task.ansible.out: TASK [common : Set the hardware clock] ***************************************** 2019-12-08T11:56:40.527 INFO:teuthology.task.ansible.out:changed: [smithi013.front.sepia.ceph.com] => {"changed": true, "cmd": ["hwclock", "--systohc"], "delta": "0:00:00.984543", "end": "2019-12-08 11:56:40.500758", "rc": 0, "start": "2019-12-08 11:56:39.516215", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-08T11:56:40.571 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:40 +0000 (0:00:01.350) 0:02:15.852 ******* 2019-12-08T11:56:41.117 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (RedHat)] ***************************** 2019-12-08T11:56:41.118 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["krb5-workstation-1.15.1-37.el7_7.2.x86_64 providing krb5-workstation is already installed"]} 2019-12-08T11:56:41.175 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:41 +0000 (0:00:00.604) 0:02:16.456 ******* 2019-12-08T11:56:41.202 INFO:teuthology.task.ansible.out: TASK [common : Clean apt cache] ************************************************ 2019-12-08T11:56:41.204 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:56:41.258 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:41 +0000 (0:00:00.083) 0:02:16.540 ******* 2019-12-08T11:56:41.295 INFO:teuthology.task.ansible.out: TASK [common : Update apt cache] *********************************************** 2019-12-08T11:56:41.296 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:56:41.335 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:41 +0000 (0:00:00.076) 0:02:16.616 ******* 2019-12-08T11:56:41.362 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (Debian)] ***************************** 2019-12-08T11:56:41.364 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:56:41.418 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:41 +0000 (0:00:00.082) 0:02:16.699 ******* 2019-12-08T11:56:41.450 INFO:teuthology.task.ansible.out: TASK [common : Install Kerberos Packages (OpenSUSE Leap)] ********************** 2019-12-08T11:56:41.452 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:56:41.492 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:41 +0000 (0:00:00.073) 0:02:16.773 ******* 2019-12-08T11:56:42.427 INFO:teuthology.task.ansible.out: TASK [common : Add krb5 config file] ******************************************* 2019-12-08T11:56:42.430 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => {"changed": false, "checksum": "b3c1a33d19a4e448c29374429629dff57657b576", "dest": "/etc/krb5.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/krb5.conf", "secontext": "system_u:object_r:krb5_conf_t:s0", "size": 131, "state": "file", "uid": 0} 2019-12-08T11:56:42.477 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:42 +0000 (0:00:00.984) 0:02:17.758 ******* 2019-12-08T11:56:42.748 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2019-12-08T11:56:42.748 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": [], "updated": []}, "msg": "", "rc": 0, "results": ["All packages providing smartmontools are up to date", ""]} 2019-12-08T11:56:42.796 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:42 +0000 (0:00:00.318) 0:02:18.077 ******* 2019-12-08T11:56:43.739 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2019-12-08T11:56:43.739 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2019-12-08T11:56:44.694 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2019-12-08T11:56:45.523 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2019-12-08T11:56:45.579 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:45 +0000 (0:00:02.778) 0:02:20.855 ******* 2019-12-08T11:56:45.890 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* ok: [smithi079.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-12-08T11:56:45.953 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:45 +0000 (0:00:00.378) 0:02:21.234 ******* 2019-12-08T11:56:46.558 INFO:teuthology.task.ansible.out: TASK [common : Make sure smartmontools is installed] *************************** 2019-12-08T11:56:46.558 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": [], "updated": []}, "msg": "", "rc": 0, "results": ["All packages providing smartmontools are up to date", ""]} 2019-12-08T11:56:46.604 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:46 +0000 (0:00:00.651) 0:02:21.886 ******* 2019-12-08T11:56:46.854 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2019-12-08T11:56:46.855 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2019-12-08T11:56:47.631 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** 2019-12-08T11:56:47.633 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item=megacli) => {"ansible_loop_var": "item", "changed": false, "checksum": "cb3ef2aa6a3e3002b234f166e739a39b1f3a1bde", "dest": "/usr/sbin/megacli", "gid": 0, "group": "root", "item": "megacli", "mode": "0755", "owner": "root", "path": "/usr/sbin/megacli", "secontext": "system_u:object_r:bin_t:s0", "size": 2716736, "state": "file", "uid": 0} 2019-12-08T11:56:47.704 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2019-12-08T11:56:47.705 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2019-12-08T11:56:48.501 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2019-12-08T11:56:48.565 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:48 +0000 (0:00:01.960) 0:02:23.846 ******* 2019-12-08T11:56:48.582 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** ok: [smithi013.front.sepia.ceph.com] => (item=cli64) => {"ansible_loop_var": "item", "changed": false, "checksum": "a3b8773b14e8594ffbd9fc156c09436eb0184bc7", "dest": "/usr/sbin/cli64", "gid": 0, "group": "root", "item": "cli64", "mode": "0755", "owner": "root", "path": "/usr/sbin/cli64", "secontext": "system_u:object_r:bin_t:s0", "size": 1952038, "state": "file", "uid": 0} 2019-12-08T11:56:48.615 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:56:48.640 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:48 +0000 (0:00:00.075) 0:02:23.921 ******* 2019-12-08T11:56:48.698 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2019-12-08T11:56:48.699 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2019-12-08T11:56:48.743 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:48 +0000 (0:00:00.102) 0:02:24.024 ******* 2019-12-08T11:56:49.445 INFO:teuthology.task.ansible.out: TASK [common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/.] *** ok: [smithi013.front.sepia.ceph.com] => (item=nvme) => {"ansible_loop_var": "item", "changed": false, "checksum": "98735dcacd6fec55dd92b67281b478603b7955b1", "dest": "/usr/sbin/nvme", "gid": 0, "group": "root", "item": "nvme", "mode": "0755", "owner": "root", "path": "/usr/sbin/nvme", "secontext": "system_u:object_r:bin_t:s0", "size": 580432, "state": "file", "uid": 0} 2019-12-08T11:56:49.482 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:49 +0000 (0:00:00.739) 0:02:24.764 ******* 2019-12-08T11:56:49.811 INFO:teuthology.task.ansible.out: TASK [common : Create /usr/libexec.] ******************************************* 2019-12-08T11:56:49.813 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/libexec", "secontext": "system_u:object_r:bin_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-12-08T11:56:49.850 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:49 +0000 (0:00:00.368) 0:02:25.132 ******* 2019-12-08T11:56:50.067 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* 2019-12-08T11:56:50.069 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2019-12-08T11:56:50.106 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:50 +0000 (0:00:00.255) 0:02:25.387 ******* 2019-12-08T11:56:50.157 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe without epel] ************************************** 2019-12-08T11:56:50.159 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-12-08T11:56:50.169 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-12-08T11:56:50.191 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-12-08T11:56:50.202 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-12-08T11:56:50.243 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:50 +0000 (0:00:00.137) 0:02:25.525 ******* 2019-12-08T11:56:50.762 INFO:teuthology.task.ansible.out: TASK [common : Upload custom netsaint scripts for raid/disk/smart/monitoring to /usr/libexec/.] *** 2019-12-08T11:56:50.764 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item=smart.sh) => {"ansible_loop_var": "item", "changed": false, "checksum": "9a447e184389aadb9aaf1e77f30f0a7f8b716c4e", "dest": "/usr/libexec/smart.sh", "gid": 0, "group": "root", "item": "smart.sh", "mode": "0755", "owner": "root", "path": "/usr/libexec/smart.sh", "secontext": "system_u:object_r:bin_t:s0", "size": 12725, "state": "file", "uid": 0} 2019-12-08T11:56:51.668 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item=raid.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9d9a89805d8a9e4c7281934e887da31f7ac464fb", "dest": "/usr/libexec/raid.pl", "gid": 0, "group": "root", "item": "raid.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/raid.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 8602, "state": "file", "uid": 0} 2019-12-08T11:56:52.478 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item=diskusage.pl) => {"ansible_loop_var": "item", "changed": false, "checksum": "9c74425885a83f23bc37817de46979ca5173ccb7", "dest": "/usr/libexec/diskusage.pl", "gid": 0, "group": "root", "item": "diskusage.pl", "mode": "0755", "owner": "root", "path": "/usr/libexec/diskusage.pl", "secontext": "system_u:object_r:bin_t:s0", "size": 3605, "state": "file", "uid": 0} 2019-12-08T11:56:52.519 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:52 +0000 (0:00:02.275) 0:02:27.800 ******* 2019-12-08T11:56:52.557 INFO:teuthology.task.ansible.out: TASK [common : Include apt_system vars] **************************************** 2019-12-08T11:56:52.558 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:56:52.594 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:52 +0000 (0:00:00.075) 0:02:27.875 ******* 2019-12-08T11:56:52.631 INFO:teuthology.task.ansible.out: TASK [common : Include yum_systems vars] *************************************** 2019-12-08T11:56:52.633 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => {"ansible_facts": {"nagios_plugins_directory": "/usr/lib64/nagios/plugins", "nrpe_group": "nrpe", "nrpe_packages": ["nagios-common", "nrpe", "nagios-plugins", "nagios-plugins-load"], "nrpe_service_name": "nrpe", "nrpe_user": "nrpe"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/common/vars/yum_systems.yml"], "changed": false} 2019-12-08T11:56:52.688 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:52 +0000 (0:00:00.093) 0:02:27.968 ******* 2019-12-08T11:56:53.024 INFO:teuthology.task.ansible.out: TASK [common : Check for epel] ************************************************* changed: [smithi013.front.sepia.ceph.com] => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} 2019-12-08T11:56:53.072 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:53 +0000 (0:00:00.385) 0:02:28.354 ******* 2019-12-08T11:56:53.114 INFO:teuthology.task.ansible.out: 2019-12-08T11:56:53.115 INFO:teuthology.task.ansible.out:TASK [common : Install nrpe without epel] ************************************** skipping: [smithi013.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-common-4.0.8-2.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-12-08T11:56:53.137 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nrpe-2.15-7.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-12-08T11:56:53.149 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-12-08T11:56:53.161 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item=http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm) => {"ansible_loop_var": "item", "changed": false, "item": "http://apt-mirror.front.sepia.ceph.com/lab-extras/rhel7/x86_64/nagios-plugins-load-2.0.3-3.el7.x86_64.rpm", "skip_reason": "Conditional result was False"} 2019-12-08T11:56:53.215 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:53 +0000 (0:00:00.142) 0:02:28.496 ******* 2019-12-08T11:56:53.608 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ ok: [smithi079.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": [], "updated": []}, "msg": "", "rc": 0, "results": ["All packages providing nagios-common are up to date", "All packages providing nrpe are up to date", "All packages providing nagios-plugins are up to date", "All packages providing nagios-plugins-load are up to date", ""]} 2019-12-08T11:56:53.659 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:53 +0000 (0:00:00.442) 0:02:28.939 ******* 2019-12-08T11:56:53.688 INFO:teuthology.task.ansible.out: 2019-12-08T11:56:53.690 INFO:teuthology.task.ansible.out:TASK [common : Install nrpe package and dependencies (Ubuntu)] ***************** skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:56:53.740 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:53 +0000 (0:00:00.082) 0:02:29.021 ******* 2019-12-08T11:56:53.741 INFO:teuthology.task.ansible.out: 2019-12-08T11:56:54.659 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2019-12-08T11:56:54.660 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2019-12-08T11:56:54.700 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:54 +0000 (0:00:00.960) 0:02:29.981 ******* 2019-12-08T11:56:55.652 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2019-12-08T11:56:55.653 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2019-12-08T11:56:55.700 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:55 +0000 (0:00:00.999) 0:02:30.981 ******* 2019-12-08T11:56:55.731 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:56:55.776 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:55 +0000 (0:00:00.072) 0:02:31.053 ******* 2019-12-08T11:56:56.105 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2019-12-08T11:56:56.106 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-08T11:56:56.148 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:56 +0000 (0:00:00.375) 0:02:31.429 ******* 2019-12-08T11:56:56.533 INFO:teuthology.task.ansible.out: TASK [common : Check firewalld status] ***************************************** 2019-12-08T11:56:56.535 INFO:teuthology.task.ansible.out:fatal: [smithi079.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2019-12-08T11:56:56.573 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:56 +0000 (0:00:00.424) 0:02:31.854 ******* 2019-12-08T11:56:56.601 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (RHEL/CentOS)] ************ 2019-12-08T11:56:56.602 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": [], "updated": []}, "msg": "", "rc": 0, "results": ["All packages providing nagios-common are up to date", "All packages providing nrpe are up to date", "All packages providing nagios-plugins are up to date", "All packages providing nagios-plugins-load are up to date", ""]} 2019-12-08T11:56:56.646 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:56 +0000 (0:00:00.073) 0:02:31.927 ******* 2019-12-08T11:56:56.654 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2019-12-08T11:56:56.656 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:56:56.695 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:56 +0000 (0:00:00.048) 0:02:31.976 ******* 2019-12-08T11:56:56.702 INFO:teuthology.task.ansible.out: TASK [common : Install nrpe package and dependencies (Ubuntu)] ***************** 2019-12-08T11:56:56.703 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:56:56.744 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:56 +0000 (0:00:00.049) 0:02:32.026 ******* 2019-12-08T11:56:57.636 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2019-12-08T11:56:57.637 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"changed": false, "checksum": "333141ba5e85aea94f51511a52d9b115d2e0112f", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1174, "state": "file", "uid": 0} 2019-12-08T11:56:57.678 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:57 +0000 (0:00:00.933) 0:02:32.959 ******* 2019-12-08T11:56:57.707 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios sudoers.d for raid utilities.] ******************** 2019-12-08T11:56:57.708 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => {"changed": false, "checksum": "b423b985ccbb69b65a711d372645a5f704b30e8b", "dest": "/etc/sudoers.d/90-nagios", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers.d/90-nagios", "secontext": "system_u:object_r:etc_t:s0", "size": 178, "state": "file", "uid": 0} 2019-12-08T11:56:57.749 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:57 +0000 (0:00:00.071) 0:02:33.031 ******* 2019-12-08T11:56:58.678 INFO:teuthology.task.ansible.out: 2019-12-08T11:56:58.681 INFO:teuthology.task.ansible.out:TASK [common : Make sure nagios nrpe service is running.] ********************** ok: [smithi079.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Sun 2019-12-08 11:54:13 UTC", "ActiveEnterTimestampMonotonic": "19685183", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "systemd-journald.socket var-run.mount basic.target local-fs.target network.target system.slice time-sync.target nss-lookup.target", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "yes", "AssertTimestamp": "Sun 2019-12-08 11:54:13 UTC", "AssertTimestampMonotonic": "19684277", "Before": "xdm.service multi-user.target shutdown.target getty@tty1.service", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "yes", "ConditionTimestamp": "Sun 2019-12-08 11:54:13 UTC", "ConditionTimestampMonotonic": "19684276", "Conflicts": "nrpe.socket shutdown.target", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Program Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "EnvironmentFile": "/etc/sysconfig/nrpe (ignore_errors=no)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "8968", "ExecMainStartTimestamp": "Sun 2019-12-08 11:54:13 UTC", "ExecMainStartTimestampMonotonic": "19685099", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/ 2019-12-08T11:56:58.683 INFO:teuthology.task.ansible.out:nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_SSL_OPT ; ignore_errors=no ; start_time=[Sun 2019-12-08 11:54:13 UTC] ; stop_time=[n/a] ; pid=8968 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "Group": "nrpe", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Sun 2019-12-08 11:54:13 UTC", "InactiveExitTimestampMonotonic": "19685183", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127511", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127511", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "8968", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "basic.target network-online.target", " 2019-12-08T11:56:58.684 INFO:teuthology.task.ansible.out:Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "WantedBy": "multi-user.target", "Wants": "system.slice", "WatchdogTimestamp": "Sun 2019-12-08 11:54:13 UTC", "WatchdogTimestampMonotonic": "19685151", "WatchdogUSec": "0"}} 2019-12-08T11:56:58.722 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:58 +0000 (0:00:00.971) 0:02:34.003 ******* 2019-12-08T11:56:58.740 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios check_mem script] ********************************* 2019-12-08T11:56:58.741 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => {"changed": false, "checksum": "39df629b10ded370443e2e4c84d690332c95104d", "dest": "/usr/lib64/nagios/plugins/check_mem.sh", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib64/nagios/plugins/check_mem.sh", "secontext": "system_u:object_r:nagios_unconfined_plugin_exec_t:s0", "size": 1964, "state": "file", "uid": 0} 2019-12-08T11:56:58.778 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:58 +0000 (0:00:00.056) 0:02:34.060 ******* 2019-12-08T11:56:58.805 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (Ubuntu)] ************************ 2019-12-08T11:56:58.807 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:56:58.849 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:58 +0000 (0:00:00.068) 0:02:34.129 ******* 2019-12-08T11:56:59.048 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* changed: [smithi079.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.003925", "end": "2019-12-08 11:56:59.019615", "rc": 0, "start": "2019-12-08 11:56:59.015690", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2019-12-08T11:56:59.120 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:59 +0000 (0:00:00.272) 0:02:34.401 ******* 2019-12-08T11:56:59.183 INFO:teuthology.task.ansible.out: TASK [common : Configure nagios nrpe settings (RHEL/CentOS)] ******************* 2019-12-08T11:56:59.184 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-08T11:56:59.257 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:59 +0000 (0:00:00.136) 0:02:34.538 ******* 2019-12-08T11:56:59.641 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** 2019-12-08T11:56:59.643 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["libsemanage-python-2.5-14.el7.x86_64 providing libsemanage-python is already installed", "policycoreutils-python-2.5-29.el7.x86_64 providing policycoreutils-python is already installed"]} TASK [common : Check firewalld status] ***************************************** fatal: [smithi013.front.sepia.ceph.com]: FAILED! => {"censored": "the output has been hidden due to the fact that 'no_log: true' was specified for this result", "changed": true} ...ignoring 2019-12-08T11:56:59.693 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:59 +0000 (0:00:00.436) 0:02:34.975 ******* 2019-12-08T11:56:59.756 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:59 +0000 (0:00:00.062) 0:02:35.037 ******* 2019-12-08T11:56:59.763 INFO:teuthology.task.ansible.out: TASK [common : Open nrpe port if firewalld enabled] **************************** 2019-12-08T11:56:59.763 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:56:59.821 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:56:59 +0000 (0:00:00.065) 0:02:35.103 ******* 2019-12-08T11:57:00.751 INFO:teuthology.task.ansible.out: TASK [common : Upload nagios nrpe config.] ************************************* 2019-12-08T11:57:00.753 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => {"changed": false, "checksum": "333141ba5e85aea94f51511a52d9b115d2e0112f", "dest": "/etc/nagios/nrpe.cfg", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/nagios/nrpe.cfg", "secontext": "system_u:object_r:nrpe_etc_t:s0", "size": 1174, "state": "file", "uid": 0} 2019-12-08T11:57:00.788 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:57:00 +0000 (0:00:00.966) 0:02:36.069 ******* 2019-12-08T11:57:01.219 INFO:teuthology.task.ansible.out: TASK [common : Make sure nagios nrpe service is running.] ********************** 2019-12-08T11:57:01.222 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => {"changed": false, "enabled": true, "name": "nrpe", "state": "started", "status": {"ActiveEnterTimestamp": "Sun 2019-12-08 11:53:54 UTC", "ActiveEnterTimestampMonotonic": "20061286", "ActiveExitTimestampMonotonic": "0", "ActiveState": "active", "After": "basic.target network.target var-run.mount system.slice local-fs.target time-sync.target systemd-journald.socket nss-lookup.target", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "yes", "AssertTimestamp": "Sun 2019-12-08 11:53:54 UTC", "AssertTimestampMonotonic": "20060736", "Before": "xdm.service getty@tty1.service shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "yes", "ConditionTimestamp": "Sun 2019-12-08 11:53:54 UTC", "ConditionTimestampMonotonic": "20060736", "Conflicts": "shutdown.target nrpe.socket", "ControlGroup": "/system.slice/nrpe.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Nagios Remote Program Executor", "DevicePolicy": "auto", "Documentation": "http://www.nagios.org/documentation", "EnvironmentFile": "/etc/sysconfig/nrpe (ignore_errors=no)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "8727", "ExecMainStartTimestamp": "Sun 2019-12-08 11:53:54 UTC", "ExecMainStartTimestampMonotonic": "20061233", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/nrpe ; argv[]=/usr/sbin/nrpe -c /etc/nagios/nrpe.cfg -f $NRPE_SSL_OPT ; ignore_err 2019-12-08T11:57:01.223 INFO:teuthology.task.ansible.out:ors=no ; start_time=[Sun 2019-12-08 11:53:54 UTC] ; stop_time=[n/a] ; pid=8727 ; code=(null) ; status=0/0 }", "ExecStopPost": "{ path=/bin/rm ; argv[]=/bin/rm -f /var/run/nrpe/nrpe.pid ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/nrpe.service", "Group": "nrpe", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "nrpe.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestamp": "Sun 2019-12-08 11:53:54 UTC", "InactiveExitTimestampMonotonic": "20061286", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127535", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127535", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "8727", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "nrpe.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "basic.target network-online.target", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOn 2019-12-08T11:57:01.225 INFO:teuthology.task.ansible.out:ly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "running", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "simple", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "User": "nrpe", "WantedBy": "multi-user.target", "Wants": "system.slice", "WatchdogTimestamp": "Sun 2019-12-08 11:53:54 UTC", "WatchdogTimestampMonotonic": "20061268", "WatchdogUSec": "0"}} 2019-12-08T11:57:01.274 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:57:01 +0000 (0:00:00.486) 0:02:36.555 ******* 2019-12-08T11:57:01.623 INFO:teuthology.task.ansible.out: TASK [common : Get SELinux status] ********************************************* 2019-12-08T11:57:01.624 INFO:teuthology.task.ansible.out:changed: [smithi013.front.sepia.ceph.com] => {"changed": true, "cmd": ["getenforce"], "delta": "0:00:00.003795", "end": "2019-12-08 11:57:01.597581", "rc": 0, "start": "2019-12-08 11:57:01.593786", "stderr": "", "stderr_lines": [], "stdout": "Permissive", "stdout_lines": ["Permissive"]} 2019-12-08T11:57:01.660 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:57:01 +0000 (0:00:00.386) 0:02:36.942 ******* 2019-12-08T11:57:02.175 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Install SELinux dependencies] **************************** ok: [smithi013.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["libsemanage-python-2.5-14.el7.x86_64 providing libsemanage-python is already installed", "policycoreutils-python-2.5-29.el7.x86_64 providing policycoreutils-python is already installed"]} 2019-12-08T11:57:02.222 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:57:02 +0000 (0:00:00.561) 0:02:37.503 ******* 2019-12-08T11:57:26.602 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* changed: [smithi079.front.sepia.ceph.com] => {"changed": true, "changes": {"installed": [], "updated": [["selinux-policy-targeted", "3.13.1-252.el7_7.6.noarch from updates"]]}, "msg": "", "rc": 0, "results": ["Loaded plugins: fastestmirror, langpacks, priorities\nLoading mirror speeds from cached hostfile\n * base: mirrors.umflint.edu\n * epel: download-cc-rdu01.fedoraproject.org\n * extras: mirror.wdc1.us.leaseweb.net\n * updates: mirror.math.princeton.edu\nResolving Dependencies\n--> Running transaction check\n---> Package selinux-policy-targeted.noarch 0:3.13.1-252.el7.1 will be updated\n---> Package selinux-policy-targeted.noarch 0:3.13.1-252.el7_7.6 will be an update\n--> Processing Dependency: selinux-policy = 3.13.1-252.el7_7.6 for package: selinux-policy-targeted-3.13.1-252.el7_7.6.noarch\n--> Processing Dependency: selinux-policy = 3.13.1-252.el7_7.6 for package: selinux-policy-targeted-3.13.1-252.el7_7.6.noarch\n--> Running transaction check\n---> Package selinux-policy.noarch 0:3.13.1-252.el7.1 will be updated\n---> Package selinux-policy.noarch 0:3.13.1-252.el7_7.6 will be an update\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nUpdating:\n selinux-policy-targeted noarch 3.13.1-252.el7_7.6 updates 7.0 M\nUpdating for dependencies:\n selinux-policy noarch 3.13.1-252.el7_7.6 updates 492 k\n\nTransaction Summary\n================================================================================\nUpgrade 1 Package (+1 Dependent package)\n\nTotal download size: 7.5 M\nDownloading packages:\nDelta RPMs disabled because /usr/bin/applydeltarpm not installed.\n-------------------------- 2019-12-08T11:57:26.605 INFO:teuthology.task.ansible.out:------------------------------------------------------\nTotal 23 MB/s | 7.5 MB 00:00 \nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Updating : selinux-policy-3.13.1-252.el7_7.6.noarch 1/4 \n Updating : selinux-policy-targeted-3.13.1-252.el7_7.6.noarch 2/4 \n Cleanup : selinux-policy-targeted-3.13.1-252.el7.1.noarch 3/4 \n Cleanup : selinux-policy-3.13.1-252.el7.1.noarch 4/4 \n Verifying : selinux-policy-3.13.1-252.el7_7.6.noarch 1/4 \n Verifying : selinux-policy-targeted-3.13.1-252.el7_7.6.noarch 2/4 \n Verifying : selinux-policy-targeted-3.13.1-252.el7.1.noarch 3/4 \n Verifying : selinux-policy-3.13.1-252.el7.1.noarch 4/4 \n\nUpdated:\n selinux-policy-targeted.noarch 0:3.13.1-252.el7_7.6 \n\nDependency Updated:\n selinux-policy.noarch 0:3.13.1-252.el7_7.6 \n\nComplete!\n"]} 2019-12-08T11:57:26.650 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:57:26 +0000 (0:00:24.427) 0:03:01.931 ******* 2019-12-08T11:57:27.385 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2019-12-08T11:57:27.387 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2019-12-08T11:57:27.428 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:57:27 +0000 (0:00:00.775) 0:03:02.707 ******* 2019-12-08T11:57:31.019 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Ensure SELinux policy is up to date] ********************* 2019-12-08T11:57:31.020 INFO:teuthology.task.ansible.out:changed: [smithi013.front.sepia.ceph.com] => {"changed": true, "changes": {"installed": [], "updated": [["selinux-policy-targeted", "3.13.1-252.el7_7.6.noarch from updates"]]}, "msg": "", "rc": 0, "results": ["Loaded plugins: fastestmirror, langpacks, priorities\nLoading mirror speeds from cached hostfile\n * base: mirrors.umflint.edu\n * epel: download-cc-rdu01.fedoraproject.org\n * extras: mirror.wdc1.us.leaseweb.net\n * updates: mirror.math.princeton.edu\nResolving Dependencies\n--> Running transaction check\n---> Package selinux-policy-targeted.noarch 0:3.13.1-252.el7.1 will be updated\n---> Package selinux-policy-targeted.noarch 0:3.13.1-252.el7_7.6 will be an update\n--> Processing Dependency: selinux-policy = 3.13.1-252.el7_7.6 for package: selinux-policy-targeted-3.13.1-252.el7_7.6.noarch\n--> Processing Dependency: selinux-policy = 3.13.1-252.el7_7.6 for package: selinux-policy-targeted-3.13.1-252.el7_7.6.noarch\n--> Running transaction check\n---> Package selinux-policy.noarch 0:3.13.1-252.el7.1 will be updated\n---> Package selinux-policy.noarch 0:3.13.1-252.el7_7.6 will be an update\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nUpdating:\n selinux-policy-targeted noarch 3.13.1-252.el7_7.6 updates 7.0 M\nUpdating for dependencies:\n selinux-policy noarch 3.13.1-252.el7_7.6 updates 492 k\n\nTransaction Summary\n================================================================================\nUpgrade 1 Package (+1 Dependent package)\n\nTotal download size: 7.5 M\nDownloading packages:\nDelta RPMs disabled because /usr/bin/applydeltarpm not installed.\n--------------------------------------------------------------------------------\nTotal 2019-12-08T11:57:31.021 INFO:teuthology.task.ansible.out: 13 MB/s | 7.5 MB 00:00 \nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Updating : selinux-policy-3.13.1-252.el7_7.6.noarch 1/4 \n Updating : selinux-policy-targeted-3.13.1-252.el7_7.6.noarch 2/4 \n Cleanup : selinux-policy-targeted-3.13.1-252.el7.1.noarch 3/4 \n Cleanup : selinux-policy-3.13.1-252.el7.1.noarch 4/4 \n Verifying : selinux-policy-3.13.1-252.el7_7.6.noarch 1/4 \n Verifying : selinux-policy-targeted-3.13.1-252.el7_7.6.noarch 2/4 \n Verifying : selinux-policy-targeted-3.13.1-252.el7.1.noarch 3/4 \n Verifying : selinux-policy-3.13.1-252.el7.1.noarch 4/4 \n\nUpdated:\n selinux-policy-targeted.noarch 0:3.13.1-252.el7_7.6 \n\nDependency Updated:\n selinux-policy.noarch 0:3.13.1-252.el7_7.6 \n\nComplete!\n"]} 2019-12-08T11:57:31.064 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:57:31 +0000 (0:00:03.638) 0:03:06.345 ******* 2019-12-08T11:57:31.643 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Set SELinux boolean nagios_run_sudo true] **************** 2019-12-08T11:57:31.645 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => {"changed": false, "name": "nagios_run_sudo", "persistent": true, "state": true} 2019-12-08T11:57:31.690 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:57:31 +0000 (0:00:00.624) 0:03:06.970 ******* 2019-12-08T11:57:35.484 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** changed: [smithi079.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:07.727651", "end": "2019-12-08 11:57:35.441488", "failed_when_result": false, "rc": 0, "start": "2019-12-08 11:57:27.713837", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2019-12-08T11:57:35.531 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:57:35 +0000 (0:00:03.842) 0:03:10.812 ******* 2019-12-08T11:57:36.496 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** 2019-12-08T11:57:36.503 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2019-12-08T11:57:36.535 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:57:36 +0000 (0:00:01.004) 0:03:11.816 ******* 2019-12-08T11:57:36.862 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2019-12-08T11:57:36.863 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.017708", "end": "2019-12-08 11:57:36.835541", "rc": 0, "start": "2019-12-08 11:57:36.817833", "stderr": "", "stderr_lines": [], "stdout": "checkmodule: loading policy configuration from /tmp/nrpe.te\ncheckmodule: policy configuration loaded\ncheckmodule: writing binary representation (version 19) to /tmp/nrpe.mod", "stdout_lines": ["checkmodule: loading policy configuration from /tmp/nrpe.te", "checkmodule: policy configuration loaded", "checkmodule: writing binary representation (version 19) to /tmp/nrpe.mod"]} 2019-12-08T11:57:36.906 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:57:36 +0000 (0:00:00.371) 0:03:12.187 ******* 2019-12-08T11:57:37.256 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2019-12-08T11:57:37.257 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.014649", "end": "2019-12-08 11:57:37.228209", "rc": 0, "start": "2019-12-08 11:57:37.213560", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-08T11:57:37.300 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:57:37 +0000 (0:00:00.389) 0:03:12.577 ******* 2019-12-08T11:57:40.392 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove SELinux policy package] *************************** 2019-12-08T11:57:40.394 INFO:teuthology.task.ansible.out:changed: [smithi013.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-r", "nrpe"], "delta": "0:00:08.372335", "end": "2019-12-08 11:57:40.357822", "failed_when_result": false, "rc": 0, "start": "2019-12-08 11:57:31.985487", "stderr": "", "stderr_lines": [], "stdout": "libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority).", "stdout_lines": ["libsemanage.semanage_direct_remove_key: Removing last nrpe module (no other nrpe module exists at another priority)."]} 2019-12-08T11:57:40.462 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:57:40 +0000 (0:00:03.166) 0:03:15.743 ******* 2019-12-08T11:57:41.452 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Copy SELinux type enforcement file] ********************** ok: [smithi013.front.sepia.ceph.com] => {"changed": false, "checksum": "99d9b2ea41fb2d6613898129718064833d2de428", "dest": "/tmp/nrpe.te", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/tmp/nrpe.te", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 934, "state": "file", "uid": 0} 2019-12-08T11:57:41.504 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:57:41 +0000 (0:00:01.042) 0:03:16.785 ******* 2019-12-08T11:57:41.847 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Compile SELinux module file] ***************************** 2019-12-08T11:57:41.848 INFO:teuthology.task.ansible.out:changed: [smithi013.front.sepia.ceph.com] => {"changed": true, "cmd": ["checkmodule", "-M", "-m", "-o", "/tmp/nrpe.mod", "/tmp/nrpe.te"], "delta": "0:00:00.023198", "end": "2019-12-08 11:57:41.811541", "rc": 0, "start": "2019-12-08 11:57:41.788343", "stderr": "", "stderr_lines": [], "stdout": "checkmodule: loading policy configuration from /tmp/nrpe.te\ncheckmodule: policy configuration loaded\ncheckmodule: writing binary representation (version 19) to /tmp/nrpe.mod", "stdout_lines": ["checkmodule: loading policy configuration from /tmp/nrpe.te", "checkmodule: policy configuration loaded", "checkmodule: writing binary representation (version 19) to /tmp/nrpe.mod"]} 2019-12-08T11:57:41.910 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:57:41 +0000 (0:00:00.406) 0:03:17.192 ******* 2019-12-08T11:57:42.244 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Build SELinux policy package] **************************** 2019-12-08T11:57:42.245 INFO:teuthology.task.ansible.out:changed: [smithi013.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule_package", "-o", "/tmp/nrpe.pp", "-m", "/tmp/nrpe.mod"], "delta": "0:00:00.015654", "end": "2019-12-08 11:57:42.218335", "rc": 0, "start": "2019-12-08 11:57:42.202681", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-08T11:57:42.309 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:57:42 +0000 (0:00:00.396) 0:03:17.588 ******* 2019-12-08T11:57:45.295 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2019-12-08T11:57:45.296 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:07.654903", "end": "2019-12-08 11:57:45.269335", "rc": 0, "start": "2019-12-08 11:57:37.614432", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-08T11:57:45.337 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:57:45 +0000 (0:00:03.029) 0:03:20.618 ******* 2019-12-08T11:57:45.679 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2019-12-08T11:57:45.680 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2019-12-08T11:57:45.717 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:57:45 +0000 (0:00:00.379) 0:03:20.998 ******* 2019-12-08T11:57:45.753 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** 2019-12-08T11:57:45.754 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi", "iozone"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/yum_systems.yml"], "changed": false} 2019-12-08T11:57:45.806 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:57:45 +0000 (0:00:00.088) 0:03:21.087 ******* 2019-12-08T11:57:45.844 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* ok: [smithi079.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2019-12-08T11:57:45.883 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:57:45 +0000 (0:00:00.077) 0:03:21.165 ******* 2019-12-08T11:57:45.925 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2019-12-08T11:57:45.926 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml) => {"ansible_facts": {"epel_packages": ["cryptopp-devel", "cryptopp", "fcgi", "dbench", "fuse-sshfs", "bonnie++", "perl-JSON-XS"], "packages": ["@core", "@base", "yum-plugin-priorities", "yum-plugin-fastestmirror", "redhat-lsb", "sysstat", "gdb", "git-all", "python-configobj", "gcc-c++", "libedit", "openssl098e", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse", "fuse-libs", "python-virtualenv", "openssl", "libuuid", "btrfs-progs", "attr", "valgrind", "python-nose", "mpich", "podman", "ant", "iozone", "libtool", "automake", "gettext", "libuuid-devel", "libacl-devel", "bc", "xfsdump", "xfsprogs-devel", "blktrace", "numpy", "python-matplotlib", "qemu-kvm", "usbredir", "genisoimage", "httpd", "httpd-devel", "httpd-tools", "mod_ssl", "mod_fastcgi-2.4.7-1.ceph.el7.centos", "libev-devel", "perl-XML-Twig", "java-1.6.0-openjdk-devel", "junit4", "nfs-utils", "ncurses-devel", "python-devel", "python-virtualenv", "perl-CPAN"], "yum_repos": {"centos7-fcgi-ceph": {"baseurl": "http://{{ gitbuilder_host }}/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/", "enabled": 1, "gpgcheck": 0, "name": "CentOS 7 Local fastcgi Repo"}, "lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/centos7/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml"} 2019-12-08T11:57:45.964 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:57:45 +0000 (0:00:00.080) 0:03:21.246 ******* 2019-12-08T11:57:46.011 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ ok: [smithi079.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2019-12-08T11:57:46.046 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:57:46 +0000 (0:00:00.082) 0:03:21.328 ******* 2019-12-08T11:57:46.399 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** ok: [smithi079.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2019-12-08T11:57:46.440 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:57:46 +0000 (0:00:00.393) 0:03:21.721 ******* 2019-12-08T11:57:46.785 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* ok: [smithi079.front.sepia.ceph.com] => {"changed": false, "gid": 1215, "name": "ubuntu", "state": "present", "system": false} 2019-12-08T11:57:46.841 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:57:46 +0000 (0:00:00.401) 0:03:22.123 ******* 2019-12-08T11:57:46.871 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:57:46.906 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:57:46 +0000 (0:00:00.064) 0:03:22.188 ******* 2019-12-08T11:57:46.934 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ 2019-12-08T11:57:46.935 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:57:46.972 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:57:46 +0000 (0:00:00.065) 0:03:22.253 ******* 2019-12-08T11:57:47.323 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** ok: [smithi079.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2019-12-08T11:57:47.364 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:57:47 +0000 (0:00:00.392) 0:03:22.645 ******* 2019-12-08T11:57:48.415 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** 2019-12-08T11:57:48.415 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2019-12-08T11:57:48.460 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:57:48 +0000 (0:00:01.095) 0:03:23.741 ******* 2019-12-08T11:57:48.497 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* 2019-12-08T11:57:48.499 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi079"}, "changed": false} 2019-12-08T11:57:48.537 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:57:48 +0000 (0:00:00.077) 0:03:23.819 ******* 2019-12-08T11:57:49.561 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2019-12-08T11:57:49.563 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi079.front.sepia.ceph.com", "ansible_hostname": "smithi079", "ansible_nodename": "smithi079"}, "changed": true, "name": "smithi079"} 2019-12-08T11:57:49.622 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:57:49 +0000 (0:00:01.084) 0:03:24.903 ******* 2019-12-08T11:57:50.546 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2019-12-08T11:57:50.547 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"changed": false, "checksum": "28e3f1fe12efa510f1199f3ab5f2a5a0feb586ff", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1042, "state": "file", "uid": 0} 2019-12-08T11:57:50.590 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:57:50 +0000 (0:00:00.968) 0:03:25.871 ******* 2019-12-08T11:57:51.285 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Load SELinux policy package] ***************************** 2019-12-08T11:57:51.286 INFO:teuthology.task.ansible.out:changed: [smithi013.front.sepia.ceph.com] => {"changed": true, "cmd": ["semodule", "-i", "/tmp/nrpe.pp"], "delta": "0:00:08.645325", "end": "2019-12-08 11:57:51.246701", "rc": 0, "start": "2019-12-08 11:57:42.601376", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-08T11:57:51.340 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:57:51 +0000 (0:00:00.749) 0:03:26.621 ******* 2019-12-08T11:57:51.565 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** 2019-12-08T11:57:51.566 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2019-12-08T11:57:51.605 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:57:51 +0000 (0:00:00.264) 0:03:26.886 ******* 2019-12-08T11:57:51.698 INFO:teuthology.task.ansible.out: TASK [common : nrpe - Remove temporary files] ********************************** 2019-12-08T11:57:51.700 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => {"changed": false, "path": "/tmp/nrpe.*", "state": "absent"} 2019-12-08T11:57:51.737 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:57:51 +0000 (0:00:00.132) 0:03:27.019 ******* 2019-12-08T11:57:51.776 INFO:teuthology.task.ansible.out: TASK [testnode : Include package type specific vars.] ************************** ok: [smithi013.front.sepia.ceph.com] => {"ansible_facts": {"ceph_dependency_packages_to_remove": ["boost-random", "boost-program-options", "leveldb", "xmlstarlet", "python-jinja2", "python-ceph", "python-flask", "python-requests", "boost-random", "python-urllib3", "python-babel", "hdparm", "python-markupsafe", "python-werkzeug", "python-itsdangerous"], "ceph_packages_to_remove": ["ceph", "ceph-base", "ceph-selinux", "ceph-common", "ceph-debuginfo", "ceph-release", "libcephfs1", "ceph-radosgw", "python-ceph", "python-rados", "python-rbd", "python-cephfs", "librbd1", "librados2", "mod_fastcgi", "iozone"], "ntp_service_name": "ntpd", "packages_to_remove": ["device-mapper-multipath"], "pip_packages_to_install": ["remoto>=0.0.35"], "ssh_service_name": "sshd"}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/yum_systems.yml"], "changed": false} 2019-12-08T11:57:51.818 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:57:51 +0000 (0:00:00.079) 0:03:27.098 ******* 2019-12-08T11:57:51.868 INFO:teuthology.task.ansible.out: TASK [testnode : Including distro specific variables.] ************************* 2019-12-08T11:57:51.869 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2019-12-08T11:57:51.909 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:57:51 +0000 (0:00:00.091) 0:03:27.190 ******* 2019-12-08T11:57:51.959 INFO:teuthology.task.ansible.out: TASK [testnode : Including major version specific variables.] ****************** 2019-12-08T11:57:51.964 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml) => {"ansible_facts": {"epel_packages": ["cryptopp-devel", "cryptopp", "fcgi", "dbench", "fuse-sshfs", "bonnie++", "perl-JSON-XS"], "packages": ["@core", "@base", "yum-plugin-priorities", "yum-plugin-fastestmirror", "redhat-lsb", "sysstat", "gdb", "git-all", "python-configobj", "gcc-c++", "libedit", "openssl098e", "boost-thread", "xfsprogs", "gdisk", "parted", "libgcrypt", "fuse", "fuse-libs", "python-virtualenv", "openssl", "libuuid", "btrfs-progs", "attr", "valgrind", "python-nose", "mpich", "podman", "ant", "iozone", "libtool", "automake", "gettext", "libuuid-devel", "libacl-devel", "bc", "xfsdump", "xfsprogs-devel", "blktrace", "numpy", "python-matplotlib", "qemu-kvm", "usbredir", "genisoimage", "httpd", "httpd-devel", "httpd-tools", "mod_ssl", "mod_fastcgi-2.4.7-1.ceph.el7.centos", "libev-devel", "perl-XML-Twig", "java-1.6.0-openjdk-devel", "junit4", "nfs-utils", "ncurses-devel", "python-devel", "python-virtualenv", "perl-CPAN"], "yum_repos": {"centos7-fcgi-ceph": {"baseurl": "http://{{ gitbuilder_host }}/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/", "enabled": 1, "gpgcheck": 0, "name": "CentOS 7 Local fastcgi Repo"}, "lab-extras": {"baseurl": "http://{{ mirror_host }}/lab-extras/centos7/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/centos_7.yml"} 2019-12-08T11:57:52.007 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:57:52 +0000 (0:00:00.098) 0:03:27.289 ******* 2019-12-08T11:57:52.058 INFO:teuthology.task.ansible.out: TASK [testnode : Including version specific variables.] ************************ ok: [smithi013.front.sepia.ceph.com] => (item=/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml) => {"ansible_facts": {}, "ansible_included_var_files": ["/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"], "ansible_loop_var": "item", "changed": false, "item": "/home/teuthworker/src/git.ceph.com_git_ceph-cm-ansible_master/roles/testnode/vars/empty.yml"} 2019-12-08T11:57:52.096 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:57:52 +0000 (0:00:00.088) 0:03:27.377 ******* 2019-12-08T11:57:52.430 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the sudo group exists.] ******************************** 2019-12-08T11:57:52.431 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => {"changed": false, "gid": 1000, "name": "sudo", "state": "present", "system": false} 2019-12-08T11:57:52.499 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:57:52 +0000 (0:00:00.403) 0:03:27.780 ******* 2019-12-08T11:57:52.522 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** 2019-12-08T11:57:52.522 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2019-12-08T11:57:52.603 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:57:52 +0000 (0:00:00.104) 0:03:27.884 ******* 2019-12-08T11:57:52.863 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the teuthology_user group exists.] ********************* 2019-12-08T11:57:52.865 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => {"changed": false, "gid": 1215, "name": "ubuntu", "state": "present", "system": false} 2019-12-08T11:57:52.906 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:57:52 +0000 (0:00:00.303) 0:03:28.188 ******* 2019-12-08T11:57:52.935 INFO:teuthology.task.ansible.out: TASK [testnode : Create the teuthology user.] ********************************** 2019-12-08T11:57:52.937 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:57:52.975 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:57:52 +0000 (0:00:00.068) 0:03:28.256 ******* 2019-12-08T11:57:53.002 INFO:teuthology.task.ansible.out: TASK [testnode : Delete the teuthology users password.] ************************ skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:57:53.044 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:57:53 +0000 (0:00:00.067) 0:03:28.323 ******* 2019-12-08T11:57:53.402 INFO:teuthology.task.ansible.out: TASK [testnode : Add a user for xfstests to test user quotas.] ***************** ok: [smithi013.front.sepia.ceph.com] => {"append": false, "changed": false, "comment": "", "group": 10101, "home": "/home/fsgqa", "move_home": false, "name": "fsgqa", "shell": "/bin/bash", "state": "present", "uid": 10101} 2019-12-08T11:57:53.455 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:57:53 +0000 (0:00:00.412) 0:03:28.736 ******* 2019-12-08T11:57:53.559 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2019-12-08T11:57:53.560 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2019-12-08T11:57:53.609 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:57:53 +0000 (0:00:00.152) 0:03:28.889 ******* 2019-12-08T11:57:53.958 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2019-12-08T11:57:53.959 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2019-12-08T11:57:54.000 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:57:53 +0000 (0:00:00.392) 0:03:29.281 ******* 2019-12-08T11:57:54.335 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2019-12-08T11:57:54.337 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"changed": false, "gid": 10103, "name": "kvm", "state": "present", "system": false} 2019-12-08T11:57:54.386 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:57:54 +0000 (0:00:00.386) 0:03:29.667 ******* 2019-12-08T11:57:54.552 INFO:teuthology.task.ansible.out: TASK [testnode : Set a high max open files limit for the teuthology user.] ***** ok: [smithi013.front.sepia.ceph.com] => {"changed": false, "checksum": "dc140f4bb26594b8d5e0753bab8d93c0cced7772", "dest": "/etc/security/limits.d/ubuntu.conf", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/security/limits.d/ubuntu.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 112, "state": "file", "uid": 0} 2019-12-08T11:57:54.625 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:57:54 +0000 (0:00:00.232) 0:03:29.899 ******* 2019-12-08T11:57:54.660 INFO:teuthology.task.ansible.out: TASK [testnode : Set hostname var] ********************************************* ok: [smithi013.front.sepia.ceph.com] => {"ansible_facts": {"hostname": "smithi013"}, "changed": false} 2019-12-08T11:57:54.697 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:57:54 +0000 (0:00:00.078) 0:03:29.978 ******* 2019-12-08T11:57:54.756 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2019-12-08T11:57:54.757 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1215, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2019-12-08T11:57:54.804 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:57:54 +0000 (0:00:00.105) 0:03:30.084 ******* 2019-12-08T11:57:55.255 INFO:teuthology.task.ansible.out: TASK [testnode : Set the system's hostname] ************************************ 2019-12-08T11:57:55.257 INFO:teuthology.task.ansible.out:changed: [smithi013.front.sepia.ceph.com] => {"ansible_facts": {"ansible_domain": "front.sepia.ceph.com", "ansible_fqdn": "smithi013.front.sepia.ceph.com", "ansible_hostname": "smithi013", "ansible_nodename": "smithi013"}, "changed": true, "name": "smithi013"} 2019-12-08T11:57:55.296 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:57:55 +0000 (0:00:00.490) 0:03:30.574 ******* 2019-12-08T11:57:55.753 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** ok: [smithi079.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2019-12-08T11:57:55.792 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:57:55 +0000 (0:00:00.498) 0:03:31.073 ******* 2019-12-08T11:57:56.276 INFO:teuthology.task.ansible.out: TASK [testnode : Upload distro major version specific sshd_config] ************* 2019-12-08T11:57:56.277 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => {"changed": false, "checksum": "28e3f1fe12efa510f1199f3ab5f2a5a0feb586ff", "dest": "/etc/ssh/sshd_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/sshd_config", "secontext": "system_u:object_r:etc_t:s0", "size": 1042, "state": "file", "uid": 0} 2019-12-08T11:57:56.346 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:57:56 +0000 (0:00:00.554) 0:03:31.628 ******* 2019-12-08T11:57:56.787 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** ok: [smithi079.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2019-12-08T11:57:56.827 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:57:56 +0000 (0:00:00.480) 0:03:32.109 ******* 2019-12-08T11:57:57.375 INFO:teuthology.task.ansible.out: TASK [testnode : Upload ssh_config] ******************************************** ok: [smithi013.front.sepia.ceph.com] => {"changed": false, "checksum": "58d78b02605c8368f1913de12e145f4ad930fafc", "dest": "/etc/ssh/ssh_config", "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/etc/ssh/ssh_config", "secontext": "system_u:object_r:etc_t:s0", "size": 570, "state": "file", "uid": 0} 2019-12-08T11:57:57.413 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:57:57 +0000 (0:00:00.586) 0:03:32.695 ******* 2019-12-08T11:57:58.326 INFO:teuthology.task.ansible.out: TASK [testnode : Add ssh pubkeys] ********************************************** changed: [smithi013.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "comment": null, "exclusive": false, "follow": false, "key": "https://raw.githubusercontent.com/ceph/keys/autogenerated/ssh/@all.pub", "key_options": null, "keyfile": "/home/ubuntu/.ssh/authorized_keys", "manage_dir": true, "path": null, "state": "present", "user": "ubuntu", "validate_certs": true} 2019-12-08T11:57:58.372 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:57:58 +0000 (0:00:00.957) 0:03:33.652 ******* 2019-12-08T11:57:59.290 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2019-12-08T11:57:59.291 INFO:teuthology.task.ansible.out: [WARNING]: Consider using the yum, dnf or zypper module rather than running 'rpm'. If you need to use command because yum, dnf or zypper is insufficient you can add 'warn: false' to this command task or set 'command_warnings=False' in ansible.cfg to get rid of this message. 2019-12-08T11:57:59.293 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:02.088666", "end": "2019-12-08 11:57:59.247002", "rc": 0, "start": "2019-12-08 11:57:57.158336", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-08T11:57:59.351 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:57:59 +0000 (0:00:00.978) 0:03:34.631 ******* 2019-12-08T11:57:59.367 INFO:teuthology.task.ansible.out: TASK [testnode : Create remote.conf] ******************************************* 2019-12-08T11:57:59.369 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => {"changed": false, "checksum": "68d0b8ee2f88a77895f257aa69f32a42e47f455b", "dest": "/etc/security/limits.d/remote.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.d/remote.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 116, "state": "file", "uid": 0} 2019-12-08T11:57:59.417 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:57:59 +0000 (0:00:00.065) 0:03:34.697 ******* 2019-12-08T11:57:59.425 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2019-12-08T11:57:59.467 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:57:59 +0000 (0:00:00.051) 0:03:34.748 ******* 2019-12-08T11:57:59.759 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2019-12-08T11:57:59.762 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => {"changed": false, "dest": "/etc/fuse.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_t:s0", "size": 0, "state": "file", "uid": 0} 2019-12-08T11:57:59.828 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:57:59 +0000 (0:00:00.354) 0:03:35.103 ******* 2019-12-08T11:58:00.163 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2019-12-08T11:58:00.165 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => {"changed": false, "gid": 10103, "name": "kvm", "state": "present", "system": false} 2019-12-08T11:58:00.206 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:00 +0000 (0:00:00.384) 0:03:35.487 ******* 2019-12-08T11:58:00.447 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2019-12-08T11:58:00.448 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'CentOS 7 Local fastcgi Repo', u'baseurl': u'http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/'}, 'key': u'centos7-fcgi-ceph'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "58f6bfe213f63251ef8c4f03709a8fcef9b9e7bf", "dest": "/etc/yum.repos.d/centos7-fcgi-ceph.repo", "gid": 0, "group": "root", "item": {"key": "centos7-fcgi-ceph", "value": {"baseurl": "http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/", "enabled": 1, "gpgcheck": 0, "name": "CentOS 7 Local fastcgi Repo"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/centos7-fcgi-ceph.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 250, "state": "file", "uid": 0} 2019-12-08T11:58:00.607 INFO:teuthology.task.ansible.out: 2019-12-08T11:58:00.608 INFO:teuthology.task.ansible.out:TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* ok: [smithi013.front.sepia.ceph.com] => {"append": true, "changed": false, "comment": "", "group": 1215, "groups": "kvm,disk", "home": "/home/ubuntu", "move_home": false, "name": "ubuntu", "shell": "/bin/bash", "state": "present", "uid": 1000} 2019-12-08T11:58:00.651 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:00 +0000 (0:00:00.444) 0:03:35.932 ******* 2019-12-08T11:58:01.408 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2019-12-08T11:58:01.410 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'lab-extras', u'baseurl': u'http://apt-mirror.front.sepia.ceph.com/lab-extras/centos7/'}, 'key': u'lab-extras'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "765bacbb40da31f952344b310a4be4322cbee8a4", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/centos7/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 209, "state": "file", "uid": 0} 2019-12-08T11:58:01.464 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:01 +0000 (0:00:00.813) 0:03:36.745 ******* 2019-12-08T11:58:01.510 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:01.548 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:01 +0000 (0:00:00.083) 0:03:36.829 ******* 2019-12-08T11:58:01.597 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2019-12-08T11:58:01.599 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi079.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2019-12-08T11:58:01.637 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:01 +0000 (0:00:00.088) 0:03:36.918 ******* 2019-12-08T11:58:01.671 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2019-12-08T11:58:01.672 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => {"changed": false, "checksum": "be3223c8b0917bde02657a5f9ddd95277cc3f812", "dest": "/etc/sudoers", "gid": 0, "group": "root", "mode": "0440", "owner": "root", "path": "/etc/sudoers", "secontext": "system_u:object_r:etc_t:s0", "size": 1808, "state": "file", "uid": 0} 2019-12-08T11:58:01.724 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:01 +0000 (0:00:00.084) 0:03:37.002 ******* 2019-12-08T11:58:01.727 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2019-12-08T11:58:01.728 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:01.771 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:01 +0000 (0:00:00.049) 0:03:37.052 ******* 2019-12-08T11:58:01.824 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi079.front.sepia.ceph.com] => {"ansible_facts": {"skip_packaging": false}, "changed": false} 2019-12-08T11:58:01.866 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:01 +0000 (0:00:00.094) 0:03:37.147 ******* 2019-12-08T11:58:01.868 INFO:teuthology.task.ansible.out: 2019-12-08T11:58:02.362 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2019-12-08T11:58:02.363 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["yum-utils-1.1.31-50.el7.noarch providing yum-utils is already installed"]} 2019-12-08T11:58:02.403 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:02 +0000 (0:00:00.537) 0:03:37.685 ******* 2019-12-08T11:58:02.759 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2019-12-08T11:58:02.760 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => {"changed": false, "checksum": "12a2e17405b9e00ea2061e25929905d08e5fe19f", "dest": "/etc/security/limits.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/security/limits.conf", "secontext": "system_u:object_r:etc_t:s0", "size": 854, "state": "file", "uid": 0} 2019-12-08T11:58:02.817 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:02 +0000 (0:00:00.408) 0:03:38.093 ******* 2019-12-08T11:58:03.068 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2019-12-08T11:58:03.069 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"changed": false, "cmd": ["yum-complete-transaction", "--cleanup-only"], "delta": "0:00:00.318630", "end": "2019-12-08 11:58:03.030147", "rc": 0, "start": "2019-12-08 11:58:02.711517", "stderr": "", "stderr_lines": [], "stdout": "Loaded plugins: fastestmirror, langpacks, priorities\nLoading mirror speeds from cached hostfile\n * base: mirrors.umflint.edu\n * epel: download-cc-rdu01.fedoraproject.org\n * extras: mirror.wdc1.us.leaseweb.net\n * updates: mirror.math.princeton.edu\nNo unfinished transactions left.", "stdout_lines": ["Loaded plugins: fastestmirror, langpacks, priorities", "Loading mirror speeds from cached hostfile", " * base: mirrors.umflint.edu", " * epel: download-cc-rdu01.fedoraproject.org", " * extras: mirror.wdc1.us.leaseweb.net", " * updates: mirror.math.princeton.edu", "No unfinished transactions left."]} 2019-12-08T11:58:03.111 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:03 +0000 (0:00:00.299) 0:03:38.393 ******* 2019-12-08T11:58:03.464 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* fatal: [smithi079.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.036922", "end": "2019-12-08 11:58:03.437768", "msg": "non-zero return code", "rc": 1, "start": "2019-12-08 11:58:03.400846", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2019-12-08T11:58:03.506 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:03 +0000 (0:00:00.394) 0:03:38.787 ******* 2019-12-08T11:58:03.538 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2019-12-08T11:58:03.540 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:03.589 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:03 +0000 (0:00:00.082) 0:03:38.870 ******* 2019-12-08T11:58:05.294 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2019-12-08T11:58:05.295 INFO:teuthology.task.ansible.out:changed: [smithi013.front.sepia.ceph.com] => {"changed": true, "cmd": ["rpm", "--rebuilddb"], "delta": "0:00:02.129342", "end": "2019-12-08 11:58:05.255644", "rc": 0, "start": "2019-12-08 11:58:03.126302", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-08T11:58:05.343 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:05 +0000 (0:00:01.754) 0:03:40.625 ******* 2019-12-08T11:58:05.371 INFO:teuthology.task.ansible.out: TASK [testnode : Configure common additional repos in /etc/yum.repos.d/] ******* 2019-12-08T11:58:05.414 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:05 +0000 (0:00:00.071) 0:03:40.696 ******* 2019-12-08T11:58:06.449 INFO:teuthology.task.ansible.out: TASK [testnode : Configure version specific repos in /etc/yum.repos.d/] ******** 2019-12-08T11:58:06.451 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'CentOS 7 Local fastcgi Repo', u'baseurl': u'http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/'}, 'key': u'centos7-fcgi-ceph'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "58f6bfe213f63251ef8c4f03709a8fcef9b9e7bf", "dest": "/etc/yum.repos.d/centos7-fcgi-ceph.repo", "gid": 0, "group": "root", "item": {"key": "centos7-fcgi-ceph", "value": {"baseurl": "http://gitbuilder.ceph.com/mod_fastcgi-rpm-centos7-x86_64-basic/ref/master/", "enabled": 1, "gpgcheck": 0, "name": "CentOS 7 Local fastcgi Repo"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/centos7-fcgi-ceph.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 250, "state": "file", "uid": 0} 2019-12-08T11:58:07.424 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={'value': {u'gpgcheck': 0, u'enabled': 1, u'name': u'lab-extras', u'baseurl': u'http://apt-mirror.front.sepia.ceph.com/lab-extras/centos7/'}, 'key': u'lab-extras'}) => {"ansible_loop_var": "item", "changed": false, "checksum": "765bacbb40da31f952344b310a4be4322cbee8a4", "dest": "/etc/yum.repos.d/lab-extras.repo", "gid": 0, "group": "root", "item": {"key": "lab-extras", "value": {"baseurl": "http://apt-mirror.front.sepia.ceph.com/lab-extras/centos7/", "enabled": 1, "gpgcheck": 0, "name": "lab-extras"}}, "mode": "0644", "owner": "root", "path": "/etc/yum.repos.d/lab-extras.repo", "secontext": "system_u:object_r:system_conf_t:s0", "size": 209, "state": "file", "uid": 0} 2019-12-08T11:58:07.481 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:07 +0000 (0:00:02.066) 0:03:42.762 ******* 2019-12-08T11:58:07.520 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG] ************************************************** 2019-12-08T11:58:07.521 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:07.563 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:07 +0000 (0:00:00.081) 0:03:42.844 ******* 2019-12-08T11:58:07.565 INFO:teuthology.task.ansible.out: 2019-12-08T11:58:07.624 INFO:teuthology.task.ansible.out: TASK [testnode : Install GPG keys] ********************************************* 2019-12-08T11:58:07.626 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} skipping: [smithi013.front.sepia.ceph.com] => (item=https://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "https://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2019-12-08T11:58:07.664 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:07 +0000 (0:00:00.100) 0:03:42.945 ******* 2019-12-08T11:58:07.691 INFO:teuthology.task.ansible.out: TASK [testnode : Clean yum cache] ********************************************** 2019-12-08T11:58:07.693 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:07.757 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:07 +0000 (0:00:00.093) 0:03:43.038 ******* 2019-12-08T11:58:07.806 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-12-08T11:58:07.808 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => {"ansible_facts": {"skip_packaging": false}, "changed": false} 2019-12-08T11:58:07.860 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:07 +0000 (0:00:00.103) 0:03:43.142 ******* 2019-12-08T11:58:08.377 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure yum_utils is present.] ********************************* 2019-12-08T11:58:08.379 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["yum-utils-1.1.31-50.el7.noarch providing yum-utils is already installed"]} 2019-12-08T11:58:08.418 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:08 +0000 (0:00:00.557) 0:03:43.699 ******* 2019-12-08T11:58:09.115 INFO:teuthology.task.ansible.out: TASK [testnode : Removing saved yum transactions] ****************************** 2019-12-08T11:58:09.116 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => {"changed": false, "cmd": ["yum-complete-transaction", "--cleanup-only"], "delta": "0:00:00.322370", "end": "2019-12-08 11:58:09.076843", "rc": 0, "start": "2019-12-08 11:58:08.754473", "stderr": "", "stderr_lines": [], "stdout": "Loaded plugins: fastestmirror, langpacks, priorities\nLoading mirror speeds from cached hostfile\n * base: mirrors.umflint.edu\n * epel: download-cc-rdu01.fedoraproject.org\n * extras: mirror.wdc1.us.leaseweb.net\n * updates: mirror.math.princeton.edu\nNo unfinished transactions left.", "stdout_lines": ["Loaded plugins: fastestmirror, langpacks, priorities", "Loading mirror speeds from cached hostfile", " * base: mirrors.umflint.edu", " * epel: download-cc-rdu01.fedoraproject.org", " * extras: mirror.wdc1.us.leaseweb.net", " * updates: mirror.math.princeton.edu", "No unfinished transactions left."]} 2019-12-08T11:58:09.185 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:09 +0000 (0:00:00.763) 0:03:44.463 ******* 2019-12-08T11:58:09.558 INFO:teuthology.task.ansible.out: TASK [testnode : Check if ceph-debuginfo is installed] ************************* 2019-12-08T11:58:09.559 INFO:teuthology.task.ansible.out:fatal: [smithi013.front.sepia.ceph.com]: FAILED! => {"changed": false, "cmd": ["rpm", "-q", "ceph-debuginfo"], "delta": "0:00:00.035685", "end": "2019-12-08 11:58:09.531615", "msg": "non-zero return code", "rc": 1, "start": "2019-12-08 11:58:09.495930", "stderr": "", "stderr_lines": [], "stdout": "package ceph-debuginfo is not installed", "stdout_lines": ["package ceph-debuginfo is not installed"]} ...ignoring 2019-12-08T11:58:09.624 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:09 +0000 (0:00:00.442) 0:03:44.905 ******* 2019-12-08T11:58:09.671 INFO:teuthology.task.ansible.out: TASK [testnode : Work around https://bugzilla.redhat.com/show_bug.cgi?id=1234967] *** 2019-12-08T11:58:09.673 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:09.722 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:09 +0000 (0:00:00.097) 0:03:45.003 ******* 2019-12-08T11:58:12.243 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2019-12-08T11:58:12.248 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => {"changed": true, "changes": {"removed": ["librbd1", "librados2", "mod_fastcgi", "iozone"]}, "msg": "", "rc": 0, "results": ["ceph is not installed", "ceph-base is not installed", "ceph-selinux is not installed", "ceph-common is not installed", "ceph-debuginfo is not installed", "ceph-release is not installed", "libcephfs1 is not installed", "ceph-radosgw is not installed", "python-ceph is not installed", "python-rados is not installed", "python-rbd is not installed", "python-cephfs is not installed", "Loaded plugins: fastestmirror, langpacks, priorities\nResolving Dependencies\n--> Running transaction check\n---> Package iozone.x86_64 0:3.424-2_ceph.el7.centos will be erased\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be erased\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-img-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be erased\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be erased\n--> Running transaction check\n---> Package qemu-img.x86_64 10:1.5.3-167.el7_7.1 will be erased\n---> Package qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 will be erased\n---> Package qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 will be erased\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nRemoving:\n iozone x86_64 3.424-2_ceph.el7.centos @lab-extras 1.3 M\n librados2 x86_64 1:10.2.5-4.el7 @base 5.5 M\n librbd1 x86_64 1:10.2.5-4.el7 2019-12-08T11:58:12.250 INFO:teuthology.task.ansible.out: @base 7.4 M\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos @centos7-fcgi-ceph 213 k\nRemoving for dependencies:\n qemu-img x86_64 10:1.5.3-167.el7_7.1 @updates 2.3 M\n qemu-kvm x86_64 10:1.5.3-167.el7_7.1 @updates 5.7 M\n qemu-kvm-common x86_64 10:1.5.3-167.el7_7.1 @updates 755 k\n\nTransaction Summary\n================================================================================\nRemove 4 Packages (+3 Dependent packages)\n\nInstalled size: 23 M\nDownloading packages:\nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Erasing : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 1/7 \n Erasing : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 2/7 \n Erasing : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 3/7 \n Erasing : 1:librbd1-10.2.5-4.el7.x86_64 4/7 \n Erasing : 1:librados2-10.2.5-4.el7.x86_64 5/7 \n Erasing : iozone-3.424-2_ceph.el7.centos.x86_64 6/7 \n Erasing : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 7/7 \nwarning: file /var/run/mod_fastcgi: remove failed: No such file or directory\n Verifying : 1:librbd1-10.2.5-4.el7.x86_64 1/7 \n Verifying : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 2/7 \n Verifying : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 3/7 \n Verifying : 1:librados2-10.2.5-4.el7.x86_64 4/7 \n Verifying : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 5/7 \n Verifying : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 6/7 \n Verifying : iozone-3.424-2_ceph.el7.centos.x86_64 7/7 \n\nRemoved:\n iozone.x86_64 0:3.424-2_ceph.el7.centos 2019-12-08T11:58:12.252 INFO:teuthology.task.ansible.out: \n librados2.x86_64 1:10.2.5-4.el7 \n librbd1.x86_64 1:10.2.5-4.el7 \n mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos \n\nDependency Removed:\n qemu-img.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 \n\nComplete!\n"]} 2019-12-08T11:58:12.284 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:12 +0000 (0:00:02.560) 0:03:47.564 ******* 2019-12-08T11:58:15.559 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2019-12-08T11:58:15.560 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => {"changed": true, "changes": {"removed": ["boost-random", "boost-random"]}, "msg": "", "rc": 0, "results": ["boost-program-options is not installed", "leveldb is not installed", "xmlstarlet is not installed", "python-jinja2 is not installed", "python-ceph is not installed", "python-flask is not installed", "python-requests is not installed", "python-urllib3 is not installed", "python-babel is not installed", "hdparm is not installed", "python-markupsafe is not installed", "python-werkzeug is not installed", "python-itsdangerous is not installed", "Loaded plugins: fastestmirror, langpacks, priorities\nResolving Dependencies\n--> Running transaction check\n---> Package boost-random.x86_64 0:1.53.0-27.el7 will be erased\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nRemoving:\n boost-random x86_64 1.53.0-27.el7 @base 28 k\n\nTransaction Summary\n================================================================================\nRemove 1 Package\n\nInstalled size: 28 k\nDownloading packages:\nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Erasing : boost-random-1.53.0-27.el7.x86_64 1/1 \n Verifying : boost-random-1.53.0-27.el7.x86_64 1/1 \n\nRemoved:\n boost-random.x86_64 0:1.53.0-27.el7 \n\nComplete!\n"]} 2019-12-08T11:58:15.603 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:15 +0000 (0:00:03.320) 0:03:50.884 ******* 2019-12-08T11:58:18.407 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ changed: [smithi013.front.sepia.ceph.com] => {"changed": true, "changes": {"removed": ["librbd1", "librados2", "mod_fastcgi", "iozone"]}, "msg": "", "rc": 0, "results": ["ceph is not installed", "ceph-base is not installed", "ceph-selinux is not installed", "ceph-common is not installed", "ceph-debuginfo is not installed", "ceph-release is not installed", "libcephfs1 is not installed", "ceph-radosgw is not installed", "python-ceph is not installed", "python-rados is not installed", "python-rbd is not installed", "python-cephfs is not installed", "Loaded plugins: fastestmirror, langpacks, priorities\nResolving Dependencies\n--> Running transaction check\n---> Package iozone.x86_64 0:3.424-2_ceph.el7.centos will be erased\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be erased\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-img-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be erased\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be erased\n--> Running transaction check\n---> Package qemu-img.x86_64 10:1.5.3-167.el7_7.1 will be erased\n---> Package qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 will be erased\n---> Package qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 will be erased\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nRemoving:\n iozone x86_64 3.424-2_ceph.el7.centos @lab-extras 1.3 M\n librados2 x86_64 1:10.2.5-4.el7 2019-12-08T11:58:18.409 INFO:teuthology.task.ansible.out: @base 5.5 M\n librbd1 x86_64 1:10.2.5-4.el7 @base 7.4 M\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos @centos7-fcgi-ceph 213 k\nRemoving for dependencies:\n qemu-img x86_64 10:1.5.3-167.el7_7.1 @updates 2.3 M\n qemu-kvm x86_64 10:1.5.3-167.el7_7.1 @updates 5.7 M\n qemu-kvm-common x86_64 10:1.5.3-167.el7_7.1 @updates 755 k\n\nTransaction Summary\n================================================================================\nRemove 4 Packages (+3 Dependent packages)\n\nInstalled size: 23 M\nDownloading packages:\nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Erasing : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 1/7 \n Erasing : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 2/7 \n Erasing : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 3/7 \n Erasing : 1:librbd1-10.2.5-4.el7.x86_64 4/7 \n Erasing : 1:librados2-10.2.5-4.el7.x86_64 5/7 \n Erasing : iozone-3.424-2_ceph.el7.centos.x86_64 6/7 \n Erasing : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 7/7 \nwarning: file /var/run/mod_fastcgi: remove failed: No such file or directory\n Verifying : 1:librbd1-10.2.5-4.el7.x86_64 1/7 \n Verifying : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 2/7 \n Verifying : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 3/7 \n Verifying : 1:librados2-10.2.5-4.el7.x86_64 4/7 \n Verifying : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 5/7 \n Verifying : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 6/7 \n Verifying : iozone-3.424-2_ceph.el7.centos.x86_64 7/7 \n\nRemov 2019-12-08T11:58:18.411 INFO:teuthology.task.ansible.out:ed:\n iozone.x86_64 0:3.424-2_ceph.el7.centos \n librados2.x86_64 1:10.2.5-4.el7 \n librbd1.x86_64 1:10.2.5-4.el7 \n mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos \n\nDependency Removed:\n qemu-img.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 \n\nComplete!\n"]} 2019-12-08T11:58:18.466 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:18 +0000 (0:00:02.863) 0:03:53.747 ******* 2019-12-08T11:58:21.902 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2019-12-08T11:58:21.903 INFO:teuthology.task.ansible.out:changed: [smithi013.front.sepia.ceph.com] => {"changed": true, "changes": {"removed": ["boost-random", "boost-random"]}, "msg": "", "rc": 0, "results": ["boost-program-options is not installed", "leveldb is not installed", "xmlstarlet is not installed", "python-jinja2 is not installed", "python-ceph is not installed", "python-flask is not installed", "python-requests is not installed", "python-urllib3 is not installed", "python-babel is not installed", "hdparm is not installed", "python-markupsafe is not installed", "python-werkzeug is not installed", "python-itsdangerous is not installed", "Loaded plugins: fastestmirror, langpacks, priorities\nResolving Dependencies\n--> Running transaction check\n---> Package boost-random.x86_64 0:1.53.0-27.el7 will be erased\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nRemoving:\n boost-random x86_64 1.53.0-27.el7 @base 28 k\n\nTransaction Summary\n================================================================================\nRemove 1 Package\n\nInstalled size: 28 k\nDownloading packages:\nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Erasing : boost-random-1.53.0-27.el7.x86_64 1/1 \n Verifying : boost-random-1.53.0-27.el7.x86_64 1/1 \n\nRemoved:\n boost-random.x86_64 0:1.53.0-27.el7 \n\nComplete!\n"]} 2019-12-08T11:58:21.945 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:21 +0000 (0:00:03.476) 0:03:57.223 ******* 2019-12-08T11:58:33.817 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* ok: [smithi079.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": ["@core", "@base", "iozone", "qemu-kvm", "mod_fastcgi-2.4.7-1.ceph.el7.centos"]}, "msg": "Warning: Group core does not have any packages to install.\nWarning: Group base does not have any packages to install.\nGroup base does have 1 conditional packages, which may get installed.\n", "rc": 0, "results": ["yum-plugin-priorities-1.1.31-52.el7.noarch providing yum-plugin-priorities is already installed", "yum-plugin-fastestmirror-1.1.31-50.el7.noarch providing yum-plugin-fastestmirror is already installed", "redhat-lsb-4.1-27.el7.centos.1.x86_64 providing redhat-lsb is already installed", "sysstat-10.1.5-17.el7.x86_64 providing sysstat is already installed", "gdb-7.6.1-114.el7.x86_64 providing gdb is already installed", "git-all-1.8.3.1-20.el7.noarch providing git-all is already installed", "python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed", "gcc-c++-4.8.5-39.el7.x86_64 providing gcc-c++ is already installed", "libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed", "openssl098e-0.9.8e-29.el7.centos.3.x86_64 providing openssl098e is already installed", "boost-thread-1.53.0-27.el7.x86_64 providing boost-thread is already installed", "xfsprogs-4.5.0-20.el7.x86_64 providing xfsprogs is already installed", "gdisk-0.8.10-2.el7.x86_64 providing gdisk is already installed", "parted-3.1-29.el7.x86_64 providing parted is already installed", "libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed", "fuse-2.9.2-11.el7.x86_64 providing fuse is already installed", "fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed", "python-virtualenv-15.1.0-2.el7.noarch providing python-virtualenv is already installed", "1:openssl-1.0.2k-16.el7.x86_64 providing openssl is already installed", "libuuid-2.23.2-61.el7.x86_64 providing libuuid i 2019-12-08T11:58:33.818 INFO:teuthology.task.ansible.out:s already installed", "btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is already installed", "attr-2.4.46-13.el7.x86_64 providing attr is already installed", "1:valgrind-3.14.0-16.el7.x86_64 providing valgrind is already installed", "python-nose-1.3.7-1.el7.noarch providing python-nose is already installed", "mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed", "podman-1.4.4-4.el7.centos.x86_64 providing podman is already installed", "ant-1.9.4-2.el7.noarch providing ant is already installed", "libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed", "automake-1.13.4-3.el7.noarch providing automake is already installed", "gettext-0.19.8.1-2.el7.x86_64 providing gettext is already installed", "libuuid-devel-2.23.2-61.el7.x86_64 providing libuuid-devel is already installed", "libacl-devel-2.2.51-14.el7.x86_64 providing libacl-devel is already installed", "bc-1.06.95-13.el7.x86_64 providing bc is already installed", "xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed", "xfsprogs-devel-4.5.0-20.el7.x86_64 providing xfsprogs-devel is already installed", "blktrace-1.0.5-8.el7.x86_64 providing blktrace is already installed", "1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed", "python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed", "usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed", "genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed", "httpd-2.4.6-90.el7.centos.x86_64 providing httpd is already installed", "httpd-devel-2.4.6-90.el7.centos.x86_64 providing httpd-devel is already installed", "httpd-tools-2.4.6-90.el7.centos.x86_64 providing httpd-tools is already installed", "1:mod_ssl-2.4.6-90.el7.centos.x86_64 providing mod_ssl is already installed", "libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed", "perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed", "1:java-1.6.0-openjdk-devel 2019-12-08T11:58:33.820 INFO:teuthology.task.ansible.out:-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already installed", "junit-4.11-8.el7.noarch providing junit4 is already installed", "1:nfs-utils-1.3.0-0.65.el7.x86_64 providing nfs-utils is already installed", "ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed", "python-devel-2.7.5-86.el7.x86_64 providing python-devel is already installed", "python-virtualenv-15.1.0-2.el7.noarch providing python-virtualenv is already installed", "perl-CPAN-1.9800-294.el7_6.noarch providing perl-CPAN is already installed", "Loaded plugins: fastestmirror, langpacks, priorities\nLoading mirror speeds from cached hostfile\n * base: mirrors.umflint.edu\n * epel: download-cc-rdu01.fedoraproject.org\n * extras: mirror.wdc1.us.leaseweb.net\n * updates: mirror.math.princeton.edu\nResolving Dependencies\n--> Running transaction check\n---> Package iozone.x86_64 0:3.424-2_ceph.el7.centos will be installed\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be installed\n---> Package qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 will be installed\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-167.el7_7.1 for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: qemu-img = 10:1.5.3-167.el7_7.1 for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Running transaction check\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\n---> Package qemu-img.x86_64 10:1.5.3-167.el7_7.1 will be installed\n---> Package qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 will be installed\n--> Running transaction check\n---> Package boost-random.x86 2019-12-08T11:58:33.821 INFO:teuthology.task.ansible.out:_64 0:1.53.0-27.el7 will be installed\n--> Finished Dependency Resolution\n\nDependencies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nInstalling:\n iozone x86_64 3.424-2_ceph.el7.centos lab-extras 800 k\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos centos7-fcgi-ceph 70 k\n qemu-kvm x86_64 10:1.5.3-167.el7_7.1 updates 1.9 M\nInstalling for dependencies:\n boost-random x86_64 1.53.0-27.el7 base 39 k\n librados2 x86_64 1:10.2.5-4.el7 base 1.8 M\n librbd1 x86_64 1:10.2.5-4.el7 base 2.4 M\n qemu-img x86_64 10:1.5.3-167.el7_7.1 updates 699 k\n qemu-kvm-common x86_64 10:1.5.3-167.el7_7.1 updates 435 k\n\nTransaction Summary\n================================================================================\nInstall 3 Packages (+5 Dependent packages)\n\nTotal download size: 8.1 M\nInstalled size: 23 M\nDownloading packages:\n--------------------------------------------------------------------------------\nTotal 14 MB/s | 8.1 MB 00:00 \nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Installing : boost-random-1.53.0-27.el7.x86_64 1/8 \n Installing : 1:librados2-10.2.5-4.el7.x86_64 2/8 \n Installing : 1:librbd1-10.2.5-4.el7.x86_64 3/8 \n Installing : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 4/8 \n Installing : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 5/8 \n Installing : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 2019-12-08T11:58:33.823 INFO:teuthology.task.ansible.out: 6/8 \n Installing : iozone-3.424-2_ceph.el7.centos.x86_64 7/8 \n Installing : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 8/8 \n Verifying : 1:librbd1-10.2.5-4.el7.x86_64 1/8 \n Verifying : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 2/8 \n Verifying : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 3/8 \n Verifying : 1:librados2-10.2.5-4.el7.x86_64 4/8 \n Verifying : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 5/8 \n Verifying : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 6/8 \n Verifying : boost-random-1.53.0-27.el7.x86_64 7/8 \n Verifying : iozone-3.424-2_ceph.el7.centos.x86_64 8/8 \n\nInstalled:\n iozone.x86_64 0:3.424-2_ceph.el7.centos \n mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos \n qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 \n\nDependency Installed:\n boost-random.x86_64 0:1.53.0-27.el7 \n librados2.x86_64 1:10.2.5-4.el7 \n librbd1.x86_64 1:10.2.5-4.el7 \n qemu-img.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 \n\nComplete!\n"]} 2019-12-08T11:58:33.866 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:33 +0000 (0:00:11.923) 0:04:09.147 ******* 2019-12-08T11:58:34.687 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2019-12-08T11:58:34.689 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["cryptopp-devel-5.6.2-10.el7.x86_64 providing cryptopp-devel is already installed", "cryptopp-5.6.2-10.el7.x86_64 providing cryptopp is already installed", "fcgi-2.4.0-25.el7.x86_64 providing fcgi is already installed", "dbench-4.0-10.el7.x86_64 providing dbench is already installed", "fuse-sshfs-2.10-1.el7.x86_64 providing fuse-sshfs is already installed", "bonnie++-1.97.3-1.el7.x86_64 providing bonnie++ is already installed", "1:perl-JSON-XS-3.01-2.el7.x86_64 providing perl-JSON-XS is already installed"]} 2019-12-08T11:58:34.731 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:34 +0000 (0:00:00.860) 0:04:10.008 ******* 2019-12-08T11:58:35.270 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2019-12-08T11:58:35.280 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["device-mapper-multipath is not installed"]} 2019-12-08T11:58:35.323 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:35 +0000 (0:00:00.596) 0:04:10.604 ******* 2019-12-08T11:58:35.360 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2019-12-08T11:58:35.362 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:35.402 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:35 +0000 (0:00:00.079) 0:04:10.683 ******* 2019-12-08T11:58:35.829 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2019-12-08T11:58:35.830 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "basic.target system.slice dbus.service polkit.service", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "shutdown.target network-pre.target", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "Conflicts": "ebtables.service ipset.service ip6tables.service shutdown.target iptables.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "EnvironmentFile": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "Igno 2019-12-08T11:58:35.831 INFO:teuthology.task.ansible.out:reOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127511", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127511", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "basic.target", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", " 2019-12-08T11:58:35.833 INFO:teuthology.task.ansible.out:TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "Wants": "system.slice network-pre.target", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2019-12-08T11:58:35.870 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:35 +0000 (0:00:00.468) 0:04:11.151 ******* 2019-12-08T11:58:36.290 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ fatal: [smithi079.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2019-12-08T11:58:36.339 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:36 +0000 (0:00:00.469) 0:04:11.621 ******* 2019-12-08T11:58:37.323 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2019-12-08T11:58:37.327 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2019-12-08T11:58:37.373 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:37 +0000 (0:00:01.033) 0:04:12.655 ******* 2019-12-08T11:58:37.410 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2019-12-08T11:58:37.412 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:37.460 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:37 +0000 (0:00:00.086) 0:04:12.741 ******* 2019-12-08T11:58:37.489 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2019-12-08T11:58:37.534 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:37 +0000 (0:00:00.074) 0:04:12.815 ******* 2019-12-08T11:58:37.564 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2019-12-08T11:58:37.566 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:37.637 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:37 +0000 (0:00:00.102) 0:04:12.918 ******* 2019-12-08T11:58:37.666 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2019-12-08T11:58:37.668 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:37.721 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:37 +0000 (0:00:00.085) 0:04:13.003 ******* 2019-12-08T11:58:37.760 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2019-12-08T11:58:37.762 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} 2019-12-08T11:58:37.772 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2019-12-08T11:58:37.815 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:37 +0000 (0:00:00.093) 0:04:13.096 ******* 2019-12-08T11:58:37.849 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2019-12-08T11:58:37.851 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:37.905 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:37 +0000 (0:00:00.088) 0:04:13.186 ******* 2019-12-08T11:58:37.932 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2019-12-08T11:58:37.983 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:37 +0000 (0:00:00.078) 0:04:13.264 ******* 2019-12-08T11:58:38.021 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2019-12-08T11:58:38.023 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:38.064 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:38 +0000 (0:00:00.081) 0:04:13.345 ******* 2019-12-08T11:58:38.112 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2019-12-08T11:58:38.114 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:38.152 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:38 +0000 (0:00:00.087) 0:04:13.433 ******* 2019-12-08T11:58:38.189 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2019-12-08T11:58:38.191 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:38.232 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:38 +0000 (0:00:00.080) 0:04:13.514 ******* 2019-12-08T11:58:38.264 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2019-12-08T11:58:38.266 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:38.306 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:38 +0000 (0:00:00.070) 0:04:13.584 ******* 2019-12-08T11:58:38.329 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2019-12-08T11:58:38.330 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:38.371 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:38 +0000 (0:00:00.068) 0:04:13.652 ******* 2019-12-08T11:58:38.399 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2019-12-08T11:58:38.400 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:38.440 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:38 +0000 (0:00:00.068) 0:04:13.721 ******* 2019-12-08T11:58:38.477 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2019-12-08T11:58:38.479 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:38.516 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:38 +0000 (0:00:00.075) 0:04:13.797 ******* 2019-12-08T11:58:38.542 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2019-12-08T11:58:38.544 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:38.587 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:38 +0000 (0:00:00.071) 0:04:13.869 ******* 2019-12-08T11:58:38.614 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2019-12-08T11:58:38.616 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:38.656 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:38 +0000 (0:00:00.068) 0:04:13.937 ******* 2019-12-08T11:58:38.684 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2019-12-08T11:58:38.686 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:38.725 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:38 +0000 (0:00:00.068) 0:04:14.006 ******* 2019-12-08T11:58:38.764 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2019-12-08T11:58:38.765 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:38.832 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:38 +0000 (0:00:00.107) 0:04:14.114 ******* 2019-12-08T11:58:38.864 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:38.904 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:38 +0000 (0:00:00.071) 0:04:14.185 ******* 2019-12-08T11:58:38.931 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2019-12-08T11:58:38.933 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:38.974 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:38 +0000 (0:00:00.070) 0:04:14.256 ******* 2019-12-08T11:58:39.013 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:39.065 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:39 +0000 (0:00:00.090) 0:04:14.346 ******* 2019-12-08T11:58:39.092 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2019-12-08T11:58:39.094 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:39.142 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:39 +0000 (0:00:00.076) 0:04:14.423 ******* 2019-12-08T11:58:39.169 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2019-12-08T11:58:39.170 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:39.206 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:39 +0000 (0:00:00.064) 0:04:14.488 ******* 2019-12-08T11:58:39.237 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2019-12-08T11:58:39.239 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:39.300 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:39 +0000 (0:00:00.087) 0:04:14.575 ******* 2019-12-08T11:58:39.324 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2019-12-08T11:58:39.326 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:39.369 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:39 +0000 (0:00:00.074) 0:04:14.650 ******* 2019-12-08T11:58:39.411 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2019-12-08T11:58:39.413 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:39.449 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:39 +0000 (0:00:00.079) 0:04:14.730 ******* 2019-12-08T11:58:39.495 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2019-12-08T11:58:39.497 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:39.532 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:39 +0000 (0:00:00.083) 0:04:14.813 ******* 2019-12-08T11:58:39.581 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2019-12-08T11:58:39.582 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:39.625 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:39 +0000 (0:00:00.093) 0:04:14.907 ******* 2019-12-08T11:58:39.652 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* 2019-12-08T11:58:39.654 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:39.704 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:39 +0000 (0:00:00.078) 0:04:14.985 ******* 2019-12-08T11:58:39.739 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:39.785 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:39 +0000 (0:00:00.081) 0:04:15.066 ******* 2019-12-08T11:58:39.814 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2019-12-08T11:58:39.815 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:39.877 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:39 +0000 (0:00:00.086) 0:04:15.153 ******* 2019-12-08T11:58:39.906 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2019-12-08T11:58:39.908 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:39.954 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:39 +0000 (0:00:00.081) 0:04:15.235 ******* 2019-12-08T11:58:39.980 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2019-12-08T11:58:39.984 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:40.032 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:40 +0000 (0:00:00.078) 0:04:15.313 ******* 2019-12-08T11:58:40.370 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2019-12-08T11:58:40.371 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/bin/lspci", "gid": 0, "group": "root", "mode": "0777", "owner": "root", "secontext": "unconfined_u:object_r:bin_t:s0", "size": 11, "src": "/sbin/lspci", "state": "link", "uid": 0} 2019-12-08T11:58:40.416 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:40 +0000 (0:00:00.382) 0:04:15.696 ******* 2019-12-08T11:58:40.749 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** ok: [smithi079.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/ltp/testcases/bin", "secontext": "unconfined_u:object_r:lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-12-08T11:58:40.787 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:40 +0000 (0:00:00.372) 0:04:16.068 ******* 2019-12-08T11:58:41.118 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2019-12-08T11:58:41.119 INFO:teuthology.task.ansible.out: [WARNING]: Cannot set fs attributes on a non-existent symlink target. follow should be set to False to avoid this. ok: [smithi079.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/lib/ltp/testcases/bin/fsstress", "src": "/usr/bin/fsstress"} 2019-12-08T11:58:41.162 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:41 +0000 (0:00:00.375) 0:04:16.443 ******* 2019-12-08T11:58:41.189 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2019-12-08T11:58:41.190 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:41.229 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:41 +0000 (0:00:00.066) 0:04:16.510 ******* 2019-12-08T11:58:41.256 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:41.299 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:41 +0000 (0:00:00.069) 0:04:16.580 ******* 2019-12-08T11:58:41.329 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2019-12-08T11:58:41.331 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:41.379 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:41 +0000 (0:00:00.079) 0:04:16.660 ******* 2019-12-08T11:58:41.398 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2019-12-08T11:58:41.399 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => {"changed": false, "changes": {"installed": ["@core", "@base", "iozone", "qemu-kvm", "mod_fastcgi-2.4.7-1.ceph.el7.centos"]}, "msg": "Warning: Group core does not have any packages to install.\nWarning: Group base does not have any packages to install.\nGroup base does have 1 conditional packages, which may get installed.\n", "rc": 0, "results": ["yum-plugin-priorities-1.1.31-52.el7.noarch providing yum-plugin-priorities is already installed", "yum-plugin-fastestmirror-1.1.31-50.el7.noarch providing yum-plugin-fastestmirror is already installed", "redhat-lsb-4.1-27.el7.centos.1.x86_64 providing redhat-lsb is already installed", "sysstat-10.1.5-17.el7.x86_64 providing sysstat is already installed", "gdb-7.6.1-114.el7.x86_64 providing gdb is already installed", "git-all-1.8.3.1-20.el7.noarch providing git-all is already installed", "python-configobj-4.7.2-7.el7.noarch providing python-configobj is already installed", "gcc-c++-4.8.5-39.el7.x86_64 providing gcc-c++ is already installed", "libedit-3.0-12.20121213cvs.el7.x86_64 providing libedit is already installed", "openssl098e-0.9.8e-29.el7.centos.3.x86_64 providing openssl098e is already installed", "boost-thread-1.53.0-27.el7.x86_64 providing boost-thread is already installed", "xfsprogs-4.5.0-20.el7.x86_64 providing xfsprogs is already installed", "gdisk-0.8.10-2.el7.x86_64 providing gdisk is already installed", "parted-3.1-29.el7.x86_64 providing parted is already installed", "libgcrypt-1.5.3-14.el7.x86_64 providing libgcrypt is already installed", "fuse-2.9.2-11.el7.x86_64 providing fuse is already installed", "fuse-libs-2.9.2-11.el7.x86_64 providing fuse-libs is already installed", "python-virtualenv-15.1.0-2.el7.noarch providing python-virtualenv is already installed", "1:openssl-1.0.2k-16.el7.x86_64 providing openssl is already installed", "libuuid-2.23.2-61.el7.x86_64 providing libuuid is already installed", "btrfs-progs-4.9.1-1.el7.x86_64 providing btrfs-progs is alrea 2019-12-08T11:58:41.401 INFO:teuthology.task.ansible.out:dy installed", "attr-2.4.46-13.el7.x86_64 providing attr is already installed", "1:valgrind-3.14.0-16.el7.x86_64 providing valgrind is already installed", "python-nose-1.3.7-1.el7.noarch providing python-nose is already installed", "mpich-3.0-3.0.4-10.el7.x86_64 providing mpich is already installed", "podman-1.4.4-4.el7.centos.x86_64 providing podman is already installed", "ant-1.9.4-2.el7.noarch providing ant is already installed", "libtool-2.4.2-22.el7_3.x86_64 providing libtool is already installed", "automake-1.13.4-3.el7.noarch providing automake is already installed", "gettext-0.19.8.1-2.el7.x86_64 providing gettext is already installed", "libuuid-devel-2.23.2-61.el7.x86_64 providing libuuid-devel is already installed", "libacl-devel-2.2.51-14.el7.x86_64 providing libacl-devel is already installed", "bc-1.06.95-13.el7.x86_64 providing bc is already installed", "xfsdump-3.1.7-1.el7.x86_64 providing xfsdump is already installed", "xfsprogs-devel-4.5.0-20.el7.x86_64 providing xfsprogs-devel is already installed", "blktrace-1.0.5-8.el7.x86_64 providing blktrace is already installed", "1:numpy-1.7.1-13.el7.x86_64 providing numpy is already installed", "python-matplotlib-1.2.0-16.el7.x86_64 providing python-matplotlib is already installed", "usbredir-0.7.1-3.el7.x86_64 providing usbredir is already installed", "genisoimage-1.1.11-25.el7.x86_64 providing genisoimage is already installed", "httpd-2.4.6-90.el7.centos.x86_64 providing httpd is already installed", "httpd-devel-2.4.6-90.el7.centos.x86_64 providing httpd-devel is already installed", "httpd-tools-2.4.6-90.el7.centos.x86_64 providing httpd-tools is already installed", "1:mod_ssl-2.4.6-90.el7.centos.x86_64 providing mod_ssl is already installed", "libev-devel-4.15-7.el7.x86_64 providing libev-devel is already installed", "perl-XML-Twig-3.44-2.el7.noarch providing perl-XML-Twig is already installed", "1:java-1.6.0-openjdk-devel-1.6.0.41-1.13.13.1.el7_3.x86_64 providing java-1.6.0-openjdk-devel is already insta 2019-12-08T11:58:41.402 INFO:teuthology.task.ansible.out:lled", "junit-4.11-8.el7.noarch providing junit4 is already installed", "1:nfs-utils-1.3.0-0.65.el7.x86_64 providing nfs-utils is already installed", "ncurses-devel-5.9-14.20130511.el7_4.x86_64 providing ncurses-devel is already installed", "python-devel-2.7.5-86.el7.x86_64 providing python-devel is already installed", "python-virtualenv-15.1.0-2.el7.noarch providing python-virtualenv is already installed", "perl-CPAN-1.9800-294.el7_6.noarch providing perl-CPAN is already installed", "Loaded plugins: fastestmirror, langpacks, priorities\nLoading mirror speeds from cached hostfile\n * base: mirrors.umflint.edu\n * epel: download-cc-rdu01.fedoraproject.org\n * extras: mirror.wdc1.us.leaseweb.net\n * updates: mirror.math.princeton.edu\nResolving Dependencies\n--> Running transaction check\n---> Package iozone.x86_64 0:3.424-2_ceph.el7.centos will be installed\n---> Package mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos will be installed\n---> Package qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 will be installed\n--> Processing Dependency: qemu-kvm-common = 10:1.5.3-167.el7_7.1 for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: qemu-img = 10:1.5.3-167.el7_7.1 for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librbd.so.1()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Processing Dependency: librados.so.2()(64bit) for package: 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64\n--> Running transaction check\n---> Package librados2.x86_64 1:10.2.5-4.el7 will be installed\n--> Processing Dependency: libboost_random-mt.so.1.53.0()(64bit) for package: 1:librados2-10.2.5-4.el7.x86_64\n---> Package librbd1.x86_64 1:10.2.5-4.el7 will be installed\n---> Package qemu-img.x86_64 10:1.5.3-167.el7_7.1 will be installed\n---> Package qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 will be installed\n--> Running transaction check\n---> Package boost-random.x86_64 0:1.53.0-27.el7 will be installed\n--> Finished Dependency Resolution\n\nDepende 2019-12-08T11:58:41.404 INFO:teuthology.task.ansible.out:ncies Resolved\n\n================================================================================\n Package Arch Version Repository Size\n================================================================================\nInstalling:\n iozone x86_64 3.424-2_ceph.el7.centos lab-extras 800 k\n mod_fastcgi x86_64 2.4.7-1.ceph.el7.centos centos7-fcgi-ceph 70 k\n qemu-kvm x86_64 10:1.5.3-167.el7_7.1 updates 1.9 M\nInstalling for dependencies:\n boost-random x86_64 1.53.0-27.el7 base 39 k\n librados2 x86_64 1:10.2.5-4.el7 base 1.8 M\n librbd1 x86_64 1:10.2.5-4.el7 base 2.4 M\n qemu-img x86_64 10:1.5.3-167.el7_7.1 updates 699 k\n qemu-kvm-common x86_64 10:1.5.3-167.el7_7.1 updates 435 k\n\nTransaction Summary\n================================================================================\nInstall 3 Packages (+5 Dependent packages)\n\nTotal download size: 8.1 M\nInstalled size: 23 M\nDownloading packages:\n--------------------------------------------------------------------------------\nTotal 13 MB/s | 8.1 MB 00:00 \nRunning transaction check\nRunning transaction test\nTransaction test succeeded\nRunning transaction\n Installing : boost-random-1.53.0-27.el7.x86_64 1/8 \n Installing : 1:librados2-10.2.5-4.el7.x86_64 2/8 \n Installing : 1:librbd1-10.2.5-4.el7.x86_64 3/8 \n Installing : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 4/8 \n Installing : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 5/8 \n Installing : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 6/8 \n Installing : iozone-3.424-2_ceph.el7.centos.x86_64 2019-12-08T11:58:41.405 INFO:teuthology.task.ansible.out: 7/8 \n Installing : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 8/8 \n Verifying : 1:librbd1-10.2.5-4.el7.x86_64 1/8 \n Verifying : 10:qemu-kvm-common-1.5.3-167.el7_7.1.x86_64 2/8 \n Verifying : mod_fastcgi-2.4.7-1.ceph.el7.centos.x86_64 3/8 \n Verifying : 1:librados2-10.2.5-4.el7.x86_64 4/8 \n Verifying : 10:qemu-kvm-1.5.3-167.el7_7.1.x86_64 5/8 \n Verifying : 10:qemu-img-1.5.3-167.el7_7.1.x86_64 6/8 \n Verifying : boost-random-1.53.0-27.el7.x86_64 7/8 \n Verifying : iozone-3.424-2_ceph.el7.centos.x86_64 8/8 \n\nInstalled:\n iozone.x86_64 0:3.424-2_ceph.el7.centos \n mod_fastcgi.x86_64 0:2.4.7-1.ceph.el7.centos \n qemu-kvm.x86_64 10:1.5.3-167.el7_7.1 \n\nDependency Installed:\n boost-random.x86_64 0:1.53.0-27.el7 \n librados2.x86_64 1:10.2.5-4.el7 \n librbd1.x86_64 1:10.2.5-4.el7 \n qemu-img.x86_64 10:1.5.3-167.el7_7.1 \n qemu-kvm-common.x86_64 10:1.5.3-167.el7_7.1 \n\nComplete!\n"]} 2019-12-08T11:58:41.438 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:41 +0000 (0:00:00.058) 0:04:16.719 ******* 2019-12-08T11:58:41.449 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2019-12-08T11:58:41.451 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:41.488 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:41 +0000 (0:00:00.050) 0:04:16.770 ******* 2019-12-08T11:58:41.513 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2019-12-08T11:58:41.515 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:41.566 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:41 +0000 (0:00:00.077) 0:04:16.847 ******* 2019-12-08T11:58:41.595 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2019-12-08T11:58:41.597 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:41.633 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:41 +0000 (0:00:00.066) 0:04:16.914 ******* 2019-12-08T11:58:41.665 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2019-12-08T11:58:41.666 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:41.711 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:41 +0000 (0:00:00.077) 0:04:16.992 ******* 2019-12-08T11:58:41.739 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2019-12-08T11:58:41.741 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:41.776 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:41 +0000 (0:00:00.065) 0:04:17.057 ******* 2019-12-08T11:58:41.803 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2019-12-08T11:58:41.805 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:41.840 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:41 +0000 (0:00:00.063) 0:04:17.122 ******* 2019-12-08T11:58:41.878 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2019-12-08T11:58:41.879 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:41.918 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:41 +0000 (0:00:00.077) 0:04:17.199 ******* 2019-12-08T11:58:41.945 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2019-12-08T11:58:41.947 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:41.984 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:41 +0000 (0:00:00.066) 0:04:17.265 ******* 2019-12-08T11:58:42.010 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2019-12-08T11:58:42.011 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:42.046 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:42 +0000 (0:00:00.062) 0:04:17.328 ******* 2019-12-08T11:58:42.090 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2019-12-08T11:58:42.091 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:42.143 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:42 +0000 (0:00:00.096) 0:04:17.424 ******* 2019-12-08T11:58:42.170 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2019-12-08T11:58:42.172 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:42.210 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:42 +0000 (0:00:00.066) 0:04:17.491 ******* 2019-12-08T11:58:42.237 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* 2019-12-08T11:58:42.239 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:42.304 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:42 +0000 (0:00:00.093) 0:04:17.586 ******* 2019-12-08T11:58:42.311 INFO:teuthology.task.ansible.out: TASK [testnode : Install epel packages] **************************************** 2019-12-08T11:58:42.313 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["cryptopp-devel-5.6.2-10.el7.x86_64 providing cryptopp-devel is already installed", "cryptopp-5.6.2-10.el7.x86_64 providing cryptopp is already installed", "fcgi-2.4.0-25.el7.x86_64 providing fcgi is already installed", "dbench-4.0-10.el7.x86_64 providing dbench is already installed", "fuse-sshfs-2.10-1.el7.x86_64 providing fuse-sshfs is already installed", "bonnie++-1.97.3-1.el7.x86_64 providing bonnie++ is already installed", "1:perl-JSON-XS-3.01-2.el7.x86_64 providing perl-JSON-XS is already installed"]} 2019-12-08T11:58:42.352 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:42 +0000 (0:00:00.048) 0:04:17.634 ******* 2019-12-08T11:58:42.359 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2019-12-08T11:58:42.361 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:42.399 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:42 +0000 (0:00:00.046) 0:04:17.680 ******* 2019-12-08T11:58:42.435 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2019-12-08T11:58:42.437 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:42.480 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:42 +0000 (0:00:00.081) 0:04:17.761 ******* 2019-12-08T11:58:42.518 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** 2019-12-08T11:58:42.520 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:42.564 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:42 +0000 (0:00:00.084) 0:04:17.846 ******* 2019-12-08T11:58:42.595 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2019-12-08T11:58:42.597 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:42.632 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:42 +0000 (0:00:00.067) 0:04:17.914 ******* 2019-12-08T11:58:42.671 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2019-12-08T11:58:42.673 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:42.711 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:42 +0000 (0:00:00.078) 0:04:17.992 ******* 2019-12-08T11:58:42.748 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2019-12-08T11:58:42.758 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:42.795 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:42 +0000 (0:00:00.084) 0:04:18.077 ******* 2019-12-08T11:58:42.823 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* 2019-12-08T11:58:42.825 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:42.874 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:42 +0000 (0:00:00.078) 0:04:18.155 ******* 2019-12-08T11:58:42.893 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2019-12-08T11:58:42.894 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["device-mapper-multipath is not installed"]} 2019-12-08T11:58:42.932 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:42 +0000 (0:00:00.058) 0:04:18.214 ******* 2019-12-08T11:58:42.940 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi079.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2019-12-08T11:58:42.982 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:42 +0000 (0:00:00.048) 0:04:18.263 ******* 2019-12-08T11:58:42.988 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:43.032 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:43 +0000 (0:00:00.049) 0:04:18.312 ******* 2019-12-08T11:58:43.039 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi079.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2019-12-08T11:58:43.062 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2019-12-08T11:58:43.076 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2019-12-08T11:58:43.078 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2019-12-08T11:58:43.093 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} skipping: [smithi079.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2019-12-08T11:58:43.100 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2019-12-08T11:58:43.147 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:43 +0000 (0:00:00.116) 0:04:18.428 ******* 2019-12-08T11:58:43.359 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2019-12-08T11:58:43.361 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.006516", "end": "2019-12-08 11:58:43.333222", "rc": 0, "start": "2019-12-08 11:58:43.326706", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2019-12-08T11:58:43.410 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:43 +0000 (0:00:00.262) 0:04:18.691 ******* 2019-12-08T11:58:43.448 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2019-12-08T11:58:43.452 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:43.495 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:43 +0000 (0:00:00.082) 0:04:18.774 ******* 2019-12-08T11:58:43.500 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable firewalld] *********************************** 2019-12-08T11:58:43.502 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => {"changed": false, "enabled": false, "name": "firewalld", "state": "stopped", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "system.slice polkit.service basic.target dbus.service", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "network-pre.target shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "BusName": "org.fedoraproject.FirewallD1", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "yes", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "Conflicts": "ipset.service shutdown.target iptables.service ip6tables.service ebtables.service", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "firewalld - dynamic firewall daemon", "DevicePolicy": "auto", "Documentation": "man:firewalld(1)", "EnvironmentFile": "/etc/sysconfig/firewalld (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecReload": "{ path=/bin/kill ; argv[]=/bin/kill -HUP $MAINPID ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "ExecStart": "{ path=/usr/sbin/firewalld ; argv[]=/usr/sbin/firewalld --nofork --nopid $FIREWALLD_ARGS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/firewalld.service", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "firewalld.service", "IgnoreOnIsolate": "no", "Igno 2019-12-08T11:58:43.503 INFO:teuthology.task.ansible.out:reOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "mixed", "KillSignal": "15", "LimitAS": "18446744073709551615", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127535", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127535", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "firewalld.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "no", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "basic.target", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "null", "StandardInput": "null", "StandardOutput": "null", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", " 2019-12-08T11:58:43.505 INFO:teuthology.task.ansible.out:TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec": "50000", "Transient": "no", "Type": "dbus", "UMask": "0022", "UnitFilePreset": "enabled", "UnitFileState": "disabled", "Wants": "network-pre.target system.slice", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2019-12-08T11:58:43.545 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:43 +0000 (0:00:00.052) 0:04:18.827 ******* 2019-12-08T11:58:43.558 INFO:teuthology.task.ansible.out: TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:43.597 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:43 +0000 (0:00:00.051) 0:04:18.878 ******* 2019-12-08T11:58:43.626 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:43.663 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:43 +0000 (0:00:00.065) 0:04:18.944 ******* 2019-12-08T11:58:43.689 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure apt dependencies are installed] ********************* 2019-12-08T11:58:43.690 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:43.727 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:43 +0000 (0:00:00.064) 0:04:19.009 ******* 2019-12-08T11:58:43.956 INFO:teuthology.task.ansible.out: TASK [testnode : Stop and disable iptables] ************************************ 2019-12-08T11:58:43.958 INFO:teuthology.task.ansible.out:fatal: [smithi013.front.sepia.ceph.com]: FAILED! => {"changed": false, "msg": "Could not find the requested service iptables: host"} ...ignoring 2019-12-08T11:58:44.002 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:43 +0000 (0:00:00.274) 0:04:19.284 ******* 2019-12-08T11:58:44.222 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* 2019-12-08T11:58:44.223 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["gdisk-0.8.10-2.el7.x86_64 providing gdisk is already installed", "7:device-mapper-1.02.149-8.el7.x86_64 providing device-mapper is already installed"]} 2019-12-08T11:58:44.271 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:44 +0000 (0:00:00.268) 0:04:19.552 ******* 2019-12-08T11:58:44.333 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ ok: [smithi079.front.sepia.ceph.com] => (item={u'block_used': 13040458, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 227284026, u'size_available': 930955370496, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60966950, u'device': u'/dev/sda1', u'inode_used': 88026, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227284026, "block_size": 4096, "block_total": 240324484, "block_used": 13040458, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60966950, "inode_total": 61054976, "inode_used": 88026, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 930955370496, "size_total": 984369086464, "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}} 2019-12-08T11:58:44.374 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:44 +0000 (0:00:00.102) 0:04:19.655 ******* 2019-12-08T11:58:44.423 INFO:teuthology.task.ansible.out: TASK [testnode : Enable SELinux] *********************************************** 2019-12-08T11:58:44.424 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => {"changed": false, "configfile": "/etc/selinux/config", "msg": "", "policy": "targeted", "reboot_required": false, "state": "permissive"} 2019-12-08T11:58:44.464 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:44 +0000 (0:00:00.088) 0:04:19.743 ******* 2019-12-08T11:58:44.498 INFO:teuthology.task.ansible.out: TASK [testnode : Check for custom repos] *************************************** 2019-12-08T11:58:44.499 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:44.552 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:44 +0000 (0:00:00.089) 0:04:19.833 ******* 2019-12-08T11:58:44.579 INFO:teuthology.task.ansible.out: TASK [testnode : Remove custom repos] ****************************************** 2019-12-08T11:58:44.619 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:44 +0000 (0:00:00.067) 0:04:19.901 ******* 2019-12-08T11:58:44.646 INFO:teuthology.task.ansible.out: TASK [testnode : Set apt preferences] ****************************************** 2019-12-08T11:58:44.648 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:44.684 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:44 +0000 (0:00:00.065) 0:04:19.966 ******* 2019-12-08T11:58:44.693 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2019-12-08T11:58:44.694 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.010890", "end": "2019-12-08 11:58:44.654097", "rc": 0, "start": "2019-12-08 11:58:44.643207", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-08T11:58:44.737 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:44 +0000 (0:00:00.052) 0:04:20.018 ******* 2019-12-08T11:58:44.743 INFO:teuthology.task.ansible.out: TASK [testnode : Add sources list] ********************************************* 2019-12-08T11:58:44.745 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:44.793 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:44 +0000 (0:00:00.056) 0:04:20.074 ******* 2019-12-08T11:58:44.800 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2019-12-08T11:58:44.801 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'block_used': 13040458, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 227284026, u'size_available': 930955370496, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60966950, u'device': u'/dev/sda1', u'inode_used': 88026, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227284026, "block_size": 4096, "block_total": 240324484, "block_used": 13040458, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60966950, "inode_total": 61054976, "inode_used": 88026, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 930955370496, "size_total": 984369086464, "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:44.841 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:44 +0000 (0:00:00.048) 0:04:20.123 ******* 2019-12-08T11:58:44.851 INFO:teuthology.task.ansible.out: TASK [testnode : Install apt keys] ********************************************* 2019-12-08T11:58:44.853 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/autobuild.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/autobuild.asc", "skip_reason": "Conditional result was False"} skipping: [smithi013.front.sepia.ceph.com] => (item=http://download.ceph.com/keys/release.asc) => {"ansible_loop_var": "item", "changed": false, "item": "http://download.ceph.com/keys/release.asc", "skip_reason": "Conditional result was False"} 2019-12-08T11:58:44.894 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:44 +0000 (0:00:00.052) 0:04:20.176 ******* 2019-12-08T11:58:44.901 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2019-12-08T11:58:44.946 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:44 +0000 (0:00:00.051) 0:04:20.227 ******* 2019-12-08T11:58:44.952 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-apt] ******************************************* 2019-12-08T11:58:44.954 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:44.997 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:44 +0000 (0:00:00.051) 0:04:20.279 ******* 2019-12-08T11:58:45.007 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-12-08T11:58:45.012 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5QDP6', u'wwn-0x5000c50091e0487b'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5QDP6', u'wwn': u'0x5000c50091e0487b', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5QDP6-part1', u'wwn-0x5000c50091e0487b-part1'], u'uuids': [u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QDP6", "wwn-0x5000c50091e0487b"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QDP6-part1", "wwn-0x5000c50091e0487b-part1"], "labels": [], "masters": [], "uuids": ["60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5QDP6", "size": "931.51 GB", "support_discard": "0", "vendor": " 2019-12-08T11:58:45.014 INFO:teuthology.task.ansible.out:ATA", "virtual": 1, "wwn": "0x5000c50091e0487b"}}, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:45.032 INFO:teuthology.task.ansible.out: TASK [testnode : Add local apt repos.] ***************************************** 2019-12-08T11:58:45.073 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:45 +0000 (0:00:00.075) 0:04:20.354 ******* 2019-12-08T11:58:45.112 INFO:teuthology.task.ansible.out: TASK [testnode : Blast the apt cache.] ***************************************** 2019-12-08T11:58:45.113 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:45.153 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:45 +0000 (0:00:00.080) 0:04:20.434 ******* 2019-12-08T11:58:45.191 INFO:teuthology.task.ansible.out: TASK [testnode : Update apt cache.] ******************************************** 2019-12-08T11:58:45.200 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:45.240 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:45 +0000 (0:00:00.087) 0:04:20.522 ******* 2019-12-08T11:58:45.279 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure packages are not present.] ***************************** 2019-12-08T11:58:45.280 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:45.331 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:45 +0000 (0:00:00.090) 0:04:20.612 ******* 2019-12-08T11:58:45.361 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2019-12-08T11:58:45.363 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:45.406 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:45 +0000 (0:00:00.075) 0:04:20.687 ******* 2019-12-08T11:58:45.438 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade non aarch64 packages] ********************************* 2019-12-08T11:58:45.440 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:45.477 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:45 +0000 (0:00:00.070) 0:04:20.758 ******* 2019-12-08T11:58:45.505 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* 2019-12-08T11:58:45.507 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:45.545 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:45 +0000 (0:00:00.067) 0:04:20.826 ******* 2019-12-08T11:58:45.570 INFO:teuthology.task.ansible.out: TASK [testnode : Install non aarch64 packages] ********************************* 2019-12-08T11:58:45.572 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:45.612 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:45 +0000 (0:00:00.067) 0:04:20.894 ******* 2019-12-08T11:58:45.650 INFO:teuthology.task.ansible.out: TASK [testnode : Use perl to add user_xattr to the root mount options in fstab.] *** 2019-12-08T11:58:45.652 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:45.700 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:45 +0000 (0:00:00.082) 0:04:20.976 ******* 2019-12-08T11:58:45.736 INFO:teuthology.task.ansible.out: TASK [testnode : Enable xattr for this boot.] ********************************** 2019-12-08T11:58:45.738 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:45.799 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:45 +0000 (0:00:00.103) 0:04:21.080 ******* 2019-12-08T11:58:45.842 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure fuse group exists.] ************************************ 2019-12-08T11:58:45.844 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:45.893 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:45 +0000 (0:00:00.094) 0:04:21.174 ******* 2019-12-08T11:58:45.926 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/fuse.conf.] *************************************** 2019-12-08T11:58:45.927 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:45.986 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:45 +0000 (0:00:00.092) 0:04:21.267 ******* 2019-12-08T11:58:46.016 INFO:teuthology.task.ansible.out: TASK [testnode : Add teuthology user to groups fuse, kvm and disk.] ************ 2019-12-08T11:58:46.018 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:46.081 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:46 +0000 (0:00:00.095) 0:04:21.363 ******* 2019-12-08T11:58:46.121 INFO:teuthology.task.ansible.out: TASK [testnode : Set up static IP in /etc/hosts.] ****************************** 2019-12-08T11:58:46.123 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:46.179 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:46 +0000 (0:00:00.097) 0:04:21.460 ******* 2019-12-08T11:58:46.210 INFO:teuthology.task.ansible.out: TASK [testnode : Stop apache2] ************************************************* 2019-12-08T11:58:46.212 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:46.259 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:46 +0000 (0:00:00.080) 0:04:21.540 ******* 2019-12-08T11:58:46.293 INFO:teuthology.task.ansible.out: TASK [testnode : Set mode on /etc/fuse.conf] *********************************** 2019-12-08T11:58:46.295 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:46.347 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:46 +0000 (0:00:00.087) 0:04:21.628 ******* 2019-12-08T11:58:46.389 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure the group kvm exists.] ********************************* 2019-12-08T11:58:46.391 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:46.450 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:46 +0000 (0:00:00.103) 0:04:21.732 ******* 2019-12-08T11:58:46.482 INFO:teuthology.task.ansible.out: TASK [testnode : Add the teuthology user to groups kvm,disk] ******************* 2019-12-08T11:58:46.484 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:46.541 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:46 +0000 (0:00:00.090) 0:04:21.822 ******* 2019-12-08T11:58:46.583 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/sudoers.] ************************************** 2019-12-08T11:58:46.589 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:46.632 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:46 +0000 (0:00:00.090) 0:04:21.913 ******* 2019-12-08T11:58:46.666 INFO:teuthology.task.ansible.out: TASK [testnode : Configure /etc/security/limits.conf] ************************** 2019-12-08T11:58:46.668 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:46.735 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:46 +0000 (0:00:00.103) 0:04:22.016 ******* 2019-12-08T11:58:46.754 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-12-08T11:58:46.757 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-dby7K4-LxZt-VdLY-6ixB-y2MR-VqC0-20rQOp', u'nvme-INTEL_SSDPEDMD400G4_PHFT6204013G400BGN', u'nvme-nvme.8086-50484654363230343031334734303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'serial': u'PHFT6204013G400BGN', u'holders': [u'vg_nvme-lv_5', u'vg_nvme-lv_4', u'vg_nvme-lv_3', u'vg_nvme-lv_2', u'vg_nvme-lv_1'], u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'INTEL SSDPEDMD400G4', u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.425598", "end": "2019-12-08 11:58:46.717008", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_5", "vg_nvme-lv_4", "vg_nvme-lv_3", "vg_nvme-lv_2", "vg_nvme-lv_1"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-dby7K4-LxZt-VdLY-6ixB-y2MR-VqC0-20rQOp", "nvme-INTEL_SSDPEDMD400G4_PHFT6204013G400BGN", "nvme-nvme.8086-50484654363230343031334734303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "serial": "PHFT6204013G400BGN", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-08 11:58:45.291 2019-12-08T11:58:46.758 INFO:teuthology.task.ansible.out:410", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-08T11:58:46.780 INFO:teuthology.task.ansible.out: TASK [testnode : Rebuild rpmdb] ************************************************ 2019-12-08T11:58:46.782 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:46.823 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:46 +0000 (0:00:00.088) 0:04:22.105 ******* 2019-12-08T11:58:46.864 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph packages are not present.] ************************ 2019-12-08T11:58:46.866 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:46.904 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:46 +0000 (0:00:00.079) 0:04:22.184 ******* 2019-12-08T11:58:46.960 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure ceph dependency packages are not present.] ************* skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:47.003 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:46 +0000 (0:00:00.101) 0:04:22.285 ******* 2019-12-08T11:58:47.045 INFO:teuthology.task.ansible.out: TASK [testnode : Remove packages] ********************************************** 2019-12-08T11:58:47.047 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:47.102 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:47 +0000 (0:00:00.098) 0:04:22.383 ******* 2019-12-08T11:58:47.147 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages] ********************************************* skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:47.185 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:47 +0000 (0:00:00.082) 0:04:22.466 ******* 2019-12-08T11:58:47.224 INFO:teuthology.task.ansible.out: TASK [testnode : Upgrade packages] ********************************************* 2019-12-08T11:58:47.225 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:47.227 INFO:teuthology.task.ansible.out: 2019-12-08T11:58:47.285 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:47 +0000 (0:00:00.100) 0:04:22.567 ******* 2019-12-08T11:58:47.339 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:47.394 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:47 +0000 (0:00:00.108) 0:04:22.675 ******* 2019-12-08T11:58:47.768 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2019-12-08T11:58:47.770 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/bin/lspci", "gid": 0, "group": "root", "mode": "0777", "owner": "root", "secontext": "unconfined_u:object_r:bin_t:s0", "size": 11, "src": "/sbin/lspci", "state": "link", "uid": 0} 2019-12-08T11:58:47.825 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:47 +0000 (0:00:00.430) 0:04:23.106 ******* 2019-12-08T11:58:48.192 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2019-12-08T11:58:48.193 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/usr/lib/ltp/testcases/bin", "secontext": "unconfined_u:object_r:lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-12-08T11:58:48.238 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:48 +0000 (0:00:00.413) 0:04:23.520 ******* 2019-12-08T11:58:48.258 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-12-08T11:58:48.259 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-R7qpzfxABT2zD9ml1aBtcqgO8HTyh4ugtB1sOzlZ1uMhdYoRif4jthnuz2NrIJ71'], u'uuids': [u'7a12410b-436e-4e29-b7a6-16fd6c2ad816']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'PHFT6204013G400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.131802", "end": "2019-12-08 11:58:48.204501", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-R7qpzfxABT2zD9ml1aBtcqgO8HTyh4ugtB1sOzlZ1uMhdYoRif4jthnuz2NrIJ71"], "labels": [], "masters" 2019-12-08T11:58:48.261 INFO:teuthology.task.ansible.out:: [], "uuids": ["7a12410b-436e-4e29-b7a6-16fd6c2ad816"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "PHFT6204013G400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-08 11:58:47.072699", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-08T11:58:48.597 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2019-12-08T11:58:48.598 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => {"changed": false, "dest": "/usr/lib/ltp/testcases/bin/fsstress", "src": "/usr/bin/fsstress"} 2019-12-08T11:58:48.636 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:48 +0000 (0:00:00.397) 0:04:23.917 ******* 2019-12-08T11:58:48.665 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** 2019-12-08T11:58:48.667 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:48.705 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:48 +0000 (0:00:00.068) 0:04:23.986 ******* 2019-12-08T11:58:48.744 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:48.820 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:48 +0000 (0:00:00.115) 0:04:24.102 ******* 2019-12-08T11:58:48.863 INFO:teuthology.task.ansible.out: TASK [testnode : Include hostname in /etc/sysconfig/network] ******************* 2019-12-08T11:58:48.865 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:48.932 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:48 +0000 (0:00:00.109) 0:04:24.211 ******* 2019-12-08T11:58:48.958 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** 2019-12-08T11:58:48.962 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:49.001 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:48 +0000 (0:00:00.071) 0:04:24.282 ******* 2019-12-08T11:58:49.030 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** 2019-12-08T11:58:49.031 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:49.069 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:49 +0000 (0:00:00.068) 0:04:24.350 ******* 2019-12-08T11:58:49.096 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2019-12-08T11:58:49.098 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:49.137 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:49 +0000 (0:00:00.067) 0:04:24.418 ******* 2019-12-08T11:58:49.175 INFO:teuthology.task.ansible.out: TASK [testnode : Make raid/smart scripts work.] ******************************** skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:49.221 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:49 +0000 (0:00:00.084) 0:04:24.503 ******* 2019-12-08T11:58:49.263 INFO:teuthology.task.ansible.out: TASK [testnode : Create FStest ubuntu directory.] ****************************** skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:49.337 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:49 +0000 (0:00:00.112) 0:04:24.616 ******* 2019-12-08T11:58:49.387 INFO:teuthology.task.ansible.out: TASK [testnode : Make fsstress same path as ubuntu.] *************************** 2019-12-08T11:58:49.389 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:49.448 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:49 +0000 (0:00:00.105) 0:04:24.721 ******* 2019-12-08T11:58:49.471 INFO:teuthology.task.ansible.out: TASK [testnode : Set grub config.] ********************************************* 2019-12-08T11:58:49.473 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:49.522 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:49 +0000 (0:00:00.081) 0:04:24.803 ******* 2019-12-08T11:58:49.554 INFO:teuthology.task.ansible.out: TASK [testnode : Remove /etc/ceph] ********************************************* 2019-12-08T11:58:49.555 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:49.595 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:49 +0000 (0:00:00.073) 0:04:24.877 ******* 2019-12-08T11:58:49.639 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-12-08T11:58:49.640 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-R7qpzfxABT2zD9ml1aBtcqgO8HTyh4ugTJuTz2W4IIIA596lTRMlqex80s4nVUeM'], u'uuids': [u'15577138-49c3-4c68-a24e-30bb08e487ff']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'PHFT6204013G400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.052585", "end": "2019-12-08 11:58:49.583149", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-R7qpzfxABT2zD9ml1aBtcqgO8HTyh4ugTJuTz2W4IIIA596lTRMlqex80s4nVUeM"], "labels": [], "masters": [], "uuids": ["15577138-49c3-4c68-a24e-30bb08e487ff"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "PHFT6204013G400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-08 11:58:48.530564", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-08T11:58:49.642 INFO:teuthology.task.ansible.out: TASK [testnode : Upload a dummy nfs export so that the nfs kernel server starts.] *** skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:49.680 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:49 +0000 (0:00:00.084) 0:04:24.961 ******* 2019-12-08T11:58:49.720 INFO:teuthology.task.ansible.out: TASK [testnode : Enable nfs-server on rhel 7.x.] ******************************* 2019-12-08T11:58:49.722 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:49.759 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:49 +0000 (0:00:00.078) 0:04:25.040 ******* 2019-12-08T11:58:49.786 INFO:teuthology.task.ansible.out: TASK [testnode : Upload weekly kernel-clean crontab.] ************************** 2019-12-08T11:58:49.788 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:49.826 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:49 +0000 (0:00:00.067) 0:04:25.108 ******* 2019-12-08T11:58:49.854 INFO:teuthology.task.ansible.out: TASK [testnode : Upload /etc/grub.d/02_force_timeout.] ************************* skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:49.891 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:49 +0000 (0:00:00.064) 0:04:25.172 ******* 2019-12-08T11:58:49.918 INFO:teuthology.task.ansible.out: TASK [testnode : Enable kernel modules to load at boot time.] ****************** 2019-12-08T11:58:49.919 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:49.965 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:49 +0000 (0:00:00.074) 0:04:25.246 ******* 2019-12-08T11:58:49.993 INFO:teuthology.task.ansible.out: TASK [testnode : Enabling auto-fsck fix to prevent boot hangup.] *************** 2019-12-08T11:58:49.994 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:50.053 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:50 +0000 (0:00:00.088) 0:04:25.335 ******* 2019-12-08T11:58:50.082 INFO:teuthology.task.ansible.out: TASK [testnode : Work around broken wget on wheezy.] *************************** skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:50.120 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:50 +0000 (0:00:00.066) 0:04:25.402 ******* 2019-12-08T11:58:50.149 INFO:teuthology.task.ansible.out: TASK [testnode : Stop collectl] ************************************************ 2019-12-08T11:58:50.150 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:50.190 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:50 +0000 (0:00:00.069) 0:04:25.472 ******* 2019-12-08T11:58:50.232 INFO:teuthology.task.ansible.out: TASK [testnode : Add PATH to the teuthology_user .bashrc.] ********************* 2019-12-08T11:58:50.233 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:50.293 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:50 +0000 (0:00:00.102) 0:04:25.574 ******* 2019-12-08T11:58:50.321 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if we need to edit /etc/profile.] **************** 2019-12-08T11:58:50.323 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:50.361 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:50 +0000 (0:00:00.067) 0:04:25.642 ******* 2019-12-08T11:58:50.390 INFO:teuthology.task.ansible.out: TASK [testnode : Update /etc/profile if needed.] ******************************* skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:50.433 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:50 +0000 (0:00:00.072) 0:04:25.715 ******* 2019-12-08T11:58:50.473 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** ok: [smithi013.front.sepia.ceph.com] => {"ansible_facts": {"nvme_card_present": false}, "changed": false} 2019-12-08T11:58:50.505 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:50 +0000 (0:00:00.071) 0:04:25.787 ******* 2019-12-08T11:58:50.561 INFO:teuthology.task.ansible.out: TASK [testnode : Check for NVMe drive] ***************************************** skipping: [smithi013.front.sepia.ceph.com] => (item=sda) => {"ansible_loop_var": "item", "changed": false, "item": "sda", "skip_reason": "Conditional result was False"} 2019-12-08T11:58:50.580 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item=nvme0n1) => {"ansible_facts": {"nvme_card_present": true}, "ansible_loop_var": "item", "changed": false, "item": "nvme0n1"} 2019-12-08T11:58:50.591 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item=dm-4) => {"ansible_loop_var": "item", "changed": false, "item": "dm-4", "skip_reason": "Conditional result was False"} 2019-12-08T11:58:50.592 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item=dm-2) => {"ansible_loop_var": "item", "changed": false, "item": "dm-2", "skip_reason": "Conditional result was False"} 2019-12-08T11:58:50.603 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item=dm-3) => {"ansible_loop_var": "item", "changed": false, "item": "dm-3", "skip_reason": "Conditional result was False"} 2019-12-08T11:58:50.615 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item=dm-0) => {"ansible_loop_var": "item", "changed": false, "item": "dm-0", "skip_reason": "Conditional result was False"} 2019-12-08T11:58:50.615 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item=dm-1) => {"ansible_loop_var": "item", "changed": false, "item": "dm-1", "skip_reason": "Conditional result was False"} 2019-12-08T11:58:50.669 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:50 +0000 (0:00:00.160) 0:04:25.948 ******* 2019-12-08T11:58:50.859 INFO:teuthology.task.ansible.out: TASK [testnode : Check for teuthology-lock command] **************************** 2019-12-08T11:58:50.861 INFO:teuthology.task.ansible.out:changed: [smithi013.front.sepia.ceph.com -> localhost] => {"changed": true, "cmd": "which teuthology-lock", "delta": "0:00:00.004694", "end": "2019-12-08 11:58:50.830154", "rc": 0, "start": "2019-12-08 11:58:50.825460", "stderr": "", "stderr_lines": [], "stdout": "/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock", "stdout_lines": ["/home/teuthworker/src/git.ceph.com_git_teuthology_master/virtualenv/bin/teuthology-lock"]} 2019-12-08T11:58:50.904 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:50 +0000 (0:00:00.237) 0:04:26.185 ******* 2019-12-08T11:58:50.953 INFO:teuthology.task.ansible.out: TASK [testnode : Mark system down if NVMe card missing] ************************ 2019-12-08T11:58:50.954 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:50.997 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:50 +0000 (0:00:00.093) 0:04:26.278 ******* 2019-12-08T11:58:51.004 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-12-08T11:58:51.006 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-R7qpzfxABT2zD9ml1aBtcqgO8HTyh4ugp60N4ra9YOFbZaCLNEfyJPtjWerGCNWH'], u'uuids': [u'9682213e-c88d-4f70-91a0-7509aad1d921']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'PHFT6204013G400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.052243", "end": "2019-12-08 11:58:50.948498", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-R7qpzfxABT2zD9ml1aBtcqgO8HTyh4ugp60N4ra9YOFbZaCLNEfyJPtjWerGCNWH"], "labels": [], "masters": [], "uuids": ["9682213e-c88d-4f70-91a0-7509aad1d921"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "PHFT6204013G400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-08 11:58:49.896255", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-08T11:58:51.029 INFO:teuthology.task.ansible.out: 2019-12-08T11:58:51.040 INFO:teuthology.task.ansible.out:TASK [testnode : Update description in paddles lock DB if NVMe card missing] *** 2019-12-08T11:58:51.041 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:51.080 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:51 +0000 (0:00:00.082) 0:04:26.361 ******* 2019-12-08T11:58:51.110 INFO:teuthology.task.ansible.out: TASK [testnode : Fail rest of playbook due to missing NVMe card] *************** 2019-12-08T11:58:51.111 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:51.161 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:51 +0000 (0:00:00.081) 0:04:26.443 ******* 2019-12-08T11:58:51.188 INFO:teuthology.task.ansible.out: 2019-12-08T11:58:51.190 INFO:teuthology.task.ansible.out:TASK [testnode : Make sure apt dependencies are installed] ********************* skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:51.232 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:51 +0000 (0:00:00.071) 0:04:26.514 ******* 2019-12-08T11:58:51.234 INFO:teuthology.task.ansible.out: 2019-12-08T11:58:51.749 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure rpm dependencies are installed] ********************* ok: [smithi013.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["gdisk-0.8.10-2.el7.x86_64 providing gdisk is already installed", "7:device-mapper-1.02.149-8.el7.x86_64 providing device-mapper is already installed"]} 2019-12-08T11:58:51.788 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:51 +0000 (0:00:00.555) 0:04:27.069 ******* 2019-12-08T11:58:51.853 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2019-12-08T11:58:51.855 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item={u'block_used': 13040464, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 227284020, u'size_available': 930955345920, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60966950, u'device': u'/dev/sda1', u'inode_used': 88026, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_facts": {"root_disk": "/dev/sda"}, "ansible_loop_var": "item", "changed": false, "item": {"block_available": 227284020, "block_size": 4096, "block_total": 240324484, "block_used": 13040464, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60966950, "inode_total": 61054976, "inode_used": 88026, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 930955345920, "size_total": 984369086464, "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}} 2019-12-08T11:58:51.893 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:51 +0000 (0:00:00.105) 0:04:27.175 ******* 2019-12-08T11:58:52.236 INFO:teuthology.task.ansible.out: TASK [testnode : Compile list of non-root partitions] ************************** 2019-12-08T11:58:52.238 INFO:teuthology.task.ansible.out:changed: [smithi013.front.sepia.ceph.com] => {"changed": true, "cmd": "lsblk --list --noheadings | grep part | grep -v sda | awk '{ print $1 }'", "delta": "0:00:00.012610", "end": "2019-12-08 11:58:52.205872", "rc": 0, "start": "2019-12-08 11:58:52.193262", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-08T11:58:52.276 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:52 +0000 (0:00:00.383) 0:04:27.558 ******* 2019-12-08T11:58:52.314 INFO:teuthology.task.ansible.out: TASK [testnode : Unmount any non-root mountpoints] ***************************** 2019-12-08T11:58:52.316 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'block_used': 13040464, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 227284020, u'size_available': 930955345920, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60966950, u'device': u'/dev/sda1', u'inode_used': 88026, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227284020, "block_size": 4096, "block_total": 240324484, "block_used": 13040464, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60966950, "inode_total": 61054976, "inode_used": 88026, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 930955345920, "size_total": 984369086464, "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:52.355 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:52 +0000 (0:00:00.078) 0:04:27.636 ******* 2019-12-08T11:58:52.383 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-12-08T11:58:52.387 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-R7qpzfxABT2zD9ml1aBtcqgO8HTyh4ugpBN6S7m36St66SsuKcFVLgZcHYggLduk'], u'uuids': [u'79498ee6-409b-458e-885d-5f96c410ac95']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'PHFT6204013G400BGN', u'holders': [], u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.073539", "end": "2019-12-08 11:58:52.350882", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-R7qpzfxABT2zD9ml1aBtcqgO8HTyh4ugpBN6S7m36St66SsuKcFVLgZcHYggLduk"], "labels": [], "masters": [], "uuids": ["79498ee6-409b-458e-885d-5f96c410ac95"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "serial": "PHFT6204013G400BGN", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-08 11:58:51.277343", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-08T11:58:52.394 INFO:teuthology.task.ansible.out: TASK [testnode : Wipe filesystems on non-root partitions] ********************** 2019-12-08T11:58:52.428 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:52 +0000 (0:00:00.073) 0:04:27.710 ******* 2019-12-08T11:58:52.484 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-12-08T11:58:52.485 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W4J2YD', u'wwn-0x5000c500871b846a'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W4J2YD', u'wwn': u'0x5000c500871b846a', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W4J2YD-part1', u'wwn-0x5000c500871b846a-part1'], u'uuids': [u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4J2YD", "wwn-0x5000c500871b846a"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4J2YD-part1", "wwn-0x5000c500871b846a-part1"], "labels": [], "masters": [], "uuids": ["60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4J2YD", "size": "931.51 GB", "support_discard": "0", "vendor": " 2019-12-08T11:58:52.487 INFO:teuthology.task.ansible.out:ATA", "virtual": 1, "wwn": "0x5000c500871b846a"}}, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:53.766 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-R7qpzfxABT2zD9ml1aBtcqgO8HTyh4ugbwgRF22xshcCQ11NlqAf25WFVkEdWzM0'], u'uuids': [u'ad23e5ab-f9a5-4c66-95fc-631b03f80cdd']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'PHFT6204013G400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.062431", "end": "2019-12-08 11:58:53.724249", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-R7qpzfxABT2zD9ml1aBtcqgO8HTyh4ugbwgRF22xshcCQ11NlqAf25WFVkEdWzM0"], "labels": [], "masters": [], "uuids": ["ad23e5ab-f9a5-4c66-95fc-631b03f80cdd"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "PHFT6204013G400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-08 11:58:52.661818", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-08T11:58:53.820 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:53 +0000 (0:00:01.391) 0:04:29.102 ******* 2019-12-08T11:58:53.870 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2019-12-08T11:58:53.871 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5QDP6', u'wwn-0x5000c50091e0487b'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W5QDP6', u'wwn': u'0x5000c50091e0487b', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W5QDP6-part1', u'wwn-0x5000c50091e0487b-part1'], u'uuids': [u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QDP6", "wwn-0x5000c50091e0487b"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W5QDP6-part1", "wwn-0x5000c50091e0487b-part1"], "labels": [], "masters": [], "uuids": ["60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W5QDP6", "size": "931.51 GB", "support_discard": "0", "vendor": " 2019-12-08T11:58:53.873 INFO:teuthology.task.ansible.out:ATA", "virtual": 1, "wwn": "0x5000c50091e0487b"}}, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:54.224 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-dby7K4-LxZt-VdLY-6ixB-y2MR-VqC0-20rQOp', u'nvme-INTEL_SSDPEDMD400G4_PHFT6204013G400BGN', u'nvme-nvme.8086-50484654363230343031334734303042474e-494e54454c205353445045444d443430304734-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'serial': u'PHFT6204013G400BGN', u'holders': [u'vg_nvme-lv_5', u'vg_nvme-lv_4', u'vg_nvme-lv_3', u'vg_nvme-lv_2', u'vg_nvme-lv_1'], u'size': u'372.61 GB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'781422768', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'INTEL SSDPEDMD400G4', u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.064569", "end": "2019-12-08 11:58:54.200753", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_5", "vg_nvme-lv_4", "vg_nvme-lv_3", "vg_nvme-lv_2", "vg_nvme-lv_1"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-dby7K4-LxZt-VdLY-6ixB-y2MR-VqC0-20rQOp", "nvme-INTEL_SSDPEDMD400G4_PHFT6204013G400BGN", "nvme-nvme.8086-50484654363230343031334734303042474e-494e54454c205353445045444d443430304734-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMD400G4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "781422768", "sectorsize": "512", "serial": "PHFT6204013G400BGN", "size": "372.61 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-08 11:58:54.136184", "stderr": 2019-12-08T11:58:54.225 INFO:teuthology.task.ansible.out: "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.0577838 s, 2.0 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.0577838 s, 2.0 GB/s"], "stdout": "", "stdout_lines": []} 2019-12-08T11:58:54.272 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-12-08T11:58:54.274 INFO:teuthology.task.ansible.out:changed: [smithi013.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-qdX3dv-AFOH-xRhw-CMro-NdDW-AiGI-YyUbif', u'nvme-INTEL_SSDPEDMX020T4_CVPD517000062P0SGN', u'nvme-nvme.8086-43565044353137303030303632503053474e-494e54454c205353445045444d583032305434-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'serial': u'CVPD517000062P0SGN', u'holders': [u'vg_nvme-lv_5', u'vg_nvme-lv_4', u'vg_nvme-lv_3', u'vg_nvme-lv_2', u'vg_nvme-lv_1'], u'size': u'1.82 TB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'3907029168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'INTEL SSDPEDMX020T4', u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/nvme0n1 || sgdisk --zap-all /dev/nvme0n1", "delta": "0:00:01.469363", "end": "2019-12-08 11:58:54.227818", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_5", "vg_nvme-lv_4", "vg_nvme-lv_3", "vg_nvme-lv_2", "vg_nvme-lv_1"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-qdX3dv-AFOH-xRhw-CMro-NdDW-AiGI-YyUbif", "nvme-INTEL_SSDPEDMX020T4_CVPD517000062P0SGN", "nvme-nvme.8086-43565044353137303030303632503053474e-494e54454c205353445045444d583032305434-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMX020T4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "3907029168", "sectorsize": "512", "serial": "CVPD517000062P0SGN", "size": "1.82 TB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-08 11:58:52.75845 2019-12-08T11:58:54.275 INFO:teuthology.task.ansible.out:5", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-08T11:58:54.675 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2019-12-08T11:58:54.676 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-R7qpzfxABT2zD9ml1aBtcqgO8HTyh4ugtB1sOzlZ1uMhdYoRif4jthnuz2NrIJ71'], u'uuids': [u'7a12410b-436e-4e29-b7a6-16fd6c2ad816']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'PHFT6204013G400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.179550", "end": "2019-12-08 11:58:54.641985", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-R7qpzfxABT2zD9ml1aBtcqgO8HTyh4ugtB1sOzlZ1uMhdYoRif4jthnuz2NrIJ71"], "labels": [], "masters": [], "uuids": ["7a12410b-436e-4e29-b7a6-16fd6c2ad816"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "PHFT6204013G400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-08 11:58:54.462435", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.173209 s, 666 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.173209 s, 666 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-08T11:58:55.199 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-R7qpzfxABT2zD9ml1aBtcqgO8HTyh4ugTJuTz2W4IIIA596lTRMlqex80s4nVUeM'], u'uuids': [u'15577138-49c3-4c68-a24e-30bb08e487ff']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'PHFT6204013G400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.205478", "end": "2019-12-08 11:58:55.158008", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-R7qpzfxABT2zD9ml1aBtcqgO8HTyh4ugTJuTz2W4IIIA596lTRMlqex80s4nVUeM"], "labels": [], "masters": [], "uuids": ["15577138-49c3-4c68-a24e-30bb08e487ff"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "PHFT6204013G400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-08 11:58:54.952530", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.198914 s, 580 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.198914 s, 580 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-08T11:58:55.722 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-12-08T11:58:55.723 INFO:teuthology.task.ansible.out:changed: [smithi013.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-wes6dumTxB7pmfGjlOpH0i4laEQ5zEWoR6mukLlJgR3y59t0iNkWFn5ETiDFO6n8'], u'uuids': [u'cdf728b6-34e0-4bb1-8d68-55aca282e1ee']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'CVPD517000062P0SGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-4 || sgdisk --zap-all /dev/dm-4", "delta": "0:00:01.080771", "end": "2019-12-08 11:58:55.676761", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-wes6dumTxB7pmfGjlOpH0i4laEQ5zEWoR6mukLlJgR3y59t0iNkWFn5ETiDFO6n8"], "labels": [], "masters" 2019-12-08T11:58:55.725 INFO:teuthology.task.ansible.out:: [], "uuids": ["cdf728b6-34e0-4bb1-8d68-55aca282e1ee"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "CVPD517000062P0SGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-08 11:58:54.595990", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-08T11:58:55.746 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2019-12-08T11:58:55.747 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-R7qpzfxABT2zD9ml1aBtcqgO8HTyh4ugp60N4ra9YOFbZaCLNEfyJPtjWerGCNWH'], u'uuids': [u'9682213e-c88d-4f70-91a0-7509aad1d921']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'PHFT6204013G400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:00.209745", "end": "2019-12-08 11:58:55.696448", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-R7qpzfxABT2zD9ml1aBtcqgO8HTyh4ugp60N4ra9YOFbZaCLNEfyJPtjWerGCNWH"], "labels": [], "masters": [], "uuids": ["9682213e-c88d-4f70-91a0-7509aad1d921"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "PHFT6204013G400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-08 11:58:55.486703", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.203139 s, 568 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.203139 s, 568 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-08T11:58:56.304 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-R7qpzfxABT2zD9ml1aBtcqgO8HTyh4ugpBN6S7m36St66SsuKcFVLgZcHYggLduk'], u'uuids': [u'79498ee6-409b-458e-885d-5f96c410ac95']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'PHFT6204013G400BGN', u'holders': [], u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.200200", "end": "2019-12-08 11:58:56.251565", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-R7qpzfxABT2zD9ml1aBtcqgO8HTyh4ugpBN6S7m36St66SsuKcFVLgZcHYggLduk"], "labels": [], "masters": [], "uuids": ["79498ee6-409b-458e-885d-5f96c410ac95"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "serial": "PHFT6204013G400BGN", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-08 11:58:56.051365", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.193776 s, 595 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.193776 s, 595 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-08T11:58:56.851 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-R7qpzfxABT2zD9ml1aBtcqgO8HTyh4ugbwgRF22xshcCQ11NlqAf25WFVkEdWzM0'], u'uuids': [u'ad23e5ab-f9a5-4c66-95fc-631b03f80cdd']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'PHFT6204013G400BGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.204760", "end": "2019-12-08 11:58:56.817337", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-R7qpzfxABT2zD9ml1aBtcqgO8HTyh4ugbwgRF22xshcCQ11NlqAf25WFVkEdWzM0"], "labels": [], "masters": [], "uuids": ["ad23e5ab-f9a5-4c66-95fc-631b03f80cdd"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "PHFT6204013G400BGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-08 11:58:56.612577", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.198125 s, 582 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.198125 s, 582 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-08T11:58:56.918 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:56 +0000 (0:00:03.097) 0:04:32.199 ******* 2019-12-08T11:58:57.135 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-12-08T11:58:57.136 INFO:teuthology.task.ansible.out:changed: [smithi013.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-wes6dumTxB7pmfGjlOpH0i4laEQ5zEWoHXABnHqmBbp5UWxjwp2wsU3D13XrBq49'], u'uuids': [u'65a954fe-d9d9-4ada-ba2b-85899073cec6']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'CVPD517000062P0SGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-2 || sgdisk --zap-all /dev/dm-2", "delta": "0:00:01.058146", "end": "2019-12-08 11:58:57.093584", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-wes6dumTxB7pmfGjlOpH0i4laEQ5zEWoHXABnHqmBbp5UWxjwp2wsU3D13XrBq49"], "labels": [], "masters": [], "uuids": ["65a954fe-d9d9-4ada-ba2b-85899073cec6"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "CVPD517000062P0SGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-08 11:58:56.035438", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-08T11:58:57.287 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2019-12-08T11:58:57.289 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.070725", "end": "2019-12-08 11:58:57.260297", "rc": 0, "start": "2019-12-08 11:58:57.189572", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-08T11:58:57.335 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:57 +0000 (0:00:00.416) 0:04:32.616 ******* 2019-12-08T11:58:57.719 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2019-12-08T11:58:57.724 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.057822", "end": "2019-12-08 11:58:57.687679", "rc": 0, "start": "2019-12-08 11:58:57.629857", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-08T11:58:57.773 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:57 +0000 (0:00:00.436) 0:04:33.052 ******* 2019-12-08T11:58:57.802 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2019-12-08T11:58:57.848 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:57 +0000 (0:00:00.076) 0:04:33.129 ******* 2019-12-08T11:58:57.890 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2019-12-08T11:58:57.891 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:57.932 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:57 +0000 (0:00:00.084) 0:04:33.214 ******* 2019-12-08T11:58:57.970 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2019-12-08T11:58:57.972 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:58.019 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:58 +0000 (0:00:00.086) 0:04:33.300 ******* 2019-12-08T11:58:58.060 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2019-12-08T11:58:58.062 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:58.104 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:58 +0000 (0:00:00.085) 0:04:33.386 ******* 2019-12-08T11:58:58.144 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2019-12-08T11:58:58.146 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:58.183 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:58 +0000 (0:00:00.078) 0:04:33.465 ******* 2019-12-08T11:58:58.508 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2019-12-08T11:58:58.510 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-08T11:58:58.546 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:58 +0000 (0:00:00.363) 0:04:33.828 ******* 2019-12-08T11:58:58.552 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-12-08T11:58:58.554 INFO:teuthology.task.ansible.out:changed: [smithi013.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-wes6dumTxB7pmfGjlOpH0i4laEQ5zEWosdgVSzbUPcDZqZUw1TgcMJ4NB8I9Ex9G'], u'uuids': [u'4910378b-21d4-4580-bbea-36f24a000f1c']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'CVPD517000062P0SGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-3 || sgdisk --zap-all /dev/dm-3", "delta": "0:00:01.054697", "end": "2019-12-08 11:58:58.478639", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-wes6dumTxB7pmfGjlOpH0i4laEQ5zEWosdgVSzbUPcDZqZUw1TgcMJ4NB8I9Ex9G"], "labels": [], "masters": [], "uuids": ["4910378b-21d4-4580-bbea-36f24a000f1c"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "CVPD517000062P0SGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-08 11:58:57.423942", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-08T11:58:58.587 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2019-12-08T11:58:58.589 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={u'block_used': 13040458, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 227284026, u'size_available': 930955370496, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60966950, u'device': u'/dev/sda1', u'inode_used': 88026, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227284026, "block_size": 4096, "block_total": 240324484, "block_used": 13040458, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60966950, "inode_total": 61054976, "inode_used": 88026, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 930955370496, "size_total": 984369086464, "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:58.625 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:58 +0000 (0:00:00.078) 0:04:33.906 ******* 2019-12-08T11:58:58.662 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2019-12-08T11:58:58.665 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:58.700 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:58 +0000 (0:00:00.075) 0:04:33.982 ******* 2019-12-08T11:58:58.738 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-12-08T11:58:58.740 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:58.776 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:58 +0000 (0:00:00.075) 0:04:34.058 ******* 2019-12-08T11:58:58.807 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:58.841 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:58 +0000 (0:00:00.064) 0:04:34.123 ******* 2019-12-08T11:58:58.868 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2019-12-08T11:58:58.870 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:58.913 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:58 +0000 (0:00:00.071) 0:04:34.194 ******* 2019-12-08T11:58:58.941 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:58.982 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:58 +0000 (0:00:00.068) 0:04:34.263 ******* 2019-12-08T11:58:59.021 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2019-12-08T11:58:59.023 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:58:59.060 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:59 +0000 (0:00:00.077) 0:04:34.341 ******* 2019-12-08T11:58:59.899 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-12-08T11:58:59.902 INFO:teuthology.task.ansible.out:changed: [smithi013.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-wes6dumTxB7pmfGjlOpH0i4laEQ5zEWoCMm7O7JdmIuAziygmQ7EGRD5fE8m0czl'], u'uuids': [u'76c1a269-f462-42d9-b94c-1ff23299fb8c']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'CVPD517000062P0SGN', u'holders': [], u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-0 || sgdisk --zap-all /dev/dm-0", "delta": "0:00:01.058935", "end": "2019-12-08 11:58:59.853726", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-wes6dumTxB7pmfGjlOpH0i4laEQ5zEWoCMm7O7JdmIuAziygmQ7EGRD5fE8m0czl"], "labels": [], "masters": [], "uuids": ["76c1a269-f462-42d9-b94c-1ff23299fb8c"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "serial": "CVPD517000062P0SGN", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-08 11:58:58.794791", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-08T11:58:59.937 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2019-12-08T11:58:59.939 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => (item={'value': {u'pvs': u'/dev/nvme0n1'}, 'key': u'vg_nvme'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2019-12-08T11:58:59.990 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:58:59 +0000 (0:00:00.930) 0:04:35.271 ******* 2019-12-08T11:59:00.804 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2019-12-08T11:59:00.805 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-08T11:59:01.288 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-08T11:59:01.322 INFO:teuthology.task.ansible.out: TASK [testnode : Zap all non-root disks] *************************************** 2019-12-08T11:59:01.323 INFO:teuthology.task.ansible.out:changed: [smithi013.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-wes6dumTxB7pmfGjlOpH0i4laEQ5zEWomFicFuE915cjfwP5FAly9s4JPFVoGV5z'], u'uuids': [u'058d5bcf-6492-4bf1-bb23-bb1ac48f1a22']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'CVPD517000062P0SGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "sgdisk --zap-all /dev/dm-1 || sgdisk --zap-all /dev/dm-1", "delta": "0:00:01.083560", "end": "2019-12-08 11:59:01.283705", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-wes6dumTxB7pmfGjlOpH0i4laEQ5zEWomFicFuE915cjfwP5FAly9s4JPFVoGV5z"], "labels": [], "masters": [], "uuids": ["058d5bcf-6492-4bf1-bb23-bb1ac48f1a22"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "CVPD517000062P0SGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-08 11:59:00.200145", "stderr": "", "stderr_lines": [], "stdout": "Creating new GPT entries.\nWarning: The kernel is still using the old partition table.\nThe new table will be used at the next reboot.\nGPT data structures destroyed! You may now partition the disk using fdisk or\nother utilities.", "stdout_lines": ["Creating new GPT entries.", "Warning: The kernel is still using the old partition table.", "The new table will be used at the next reboot.", "GPT data structures destroyed! You may now partition the disk using fdisk or", "other utilities."]} 2019-12-08T11:59:01.375 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:01 +0000 (0:00:01.384) 0:04:36.656 ******* 2019-12-08T11:59:01.423 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2019-12-08T11:59:01.424 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': u'ATA', u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W4J2YD', u'wwn-0x5000c500871b846a'], u'uuids': []}, u'sas_device_handle': None, u'host': u'SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)', u'support_discard': u'0', u'serial': u'Z1W4J2YD', u'wwn': u'0x5000c500871b846a', u'holders': [], u'size': u'931.51 GB', u'scheduler_mode': u'deadline', u'rotational': u'1', u'sectors': u'1953525168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'ST1000NM0033-9ZM', u'partitions': {u'sda1': {u'start': u'2048', u'sectorsize': 512, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'sectors': u'1953522688', u'holders': [], u'links': {u'masters': [], u'labels': [], u'ids': [u'ata-ST1000NM0033-9ZM173_Z1W4J2YD-part1', u'wwn-0x5000c500871b846a-part1'], u'uuids': [u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67']}, u'size': u'931.51 GB'}}}, 'key': u'sda'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "sda", "value": {"holders": [], "host": "SATA controller: Intel Corporation C610/X99 series chipset 6-Port SATA Controller [AHCI mode] (rev 05)", "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4J2YD", "wwn-0x5000c500871b846a"], "labels": [], "masters": [], "uuids": []}, "model": "ST1000NM0033-9ZM", "partitions": {"sda1": {"holders": [], "links": {"ids": ["ata-ST1000NM0033-9ZM173_Z1W4J2YD-part1", "wwn-0x5000c500871b846a-part1"], "labels": [], "masters": [], "uuids": ["60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"]}, "sectors": "1953522688", "sectorsize": 512, "size": "931.51 GB", "start": "2048", "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}}, "removable": "0", "rotational": "1", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "deadline", "sectors": "1953525168", "sectorsize": "512", "serial": "Z1W4J2YD", "size": "931.51 GB", "support_discard": "0", "vendor": " 2019-12-08T11:59:01.426 INFO:teuthology.task.ansible.out:ATA", "virtual": 1, "wwn": "0x5000c500871b846a"}}, "skip_reason": "Conditional result was False"} 2019-12-08T11:59:01.757 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2019-12-08T11:59:01.758 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-08T11:59:01.799 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2019-12-08T11:59:01.800 INFO:teuthology.task.ansible.out:changed: [smithi013.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [u'dm-0', u'dm-1', u'dm-2', u'dm-3', u'dm-4'], u'labels': [], u'ids': [u'lvm-pv-uuid-qdX3dv-AFOH-xRhw-CMro-NdDW-AiGI-YyUbif', u'nvme-INTEL_SSDPEDMX020T4_CVPD517000062P0SGN', u'nvme-nvme.8086-43565044353137303030303632503053474e-494e54454c205353445045444d583032305434-00000001'], u'uuids': []}, u'sas_device_handle': None, u'host': u'Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)', u'support_discard': u'512', u'serial': u'CVPD517000062P0SGN', u'holders': [u'vg_nvme-lv_5', u'vg_nvme-lv_4', u'vg_nvme-lv_3', u'vg_nvme-lv_2', u'vg_nvme-lv_1'], u'size': u'1.82 TB', u'scheduler_mode': u'none', u'rotational': u'0', u'sectors': u'3907029168', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': u'INTEL SSDPEDMX020T4', u'partitions': {}}, 'key': u'nvme0n1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=110", "delta": "0:00:00.064940", "end": "2019-12-08 11:59:01.770436", "item": {"key": "nvme0n1", "value": {"holders": ["vg_nvme-lv_5", "vg_nvme-lv_4", "vg_nvme-lv_3", "vg_nvme-lv_2", "vg_nvme-lv_1"], "host": "Non-Volatile memory controller: Intel Corporation PCIe Data Center SSD (rev 01)", "links": {"ids": ["lvm-pv-uuid-qdX3dv-AFOH-xRhw-CMro-NdDW-AiGI-YyUbif", "nvme-INTEL_SSDPEDMX020T4_CVPD517000062P0SGN", "nvme-nvme.8086-43565044353137303030303632503053474e-494e54454c205353445045444d583032305434-00000001"], "labels": [], "masters": ["dm-0", "dm-1", "dm-2", "dm-3", "dm-4"], "uuids": []}, "model": "INTEL SSDPEDMX020T4", "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "none", "sectors": "3907029168", "sectorsize": "512", "serial": "CVPD517000062P0SGN", "size": "1.82 TB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-08 11:59:01.705496", "stderr": " 2019-12-08T11:59:01.802 INFO:teuthology.task.ansible.out:110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.058571 s, 2.0 GB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.058571 s, 2.0 GB/s"], "stdout": "", "stdout_lines": []} 2019-12-08T11:59:02.218 INFO:teuthology.task.ansible.out:changed: [smithi013.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_1', u'dm-uuid-LVM-wes6dumTxB7pmfGjlOpH0i4laEQ5zEWoR6mukLlJgR3y59t0iNkWFn5ETiDFO6n8'], u'uuids': [u'cdf728b6-34e0-4bb1-8d68-55aca282e1ee']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'CVPD517000062P0SGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-4'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-4 bs=1M count=110", "delta": "0:00:00.135826", "end": "2019-12-08 11:59:02.190639", "item": {"key": "dm-4", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_1", "dm-uuid-LVM-wes6dumTxB7pmfGjlOpH0i4laEQ5zEWoR6mukLlJgR3y59t0iNkWFn5ETiDFO6n8"], "labels": [], "masters": [], "uuids": ["cdf728b6-34e0-4bb1-8d68-55aca282e1ee"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "CVPD517000062P0SGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-08 11:59:02.054813", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.129293 s, 892 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.129293 s, 892 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-08T11:59:02.240 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2019-12-08T11:59:02.242 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-08T11:59:02.694 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-08T11:59:02.747 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:02 +0000 (0:00:01.372) 0:04:38.028 ******* 2019-12-08T11:59:02.759 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2019-12-08T11:59:02.761 INFO:teuthology.task.ansible.out:changed: [smithi013.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_3', u'dm-uuid-LVM-wes6dumTxB7pmfGjlOpH0i4laEQ5zEWoHXABnHqmBbp5UWxjwp2wsU3D13XrBq49'], u'uuids': [u'65a954fe-d9d9-4ada-ba2b-85899073cec6']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'CVPD517000062P0SGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-2'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-2 bs=1M count=110", "delta": "0:00:00.160907", "end": "2019-12-08 11:59:02.663589", "item": {"key": "dm-2", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_3", "dm-uuid-LVM-wes6dumTxB7pmfGjlOpH0i4laEQ5zEWoHXABnHqmBbp5UWxjwp2wsU3D13XrBq49"], "labels": [], "masters": [], "uuids": ["65a954fe-d9d9-4ada-ba2b-85899073cec6"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "CVPD517000062P0SGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-08 11:59:02.502682", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.154095 s, 749 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.154095 s, 749 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-08T11:59:03.086 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2019-12-08T11:59:03.088 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2019-12-08T11:59:03.143 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:03 +0000 (0:00:00.395) 0:04:38.424 ******* 2019-12-08T11:59:03.217 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2019-12-08T11:59:03.219 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2019-12-08T11:59:03.539 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-12-08T11:59:03.837 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-12-08T11:59:04.142 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2019-12-08T11:59:04.143 INFO:teuthology.task.ansible.out:changed: [smithi013.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_2', u'dm-uuid-LVM-wes6dumTxB7pmfGjlOpH0i4laEQ5zEWosdgVSzbUPcDZqZUw1TgcMJ4NB8I9Ex9G'], u'uuids': [u'4910378b-21d4-4580-bbea-36f24a000f1c']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'CVPD517000062P0SGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-3'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-3 bs=1M count=110", "delta": "0:00:01.130847", "end": "2019-12-08 11:59:04.104010", "item": {"key": "dm-3", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_2", "dm-uuid-LVM-wes6dumTxB7pmfGjlOpH0i4laEQ5zEWosdgVSzbUPcDZqZUw1TgcMJ4NB8I9Ex9G"], "labels": [], "masters": [], "uuids": ["4910378b-21d4-4580-bbea-36f24a000f1c"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "CVPD517000062P0SGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-08 11:59:02.973163", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.123687 s, 933 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.123687 s, 933 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-08T11:59:04.160 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2019-12-08T11:59:04.162 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-12-08T11:59:04.492 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-12-08T11:59:04.534 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:04 +0000 (0:00:01.391) 0:04:39.815 ******* 2019-12-08T11:59:04.600 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2019-12-08T11:59:04.601 INFO:teuthology.task.ansible.out:changed: [smithi013.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_5', u'dm-uuid-LVM-wes6dumTxB7pmfGjlOpH0i4laEQ5zEWoCMm7O7JdmIuAziygmQ7EGRD5fE8m0czl'], u'uuids': [u'76c1a269-f462-42d9-b94c-1ff23299fb8c']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'CVPD517000062P0SGN', u'holders': [], u'size': u'14.90 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'31252480', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-0'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-0 bs=1M count=110", "delta": "0:00:00.131636", "end": "2019-12-08 11:59:04.556919", "item": {"key": "dm-0", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_5", "dm-uuid-LVM-wes6dumTxB7pmfGjlOpH0i4laEQ5zEWoCMm7O7JdmIuAziygmQ7EGRD5fE8m0czl"], "labels": [], "masters": [], "uuids": ["76c1a269-f462-42d9-b94c-1ff23299fb8c"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "31252480", "sectorsize": "512", "serial": "CVPD517000062P0SGN", "size": "14.90 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-08 11:59:04.425283", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.126145 s, 914 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.126145 s, 914 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-08T11:59:04.840 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** 2019-12-08T11:59:04.842 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-12-08T11:59:04.902 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:04 +0000 (0:00:00.367) 0:04:40.183 ******* 2019-12-08T11:59:04.947 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** ok: [smithi079.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2019-12-08T11:59:04.997 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:04 +0000 (0:00:00.095) 0:04:40.278 ******* 2019-12-08T11:59:05.090 INFO:teuthology.task.ansible.out: TASK [testnode : Blow away lingering OSD data and FSIDs] *********************** 2019-12-08T11:59:05.094 INFO:teuthology.task.ansible.out:changed: [smithi013.front.sepia.ceph.com] => (item={'value': {u'sectorsize': u'512', u'vendor': None, u'links': {u'masters': [], u'labels': [], u'ids': [u'dm-name-vg_nvme-lv_4', u'dm-uuid-LVM-wes6dumTxB7pmfGjlOpH0i4laEQ5zEWomFicFuE915cjfwP5FAly9s4JPFVoGV5z'], u'uuids': [u'058d5bcf-6492-4bf1-bb23-bb1ac48f1a22']}, u'sas_device_handle': None, u'host': u'', u'support_discard': u'512', u'serial': u'CVPD517000062P0SGN', u'holders': [], u'size': u'89.40 GB', u'scheduler_mode': u'', u'rotational': u'0', u'sectors': u'187490304', u'sas_address': None, u'virtual': 1, u'removable': u'0', u'model': None, u'partitions': {}}, 'key': u'dm-1'}) => {"ansible_loop_var": "item", "changed": true, "cmd": "dd if=/dev/zero of=/dev/dm-1 bs=1M count=110", "delta": "0:00:00.158287", "end": "2019-12-08 11:59:05.044521", "item": {"key": "dm-1", "value": {"holders": [], "host": "", "links": {"ids": ["dm-name-vg_nvme-lv_4", "dm-uuid-LVM-wes6dumTxB7pmfGjlOpH0i4laEQ5zEWomFicFuE915cjfwP5FAly9s4JPFVoGV5z"], "labels": [], "masters": [], "uuids": ["058d5bcf-6492-4bf1-bb23-bb1ac48f1a22"]}, "model": null, "partitions": {}, "removable": "0", "rotational": "0", "sas_address": null, "sas_device_handle": null, "scheduler_mode": "", "sectors": "187490304", "sectorsize": "512", "serial": "CVPD517000062P0SGN", "size": "89.40 GB", "support_discard": "512", "vendor": null, "virtual": 1}}, "rc": 0, "start": "2019-12-08 11:59:04.886234", "stderr": "110+0 records in\n110+0 records out\n115343360 bytes (115 MB) copied, 0.151919 s, 759 MB/s", "stderr_lines": ["110+0 records in", "110+0 records out", "115343360 bytes (115 MB) copied, 0.151919 s, 759 MB/s"], "stdout": "", "stdout_lines": []} 2019-12-08T11:59:05.142 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:05 +0000 (0:00:00.145) 0:04:40.424 ******* 2019-12-08T11:59:05.557 INFO:teuthology.task.ansible.out: TASK [testnode : Remove all LVM data] ****************************************** 2019-12-08T11:59:05.559 INFO:teuthology.task.ansible.out:changed: [smithi013.front.sepia.ceph.com] => {"attempts": 1, "changed": true, "cmd": "dmsetup remove_all --force", "delta": "0:00:00.071726", "end": "2019-12-08 11:59:05.524201", "rc": 0, "start": "2019-12-08 11:59:05.452475", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-08T11:59:05.606 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:05 +0000 (0:00:00.464) 0:04:40.888 ******* 2019-12-08T11:59:05.771 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2019-12-08T11:59:05.773 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => {"changed": true} 2019-12-08T11:59:05.825 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:05 +0000 (0:00:00.217) 0:04:41.106 ******* 2019-12-08T11:59:06.025 INFO:teuthology.task.ansible.out: TASK [testnode : Check for physical volumes] *********************************** 2019-12-08T11:59:06.025 INFO:teuthology.task.ansible.out:changed: [smithi013.front.sepia.ceph.com] => {"changed": true, "cmd": "pvdisplay | grep 'PV Name' | awk '{ print $3 }'", "delta": "0:00:00.067457", "end": "2019-12-08 11:59:05.993558", "rc": 0, "start": "2019-12-08 11:59:05.926101", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-08T11:59:06.065 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:06 +0000 (0:00:00.241) 0:04:41.347 ******* 2019-12-08T11:59:06.093 INFO:teuthology.task.ansible.out: TASK [testnode : Remove physical volumes] ************************************** 2019-12-08T11:59:06.135 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:06 +0000 (0:00:00.069) 0:04:41.416 ******* 2019-12-08T11:59:06.162 INFO:teuthology.task.ansible.out: TASK [testnode : Write a new partition table to {{ item.value.device }}] ******* 2019-12-08T11:59:06.164 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:59:06.203 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:06 +0000 (0:00:00.068) 0:04:41.485 ******* 2019-12-08T11:59:06.236 INFO:teuthology.task.ansible.out: TASK [testnode : Write partition entries to {{ item.0.device }}] *************** 2019-12-08T11:59:06.238 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:59:06.275 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:06 +0000 (0:00:00.071) 0:04:41.556 ******* 2019-12-08T11:59:06.303 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2019-12-08T11:59:06.304 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:59:06.346 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:06 +0000 (0:00:00.070) 0:04:41.627 ******* 2019-12-08T11:59:06.370 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs for {{ item.0.device }}] ****************** 2019-12-08T11:59:06.372 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:59:06.410 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:06 +0000 (0:00:00.064) 0:04:41.692 ******* 2019-12-08T11:59:06.583 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2019-12-08T11:59:06.584 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2019-12-08T11:59:06.648 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:06 +0000 (0:00:00.237) 0:04:41.929 ******* 2019-12-08T11:59:06.686 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:59:06.737 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:06 +0000 (0:00:00.087) 0:04:42.017 ******* 2019-12-08T11:59:06.756 INFO:teuthology.task.ansible.out: TASK [testnode : Edit lvm.conf to support LVM on kRBD.] ************************ 2019-12-08T11:59:06.757 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => {"backup": "", "changed": false, "msg": ""} 2019-12-08T11:59:06.808 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:06 +0000 (0:00:00.070) 0:04:42.088 ******* 2019-12-08T11:59:06.812 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** 2019-12-08T11:59:06.813 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:59:06.854 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:06 +0000 (0:00:00.047) 0:04:42.135 ******* 2019-12-08T11:59:06.860 INFO:teuthology.task.ansible.out: TASK [testnode : Set root disk] ************************************************ 2019-12-08T11:59:06.861 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={u'block_used': 13040464, u'uuid': u'60ab4ba9-cdc2-4668-aaad-a5769fd8ef67', u'size_total': 984369086464, u'block_total': 240324484, u'mount': u'/', u'block_available': 227284020, u'size_available': 930955345920, u'fstype': u'ext4', u'inode_total': 61054976, u'inode_available': 60966950, u'device': u'/dev/sda1', u'inode_used': 88026, u'block_size': 4096, u'options': u'rw,seclabel,relatime,data=ordered'}) => {"ansible_loop_var": "item", "changed": false, "item": {"block_available": 227284020, "block_size": 4096, "block_total": 240324484, "block_used": 13040464, "device": "/dev/sda1", "fstype": "ext4", "inode_available": 60966950, "inode_total": 61054976, "inode_used": 88026, "mount": "/", "options": "rw,seclabel,relatime,data=ordered", "size_available": 930955345920, "size_total": 984369086464, "uuid": "60ab4ba9-cdc2-4668-aaad-a5769fd8ef67"}, "skip_reason": "Conditional result was False"} 2019-12-08T11:59:06.901 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:06 +0000 (0:00:00.047) 0:04:42.183 ******* 2019-12-08T11:59:06.912 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:59:06.954 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:06 +0000 (0:00:00.052) 0:04:42.235 ******* 2019-12-08T11:59:06.959 INFO:teuthology.task.ansible.out: TASK [testnode : Combine list of non-root disks] ******************************* 2019-12-08T11:59:06.959 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:59:06.999 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:06 +0000 (0:00:00.045) 0:04:42.280 ******* 2019-12-08T11:59:07.010 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:59:07.048 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:07 +0000 (0:00:00.049) 0:04:42.330 ******* 2019-12-08T11:59:07.054 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-12-08T11:59:07.055 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:59:07.100 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:07 +0000 (0:00:00.051) 0:04:42.381 ******* 2019-12-08T11:59:07.106 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2019-12-08T11:59:07.107 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:59:07.152 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:07 +0000 (0:00:00.051) 0:04:42.433 ******* 2019-12-08T11:59:07.158 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:59:07.197 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:07 +0000 (0:00:00.045) 0:04:42.479 ******* 2019-12-08T11:59:07.204 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2019-12-08T11:59:07.205 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:59:07.247 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:07 +0000 (0:00:00.049) 0:04:42.528 ******* 2019-12-08T11:59:07.256 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume_groups dict] ************************************ 2019-12-08T11:59:07.257 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:59:07.305 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:07 +0000 (0:00:00.057) 0:04:42.586 ******* 2019-12-08T11:59:07.313 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2019-12-08T11:59:07.315 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:59:07.363 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:07 +0000 (0:00:00.058) 0:04:42.645 ******* 2019-12-08T11:59:07.369 INFO:teuthology.task.ansible.out: TASK [testnode : Determine desired logical volume percentage size] ************* 2019-12-08T11:59:07.371 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:59:07.408 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:07 +0000 (0:00:00.044) 0:04:42.690 ******* 2019-12-08T11:59:07.435 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical_volumes dict] ********************************** 2019-12-08T11:59:07.436 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:59:07.477 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:07 +0000 (0:00:00.068) 0:04:42.758 ******* 2019-12-08T11:59:07.875 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2019-12-08T11:59:07.877 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["ntp-4.2.6p5-28.el7.centos.x86_64 providing ntp is already installed"]} 2019-12-08T11:59:07.934 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:07 +0000 (0:00:00.457) 0:04:43.215 ******* 2019-12-08T11:59:07.961 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2019-12-08T11:59:07.963 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:59:07.999 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:07 +0000 (0:00:00.064) 0:04:43.280 ******* 2019-12-08T11:59:08.030 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** 2019-12-08T11:59:08.032 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:59:08.091 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:08 +0000 (0:00:00.092) 0:04:43.373 ******* 2019-12-08T11:59:08.098 INFO:teuthology.task.ansible.out: TASK [testnode : Create volume group(s)] *************************************** 2019-12-08T11:59:08.099 INFO:teuthology.task.ansible.out:changed: [smithi013.front.sepia.ceph.com] => (item={'value': {u'pvs': u'/dev/nvme0n1'}, 'key': u'vg_nvme'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "vg_nvme", "value": {"pvs": "/dev/nvme0n1"}}} 2019-12-08T11:59:08.141 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:08 +0000 (0:00:00.049) 0:04:43.423 ******* 2019-12-08T11:59:08.671 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2019-12-08T11:59:08.673 INFO:teuthology.task.ansible.out:changed: [smithi013.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-08T11:59:09.051 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ ok: [smithi079.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "secontext": "system_u:object_r:net_conf_t:s0", "size": 2767, "state": "file", "uid": 0} 2019-12-08T11:59:09.103 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:09 +0000 (0:00:00.961) 0:04:44.384 ******* 2019-12-08T11:59:09.132 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:59:09.183 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:09 +0000 (0:00:00.080) 0:04:44.465 ******* 2019-12-08T11:59:09.190 INFO:teuthology.task.ansible.out: TASK [testnode : Create logical volume(s)] ************************************* 2019-12-08T11:59:09.191 INFO:teuthology.task.ansible.out:changed: [smithi013.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-08T11:59:09.680 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2019-12-08T11:59:09.682 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => {"changed": true, "enabled": true, "name": "ntpd", "state": "started", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "syslog.target tmp.mount sntp.service ntpdate.service systemd-journald.socket -.mount basic.target system.slice", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "chronyd.service shutdown.target multi-user.target", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConflictedBy": "chronyd.service", "Conflicts": "shutdown.target", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "EnvironmentFile": "/etc/sysconfig/ntpd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/ntpd ; argv[]=/usr/sbin/ntpd -u ntp:ntp $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/ntpd.service", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "ntpd.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "1844674407370955161 2019-12-08T11:59:09.684 INFO:teuthology.task.ansible.out:5", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127511", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127511", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "ntpd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "-.mount basic.target", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec 2019-12-08T11:59:09.685 INFO:teuthology.task.ansible.out:": "50000", "Transient": "no", "Type": "forking", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "WantedBy": "multi-user.target", "Wants": "system.slice", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} TASK [testnode : Create logical volume(s)] ************************************* changed: [smithi013.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-08T11:59:09.731 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:09 +0000 (0:00:00.547) 0:04:45.012 ******* 2019-12-08T11:59:10.174 INFO:teuthology.task.ansible.out:changed: [smithi013.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-08T11:59:10.665 INFO:teuthology.task.ansible.out:changed: [smithi013.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": ""} 2019-12-08T11:59:10.708 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:10 +0000 (0:00:00.977) 0:04:45.990 ******* 2019-12-08T11:59:10.717 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2019-12-08T11:59:10.721 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["python2-pip-8.1.2-10.el7.noarch providing python-pip is already installed"]} 2019-12-08T11:59:10.767 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:10 +0000 (0:00:00.058) 0:04:46.048 ******* 2019-12-08T11:59:10.795 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2019-12-08T11:59:10.797 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:59:10.835 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:10 +0000 (0:00:00.068) 0:04:46.117 ******* 2019-12-08T11:59:10.862 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2019-12-08T11:59:10.864 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:59:10.904 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:10 +0000 (0:00:00.066) 0:04:46.183 ******* 2019-12-08T11:59:11.060 INFO:teuthology.task.ansible.out: TASK [testnode : Erase /scratch_devs so we know it's accurate] ***************** 2019-12-08T11:59:11.062 INFO:teuthology.task.ansible.out:changed: [smithi013.front.sepia.ceph.com] => {"changed": true, "path": "/scratch_devs", "state": "absent"} 2019-12-08T11:59:11.099 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:11 +0000 (0:00:00.197) 0:04:46.380 ******* 2019-12-08T11:59:11.137 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2019-12-08T11:59:11.138 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={'value': {u'vg': u'vg_nvme', u'size': u'14.9G'}, 'key': u'lv_5'}) => {"ansible_loop_var": "item", "changed": false, "item": {"key": "lv_5", "value": {"size": "14.9G", "vg": "vg_nvme"}}, "skip_reason": "Conditional result was False"} 2019-12-08T11:59:11.260 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** 2019-12-08T11:59:11.262 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"changed": false, "gid": 1215, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2019-12-08T11:59:11.303 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:11 +0000 (0:00:00.203) 0:04:46.584 ******* 2019-12-08T11:59:11.481 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2019-12-08T11:59:11.482 INFO:teuthology.task.ansible.out:changed: [smithi013.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_4'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_4", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-12-08T11:59:11.836 INFO:teuthology.task.ansible.out:changed: [smithi013.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_3'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_3", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-12-08T11:59:12.185 INFO:teuthology.task.ansible.out:changed: [smithi013.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_2'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_2", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-12-08T11:59:12.240 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2019-12-08T11:59:12.244 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1215, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2019-12-08T11:59:12.287 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:12 +0000 (0:00:00.984) 0:04:47.569 ******* 2019-12-08T11:59:12.515 INFO:teuthology.task.ansible.out: TASK [testnode : Write /scratch_devs] ****************************************** 2019-12-08T11:59:12.515 INFO:teuthology.task.ansible.out:changed: [smithi013.front.sepia.ceph.com] => (item={'value': {u'scratch_dev': True, u'vg': u'vg_nvme', u'size': u'89.4G'}, 'key': u'lv_1'}) => {"ansible_loop_var": "item", "backup": "", "changed": true, "item": {"key": "lv_1", "value": {"scratch_dev": true, "size": "89.4G", "vg": "vg_nvme"}}, "msg": "line added"} 2019-12-08T11:59:12.564 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:12 +0000 (0:00:00.276) 0:04:47.845 ******* 2019-12-08T11:59:12.908 INFO:teuthology.task.ansible.out: TASK [testnode : Create /var/lib/ceph] ***************************************** ok: [smithi013.front.sepia.ceph.com] => {"changed": false, "gid": 0, "group": "root", "mode": "0755", "owner": "root", "path": "/var/lib/ceph", "secontext": "unconfined_u:object_r:var_lib_t:s0", "size": 4096, "state": "directory", "uid": 0} 2019-12-08T11:59:12.956 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:12 +0000 (0:00:00.390) 0:04:48.236 ******* 2019-12-08T11:59:12.999 INFO:teuthology.task.ansible.out: TASK [testnode : Set xfs_opts on newer OSes] *********************************** 2019-12-08T11:59:13.000 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => {"ansible_facts": {"xfs_opts": "-m crc=0,finobt=0"}, "changed": false} 2019-12-08T11:59:13.059 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:13 +0000 (0:00:00.104) 0:04:48.340 ******* 2019-12-08T11:59:13.526 INFO:teuthology.task.ansible.out: TASK [testnode : Create xfs filesystem on /dev/vg_nvme/lv_5] ******************* 2019-12-08T11:59:13.527 INFO:teuthology.task.ansible.out:changed: [smithi013.front.sepia.ceph.com] => {"changed": true} 2019-12-08T11:59:13.576 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:13 +0000 (0:00:00.517) 0:04:48.857 ******* 2019-12-08T11:59:14.055 INFO:teuthology.task.ansible.out: TASK [testnode : Mount /dev/vg_nvme/lv_5 to /var/lib/ceph] ********************* 2019-12-08T11:59:14.057 INFO:teuthology.task.ansible.out:changed: [smithi013.front.sepia.ceph.com] => {"changed": true, "dump": "0", "fstab": "/etc/fstab", "fstype": "xfs", "name": "/var/lib/ceph", "opts": "defaults,nofail", "passno": "0", "src": "/dev/vg_nvme/lv_5"} 2019-12-08T11:59:14.098 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:14 +0000 (0:00:00.521) 0:04:49.379 ******* 2019-12-08T11:59:14.129 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the teuthology user.] *********** 2019-12-08T11:59:14.131 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:59:14.188 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:14 +0000 (0:00:00.089) 0:04:49.469 ******* 2019-12-08T11:59:14.201 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* ok: [smithi079.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip2", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "You are using pip version 8.1.2, however version 19.3.1 is available.\nYou should consider upgrading via the 'pip install --upgrade pip' command.\n", "stderr_lines": ["You are using pip version 8.1.2, however version 19.3.1 is available.", "You should consider upgrading via the 'pip install --upgrade pip' command."], "stdout": "Requirement already satisfied (use --upgrade to upgrade): remoto>=0.0.35 in /usr/lib/python2.7/site-packages\nRequirement already satisfied (use --upgrade to upgrade): execnet in /usr/lib/python2.7/site-packages (from remoto>=0.0.35)\nRequirement already satisfied (use --upgrade to upgrade): apipkg>=1.4 in /usr/lib/python2.7/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied (use --upgrade to upgrade): remoto>=0.0.35 in /usr/lib/python2.7/site-packages", "Requirement already satisfied (use --upgrade to upgrade): execnet in /usr/lib/python2.7/site-packages (from remoto>=0.0.35)", "Requirement already satisfied (use --upgrade to upgrade): apipkg>=1.4 in /usr/lib/python2.7/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2019-12-08T11:59:14.243 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:14 +0000 (0:00:00.055) 0:04:49.524 ******* 2019-12-08T11:59:14.254 INFO:teuthology.task.ansible.out: TASK [testnode : Add CPAN config directory for the root user.] ***************** skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:59:14.296 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:14 +0000 (0:00:00.052) 0:04:49.577 ******* 2019-12-08T11:59:14.304 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2019-12-08T11:59:14.306 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:59:14.365 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:14 +0000 (0:00:00.068) 0:04:49.646 ******* 2019-12-08T11:59:14.377 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for the teuthology user.] ****************** 2019-12-08T11:59:14.380 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:59:14.435 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:14 +0000 (0:00:00.069) 0:04:49.716 ******* 2019-12-08T11:59:14.448 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2019-12-08T11:59:14.450 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"ansible_facts": {"interface": "enp3s0f1"}, "changed": false} 2019-12-08T11:59:14.515 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:14 +0000 (0:00:00.080) 0:04:49.796 ******* 2019-12-08T11:59:14.522 INFO:teuthology.task.ansible.out: TASK [testnode : Upload CPAN config for root.] ********************************* 2019-12-08T11:59:14.523 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:59:14.582 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:14 +0000 (0:00:00.066) 0:04:49.863 ******* 2019-12-08T11:59:14.620 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure perl-doc is installed on apt systems.] ***************** 2019-12-08T11:59:14.623 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:59:14.659 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:14 +0000 (0:00:00.077) 0:04:49.940 ******* 2019-12-08T11:59:14.698 INFO:teuthology.task.ansible.out: TASK [testnode : Check to see if Amazon::S3 is installed.] ********************* 2019-12-08T11:59:14.700 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:59:14.736 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:14 +0000 (0:00:00.076) 0:04:50.017 ******* 2019-12-08T11:59:14.778 INFO:teuthology.task.ansible.out: TASK [testnode : Install Amazon::S3.] ****************************************** 2019-12-08T11:59:14.780 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:59:14.844 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:14 +0000 (0:00:00.108) 0:04:50.125 ******* 2019-12-08T11:59:14.854 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2019-12-08T11:59:14.856 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2019-12-08T11:59:14.904 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:14 +0000 (0:00:00.057) 0:04:50.185 ******* 2019-12-08T11:59:14.939 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2019-12-08T11:59:14.941 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:59:14.980 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:14 +0000 (0:00:00.076) 0:04:50.261 ******* 2019-12-08T11:59:15.017 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2019-12-08T11:59:15.019 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2019-12-08T11:59:15.068 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:15 +0000 (0:00:00.087) 0:04:50.349 ******* 2019-12-08T11:59:15.113 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:59:15.167 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:15 +0000 (0:00:00.096) 0:04:50.445 ******* 2019-12-08T11:59:15.377 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on rpm based systems.] ******************** 2019-12-08T11:59:15.378 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["ntp-4.2.6p5-28.el7.centos.x86_64 providing ntp is already installed"]} 2019-12-08T11:59:15.426 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:15 +0000 (0:00:00.262) 0:04:50.707 ******* 2019-12-08T11:59:15.469 INFO:teuthology.task.ansible.out: TASK [testnode : Install ntp package on apt based systems.] ******************** 2019-12-08T11:59:15.471 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:59:15.541 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:15 +0000 (0:00:00.110) 0:04:50.818 ******* 2019-12-08T11:59:15.543 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2019-12-08T11:59:15.544 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2019-12-08T11:59:15.589 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:15 +0000 (0:00:00.051) 0:04:50.870 ******* 2019-12-08T11:59:15.596 INFO:teuthology.task.ansible.out: TASK [testnode : Remove racy /etc/network/if-up.d/ntpdate on xenial] *********** skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:59:15.637 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:15 +0000 (0:00:00.048) 0:04:50.918 ******* 2019-12-08T11:59:15.942 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2019-12-08T11:59:15.943 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2019-12-08T11:59:15.986 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:15 +0000 (0:00:00.349) 0:04:51.268 ******* 2019-12-08T11:59:16.021 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2019-12-08T11:59:16.022 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:59:16.067 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:16 +0000 (0:00:00.081) 0:04:51.349 ******* 2019-12-08T11:59:16.113 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* skipping: [smithi079.front.sepia.ceph.com] => (item=enp3s0f1) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False"} skipping: [smithi079.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2019-12-08T11:59:16.121 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} 2019-12-08T11:59:16.144 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2019-12-08T11:59:16.146 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item=enp3s0f0) => {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False"} 2019-12-08T11:59:16.200 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:16 +0000 (0:00:00.132) 0:04:51.481 ******* 2019-12-08T11:59:16.250 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2019-12-08T11:59:16.253 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-12-08T11:59:16.262 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-12-08T11:59:16.274 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno2', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-12-08T11:59:16.275 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'lo', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-12-08T11:59:16.286 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'enp3s0f0', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "enp3s0f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-12-08T11:59:16.334 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:16 +0000 (0:00:00.134) 0:04:51.616 ******* 2019-12-08T11:59:16.373 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-12-08T11:59:16.375 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:59:16.419 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:16 +0000 (0:00:00.084) 0:04:51.700 ******* 2019-12-08T11:59:16.446 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** 2019-12-08T11:59:16.448 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:59:16.489 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:16 +0000 (0:00:00.070) 0:04:51.771 ******* 2019-12-08T11:59:16.517 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2019-12-08T11:59:16.519 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:59:16.578 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:16 +0000 (0:00:00.088) 0:04:51.859 ******* 2019-12-08T11:59:16.616 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* 2019-12-08T11:59:16.618 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:59:16.654 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:16 +0000 (0:00:00.076) 0:04:51.935 ******* 2019-12-08T11:59:16.692 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2019-12-08T11:59:16.693 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:59:16.739 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:16 +0000 (0:00:00.083) 0:04:52.019 ******* 2019-12-08T11:59:16.752 INFO:teuthology.task.ansible.out: TASK [testnode : Create the ntp.conf file.] ************************************ 2019-12-08T11:59:16.753 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => {"changed": false, "checksum": "645fd5116197cd9da73b328bc11bf633a40d80e1", "dest": "/etc/ntp.conf", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "path": "/etc/ntp.conf", "secontext": "system_u:object_r:net_conf_t:s0", "size": 2767, "state": "file", "uid": 0} 2019-12-08T11:59:16.795 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:16 +0000 (0:00:00.056) 0:04:52.076 ******* 2019-12-08T11:59:16.801 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2019-12-08T11:59:16.803 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:59:16.846 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:16 +0000 (0:00:00.051) 0:04:52.128 ******* 2019-12-08T11:59:16.853 INFO:teuthology.task.ansible.out: TASK [testnode : Create the chrony.conf file] ********************************** 2019-12-08T11:59:16.854 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:59:16.895 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:16 +0000 (0:00:00.048) 0:04:52.176 ******* 2019-12-08T11:59:16.902 INFO:teuthology.task.ansible.out: TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** 2019-12-08T11:59:16.903 INFO:teuthology.task.ansible.out:skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:59:16.945 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:16 +0000 (0:00:00.049) 0:04:52.226 ******* 2019-12-08T11:59:16.974 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi079.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:59:17.016 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:17 +0000 (0:00:00.071) 0:04:52.297 ******* 2019-12-08T11:59:17.366 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** ok: [smithi079.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.013415", "end": "2019-12-08 11:59:17.308413", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2019-12-08 11:59:17.294998", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-08T11:59:17.397 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ntpd is running.] *********************************** 2019-12-08T11:59:17.398 INFO:teuthology.task.ansible.out:changed: [smithi013.front.sepia.ceph.com] => {"changed": true, "enabled": true, "name": "ntpd", "state": "started", "status": {"ActiveEnterTimestampMonotonic": "0", "ActiveExitTimestampMonotonic": "0", "ActiveState": "inactive", "After": "syslog.target sntp.service system.slice systemd-journald.socket basic.target -.mount ntpdate.service tmp.mount", "AllowIsolate": "no", "AmbientCapabilities": "0", "AssertResult": "no", "AssertTimestampMonotonic": "0", "Before": "multi-user.target chronyd.service shutdown.target", "BlockIOAccounting": "no", "BlockIOWeight": "18446744073709551615", "CPUAccounting": "no", "CPUQuotaPerSecUSec": "infinity", "CPUSchedulingPolicy": "0", "CPUSchedulingPriority": "0", "CPUSchedulingResetOnFork": "no", "CPUShares": "18446744073709551615", "CanIsolate": "no", "CanReload": "no", "CanStart": "yes", "CanStop": "yes", "CapabilityBoundingSet": "18446744073709551615", "ConditionResult": "no", "ConditionTimestampMonotonic": "0", "ConflictedBy": "chronyd.service", "Conflicts": "shutdown.target", "ControlPID": "0", "DefaultDependencies": "yes", "Delegate": "no", "Description": "Network Time Service", "DevicePolicy": "auto", "EnvironmentFile": "/etc/sysconfig/ntpd (ignore_errors=yes)", "ExecMainCode": "0", "ExecMainExitTimestampMonotonic": "0", "ExecMainPID": "0", "ExecMainStartTimestampMonotonic": "0", "ExecMainStatus": "0", "ExecStart": "{ path=/usr/sbin/ntpd ; argv[]=/usr/sbin/ntpd -u ntp:ntp $OPTIONS ; ignore_errors=no ; start_time=[n/a] ; stop_time=[n/a] ; pid=0 ; code=(null) ; status=0/0 }", "FailureAction": "none", "FileDescriptorStoreMax": "0", "FragmentPath": "/usr/lib/systemd/system/ntpd.service", "GuessMainPID": "yes", "IOScheduling": "0", "Id": "ntpd.service", "IgnoreOnIsolate": "no", "IgnoreOnSnapshot": "no", "IgnoreSIGPIPE": "yes", "InactiveEnterTimestampMonotonic": "0", "InactiveExitTimestampMonotonic": "0", "JobTimeoutAction": "none", "JobTimeoutUSec": "0", "KillMode": "control-group", "KillSignal": "15", "LimitAS": "1844674407370955161 2019-12-08T11:59:17.399 INFO:teuthology.task.ansible.out:5", "LimitCORE": "18446744073709551615", "LimitCPU": "18446744073709551615", "LimitDATA": "18446744073709551615", "LimitFSIZE": "18446744073709551615", "LimitLOCKS": "18446744073709551615", "LimitMEMLOCK": "65536", "LimitMSGQUEUE": "819200", "LimitNICE": "0", "LimitNOFILE": "4096", "LimitNPROC": "127535", "LimitRSS": "18446744073709551615", "LimitRTPRIO": "0", "LimitRTTIME": "18446744073709551615", "LimitSIGPENDING": "127535", "LimitSTACK": "18446744073709551615", "LoadState": "loaded", "MainPID": "0", "MemoryAccounting": "no", "MemoryCurrent": "18446744073709551615", "MemoryLimit": "18446744073709551615", "MountFlags": "0", "Names": "ntpd.service", "NeedDaemonReload": "no", "Nice": "0", "NoNewPrivileges": "no", "NonBlocking": "no", "NotifyAccess": "none", "OOMScoreAdjust": "0", "OnFailureJobMode": "replace", "PermissionsStartOnly": "no", "PrivateDevices": "no", "PrivateNetwork": "no", "PrivateTmp": "yes", "ProtectHome": "no", "ProtectSystem": "no", "RefuseManualStart": "no", "RefuseManualStop": "no", "RemainAfterExit": "no", "Requires": "basic.target -.mount", "RequiresMountsFor": "/var/tmp", "Restart": "no", "RestartUSec": "100ms", "Result": "success", "RootDirectoryStartOnly": "no", "RuntimeDirectoryMode": "0755", "SameProcessGroup": "no", "SecureBits": "0", "SendSIGHUP": "no", "SendSIGKILL": "yes", "Slice": "system.slice", "StandardError": "inherit", "StandardInput": "null", "StandardOutput": "journal", "StartLimitAction": "none", "StartLimitBurst": "5", "StartLimitInterval": "10000000", "StartupBlockIOWeight": "18446744073709551615", "StartupCPUShares": "18446744073709551615", "StatusErrno": "0", "StopWhenUnneeded": "no", "SubState": "dead", "SyslogLevelPrefix": "yes", "SyslogPriority": "30", "SystemCallErrorNumber": "0", "TTYReset": "no", "TTYVHangup": "no", "TTYVTDisallocate": "no", "TasksAccounting": "no", "TasksCurrent": "18446744073709551615", "TasksMax": "18446744073709551615", "TimeoutStartUSec": "1min 30s", "TimeoutStopUSec": "1min 30s", "TimerSlackNSec 2019-12-08T11:59:17.401 INFO:teuthology.task.ansible.out:": "50000", "Transient": "no", "Type": "forking", "UMask": "0022", "UnitFilePreset": "disabled", "UnitFileState": "enabled", "WantedBy": "multi-user.target", "Wants": "system.slice", "WatchdogTimestampMonotonic": "0", "WatchdogUSec": "0"}} 2019-12-08T11:59:17.448 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:17 +0000 (0:00:00.430) 0:04:52.728 ******* 2019-12-08T11:59:17.668 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2019-12-08T11:59:17.669 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.007006", "end": "2019-12-08 11:59:17.629884", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2019-12-08 11:59:17.622878", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-08T11:59:17.973 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.005915", "end": "2019-12-08 11:59:17.934791", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2019-12-08 11:59:17.928876", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2019-12-08T11:59:18.283 INFO:teuthology.task.ansible.out:ok: [smithi079.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.008261", "end": "2019-12-08 11:59:18.244487", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2019-12-08 11:59:18.236226", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-08T11:59:18.322 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:18 +0000 (0:00:00.875) 0:04:53.604 ******* 2019-12-08T11:59:18.350 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2019-12-08T11:59:18.403 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:18 +0000 (0:00:00.081) 0:04:53.685 ******* 2019-12-08T11:59:18.422 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on rpm based systems.] ********************* 2019-12-08T11:59:18.423 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => {"changed": false, "msg": "", "rc": 0, "results": ["python2-pip-8.1.2-10.el7.noarch providing python-pip is already installed"]} 2019-12-08T11:59:18.495 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:18 +0000 (0:00:00.091) 0:04:53.776 ******* 2019-12-08T11:59:18.524 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on apt based systems.] ********************* 2019-12-08T11:59:18.525 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:59:18.576 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:18 +0000 (0:00:00.080) 0:04:53.857 ******* 2019-12-08T11:59:18.619 INFO:teuthology.task.ansible.out: TASK [testnode : Install python-pip on zypper based systems.] ****************** 2019-12-08T11:59:18.621 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:59:18.680 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:18 +0000 (0:00:00.104) 0:04:53.961 ******* 2019-12-08T11:59:18.751 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2019-12-08T11:59:18.752 INFO:teuthology.task.ansible.out:changed: [smithi079.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2019-12-08T11:59:19.041 INFO:teuthology.task.ansible.out: TASK [testnode : Create the .pip directory for the teuthology user.] *********** ok: [smithi013.front.sepia.ceph.com] => {"changed": false, "gid": 1215, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 4096, "state": "directory", "uid": 1000} 2019-12-08T11:59:19.095 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:19 +0000 (0:00:00.415) 0:04:54.377 ******* 2019-12-08T11:59:20.086 INFO:teuthology.task.ansible.out: TASK [testnode : Create pip.conf and configure it to use our mirror] *********** 2019-12-08T11:59:20.087 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => {"changed": false, "checksum": "959d37ab30545da205b389a6b7561b225a478a06", "dest": "/home/ubuntu/.pip/pip.conf", "gid": 1215, "group": "ubuntu", "mode": "0644", "owner": "ubuntu", "path": "/home/ubuntu/.pip/pip.conf", "secontext": "unconfined_u:object_r:user_home_t:s0", "size": 73, "state": "file", "uid": 1000} 2019-12-08T11:59:20.126 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:20 +0000 (0:00:01.030) 0:04:55.407 ******* 2019-12-08T11:59:21.720 INFO:teuthology.task.ansible.out: TASK [testnode : Install packages via pip] ************************************* 2019-12-08T11:59:21.722 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => {"changed": false, "cmd": ["/bin/pip2", "install", "remoto>=0.0.35"], "name": ["remoto>=0.0.35"], "requirements": null, "state": "present", "stderr": "You are using pip version 8.1.2, however version 19.3.1 is available.\nYou should consider upgrading via the 'pip install --upgrade pip' command.\n", "stderr_lines": ["You are using pip version 8.1.2, however version 19.3.1 is available.", "You should consider upgrading via the 'pip install --upgrade pip' command."], "stdout": "Requirement already satisfied (use --upgrade to upgrade): remoto>=0.0.35 in /usr/lib/python2.7/site-packages\nRequirement already satisfied (use --upgrade to upgrade): execnet in /usr/lib/python2.7/site-packages (from remoto>=0.0.35)\nRequirement already satisfied (use --upgrade to upgrade): apipkg>=1.4 in /usr/lib/python2.7/site-packages (from execnet->remoto>=0.0.35)\n", "stdout_lines": ["Requirement already satisfied (use --upgrade to upgrade): remoto>=0.0.35 in /usr/lib/python2.7/site-packages", "Requirement already satisfied (use --upgrade to upgrade): execnet in /usr/lib/python2.7/site-packages (from remoto>=0.0.35)", "Requirement already satisfied (use --upgrade to upgrade): apipkg>=1.4 in /usr/lib/python2.7/site-packages (from execnet->remoto>=0.0.35)"], "version": null, "virtualenv": null} 2019-12-08T11:59:21.787 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:21 +0000 (0:00:01.660) 0:04:57.068 ******* 2019-12-08T11:59:21.826 INFO:teuthology.task.ansible.out: TASK [testnode : Purge resolvconf] ********************************************* 2019-12-08T11:59:21.828 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:59:21.873 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:21 +0000 (0:00:00.086) 0:04:57.154 ******* 2019-12-08T11:59:21.911 INFO:teuthology.task.ansible.out: TASK [testnode : Set interface] ************************************************ 2019-12-08T11:59:21.914 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => {"ansible_facts": {"interface": "ens1f0"}, "changed": false} 2019-12-08T11:59:21.957 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:21 +0000 (0:00:00.084) 0:04:57.238 ******* 2019-12-08T11:59:22.277 INFO:teuthology.task.ansible.out: TASK [testnode : Check for presence of /etc/network/interfaces] **************** 2019-12-08T11:59:22.279 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => {"changed": false, "stat": {"exists": false}} 2019-12-08T11:59:22.337 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:22 +0000 (0:00:00.379) 0:04:57.618 ******* 2019-12-08T11:59:22.366 INFO:teuthology.task.ansible.out: TASK [testnode : Rewrite /etc/network/interfaces to use dhcp] ****************** 2019-12-08T11:59:22.368 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:59:22.407 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:22 +0000 (0:00:00.070) 0:04:57.689 ******* 2019-12-08T11:59:22.439 INFO:teuthology.task.ansible.out: TASK [testnode : Set bounce_interface if we just enabled dhcp] ***************** 2019-12-08T11:59:22.441 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => {"ansible_facts": {"bounce_interface": false}, "changed": false} 2019-12-08T11:59:22.505 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:22 +0000 (0:00:00.097) 0:04:57.786 ******* 2019-12-08T11:59:22.532 INFO:teuthology.task.ansible.out: TASK [testnode : ifdown and ifup] ********************************************** 2019-12-08T11:59:22.534 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:59:22.584 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:22 +0000 (0:00:00.078) 0:04:57.865 ******* 2019-12-08T11:59:22.936 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure lab_domain is in search domains in /etc/resolv.conf] *** 2019-12-08T11:59:22.938 INFO:teuthology.task.ansible.out:changed: [smithi013.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line replaced"} 2019-12-08T11:59:22.993 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:22 +0000 (0:00:00.409) 0:04:58.274 ******* 2019-12-08T11:59:23.298 INFO:teuthology.task.ansible.out: TASK [testnode : Ensure domain is set in /etc/resolv.conf] ********************* 2019-12-08T11:59:23.300 INFO:teuthology.task.ansible.out:changed: [smithi013.front.sepia.ceph.com] => {"backup": "", "changed": true, "msg": "line added"} 2019-12-08T11:59:23.338 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:23 +0000 (0:00:00.345) 0:04:58.619 ******* 2019-12-08T11:59:23.375 INFO:teuthology.task.ansible.out: TASK [testnode : Make sure ethtool is installed] ******************************* 2019-12-08T11:59:23.377 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:59:23.413 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:23 +0000 (0:00:00.074) 0:04:58.694 ******* 2019-12-08T11:59:23.450 INFO:teuthology.task.ansible.out: TASK [testnode : grep ethtool for secondary NIC MAC address] ******************* 2019-12-08T11:59:23.452 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item=ens1f1) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False"} 2019-12-08T11:59:23.462 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item=eno1) => {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False"} 2019-12-08T11:59:23.473 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item=eno2) => {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False"} skipping: [smithi013.front.sepia.ceph.com] => (item=lo) => {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False"} 2019-12-08T11:59:23.485 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item=ens1f0) => {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False"} 2019-12-08T11:59:23.529 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:23 +0000 (0:00:00.110) 0:04:58.805 ******* 2019-12-08T11:59:23.561 INFO:teuthology.task.ansible.out: TASK [testnode : Define net_to_configure var] ********************************** 2019-12-08T11:59:23.563 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'ens1f1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-12-08T11:59:23.573 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno1', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno1", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-12-08T11:59:23.588 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'eno2', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "eno2", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} skipping: [smithi013.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'lo', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "lo", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-12-08T11:59:23.598 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => (item={'skip_reason': u'Conditional result was False', 'item': u'ens1f0', 'skipped': True, 'ansible_loop_var': u'item', 'changed': False}) => {"ansible_loop_var": "item", "changed": false, "item": {"ansible_loop_var": "item", "changed": false, "item": "ens1f0", "skip_reason": "Conditional result was False", "skipped": true}, "skip_reason": "Conditional result was False"} 2019-12-08T11:59:23.635 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:23 +0000 (0:00:00.111) 0:04:58.917 ******* 2019-12-08T11:59:23.662 INFO:teuthology.task.ansible.out: TASK [testnode : set_fact] ***************************************************** 2019-12-08T11:59:23.664 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:59:23.702 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:23 +0000 (0:00:00.066) 0:04:58.984 ******* 2019-12-08T11:59:23.751 INFO:teuthology.task.ansible.out: TASK [testnode : Check if {{ nic_to_configure }} is 10Gb] ********************** skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:59:23.792 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:23 +0000 (0:00:00.089) 0:04:59.074 ******* 2019-12-08T11:59:23.830 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU to 9000 if 10Gb] ************************************** 2019-12-08T11:59:23.832 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:59:23.887 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:23 +0000 (0:00:00.089) 0:04:59.163 ******* 2019-12-08T11:59:23.911 INFO:teuthology.task.ansible.out: TASK [testnode : Write Ubuntu network config for {{ nic_to_configure }}] ******* skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:59:23.947 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:23 +0000 (0:00:00.064) 0:04:59.228 ******* 2019-12-08T11:59:23.977 INFO:teuthology.task.ansible.out: TASK [testnode : Set MTU on Ubuntu] ******************************************** 2019-12-08T11:59:23.979 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:59:24.020 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:24 +0000 (0:00:00.072) 0:04:59.301 ******* 2019-12-08T11:59:24.073 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** 2019-12-08T11:59:24.075 INFO:teuthology.task.ansible.out:skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:59:24.144 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:24 +0000 (0:00:00.124) 0:04:59.426 ******* 2019-12-08T11:59:24.184 INFO:teuthology.task.ansible.out: 2019-12-08T11:59:24.185 INFO:teuthology.task.ansible.out:TASK [testnode : Write RHEL/CentOS network config for {{ nic_to_configure }}] *** skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:59:24.234 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:24 +0000 (0:00:00.088) 0:04:59.515 ******* 2019-12-08T11:59:24.277 INFO:teuthology.task.ansible.out: TASK [testnode : Bounce {{ nic_to_configure }}] ******************************** skipping: [smithi013.front.sepia.ceph.com] => {"changed": false, "skip_reason": "Conditional result was False"} 2019-12-08T11:59:24.335 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:24 +0000 (0:00:00.101) 0:04:59.617 ******* 2019-12-08T11:59:24.700 INFO:teuthology.task.ansible.out: TASK [testnode : List any leftover Ceph artifacts from previous jobs] ********** 2019-12-08T11:59:24.702 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item=/var/run/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/run/ -name \"*ceph*\"", "delta": "0:00:00.012318", "end": "2019-12-08 11:59:24.641307", "failed_when_result": false, "item": "/var/run/", "rc": 0, "start": "2019-12-08 11:59:24.628989", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-08T11:59:25.044 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item=/etc/systemd/system/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/systemd/system/ -name \"*ceph*\"", "delta": "0:00:00.007035", "end": "2019-12-08 11:59:24.994497", "failed_when_result": false, "item": "/etc/systemd/system/", "rc": 0, "start": "2019-12-08 11:59:24.987462", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-08T11:59:25.391 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item=/etc/ceph) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /etc/ceph -name \"*ceph*\"", "delta": "0:00:00.007280", "end": "2019-12-08 11:59:25.344056", "failed_when_result": false, "item": "/etc/ceph", "msg": "non-zero return code", "rc": 1, "start": "2019-12-08 11:59:25.336776", "stderr": "find: ‘/etc/ceph’: No such file or directory", "stderr_lines": ["find: ‘/etc/ceph’: No such file or directory"], "stdout": "", "stdout_lines": []} 2019-12-08T11:59:25.719 INFO:teuthology.task.ansible.out:ok: [smithi013.front.sepia.ceph.com] => (item=/var/log/) => {"ansible_loop_var": "item", "changed": false, "cmd": "find /var/log/ -name \"*ceph*\"", "delta": "0:00:00.008333", "end": "2019-12-08 11:59:25.675121", "failed_when_result": false, "item": "/var/log/", "rc": 0, "start": "2019-12-08 11:59:25.666788", "stderr": "", "stderr_lines": [], "stdout": "", "stdout_lines": []} 2019-12-08T11:59:25.760 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:25 +0000 (0:00:01.424) 0:05:01.041 ******* 2019-12-08T11:59:25.802 INFO:teuthology.task.ansible.out: TASK [testnode : Delete any leftover Ceph artifacts from previous jobs] ******** 2019-12-08T11:59:25.846 INFO:teuthology.task.ansible.out:Sunday 08 December 2019 11:59:25 +0000 (0:00:00.085) 0:05:01.127 ******* 2019-12-08T11:59:26.182 INFO:teuthology.task.ansible.out: TASK [testnode : Touch /ceph-qa-ready] ***************************************** 2019-12-08T11:59:26.183 INFO:teuthology.task.ansible.out:changed: [smithi013.front.sepia.ceph.com] => {"changed": true, "dest": "/ceph-qa-ready", "gid": 0, "group": "root", "mode": "0644", "owner": "root", "secontext": "unconfined_u:object_r:etc_runtime_t:s0", "size": 0, "state": "file", "uid": 0} 2019-12-08T11:59:26.308 INFO:teuthology.task.ansible.out: PLAY [cobbler] ***************************************************************** skipping: no hosts matched 2019-12-08T11:59:26.310 INFO:teuthology.task.ansible.out: PLAY [paddles] ***************************************************************** skipping: no hosts matched 2019-12-08T11:59:26.312 INFO:teuthology.task.ansible.out: PLAY [pulpito] ***************************************************************** skipping: no hosts matched 2019-12-08T11:59:26.314 INFO:teuthology.task.ansible.out: PLAY RECAP ********************************************************************* smithi013.front.sepia.ceph.com : ok=121 changed=41 unreachable=0 failed=0 skipped=160 rescued=0 ignored=3 smithi079.front.sepia.ceph.com : ok=121 changed=41 unreachable=0 failed=0 skipped=160 rescued=0 ignored=3 Sunday 08 December 2019 11:59:26 +0000 (0:00:00.467) 0:05:01.594 ******* =============================================================================== users : Create all admin users with sudo access. ----------------------- 36.26s users : Update authorized_keys using the keys repo --------------------- 34.64s common : nrpe - Ensure SELinux policy is up to date -------------------- 24.43s users : Remove revoked users ------------------------------------------- 14.30s testnode : Install packages -------------------------------------------- 11.92s common : Update yum cache ----------------------------------------------- 9.34s common : nrpe - Remove SELinux policy package --------------------------- 3.84s Gathering Facts --------------------------------------------------------- 3.59s 2019-12-08T11:59:26.315 INFO:teuthology.task.ansible.out:testnode : Ensure ceph dependency packages are not present. ------------- 3.48s ansible-managed : Add authorized keys for the ansible user. ------------- 3.07s common : nrpe - Load SELinux policy package ----------------------------- 3.03s testnode : Ensure ceph packages are not present. ------------------------ 2.56s common : Configure local epel mirrorlists ------------------------------- 2.46s testnode : Configure version specific repos in /etc/yum.repos.d/ -------- 2.07s common : Upload megacli and cli64 for raid monitoring and smart.pl to /usr/sbin/. --- 1.96s testnode : Install packages via pip ------------------------------------- 1.66s ansible-managed : Create the cephlab_sudo sudoers.d file. --------------- 1.55s testnode : List any leftover Ceph artifacts from previous jobs ---------- 1.42s testnode : Zap all non-root disks --------------------------------------- 1.39s testnode : Blow away lingering OSD data and FSIDs ----------------------- 1.37s 2019-12-08T11:59:26.625 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi013.front.sepia.ceph.com'), Remote(name='ubuntu@smithi079.front.sepia.ceph.com')] 2019-12-08T11:59:26.628 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-08T11:59:26.629 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi013.front.sepia.ceph.com', 'timeout': 60} 2019-12-08T11:59:26.732 INFO:teuthology.orchestra.run.smithi013:> true 2019-12-08T11:59:27.128 INFO:teuthology.orchestra.remote:Trying to reconnect to host 2019-12-08T11:59:27.129 DEBUG:teuthology.orchestra.connection:{'username': 'ubuntu', 'hostname': 'smithi079.front.sepia.ceph.com', 'timeout': 60} 2019-12-08T11:59:27.228 INFO:teuthology.orchestra.run.smithi079:> true 2019-12-08T11:59:27.596 INFO:teuthology.run_tasks:Running task clock... 2019-12-08T11:59:27.609 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2019-12-08T11:59:27.609 INFO:teuthology.orchestra.run.smithi013:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2019-12-08T11:59:27.753 INFO:teuthology.orchestra.run.smithi013.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2019-12-08T11:59:37.843 INFO:teuthology.orchestra.run.smithi013.stdout:ntpd: time slew +0.003790s 2019-12-08T11:59:37.886 INFO:teuthology.orchestra.run.smithi013.stderr:Failed to start ntp.service: Unit not found. 2019-12-08T11:59:37.973 INFO:teuthology.orchestra.run.smithi013.stdout: remote refid st t when poll reach delay offset jitter 2019-12-08T11:59:37.973 INFO:teuthology.orchestra.run.smithi013.stdout:============================================================================== 2019-12-08T11:59:37.974 INFO:teuthology.orchestra.run.smithi013.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-12-08T11:59:37.974 INFO:teuthology.orchestra.run.smithi013.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-12-08T11:59:37.974 INFO:teuthology.orchestra.run.smithi013.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-12-08T11:59:37.974 INFO:teuthology.orchestra.run.smithi013.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-12-08T11:59:37.975 INFO:teuthology.orchestra.run.smithi079:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2019-12-08T11:59:38.111 INFO:teuthology.orchestra.run.smithi079.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2019-12-08T11:59:48.186 INFO:teuthology.orchestra.run.smithi079.stdout:ntpd: time slew +0.003370s 2019-12-08T11:59:48.222 INFO:teuthology.orchestra.run.smithi079.stderr:Failed to start ntp.service: Unit not found. 2019-12-08T11:59:48.307 INFO:teuthology.orchestra.run.smithi079.stdout: remote refid st t when poll reach delay offset jitter 2019-12-08T11:59:48.307 INFO:teuthology.orchestra.run.smithi079.stdout:============================================================================== 2019-12-08T11:59:48.307 INFO:teuthology.orchestra.run.smithi079.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-12-08T11:59:48.308 INFO:teuthology.orchestra.run.smithi079.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-12-08T11:59:48.308 INFO:teuthology.orchestra.run.smithi079.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-12-08T11:59:48.308 INFO:teuthology.orchestra.run.smithi079.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 0.000 0.000 2019-12-08T11:59:48.309 INFO:teuthology.run_tasks:Running task install... 2019-12-08T11:59:49.642 DEBUG:teuthology.task.install:project ceph 2019-12-08T11:59:49.642 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'notcmalloc', 'sha1': '1351c819e1a9518cde4c8b12d645782009028360'}} 2019-12-08T11:59:49.642 DEBUG:teuthology.task.install:config {'flavor': 'notcmalloc', 'sha1': '1351c819e1a9518cde4c8b12d645782009028360'} 2019-12-08T11:59:49.643 INFO:teuthology.task.install:Using flavor: notcmalloc 2019-12-08T11:59:49.648 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'ceph-daemon', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python-ceph', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-daemon', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-cloud', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-ssh', 'ceph-fuse', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python-ceph', 'rbd-fuse']} 2019-12-08T11:59:49.648 INFO:teuthology.task.install:extra packages: [] 2019-12-08T11:59:49.649 INFO:teuthology.orchestra.run.smithi013:> sudo lsb_release -is 2019-12-08T11:59:49.821 INFO:teuthology.orchestra.run.smithi013.stdout:CentOS 2019-12-08T11:59:49.823 DEBUG:teuthology.misc:System to be installed: CentOS 2019-12-08T11:59:49.824 INFO:teuthology.orchestra.run.smithi079:> sudo lsb_release -is 2019-12-08T11:59:49.824 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'sha1': '1351c819e1a9518cde4c8b12d645782009028360', 'exclude_packages': [], 'debuginfo': None, 'install_ceph_packages': True, 'wait_for_package': False, 'downgrade_packages': [], 'project': 'ceph', 'tag': None, 'extra_packages': [], 'branch': None, 'packages': {}, 'repos_only': False, 'extra_system_packages': [], 'flavor': 'notcmalloc', 'extras': None} 2019-12-08T11:59:49.824 INFO:teuthology.orchestra.run.smithi013:> sudo lsb_release -is 2019-12-08T11:59:49.968 INFO:teuthology.orchestra.run.smithi013.stdout:CentOS 2019-12-08T11:59:49.970 DEBUG:teuthology.misc:System to be installed: CentOS 2019-12-08T11:59:49.971 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=notcmalloc&distros=centos%2F7%2Fx86_64&sha1=1351c819e1a9518cde4c8b12d645782009028360 2019-12-08T11:59:49.985 INFO:teuthology.orchestra.run.smithi079.stdout:CentOS 2019-12-08T11:59:49.987 DEBUG:teuthology.misc:System to be installed: CentOS 2019-12-08T11:59:49.987 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'sha1': '1351c819e1a9518cde4c8b12d645782009028360', 'exclude_packages': [], 'debuginfo': None, 'install_ceph_packages': True, 'wait_for_package': False, 'downgrade_packages': [], 'project': 'ceph', 'tag': None, 'extra_packages': [], 'branch': None, 'packages': {}, 'repos_only': False, 'extra_system_packages': [], 'flavor': 'notcmalloc', 'extras': None} 2019-12-08T11:59:49.988 INFO:teuthology.orchestra.run.smithi079:> sudo lsb_release -is 2019-12-08T11:59:50.128 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-ofriedma-dynamic-disable/1351c819e1a9518cde4c8b12d645782009028360/centos/7/flavors/notcmalloc/ 2019-12-08T11:59:50.129 INFO:teuthology.task.install.rpm:Package version is 15.0.0-7900.g1351c81 2019-12-08T11:59:50.135 INFO:teuthology.orchestra.run.smithi079.stdout:CentOS 2019-12-08T11:59:50.137 DEBUG:teuthology.misc:System to be installed: CentOS 2019-12-08T11:59:50.139 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=notcmalloc&distros=centos%2F7%2Fx86_64&sha1=1351c819e1a9518cde4c8b12d645782009028360 2019-12-08T11:59:50.256 INFO:teuthology.orchestra.run.smithi013:> sudo sh -c 'cat > /etc/yum.repos.d/ceph.repo' 2019-12-08T11:59:50.296 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-ofriedma-dynamic-disable/1351c819e1a9518cde4c8b12d645782009028360/centos/7/flavors/notcmalloc/ 2019-12-08T11:59:50.296 INFO:teuthology.task.install.rpm:Package version is 15.0.0-7900.g1351c81 2019-12-08T11:59:50.380 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-daemon, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-cloud, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-ssh, ceph-fuse, libcephfs2, libcephfs-devel, librados2, librbd1, python-ceph, rbd-fuse on remote rpm x86_64 2019-12-08T11:59:50.380 INFO:teuthology.orchestra.run.smithi013:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1351c819e1a9518cde4c8b12d645782009028360/;g' /etc/yum.repos.d/ceph.repo ; fi 2019-12-08T11:59:50.412 INFO:teuthology.orchestra.run.smithi079:> sudo sh -c 'cat > /etc/yum.repos.d/ceph.repo' 2019-12-08T11:59:50.488 INFO:teuthology.orchestra.run.smithi013:> test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2019-12-08T11:59:50.531 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-daemon, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-cloud, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-ssh, ceph-fuse, libcephfs2, libcephfs-devel, librados2, librbd1, python-ceph, rbd-fuse on remote rpm x86_64 2019-12-08T11:59:50.531 INFO:teuthology.orchestra.run.smithi079:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/1351c819e1a9518cde4c8b12d645782009028360/;g' /etc/yum.repos.d/ceph.repo ; fi 2019-12-08T11:59:50.578 INFO:teuthology.orchestra.run.smithi013:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2019-12-08T11:59:50.626 INFO:teuthology.orchestra.run.smithi079:> test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2019-12-08T11:59:50.664 INFO:teuthology.orchestra.run.smithi013.stdout:check_obsoletes = 1 2019-12-08T11:59:50.667 INFO:teuthology.orchestra.run.smithi013:> sudo yum clean all 2019-12-08T11:59:50.712 INFO:teuthology.orchestra.run.smithi079:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2019-12-08T11:59:50.779 INFO:teuthology.orchestra.run.smithi079.stdout:check_obsoletes = 1 2019-12-08T11:59:50.785 INFO:teuthology.orchestra.run.smithi079:> sudo yum clean all 2019-12-08T11:59:50.884 INFO:teuthology.orchestra.run.smithi013.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-08T11:59:50.927 INFO:teuthology.orchestra.run.smithi013.stdout:Cleaning repos: base centos7-fcgi-ceph ceph ceph-noarch ceph-source epel extras 2019-12-08T11:59:50.928 INFO:teuthology.orchestra.run.smithi013.stdout: : lab-extras updates 2019-12-08T11:59:50.935 INFO:teuthology.orchestra.run.smithi079.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-08T11:59:50.973 INFO:teuthology.orchestra.run.smithi079.stdout:Cleaning repos: base centos7-fcgi-ceph ceph ceph-noarch ceph-source epel extras 2019-12-08T11:59:50.974 INFO:teuthology.orchestra.run.smithi079.stdout: : lab-extras updates 2019-12-08T11:59:50.974 INFO:teuthology.orchestra.run.smithi013.stdout:Cleaning up list of fastest mirrors 2019-12-08T11:59:50.975 INFO:teuthology.orchestra.run.smithi013.stdout:Other repos take up 1.5 M of disk space (use --verbose for details) 2019-12-08T11:59:50.989 INFO:teuthology.orchestra.run.smithi013:> sudo yum -y install ceph-radosgw 2019-12-08T11:59:51.020 INFO:teuthology.orchestra.run.smithi079.stdout:Cleaning up list of fastest mirrors 2019-12-08T11:59:51.020 INFO:teuthology.orchestra.run.smithi079.stdout:Other repos take up 1.5 M of disk space (use --verbose for details) 2019-12-08T11:59:51.033 INFO:teuthology.orchestra.run.smithi079:> sudo yum -y install ceph-radosgw 2019-12-08T11:59:51.172 INFO:teuthology.orchestra.run.smithi013.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-08T11:59:51.209 INFO:teuthology.orchestra.run.smithi013.stdout:Determining fastest mirrors 2019-12-08T11:59:51.217 INFO:teuthology.orchestra.run.smithi079.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-08T11:59:51.254 INFO:teuthology.orchestra.run.smithi079.stdout:Determining fastest mirrors 2019-12-08T11:59:51.818 INFO:teuthology.orchestra.run.smithi013.stdout: * base: mirrors.umflint.edu 2019-12-08T11:59:51.819 INFO:teuthology.orchestra.run.smithi013.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-08T11:59:51.819 INFO:teuthology.orchestra.run.smithi013.stdout: * extras: mirror.facebook.net 2019-12-08T11:59:51.820 INFO:teuthology.orchestra.run.smithi013.stdout: * updates: mirror.math.princeton.edu 2019-12-08T11:59:51.874 INFO:teuthology.orchestra.run.smithi079.stdout: * base: mirrors.umflint.edu 2019-12-08T11:59:51.875 INFO:teuthology.orchestra.run.smithi079.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-08T11:59:51.875 INFO:teuthology.orchestra.run.smithi079.stdout: * extras: mirror.facebook.net 2019-12-08T11:59:51.876 INFO:teuthology.orchestra.run.smithi079.stdout: * updates: mirror.math.princeton.edu 2019-12-08T11:59:59.226 INFO:teuthology.orchestra.run.smithi079.stdout:7 packages excluded due to repository priority protections 2019-12-08T11:59:59.565 INFO:teuthology.orchestra.run.smithi013.stdout:7 packages excluded due to repository priority protections 2019-12-08T11:59:59.578 INFO:teuthology.orchestra.run.smithi079.stdout:Resolving Dependencies 2019-12-08T11:59:59.578 INFO:teuthology.orchestra.run.smithi079.stdout:--> Running transaction check 2019-12-08T11:59:59.579 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package ceph-radosgw.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-08T11:59:59.591 INFO:teuthology.orchestra.run.smithi079.stdout:--> Processing Dependency: librgw2 = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-radosgw-15.0.0-7900.g1351c81.el7.x86_64 2019-12-08T11:59:59.698 INFO:teuthology.orchestra.run.smithi079.stdout:--> Processing Dependency: ceph-base = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-radosgw-15.0.0-7900.g1351c81.el7.x86_64 2019-12-08T11:59:59.699 INFO:teuthology.orchestra.run.smithi079.stdout:--> Processing Dependency: ceph-selinux = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-radosgw-15.0.0-7900.g1351c81.el7.x86_64 2019-12-08T11:59:59.700 INFO:teuthology.orchestra.run.smithi079.stdout:--> Processing Dependency: librados2 = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-radosgw-15.0.0-7900.g1351c81.el7.x86_64 2019-12-08T11:59:59.702 INFO:teuthology.orchestra.run.smithi079.stdout:--> Processing Dependency: librados.so.2(LIBRADOS_14.2.0)(64bit) for package: 2:ceph-radosgw-15.0.0-7900.g1351c81.el7.x86_64 2019-12-08T11:59:59.702 INFO:teuthology.orchestra.run.smithi079.stdout:--> Processing Dependency: librdkafka.so.1()(64bit) for package: 2:ceph-radosgw-15.0.0-7900.g1351c81.el7.x86_64 2019-12-08T11:59:59.709 INFO:teuthology.orchestra.run.smithi079.stdout:--> Processing Dependency: libceph-common.so.2()(64bit) for package: 2:ceph-radosgw-15.0.0-7900.g1351c81.el7.x86_64 2019-12-08T11:59:59.709 INFO:teuthology.orchestra.run.smithi079.stdout:--> Processing Dependency: librabbitmq.so.4()(64bit) for package: 2:ceph-radosgw-15.0.0-7900.g1351c81.el7.x86_64 2019-12-08T11:59:59.709 INFO:teuthology.orchestra.run.smithi079.stdout:--> Processing Dependency: liboath.so.0()(64bit) for package: 2:ceph-radosgw-15.0.0-7900.g1351c81.el7.x86_64 2019-12-08T11:59:59.710 INFO:teuthology.orchestra.run.smithi079.stdout:--> Running transaction check 2019-12-08T11:59:59.710 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package ceph-base.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-08T11:59:59.715 INFO:teuthology.orchestra.run.smithi079.stdout:--> Processing Dependency: librbd1 = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-base-15.0.0-7900.g1351c81.el7.x86_64 2019-12-08T11:59:59.717 INFO:teuthology.orchestra.run.smithi079.stdout:--> Processing Dependency: libcephfs2 = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-base-15.0.0-7900.g1351c81.el7.x86_64 2019-12-08T11:59:59.718 INFO:teuthology.orchestra.run.smithi079.stdout:--> Processing Dependency: ceph-common = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-base-15.0.0-7900.g1351c81.el7.x86_64 2019-12-08T11:59:59.719 INFO:teuthology.orchestra.run.smithi079.stdout:--> Processing Dependency: libleveldb.so.1()(64bit) for package: 2:ceph-base-15.0.0-7900.g1351c81.el7.x86_64 2019-12-08T11:59:59.720 INFO:teuthology.orchestra.run.smithi079.stdout:--> Processing Dependency: liblttng-ust.so.0()(64bit) for package: 2:ceph-base-15.0.0-7900.g1351c81.el7.x86_64 2019-12-08T11:59:59.721 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package ceph-selinux.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-08T11:59:59.724 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package liboath.x86_64 0:2.6.2-1.el7 will be installed 2019-12-08T11:59:59.724 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package librabbitmq.x86_64 0:0.8.0-2.el7 will be installed 2019-12-08T11:59:59.725 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package librados2.x86_64 1:10.2.5-4.el7 will be updated 2019-12-08T11:59:59.725 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package librados2.x86_64 2:15.0.0-7900.g1351c81.el7 will be an update 2019-12-08T11:59:59.727 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package librdkafka.x86_64 0:0.11.5-1.el7 will be installed 2019-12-08T11:59:59.728 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package librgw2.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-08T11:59:59.729 INFO:teuthology.orchestra.run.smithi079.stdout:--> Running transaction check 2019-12-08T11:59:59.729 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package ceph-common.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-08T11:59:59.733 INFO:teuthology.orchestra.run.smithi079.stdout:--> Processing Dependency: python-ceph-common = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-common-15.0.0-7900.g1351c81.el7.x86_64 2019-12-08T11:59:59.734 INFO:teuthology.orchestra.run.smithi079.stdout:--> Processing Dependency: python-rados = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-common-15.0.0-7900.g1351c81.el7.x86_64 2019-12-08T11:59:59.735 INFO:teuthology.orchestra.run.smithi079.stdout:--> Processing Dependency: python-rbd = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-common-15.0.0-7900.g1351c81.el7.x86_64 2019-12-08T11:59:59.736 INFO:teuthology.orchestra.run.smithi079.stdout:--> Processing Dependency: python-rgw = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-common-15.0.0-7900.g1351c81.el7.x86_64 2019-12-08T11:59:59.737 INFO:teuthology.orchestra.run.smithi079.stdout:--> Processing Dependency: libradosstriper1 = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-common-15.0.0-7900.g1351c81.el7.x86_64 2019-12-08T11:59:59.738 INFO:teuthology.orchestra.run.smithi079.stdout:--> Processing Dependency: python-ceph-argparse = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-common-15.0.0-7900.g1351c81.el7.x86_64 2019-12-08T11:59:59.739 INFO:teuthology.orchestra.run.smithi079.stdout:--> Processing Dependency: python-cephfs = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-common-15.0.0-7900.g1351c81.el7.x86_64 2019-12-08T11:59:59.740 INFO:teuthology.orchestra.run.smithi079.stdout:--> Processing Dependency: python-prettytable for package: 2:ceph-common-15.0.0-7900.g1351c81.el7.x86_64 2019-12-08T11:59:59.741 INFO:teuthology.orchestra.run.smithi079.stdout:--> Processing Dependency: libradosstriper.so.1()(64bit) for package: 2:ceph-common-15.0.0-7900.g1351c81.el7.x86_64 2019-12-08T11:59:59.742 INFO:teuthology.orchestra.run.smithi079.stdout:--> Processing Dependency: libbabeltrace.so.1()(64bit) for package: 2:ceph-common-15.0.0-7900.g1351c81.el7.x86_64 2019-12-08T11:59:59.742 INFO:teuthology.orchestra.run.smithi079.stdout:--> Processing Dependency: libbabeltrace-ctf.so.1()(64bit) for package: 2:ceph-common-15.0.0-7900.g1351c81.el7.x86_64 2019-12-08T11:59:59.743 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package leveldb.x86_64 0:1.12.0-11.el7 will be installed 2019-12-08T11:59:59.743 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package libcephfs2.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-08T11:59:59.743 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package librbd1.x86_64 1:10.2.5-4.el7 will be updated 2019-12-08T11:59:59.743 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package librbd1.x86_64 2:15.0.0-7900.g1351c81.el7 will be an update 2019-12-08T11:59:59.744 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package lttng-ust.x86_64 0:2.4.1-4.el7 will be installed 2019-12-08T11:59:59.745 INFO:teuthology.orchestra.run.smithi079.stdout:--> Processing Dependency: liburcu-bp.so.1()(64bit) for package: lttng-ust-2.4.1-4.el7.x86_64 2019-12-08T11:59:59.746 INFO:teuthology.orchestra.run.smithi079.stdout:--> Processing Dependency: liburcu-cds.so.1()(64bit) for package: lttng-ust-2.4.1-4.el7.x86_64 2019-12-08T11:59:59.746 INFO:teuthology.orchestra.run.smithi079.stdout:--> Running transaction check 2019-12-08T11:59:59.746 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package libbabeltrace.x86_64 0:1.2.4-3.el7 will be installed 2019-12-08T11:59:59.747 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package libradosstriper1.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-08T11:59:59.748 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package python-ceph-argparse.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-08T11:59:59.748 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package python-ceph-common.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-08T11:59:59.749 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package python-cephfs.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-08T11:59:59.750 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package python-prettytable.noarch 0:0.7.2-3.el7 will be installed 2019-12-08T11:59:59.750 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package python-rados.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-08T11:59:59.750 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package python-rbd.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-08T11:59:59.751 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package python-rgw.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-08T11:59:59.751 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package userspace-rcu.x86_64 0:0.7.16-1.el7 will be installed 2019-12-08T11:59:59.929 INFO:teuthology.orchestra.run.smithi013.stdout:Resolving Dependencies 2019-12-08T11:59:59.930 INFO:teuthology.orchestra.run.smithi013.stdout:--> Running transaction check 2019-12-08T11:59:59.930 INFO:teuthology.orchestra.run.smithi013.stdout:---> Package ceph-radosgw.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-08T11:59:59.944 INFO:teuthology.orchestra.run.smithi013.stdout:--> Processing Dependency: librgw2 = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-radosgw-15.0.0-7900.g1351c81.el7.x86_64 2019-12-08T12:00:00.054 INFO:teuthology.orchestra.run.smithi013.stdout:--> Processing Dependency: ceph-base = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-radosgw-15.0.0-7900.g1351c81.el7.x86_64 2019-12-08T12:00:00.056 INFO:teuthology.orchestra.run.smithi013.stdout:--> Processing Dependency: ceph-selinux = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-radosgw-15.0.0-7900.g1351c81.el7.x86_64 2019-12-08T12:00:00.057 INFO:teuthology.orchestra.run.smithi013.stdout:--> Processing Dependency: librados2 = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-radosgw-15.0.0-7900.g1351c81.el7.x86_64 2019-12-08T12:00:00.058 INFO:teuthology.orchestra.run.smithi013.stdout:--> Processing Dependency: librados.so.2(LIBRADOS_14.2.0)(64bit) for package: 2:ceph-radosgw-15.0.0-7900.g1351c81.el7.x86_64 2019-12-08T12:00:00.058 INFO:teuthology.orchestra.run.smithi013.stdout:--> Processing Dependency: librdkafka.so.1()(64bit) for package: 2:ceph-radosgw-15.0.0-7900.g1351c81.el7.x86_64 2019-12-08T12:00:00.061 INFO:teuthology.orchestra.run.smithi013.stdout:--> Processing Dependency: libceph-common.so.2()(64bit) for package: 2:ceph-radosgw-15.0.0-7900.g1351c81.el7.x86_64 2019-12-08T12:00:00.061 INFO:teuthology.orchestra.run.smithi013.stdout:--> Processing Dependency: librabbitmq.so.4()(64bit) for package: 2:ceph-radosgw-15.0.0-7900.g1351c81.el7.x86_64 2019-12-08T12:00:00.063 INFO:teuthology.orchestra.run.smithi013.stdout:--> Processing Dependency: liboath.so.0()(64bit) for package: 2:ceph-radosgw-15.0.0-7900.g1351c81.el7.x86_64 2019-12-08T12:00:00.064 INFO:teuthology.orchestra.run.smithi013.stdout:--> Running transaction check 2019-12-08T12:00:00.064 INFO:teuthology.orchestra.run.smithi013.stdout:---> Package ceph-base.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-08T12:00:00.073 INFO:teuthology.orchestra.run.smithi013.stdout:--> Processing Dependency: librbd1 = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-base-15.0.0-7900.g1351c81.el7.x86_64 2019-12-08T12:00:00.077 INFO:teuthology.orchestra.run.smithi013.stdout:--> Processing Dependency: libcephfs2 = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-base-15.0.0-7900.g1351c81.el7.x86_64 2019-12-08T12:00:00.077 INFO:teuthology.orchestra.run.smithi013.stdout:--> Processing Dependency: ceph-common = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-base-15.0.0-7900.g1351c81.el7.x86_64 2019-12-08T12:00:00.078 INFO:teuthology.orchestra.run.smithi013.stdout:--> Processing Dependency: libleveldb.so.1()(64bit) for package: 2:ceph-base-15.0.0-7900.g1351c81.el7.x86_64 2019-12-08T12:00:00.078 INFO:teuthology.orchestra.run.smithi013.stdout:--> Processing Dependency: liblttng-ust.so.0()(64bit) for package: 2:ceph-base-15.0.0-7900.g1351c81.el7.x86_64 2019-12-08T12:00:00.085 INFO:teuthology.orchestra.run.smithi013.stdout:---> Package ceph-selinux.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-08T12:00:00.085 INFO:teuthology.orchestra.run.smithi013.stdout:---> Package liboath.x86_64 0:2.6.2-1.el7 will be installed 2019-12-08T12:00:00.085 INFO:teuthology.orchestra.run.smithi013.stdout:---> Package librabbitmq.x86_64 0:0.8.0-2.el7 will be installed 2019-12-08T12:00:00.085 INFO:teuthology.orchestra.run.smithi013.stdout:---> Package librados2.x86_64 1:10.2.5-4.el7 will be updated 2019-12-08T12:00:00.086 INFO:teuthology.orchestra.run.smithi013.stdout:---> Package librados2.x86_64 2:15.0.0-7900.g1351c81.el7 will be an update 2019-12-08T12:00:00.086 INFO:teuthology.orchestra.run.smithi013.stdout:---> Package librdkafka.x86_64 0:0.11.5-1.el7 will be installed 2019-12-08T12:00:00.086 INFO:teuthology.orchestra.run.smithi013.stdout:---> Package librgw2.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-08T12:00:00.087 INFO:teuthology.orchestra.run.smithi013.stdout:--> Running transaction check 2019-12-08T12:00:00.087 INFO:teuthology.orchestra.run.smithi013.stdout:---> Package ceph-common.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-08T12:00:00.092 INFO:teuthology.orchestra.run.smithi013.stdout:--> Processing Dependency: python-ceph-common = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-common-15.0.0-7900.g1351c81.el7.x86_64 2019-12-08T12:00:00.093 INFO:teuthology.orchestra.run.smithi013.stdout:--> Processing Dependency: python-rados = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-common-15.0.0-7900.g1351c81.el7.x86_64 2019-12-08T12:00:00.094 INFO:teuthology.orchestra.run.smithi013.stdout:--> Processing Dependency: python-rbd = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-common-15.0.0-7900.g1351c81.el7.x86_64 2019-12-08T12:00:00.095 INFO:teuthology.orchestra.run.smithi013.stdout:--> Processing Dependency: python-rgw = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-common-15.0.0-7900.g1351c81.el7.x86_64 2019-12-08T12:00:00.096 INFO:teuthology.orchestra.run.smithi013.stdout:--> Processing Dependency: libradosstriper1 = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-common-15.0.0-7900.g1351c81.el7.x86_64 2019-12-08T12:00:00.097 INFO:teuthology.orchestra.run.smithi013.stdout:--> Processing Dependency: python-ceph-argparse = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-common-15.0.0-7900.g1351c81.el7.x86_64 2019-12-08T12:00:00.098 INFO:teuthology.orchestra.run.smithi013.stdout:--> Processing Dependency: python-cephfs = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-common-15.0.0-7900.g1351c81.el7.x86_64 2019-12-08T12:00:00.099 INFO:teuthology.orchestra.run.smithi013.stdout:--> Processing Dependency: python-prettytable for package: 2:ceph-common-15.0.0-7900.g1351c81.el7.x86_64 2019-12-08T12:00:00.100 INFO:teuthology.orchestra.run.smithi013.stdout:--> Processing Dependency: libradosstriper.so.1()(64bit) for package: 2:ceph-common-15.0.0-7900.g1351c81.el7.x86_64 2019-12-08T12:00:00.100 INFO:teuthology.orchestra.run.smithi013.stdout:--> Processing Dependency: libbabeltrace.so.1()(64bit) for package: 2:ceph-common-15.0.0-7900.g1351c81.el7.x86_64 2019-12-08T12:00:00.101 INFO:teuthology.orchestra.run.smithi013.stdout:--> Processing Dependency: libbabeltrace-ctf.so.1()(64bit) for package: 2:ceph-common-15.0.0-7900.g1351c81.el7.x86_64 2019-12-08T12:00:00.101 INFO:teuthology.orchestra.run.smithi013.stdout:---> Package leveldb.x86_64 0:1.12.0-11.el7 will be installed 2019-12-08T12:00:00.102 INFO:teuthology.orchestra.run.smithi013.stdout:---> Package libcephfs2.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-08T12:00:00.102 INFO:teuthology.orchestra.run.smithi013.stdout:---> Package librbd1.x86_64 1:10.2.5-4.el7 will be updated 2019-12-08T12:00:00.102 INFO:teuthology.orchestra.run.smithi013.stdout:---> Package librbd1.x86_64 2:15.0.0-7900.g1351c81.el7 will be an update 2019-12-08T12:00:00.103 INFO:teuthology.orchestra.run.smithi013.stdout:---> Package lttng-ust.x86_64 0:2.4.1-4.el7 will be installed 2019-12-08T12:00:00.104 INFO:teuthology.orchestra.run.smithi013.stdout:--> Processing Dependency: liburcu-bp.so.1()(64bit) for package: lttng-ust-2.4.1-4.el7.x86_64 2019-12-08T12:00:00.105 INFO:teuthology.orchestra.run.smithi013.stdout:--> Processing Dependency: liburcu-cds.so.1()(64bit) for package: lttng-ust-2.4.1-4.el7.x86_64 2019-12-08T12:00:00.105 INFO:teuthology.orchestra.run.smithi013.stdout:--> Running transaction check 2019-12-08T12:00:00.105 INFO:teuthology.orchestra.run.smithi013.stdout:---> Package libbabeltrace.x86_64 0:1.2.4-3.el7 will be installed 2019-12-08T12:00:00.106 INFO:teuthology.orchestra.run.smithi013.stdout:---> Package libradosstriper1.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-08T12:00:00.108 INFO:teuthology.orchestra.run.smithi013.stdout:---> Package python-ceph-argparse.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-08T12:00:00.108 INFO:teuthology.orchestra.run.smithi013.stdout:---> Package python-ceph-common.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-08T12:00:00.108 INFO:teuthology.orchestra.run.smithi013.stdout:---> Package python-cephfs.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-08T12:00:00.109 INFO:teuthology.orchestra.run.smithi013.stdout:---> Package python-prettytable.noarch 0:0.7.2-3.el7 will be installed 2019-12-08T12:00:00.109 INFO:teuthology.orchestra.run.smithi013.stdout:---> Package python-rados.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-08T12:00:00.110 INFO:teuthology.orchestra.run.smithi013.stdout:---> Package python-rbd.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-08T12:00:00.110 INFO:teuthology.orchestra.run.smithi013.stdout:---> Package python-rgw.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-08T12:00:00.110 INFO:teuthology.orchestra.run.smithi013.stdout:---> Package userspace-rcu.x86_64 0:0.7.16-1.el7 will be installed 2019-12-08T12:00:00.608 INFO:teuthology.orchestra.run.smithi079.stdout:--> Finished Dependency Resolution 2019-12-08T12:00:00.693 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:00:00.694 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies Resolved 2019-12-08T12:00:00.697 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:00:00.697 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2019-12-08T12:00:00.697 INFO:teuthology.orchestra.run.smithi079.stdout: Package Arch Version Repository 2019-12-08T12:00:00.697 INFO:teuthology.orchestra.run.smithi079.stdout: Size 2019-12-08T12:00:00.697 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2019-12-08T12:00:00.697 INFO:teuthology.orchestra.run.smithi079.stdout:Installing: 2019-12-08T12:00:00.697 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-radosgw x86_64 2:15.0.0-7900.g1351c81.el7 ceph 6.2 M 2019-12-08T12:00:00.698 INFO:teuthology.orchestra.run.smithi079.stdout:Installing for dependencies: 2019-12-08T12:00:00.698 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-base x86_64 2:15.0.0-7900.g1351c81.el7 ceph 5.6 M 2019-12-08T12:00:00.698 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-common x86_64 2:15.0.0-7900.g1351c81.el7 ceph 20 M 2019-12-08T12:00:00.698 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-selinux x86_64 2:15.0.0-7900.g1351c81.el7 ceph 20 k 2019-12-08T12:00:00.698 INFO:teuthology.orchestra.run.smithi079.stdout: leveldb x86_64 1.12.0-11.el7 epel 161 k 2019-12-08T12:00:00.698 INFO:teuthology.orchestra.run.smithi079.stdout: libbabeltrace x86_64 1.2.4-3.el7 epel 147 k 2019-12-08T12:00:00.698 INFO:teuthology.orchestra.run.smithi079.stdout: libcephfs2 x86_64 2:15.0.0-7900.g1351c81.el7 ceph 489 k 2019-12-08T12:00:00.699 INFO:teuthology.orchestra.run.smithi079.stdout: liboath x86_64 2.6.2-1.el7 epel 51 k 2019-12-08T12:00:00.699 INFO:teuthology.orchestra.run.smithi079.stdout: librabbitmq x86_64 0.8.0-2.el7 base 37 k 2019-12-08T12:00:00.699 INFO:teuthology.orchestra.run.smithi079.stdout: libradosstriper1 x86_64 2:15.0.0-7900.g1351c81.el7 ceph 374 k 2019-12-08T12:00:00.699 INFO:teuthology.orchestra.run.smithi079.stdout: librdkafka x86_64 0.11.5-1.el7 epel 368 k 2019-12-08T12:00:00.699 INFO:teuthology.orchestra.run.smithi079.stdout: librgw2 x86_64 2:15.0.0-7900.g1351c81.el7 ceph 5.4 M 2019-12-08T12:00:00.699 INFO:teuthology.orchestra.run.smithi079.stdout: lttng-ust x86_64 2.4.1-4.el7 epel 176 k 2019-12-08T12:00:00.699 INFO:teuthology.orchestra.run.smithi079.stdout: python-ceph-argparse x86_64 2:15.0.0-7900.g1351c81.el7 ceph 35 k 2019-12-08T12:00:00.700 INFO:teuthology.orchestra.run.smithi079.stdout: python-ceph-common x86_64 2:15.0.0-7900.g1351c81.el7 ceph 42 k 2019-12-08T12:00:00.700 INFO:teuthology.orchestra.run.smithi079.stdout: python-cephfs x86_64 2:15.0.0-7900.g1351c81.el7 ceph 102 k 2019-12-08T12:00:00.700 INFO:teuthology.orchestra.run.smithi079.stdout: python-prettytable noarch 0.7.2-3.el7 base 37 k 2019-12-08T12:00:00.700 INFO:teuthology.orchestra.run.smithi079.stdout: python-rados x86_64 2:15.0.0-7900.g1351c81.el7 ceph 209 k 2019-12-08T12:00:00.700 INFO:teuthology.orchestra.run.smithi079.stdout: python-rbd x86_64 2:15.0.0-7900.g1351c81.el7 ceph 199 k 2019-12-08T12:00:00.700 INFO:teuthology.orchestra.run.smithi079.stdout: python-rgw x86_64 2:15.0.0-7900.g1351c81.el7 ceph 77 k 2019-12-08T12:00:00.701 INFO:teuthology.orchestra.run.smithi079.stdout: userspace-rcu x86_64 0.7.16-1.el7 epel 73 k 2019-12-08T12:00:00.701 INFO:teuthology.orchestra.run.smithi079.stdout:Updating for dependencies: 2019-12-08T12:00:00.701 INFO:teuthology.orchestra.run.smithi079.stdout: librados2 x86_64 2:15.0.0-7900.g1351c81.el7 ceph 3.5 M 2019-12-08T12:00:00.701 INFO:teuthology.orchestra.run.smithi079.stdout: librbd1 x86_64 2:15.0.0-7900.g1351c81.el7 ceph 1.8 M 2019-12-08T12:00:00.701 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:00:00.701 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction Summary 2019-12-08T12:00:00.701 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2019-12-08T12:00:00.701 INFO:teuthology.orchestra.run.smithi079.stdout:Install 1 Package (+20 Dependent packages) 2019-12-08T12:00:00.702 INFO:teuthology.orchestra.run.smithi079.stdout:Upgrade ( 2 Dependent packages) 2019-12-08T12:00:00.702 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:00:00.702 INFO:teuthology.orchestra.run.smithi079.stdout:Total download size: 45 M 2019-12-08T12:00:00.702 INFO:teuthology.orchestra.run.smithi079.stdout:Downloading packages: 2019-12-08T12:00:00.702 INFO:teuthology.orchestra.run.smithi079.stdout:Delta RPMs disabled because /usr/bin/applydeltarpm not installed. 2019-12-08T12:00:01.018 INFO:teuthology.orchestra.run.smithi013.stdout:--> Finished Dependency Resolution 2019-12-08T12:00:01.107 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T12:00:01.108 INFO:teuthology.orchestra.run.smithi013.stdout:Dependencies Resolved 2019-12-08T12:00:01.114 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T12:00:01.114 INFO:teuthology.orchestra.run.smithi013.stdout:================================================================================ 2019-12-08T12:00:01.114 INFO:teuthology.orchestra.run.smithi013.stdout: Package Arch Version Repository 2019-12-08T12:00:01.115 INFO:teuthology.orchestra.run.smithi013.stdout: Size 2019-12-08T12:00:01.115 INFO:teuthology.orchestra.run.smithi013.stdout:================================================================================ 2019-12-08T12:00:01.115 INFO:teuthology.orchestra.run.smithi013.stdout:Installing: 2019-12-08T12:00:01.115 INFO:teuthology.orchestra.run.smithi013.stdout: ceph-radosgw x86_64 2:15.0.0-7900.g1351c81.el7 ceph 6.2 M 2019-12-08T12:00:01.115 INFO:teuthology.orchestra.run.smithi013.stdout:Installing for dependencies: 2019-12-08T12:00:01.116 INFO:teuthology.orchestra.run.smithi013.stdout: ceph-base x86_64 2:15.0.0-7900.g1351c81.el7 ceph 5.6 M 2019-12-08T12:00:01.116 INFO:teuthology.orchestra.run.smithi013.stdout: ceph-common x86_64 2:15.0.0-7900.g1351c81.el7 ceph 20 M 2019-12-08T12:00:01.116 INFO:teuthology.orchestra.run.smithi013.stdout: ceph-selinux x86_64 2:15.0.0-7900.g1351c81.el7 ceph 20 k 2019-12-08T12:00:01.116 INFO:teuthology.orchestra.run.smithi013.stdout: leveldb x86_64 1.12.0-11.el7 epel 161 k 2019-12-08T12:00:01.117 INFO:teuthology.orchestra.run.smithi013.stdout: libbabeltrace x86_64 1.2.4-3.el7 epel 147 k 2019-12-08T12:00:01.117 INFO:teuthology.orchestra.run.smithi013.stdout: libcephfs2 x86_64 2:15.0.0-7900.g1351c81.el7 ceph 489 k 2019-12-08T12:00:01.117 INFO:teuthology.orchestra.run.smithi013.stdout: liboath x86_64 2.6.2-1.el7 epel 51 k 2019-12-08T12:00:01.117 INFO:teuthology.orchestra.run.smithi013.stdout: librabbitmq x86_64 0.8.0-2.el7 base 37 k 2019-12-08T12:00:01.117 INFO:teuthology.orchestra.run.smithi013.stdout: libradosstriper1 x86_64 2:15.0.0-7900.g1351c81.el7 ceph 374 k 2019-12-08T12:00:01.118 INFO:teuthology.orchestra.run.smithi013.stdout: librdkafka x86_64 0.11.5-1.el7 epel 368 k 2019-12-08T12:00:01.118 INFO:teuthology.orchestra.run.smithi013.stdout: librgw2 x86_64 2:15.0.0-7900.g1351c81.el7 ceph 5.4 M 2019-12-08T12:00:01.118 INFO:teuthology.orchestra.run.smithi013.stdout: lttng-ust x86_64 2.4.1-4.el7 epel 176 k 2019-12-08T12:00:01.118 INFO:teuthology.orchestra.run.smithi013.stdout: python-ceph-argparse x86_64 2:15.0.0-7900.g1351c81.el7 ceph 35 k 2019-12-08T12:00:01.119 INFO:teuthology.orchestra.run.smithi013.stdout: python-ceph-common x86_64 2:15.0.0-7900.g1351c81.el7 ceph 42 k 2019-12-08T12:00:01.119 INFO:teuthology.orchestra.run.smithi013.stdout: python-cephfs x86_64 2:15.0.0-7900.g1351c81.el7 ceph 102 k 2019-12-08T12:00:01.119 INFO:teuthology.orchestra.run.smithi013.stdout: python-prettytable noarch 0.7.2-3.el7 base 37 k 2019-12-08T12:00:01.119 INFO:teuthology.orchestra.run.smithi013.stdout: python-rados x86_64 2:15.0.0-7900.g1351c81.el7 ceph 209 k 2019-12-08T12:00:01.120 INFO:teuthology.orchestra.run.smithi013.stdout: python-rbd x86_64 2:15.0.0-7900.g1351c81.el7 ceph 199 k 2019-12-08T12:00:01.120 INFO:teuthology.orchestra.run.smithi013.stdout: python-rgw x86_64 2:15.0.0-7900.g1351c81.el7 ceph 77 k 2019-12-08T12:00:01.120 INFO:teuthology.orchestra.run.smithi013.stdout: userspace-rcu x86_64 0.7.16-1.el7 epel 73 k 2019-12-08T12:00:01.120 INFO:teuthology.orchestra.run.smithi013.stdout:Updating for dependencies: 2019-12-08T12:00:01.120 INFO:teuthology.orchestra.run.smithi013.stdout: librados2 x86_64 2:15.0.0-7900.g1351c81.el7 ceph 3.5 M 2019-12-08T12:00:01.121 INFO:teuthology.orchestra.run.smithi013.stdout: librbd1 x86_64 2:15.0.0-7900.g1351c81.el7 ceph 1.8 M 2019-12-08T12:00:01.121 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T12:00:01.121 INFO:teuthology.orchestra.run.smithi013.stdout:Transaction Summary 2019-12-08T12:00:01.121 INFO:teuthology.orchestra.run.smithi013.stdout:================================================================================ 2019-12-08T12:00:01.122 INFO:teuthology.orchestra.run.smithi013.stdout:Install 1 Package (+20 Dependent packages) 2019-12-08T12:00:01.122 INFO:teuthology.orchestra.run.smithi013.stdout:Upgrade ( 2 Dependent packages) 2019-12-08T12:00:01.122 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T12:00:01.122 INFO:teuthology.orchestra.run.smithi013.stdout:Total download size: 45 M 2019-12-08T12:00:01.123 INFO:teuthology.orchestra.run.smithi013.stdout:Downloading packages: 2019-12-08T12:00:01.123 INFO:teuthology.orchestra.run.smithi013.stdout:Delta RPMs disabled because /usr/bin/applydeltarpm not installed. 2019-12-08T12:00:03.260 INFO:teuthology.orchestra.run.smithi079.stdout:-------------------------------------------------------------------------------- 2019-12-08T12:00:03.260 INFO:teuthology.orchestra.run.smithi079.stdout:Total 17 MB/s | 45 MB 00:02 2019-12-08T12:00:03.276 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction check 2019-12-08T12:00:03.346 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction test 2019-12-08T12:00:03.542 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction test succeeded 2019-12-08T12:00:03.544 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction 2019-12-08T12:00:04.218 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : liboath-2.6.2-1.el7.x86_64 1/25 2019-12-08T12:00:04.572 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : librabbitmq-0.8.0-2.el7.x86_64 2/25 2019-12-08T12:00:04.921 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : librdkafka-0.11.5-1.el7.x86_64 3/25 2019-12-08T12:00:05.241 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : leveldb-1.12.0-11.el7.x86_64 4/25 2019-12-08T12:00:05.519 INFO:teuthology.orchestra.run.smithi013.stdout:-------------------------------------------------------------------------------- 2019-12-08T12:00:05.519 INFO:teuthology.orchestra.run.smithi013.stdout:Total 10 MB/s | 45 MB 00:04 2019-12-08T12:00:05.532 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : 2:python-ceph-argparse-15.0.0-7900.g1351c81.el7.x86_64 5/25 2019-12-08T12:00:05.533 INFO:teuthology.orchestra.run.smithi013.stdout:Running transaction check 2019-12-08T12:00:05.597 INFO:teuthology.orchestra.run.smithi013.stdout:Running transaction test 2019-12-08T12:00:05.807 INFO:teuthology.orchestra.run.smithi013.stdout:Transaction test succeeded 2019-12-08T12:00:05.808 INFO:teuthology.orchestra.run.smithi013.stdout:Running transaction 2019-12-08T12:00:05.890 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : userspace-rcu-0.7.16-1.el7.x86_64 6/25 2019-12-08T12:00:06.501 INFO:teuthology.orchestra.run.smithi013.stdout: Installing : liboath-2.6.2-1.el7.x86_64 1/25 2019-12-08T12:00:06.665 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : lttng-ust-2.4.1-4.el7.x86_64 7/25 2019-12-08T12:00:06.863 INFO:teuthology.orchestra.run.smithi013.stdout: Installing : librabbitmq-0.8.0-2.el7.x86_64 2/25 2019-12-08T12:00:07.019 INFO:teuthology.orchestra.run.smithi079.stdout: Updating : 2:librados2-15.0.0-7900.g1351c81.el7.x86_64 8/25 2019-12-08T12:00:07.202 INFO:teuthology.orchestra.run.smithi013.stdout: Installing : librdkafka-0.11.5-1.el7.x86_64 3/25 2019-12-08T12:00:07.556 INFO:teuthology.orchestra.run.smithi013.stdout: Installing : leveldb-1.12.0-11.el7.x86_64 4/25 2019-12-08T12:00:07.874 INFO:teuthology.orchestra.run.smithi013.stdout: Installing : 2:python-ceph-argparse-15.0.0-7900.g1351c81.el7.x86_64 5/25 2019-12-08T12:00:07.915 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : 2:python-rados-15.0.0-7900.g1351c81.el7.x86_64 9/25 2019-12-08T12:00:08.238 INFO:teuthology.orchestra.run.smithi013.stdout: Installing : userspace-rcu-0.7.16-1.el7.x86_64 6/25 2019-12-08T12:00:08.297 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : 2:librgw2-15.0.0-7900.g1351c81.el7.x86_64 10/25 2019-12-08T12:00:08.875 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : 2:libcephfs2-15.0.0-7900.g1351c81.el7.x86_64 11/25 2019-12-08T12:00:09.031 INFO:teuthology.orchestra.run.smithi013.stdout: Installing : lttng-ust-2.4.1-4.el7.x86_64 7/25 2019-12-08T12:00:09.235 INFO:teuthology.orchestra.run.smithi079.stdout: Updating : 2:librbd1-15.0.0-7900.g1351c81.el7.x86_64 12/25 2019-12-08T12:00:09.444 INFO:teuthology.orchestra.run.smithi013.stdout: Updating : 2:librados2-15.0.0-7900.g1351c81.el7.x86_64 8/25 2019-12-08T12:00:09.494 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : 2:python-rbd-15.0.0-7900.g1351c81.el7.x86_64 13/25 2019-12-08T12:00:09.793 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : 2:python-cephfs-15.0.0-7900.g1351c81.el7.x86_64 14/25 2019-12-08T12:00:10.090 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : 2:python-rgw-15.0.0-7900.g1351c81.el7.x86_64 15/25 2019-12-08T12:00:10.366 INFO:teuthology.orchestra.run.smithi013.stdout: Installing : 2:python-rados-15.0.0-7900.g1351c81.el7.x86_64 9/25 2019-12-08T12:00:10.376 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : 2:libradosstriper1-15.0.0-7900.g1351c81.el7.x86_64 16/25 2019-12-08T12:00:10.649 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python-prettytable-0.7.2-3.el7.noarch 17/25 2019-12-08T12:00:10.735 INFO:teuthology.orchestra.run.smithi013.stdout: Installing : 2:librgw2-15.0.0-7900.g1351c81.el7.x86_64 10/25 2019-12-08T12:00:11.049 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libbabeltrace-1.2.4-3.el7.x86_64 18/25 2019-12-08T12:00:11.306 INFO:teuthology.orchestra.run.smithi013.stdout: Installing : 2:libcephfs2-15.0.0-7900.g1351c81.el7.x86_64 11/25 2019-12-08T12:00:11.658 INFO:teuthology.orchestra.run.smithi013.stdout: Updating : 2:librbd1-15.0.0-7900.g1351c81.el7.x86_64 12/25 2019-12-08T12:00:11.934 INFO:teuthology.orchestra.run.smithi013.stdout: Installing : 2:python-rbd-15.0.0-7900.g1351c81.el7.x86_64 13/25 2019-12-08T12:00:12.201 INFO:teuthology.orchestra.run.smithi013.stdout: Installing : 2:python-cephfs-15.0.0-7900.g1351c81.el7.x86_64 14/25 2019-12-08T12:00:12.534 INFO:teuthology.orchestra.run.smithi013.stdout: Installing : 2:python-rgw-15.0.0-7900.g1351c81.el7.x86_64 15/25 2019-12-08T12:00:12.850 INFO:teuthology.orchestra.run.smithi013.stdout: Installing : 2:libradosstriper1-15.0.0-7900.g1351c81.el7.x86_64 16/25 2019-12-08T12:00:13.147 INFO:teuthology.orchestra.run.smithi013.stdout: Installing : python-prettytable-0.7.2-3.el7.noarch 17/25 2019-12-08T12:00:13.636 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : 2:python-ceph-common-15.0.0-7900.g1351c81.el7.x86_64 19/25 2019-12-08T12:00:13.636 INFO:teuthology.orchestra.run.smithi013.stdout: Installing : libbabeltrace-1.2.4-3.el7.x86_64 18/25 2019-12-08T12:00:14.619 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : 2:ceph-common-15.0.0-7900.g1351c81.el7.x86_64 20/25 2019-12-08T12:00:15.206 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : 2:ceph-base-15.0.0-7900.g1351c81.el7.x86_64 21/25 2019-12-08T12:00:16.008 INFO:teuthology.orchestra.run.smithi013.stdout: Installing : 2:python-ceph-common-15.0.0-7900.g1351c81.el7.x86_64 19/25 2019-12-08T12:00:17.157 INFO:teuthology.orchestra.run.smithi013.stdout: Installing : 2:ceph-common-15.0.0-7900.g1351c81.el7.x86_64 20/25 2019-12-08T12:00:17.699 INFO:teuthology.orchestra.run.smithi013.stdout: Installing : 2:ceph-base-15.0.0-7900.g1351c81.el7.x86_64 21/25 2019-12-08T12:00:24.579 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : 2:ceph-selinux-15.0.0-7900.g1351c81.el7.x86_64 22/25 2019-12-08T12:00:25.005 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : 2:ceph-radosgw-15.0.0-7900.g1351c81.el7.x86_64 23/25 2019-12-08T12:00:25.271 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : 1:librbd1-10.2.5-4.el7.x86_64 24/25 2019-12-08T12:00:25.573 INFO:teuthology.orchestra.run.smithi079.stdout: Cleanup : 1:librados2-10.2.5-4.el7.x86_64 25/25 2019-12-08T12:00:25.694 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : 2:python-ceph-argparse-15.0.0-7900.g1351c81.el7.x86_64 1/25 2019-12-08T12:00:25.836 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : liboath-2.6.2-1.el7.x86_64 2/25 2019-12-08T12:00:25.978 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : 2:libradosstriper1-15.0.0-7900.g1351c81.el7.x86_64 3/25 2019-12-08T12:00:26.079 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : leveldb-1.12.0-11.el7.x86_64 4/25 2019-12-08T12:00:26.188 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : 2:librados2-15.0.0-7900.g1351c81.el7.x86_64 5/25 2019-12-08T12:00:26.305 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : 2:python-ceph-common-15.0.0-7900.g1351c81.el7.x86_64 6/25 2019-12-08T12:00:26.433 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : 2:librgw2-15.0.0-7900.g1351c81.el7.x86_64 7/25 2019-12-08T12:00:26.548 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libbabeltrace-1.2.4-3.el7.x86_64 8/25 2019-12-08T12:00:26.656 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : 2:ceph-common-15.0.0-7900.g1351c81.el7.x86_64 9/25 2019-12-08T12:00:26.765 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : 2:libcephfs2-15.0.0-7900.g1351c81.el7.x86_64 10/25 2019-12-08T12:00:26.866 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python-prettytable-0.7.2-3.el7.noarch 11/25 2019-12-08T12:00:26.991 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : 2:python-rgw-15.0.0-7900.g1351c81.el7.x86_64 12/25 2019-12-08T12:00:27.092 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librdkafka-0.11.5-1.el7.x86_64 13/25 2019-12-08T12:00:27.176 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : lttng-ust-2.4.1-4.el7.x86_64 14/25 2019-12-08T12:00:27.268 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : 2:ceph-selinux-15.0.0-7900.g1351c81.el7.x86_64 15/25 2019-12-08T12:00:27.369 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : 2:ceph-radosgw-15.0.0-7900.g1351c81.el7.x86_64 16/25 2019-12-08T12:00:27.510 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : 2:librbd1-15.0.0-7900.g1351c81.el7.x86_64 17/25 2019-12-08T12:00:27.628 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : 2:python-rbd-15.0.0-7900.g1351c81.el7.x86_64 18/25 2019-12-08T12:00:27.728 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : librabbitmq-0.8.0-2.el7.x86_64 19/25 2019-12-08T12:00:27.846 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : 2:ceph-base-15.0.0-7900.g1351c81.el7.x86_64 20/25 2019-12-08T12:00:27.946 INFO:teuthology.orchestra.run.smithi013.stdout: Installing : 2:ceph-selinux-15.0.0-7900.g1351c81.el7.x86_64 22/25 2019-12-08T12:00:28.330 INFO:teuthology.orchestra.run.smithi013.stdout: Installing : 2:ceph-radosgw-15.0.0-7900.g1351c81.el7.x86_64 23/25 2019-12-08T12:00:28.588 INFO:teuthology.orchestra.run.smithi013.stdout: Cleanup : 1:librbd1-10.2.5-4.el7.x86_64 24/25 2019-12-08T12:00:28.881 INFO:teuthology.orchestra.run.smithi013.stdout: Cleanup : 1:librados2-10.2.5-4.el7.x86_64 25/25 2019-12-08T12:00:28.946 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : userspace-rcu-0.7.16-1.el7.x86_64 21/25 2019-12-08T12:00:29.035 INFO:teuthology.orchestra.run.smithi013.stdout: Verifying : 2:python-ceph-argparse-15.0.0-7900.g1351c81.el7.x86_64 1/25 2019-12-08T12:00:29.047 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : 2:python-rados-15.0.0-7900.g1351c81.el7.x86_64 22/25 2019-12-08T12:00:29.144 INFO:teuthology.orchestra.run.smithi013.stdout: Verifying : liboath-2.6.2-1.el7.x86_64 2/25 2019-12-08T12:00:29.189 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : 2:python-cephfs-15.0.0-7900.g1351c81.el7.x86_64 23/25 2019-12-08T12:00:29.191 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : 1:librbd1-10.2.5-4.el7.x86_64 24/25 2019-12-08T12:00:29.319 INFO:teuthology.orchestra.run.smithi013.stdout: Verifying : 2:libradosstriper1-15.0.0-7900.g1351c81.el7.x86_64 3/25 2019-12-08T12:00:29.428 INFO:teuthology.orchestra.run.smithi013.stdout: Verifying : leveldb-1.12.0-11.el7.x86_64 4/25 2019-12-08T12:00:29.554 INFO:teuthology.orchestra.run.smithi013.stdout: Verifying : 2:librados2-15.0.0-7900.g1351c81.el7.x86_64 5/25 2019-12-08T12:00:29.563 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : 1:librados2-10.2.5-4.el7.x86_64 25/25 2019-12-08T12:00:29.563 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:00:29.563 INFO:teuthology.orchestra.run.smithi079.stdout:Installed: 2019-12-08T12:00:29.563 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-radosgw.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-08T12:00:29.563 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:00:29.563 INFO:teuthology.orchestra.run.smithi079.stdout:Dependency Installed: 2019-12-08T12:00:29.564 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-base.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-08T12:00:29.564 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-common.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-08T12:00:29.564 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-selinux.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-08T12:00:29.564 INFO:teuthology.orchestra.run.smithi079.stdout: leveldb.x86_64 0:1.12.0-11.el7 2019-12-08T12:00:29.564 INFO:teuthology.orchestra.run.smithi079.stdout: libbabeltrace.x86_64 0:1.2.4-3.el7 2019-12-08T12:00:29.564 INFO:teuthology.orchestra.run.smithi079.stdout: libcephfs2.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-08T12:00:29.565 INFO:teuthology.orchestra.run.smithi079.stdout: liboath.x86_64 0:2.6.2-1.el7 2019-12-08T12:00:29.565 INFO:teuthology.orchestra.run.smithi079.stdout: librabbitmq.x86_64 0:0.8.0-2.el7 2019-12-08T12:00:29.565 INFO:teuthology.orchestra.run.smithi079.stdout: libradosstriper1.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-08T12:00:29.565 INFO:teuthology.orchestra.run.smithi079.stdout: librdkafka.x86_64 0:0.11.5-1.el7 2019-12-08T12:00:29.565 INFO:teuthology.orchestra.run.smithi079.stdout: librgw2.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-08T12:00:29.565 INFO:teuthology.orchestra.run.smithi079.stdout: lttng-ust.x86_64 0:2.4.1-4.el7 2019-12-08T12:00:29.565 INFO:teuthology.orchestra.run.smithi079.stdout: python-ceph-argparse.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-08T12:00:29.566 INFO:teuthology.orchestra.run.smithi079.stdout: python-ceph-common.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-08T12:00:29.566 INFO:teuthology.orchestra.run.smithi079.stdout: python-cephfs.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-08T12:00:29.566 INFO:teuthology.orchestra.run.smithi079.stdout: python-prettytable.noarch 0:0.7.2-3.el7 2019-12-08T12:00:29.566 INFO:teuthology.orchestra.run.smithi079.stdout: python-rados.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-08T12:00:29.566 INFO:teuthology.orchestra.run.smithi079.stdout: python-rbd.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-08T12:00:29.566 INFO:teuthology.orchestra.run.smithi079.stdout: python-rgw.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-08T12:00:29.566 INFO:teuthology.orchestra.run.smithi079.stdout: userspace-rcu.x86_64 0:0.7.16-1.el7 2019-12-08T12:00:29.567 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:00:29.567 INFO:teuthology.orchestra.run.smithi079.stdout:Dependency Updated: 2019-12-08T12:00:29.567 INFO:teuthology.orchestra.run.smithi079.stdout: librados2.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-08T12:00:29.567 INFO:teuthology.orchestra.run.smithi079.stdout: librbd1.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-08T12:00:29.567 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:00:29.567 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2019-12-08T12:00:29.692 INFO:teuthology.orchestra.run.smithi079:> sudo yum -y install ceph-test 2019-12-08T12:00:29.712 INFO:teuthology.orchestra.run.smithi013.stdout: Verifying : 2:python-ceph-common-15.0.0-7900.g1351c81.el7.x86_64 6/25 2019-12-08T12:00:29.829 INFO:teuthology.orchestra.run.smithi013.stdout: Verifying : 2:librgw2-15.0.0-7900.g1351c81.el7.x86_64 7/25 2019-12-08T12:00:29.955 INFO:teuthology.orchestra.run.smithi079.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-08T12:00:29.988 INFO:teuthology.orchestra.run.smithi013.stdout: Verifying : libbabeltrace-1.2.4-3.el7.x86_64 8/25 2019-12-08T12:00:29.997 INFO:teuthology.orchestra.run.smithi079.stdout:Loading mirror speeds from cached hostfile 2019-12-08T12:00:29.998 INFO:teuthology.orchestra.run.smithi079.stdout: * base: mirrors.umflint.edu 2019-12-08T12:00:29.999 INFO:teuthology.orchestra.run.smithi079.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-08T12:00:29.999 INFO:teuthology.orchestra.run.smithi079.stdout: * extras: mirror.facebook.net 2019-12-08T12:00:29.999 INFO:teuthology.orchestra.run.smithi079.stdout: * updates: mirror.math.princeton.edu 2019-12-08T12:00:30.089 INFO:teuthology.orchestra.run.smithi013.stdout: Verifying : 2:ceph-common-15.0.0-7900.g1351c81.el7.x86_64 9/25 2019-12-08T12:00:30.181 INFO:teuthology.orchestra.run.smithi013.stdout: Verifying : 2:libcephfs2-15.0.0-7900.g1351c81.el7.x86_64 10/25 2019-12-08T12:00:30.316 INFO:teuthology.orchestra.run.smithi013.stdout: Verifying : python-prettytable-0.7.2-3.el7.noarch 11/25 2019-12-08T12:00:30.432 INFO:teuthology.orchestra.run.smithi013.stdout: Verifying : 2:python-rgw-15.0.0-7900.g1351c81.el7.x86_64 12/25 2019-12-08T12:00:30.640 INFO:teuthology.orchestra.run.smithi079.stdout:7 packages excluded due to repository priority protections 2019-12-08T12:00:30.974 INFO:teuthology.orchestra.run.smithi079.stdout:Resolving Dependencies 2019-12-08T12:00:30.975 INFO:teuthology.orchestra.run.smithi079.stdout:--> Running transaction check 2019-12-08T12:00:30.975 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package ceph-test.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-08T12:00:30.992 INFO:teuthology.orchestra.run.smithi079.stdout:--> Processing Dependency: xmlstarlet for package: 2:ceph-test-15.0.0-7900.g1351c81.el7.x86_64 2019-12-08T12:00:31.008 INFO:teuthology.orchestra.run.smithi013.stdout: Verifying : librdkafka-0.11.5-1.el7.x86_64 13/25 2019-12-08T12:00:31.022 INFO:teuthology.orchestra.run.smithi079.stdout:--> Processing Dependency: jq for package: 2:ceph-test-15.0.0-7900.g1351c81.el7.x86_64 2019-12-08T12:00:31.022 INFO:teuthology.orchestra.run.smithi079.stdout:--> Processing Dependency: socat for package: 2:ceph-test-15.0.0-7900.g1351c81.el7.x86_64 2019-12-08T12:00:31.024 INFO:teuthology.orchestra.run.smithi079.stdout:--> Running transaction check 2019-12-08T12:00:31.024 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package jq.x86_64 0:1.5-1.el7 will be installed 2019-12-08T12:00:31.025 INFO:teuthology.orchestra.run.smithi079.stdout:--> Processing Dependency: libonig.so.2()(64bit) for package: jq-1.5-1.el7.x86_64 2019-12-08T12:00:31.025 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package socat.x86_64 0:1.7.3.2-2.el7 will be installed 2019-12-08T12:00:31.027 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package xmlstarlet.x86_64 0:1.6.1-1.el7 will be installed 2019-12-08T12:00:31.030 INFO:teuthology.orchestra.run.smithi079.stdout:--> Running transaction check 2019-12-08T12:00:31.030 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package oniguruma.x86_64 0:5.9.5-3.el7 will be installed 2019-12-08T12:00:31.100 INFO:teuthology.orchestra.run.smithi013.stdout: Verifying : lttng-ust-2.4.1-4.el7.x86_64 14/25 2019-12-08T12:00:31.234 INFO:teuthology.orchestra.run.smithi013.stdout: Verifying : 2:ceph-selinux-15.0.0-7900.g1351c81.el7.x86_64 15/25 2019-12-08T12:00:31.343 INFO:teuthology.orchestra.run.smithi013.stdout: Verifying : 2:ceph-radosgw-15.0.0-7900.g1351c81.el7.x86_64 16/25 2019-12-08T12:00:31.387 INFO:teuthology.orchestra.run.smithi079.stdout:--> Finished Dependency Resolution 2019-12-08T12:00:31.502 INFO:teuthology.orchestra.run.smithi013.stdout: Verifying : 2:librbd1-15.0.0-7900.g1351c81.el7.x86_64 17/25 2019-12-08T12:00:31.606 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:00:31.606 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies Resolved 2019-12-08T12:00:31.607 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:00:31.607 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2019-12-08T12:00:31.607 INFO:teuthology.orchestra.run.smithi079.stdout: Package Arch Version Repository 2019-12-08T12:00:31.607 INFO:teuthology.orchestra.run.smithi079.stdout: Size 2019-12-08T12:00:31.607 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2019-12-08T12:00:31.607 INFO:teuthology.orchestra.run.smithi079.stdout:Installing: 2019-12-08T12:00:31.607 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-test x86_64 2:15.0.0-7900.g1351c81.el7 ceph 38 M 2019-12-08T12:00:31.608 INFO:teuthology.orchestra.run.smithi079.stdout:Installing for dependencies: 2019-12-08T12:00:31.608 INFO:teuthology.orchestra.run.smithi079.stdout: jq x86_64 1.5-1.el7 epel 153 k 2019-12-08T12:00:31.608 INFO:teuthology.orchestra.run.smithi079.stdout: oniguruma x86_64 5.9.5-3.el7 epel 129 k 2019-12-08T12:00:31.608 INFO:teuthology.orchestra.run.smithi079.stdout: socat x86_64 1.7.3.2-2.el7 base 290 k 2019-12-08T12:00:31.609 INFO:teuthology.orchestra.run.smithi079.stdout: xmlstarlet x86_64 1.6.1-1.el7 epel 62 k 2019-12-08T12:00:31.609 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:00:31.609 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction Summary 2019-12-08T12:00:31.609 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2019-12-08T12:00:31.609 INFO:teuthology.orchestra.run.smithi079.stdout:Install 1 Package (+4 Dependent packages) 2019-12-08T12:00:31.609 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:00:31.611 INFO:teuthology.orchestra.run.smithi079.stdout:Total download size: 38 M 2019-12-08T12:00:31.611 INFO:teuthology.orchestra.run.smithi079.stdout:Installed size: 134 M 2019-12-08T12:00:31.612 INFO:teuthology.orchestra.run.smithi079.stdout:Downloading packages: 2019-12-08T12:00:31.627 INFO:teuthology.orchestra.run.smithi013.stdout: Verifying : 2:python-rbd-15.0.0-7900.g1351c81.el7.x86_64 18/25 2019-12-08T12:00:31.745 INFO:teuthology.orchestra.run.smithi013.stdout: Verifying : librabbitmq-0.8.0-2.el7.x86_64 19/25 2019-12-08T12:00:31.912 INFO:teuthology.orchestra.run.smithi013.stdout: Verifying : 2:ceph-base-15.0.0-7900.g1351c81.el7.x86_64 20/25 2019-12-08T12:00:32.037 INFO:teuthology.orchestra.run.smithi013.stdout: Verifying : userspace-rcu-0.7.16-1.el7.x86_64 21/25 2019-12-08T12:00:32.180 INFO:teuthology.orchestra.run.smithi013.stdout: Verifying : 2:python-rados-15.0.0-7900.g1351c81.el7.x86_64 22/25 2019-12-08T12:00:32.297 INFO:teuthology.orchestra.run.smithi013.stdout: Verifying : 2:python-cephfs-15.0.0-7900.g1351c81.el7.x86_64 23/25 2019-12-08T12:00:32.299 INFO:teuthology.orchestra.run.smithi013.stdout: Verifying : 1:librbd1-10.2.5-4.el7.x86_64 24/25 2019-12-08T12:00:32.670 INFO:teuthology.orchestra.run.smithi013.stdout: Verifying : 1:librados2-10.2.5-4.el7.x86_64 25/25 2019-12-08T12:00:32.670 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T12:00:32.671 INFO:teuthology.orchestra.run.smithi013.stdout:Installed: 2019-12-08T12:00:32.671 INFO:teuthology.orchestra.run.smithi013.stdout: ceph-radosgw.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-08T12:00:32.671 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T12:00:32.671 INFO:teuthology.orchestra.run.smithi013.stdout:Dependency Installed: 2019-12-08T12:00:32.671 INFO:teuthology.orchestra.run.smithi013.stdout: ceph-base.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-08T12:00:32.671 INFO:teuthology.orchestra.run.smithi013.stdout: ceph-common.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-08T12:00:32.671 INFO:teuthology.orchestra.run.smithi013.stdout: ceph-selinux.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-08T12:00:32.672 INFO:teuthology.orchestra.run.smithi013.stdout: leveldb.x86_64 0:1.12.0-11.el7 2019-12-08T12:00:32.672 INFO:teuthology.orchestra.run.smithi013.stdout: libbabeltrace.x86_64 0:1.2.4-3.el7 2019-12-08T12:00:32.672 INFO:teuthology.orchestra.run.smithi013.stdout: libcephfs2.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-08T12:00:32.672 INFO:teuthology.orchestra.run.smithi013.stdout: liboath.x86_64 0:2.6.2-1.el7 2019-12-08T12:00:32.672 INFO:teuthology.orchestra.run.smithi013.stdout: librabbitmq.x86_64 0:0.8.0-2.el7 2019-12-08T12:00:32.672 INFO:teuthology.orchestra.run.smithi013.stdout: libradosstriper1.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-08T12:00:32.672 INFO:teuthology.orchestra.run.smithi013.stdout: librdkafka.x86_64 0:0.11.5-1.el7 2019-12-08T12:00:32.673 INFO:teuthology.orchestra.run.smithi013.stdout: librgw2.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-08T12:00:32.673 INFO:teuthology.orchestra.run.smithi013.stdout: lttng-ust.x86_64 0:2.4.1-4.el7 2019-12-08T12:00:32.673 INFO:teuthology.orchestra.run.smithi013.stdout: python-ceph-argparse.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-08T12:00:32.673 INFO:teuthology.orchestra.run.smithi013.stdout: python-ceph-common.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-08T12:00:32.673 INFO:teuthology.orchestra.run.smithi013.stdout: python-cephfs.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-08T12:00:32.673 INFO:teuthology.orchestra.run.smithi013.stdout: python-prettytable.noarch 0:0.7.2-3.el7 2019-12-08T12:00:32.673 INFO:teuthology.orchestra.run.smithi013.stdout: python-rados.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-08T12:00:32.674 INFO:teuthology.orchestra.run.smithi013.stdout: python-rbd.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-08T12:00:32.674 INFO:teuthology.orchestra.run.smithi013.stdout: python-rgw.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-08T12:00:32.674 INFO:teuthology.orchestra.run.smithi013.stdout: userspace-rcu.x86_64 0:0.7.16-1.el7 2019-12-08T12:00:32.674 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T12:00:32.674 INFO:teuthology.orchestra.run.smithi013.stdout:Dependency Updated: 2019-12-08T12:00:32.674 INFO:teuthology.orchestra.run.smithi013.stdout: librados2.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-08T12:00:32.674 INFO:teuthology.orchestra.run.smithi013.stdout: librbd1.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-08T12:00:32.675 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T12:00:32.675 INFO:teuthology.orchestra.run.smithi013.stdout:Complete! 2019-12-08T12:00:32.802 INFO:teuthology.orchestra.run.smithi013:> sudo yum -y install ceph-test 2019-12-08T12:00:33.122 INFO:teuthology.orchestra.run.smithi013.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-08T12:00:33.170 INFO:teuthology.orchestra.run.smithi013.stdout:Loading mirror speeds from cached hostfile 2019-12-08T12:00:33.171 INFO:teuthology.orchestra.run.smithi013.stdout: * base: mirrors.umflint.edu 2019-12-08T12:00:33.171 INFO:teuthology.orchestra.run.smithi013.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-08T12:00:33.171 INFO:teuthology.orchestra.run.smithi013.stdout: * extras: mirror.facebook.net 2019-12-08T12:00:33.172 INFO:teuthology.orchestra.run.smithi013.stdout: * updates: mirror.math.princeton.edu 2019-12-08T12:00:33.406 INFO:teuthology.orchestra.run.smithi079.stdout:-------------------------------------------------------------------------------- 2019-12-08T12:00:33.406 INFO:teuthology.orchestra.run.smithi079.stdout:Total 21 MB/s | 38 MB 00:01 2019-12-08T12:00:33.409 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction check 2019-12-08T12:00:33.430 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction test 2019-12-08T12:00:33.515 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction test succeeded 2019-12-08T12:00:33.515 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction 2019-12-08T12:00:33.838 INFO:teuthology.orchestra.run.smithi013.stdout:7 packages excluded due to repository priority protections 2019-12-08T12:00:34.190 INFO:teuthology.orchestra.run.smithi013.stdout:Resolving Dependencies 2019-12-08T12:00:34.190 INFO:teuthology.orchestra.run.smithi013.stdout:--> Running transaction check 2019-12-08T12:00:34.190 INFO:teuthology.orchestra.run.smithi013.stdout:---> Package ceph-test.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-08T12:00:34.209 INFO:teuthology.orchestra.run.smithi013.stdout:--> Processing Dependency: xmlstarlet for package: 2:ceph-test-15.0.0-7900.g1351c81.el7.x86_64 2019-12-08T12:00:34.240 INFO:teuthology.orchestra.run.smithi013.stdout:--> Processing Dependency: jq for package: 2:ceph-test-15.0.0-7900.g1351c81.el7.x86_64 2019-12-08T12:00:34.241 INFO:teuthology.orchestra.run.smithi013.stdout:--> Processing Dependency: socat for package: 2:ceph-test-15.0.0-7900.g1351c81.el7.x86_64 2019-12-08T12:00:34.242 INFO:teuthology.orchestra.run.smithi013.stdout:--> Running transaction check 2019-12-08T12:00:34.242 INFO:teuthology.orchestra.run.smithi013.stdout:---> Package jq.x86_64 0:1.5-1.el7 will be installed 2019-12-08T12:00:34.243 INFO:teuthology.orchestra.run.smithi013.stdout:--> Processing Dependency: libonig.so.2()(64bit) for package: jq-1.5-1.el7.x86_64 2019-12-08T12:00:34.252 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : xmlstarlet-1.6.1-1.el7.x86_64 1/5 2019-12-08T12:00:34.252 INFO:teuthology.orchestra.run.smithi013.stdout:---> Package socat.x86_64 0:1.7.3.2-2.el7 will be installed 2019-12-08T12:00:34.252 INFO:teuthology.orchestra.run.smithi013.stdout:---> Package xmlstarlet.x86_64 0:1.6.1-1.el7 will be installed 2019-12-08T12:00:34.253 INFO:teuthology.orchestra.run.smithi013.stdout:--> Running transaction check 2019-12-08T12:00:34.253 INFO:teuthology.orchestra.run.smithi013.stdout:---> Package oniguruma.x86_64 0:5.9.5-3.el7 will be installed 2019-12-08T12:00:34.576 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : socat-1.7.3.2-2.el7.x86_64 2/5 2019-12-08T12:00:34.632 INFO:teuthology.orchestra.run.smithi013.stdout:--> Finished Dependency Resolution 2019-12-08T12:00:34.860 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T12:00:34.860 INFO:teuthology.orchestra.run.smithi013.stdout:Dependencies Resolved 2019-12-08T12:00:34.861 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T12:00:34.861 INFO:teuthology.orchestra.run.smithi013.stdout:================================================================================ 2019-12-08T12:00:34.861 INFO:teuthology.orchestra.run.smithi013.stdout: Package Arch Version Repository 2019-12-08T12:00:34.862 INFO:teuthology.orchestra.run.smithi013.stdout: Size 2019-12-08T12:00:34.862 INFO:teuthology.orchestra.run.smithi013.stdout:================================================================================ 2019-12-08T12:00:34.862 INFO:teuthology.orchestra.run.smithi013.stdout:Installing: 2019-12-08T12:00:34.862 INFO:teuthology.orchestra.run.smithi013.stdout: ceph-test x86_64 2:15.0.0-7900.g1351c81.el7 ceph 38 M 2019-12-08T12:00:34.862 INFO:teuthology.orchestra.run.smithi013.stdout:Installing for dependencies: 2019-12-08T12:00:34.862 INFO:teuthology.orchestra.run.smithi013.stdout: jq x86_64 1.5-1.el7 epel 153 k 2019-12-08T12:00:34.862 INFO:teuthology.orchestra.run.smithi013.stdout: oniguruma x86_64 5.9.5-3.el7 epel 129 k 2019-12-08T12:00:34.863 INFO:teuthology.orchestra.run.smithi013.stdout: socat x86_64 1.7.3.2-2.el7 base 290 k 2019-12-08T12:00:34.863 INFO:teuthology.orchestra.run.smithi013.stdout: xmlstarlet x86_64 1.6.1-1.el7 epel 62 k 2019-12-08T12:00:34.863 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T12:00:34.863 INFO:teuthology.orchestra.run.smithi013.stdout:Transaction Summary 2019-12-08T12:00:34.863 INFO:teuthology.orchestra.run.smithi013.stdout:================================================================================ 2019-12-08T12:00:34.863 INFO:teuthology.orchestra.run.smithi013.stdout:Install 1 Package (+4 Dependent packages) 2019-12-08T12:00:34.863 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T12:00:34.864 INFO:teuthology.orchestra.run.smithi013.stdout:Total download size: 38 M 2019-12-08T12:00:34.864 INFO:teuthology.orchestra.run.smithi013.stdout:Installed size: 134 M 2019-12-08T12:00:34.864 INFO:teuthology.orchestra.run.smithi013.stdout:Downloading packages: 2019-12-08T12:00:34.940 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : oniguruma-5.9.5-3.el7.x86_64 3/5 2019-12-08T12:00:36.680 INFO:teuthology.orchestra.run.smithi013.stdout:-------------------------------------------------------------------------------- 2019-12-08T12:00:36.680 INFO:teuthology.orchestra.run.smithi013.stdout:Total 21 MB/s | 38 MB 00:01 2019-12-08T12:00:36.687 INFO:teuthology.orchestra.run.smithi013.stdout:Running transaction check 2019-12-08T12:00:36.706 INFO:teuthology.orchestra.run.smithi013.stdout:Running transaction test 2019-12-08T12:00:36.791 INFO:teuthology.orchestra.run.smithi013.stdout:Transaction test succeeded 2019-12-08T12:00:36.791 INFO:teuthology.orchestra.run.smithi013.stdout:Running transaction 2019-12-08T12:00:37.484 INFO:teuthology.orchestra.run.smithi013.stdout: Installing : xmlstarlet-1.6.1-1.el7.x86_64 1/5 2019-12-08T12:00:37.810 INFO:teuthology.orchestra.run.smithi013.stdout: Installing : socat-1.7.3.2-2.el7.x86_64 2/5 2019-12-08T12:00:38.149 INFO:teuthology.orchestra.run.smithi013.stdout: Installing : oniguruma-5.9.5-3.el7.x86_64 3/5 2019-12-08T12:00:38.905 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : jq-1.5-1.el7.x86_64 4/5 2019-12-08T12:00:39.332 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : 2:ceph-test-15.0.0-7900.g1351c81.el7.x86_64 5/5 2019-12-08T12:00:39.429 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : 2:ceph-test-15.0.0-7900.g1351c81.el7.x86_64 1/5 2019-12-08T12:00:39.530 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : oniguruma-5.9.5-3.el7.x86_64 2/5 2019-12-08T12:00:39.664 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : socat-1.7.3.2-2.el7.x86_64 3/5 2019-12-08T12:00:39.764 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : jq-1.5-1.el7.x86_64 4/5 2019-12-08T12:00:40.199 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : xmlstarlet-1.6.1-1.el7.x86_64 5/5 2019-12-08T12:00:40.199 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:00:40.199 INFO:teuthology.orchestra.run.smithi079.stdout:Installed: 2019-12-08T12:00:40.199 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-test.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-08T12:00:40.200 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:00:40.200 INFO:teuthology.orchestra.run.smithi079.stdout:Dependency Installed: 2019-12-08T12:00:40.200 INFO:teuthology.orchestra.run.smithi079.stdout: jq.x86_64 0:1.5-1.el7 oniguruma.x86_64 0:5.9.5-3.el7 2019-12-08T12:00:40.200 INFO:teuthology.orchestra.run.smithi079.stdout: socat.x86_64 0:1.7.3.2-2.el7 xmlstarlet.x86_64 0:1.6.1-1.el7 2019-12-08T12:00:40.200 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:00:40.200 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2019-12-08T12:00:40.322 INFO:teuthology.orchestra.run.smithi079:> sudo yum -y install ceph 2019-12-08T12:00:40.548 INFO:teuthology.orchestra.run.smithi079.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-08T12:00:40.591 INFO:teuthology.orchestra.run.smithi079.stdout:Loading mirror speeds from cached hostfile 2019-12-08T12:00:40.592 INFO:teuthology.orchestra.run.smithi079.stdout: * base: mirrors.umflint.edu 2019-12-08T12:00:40.593 INFO:teuthology.orchestra.run.smithi079.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-08T12:00:40.593 INFO:teuthology.orchestra.run.smithi079.stdout: * extras: mirror.facebook.net 2019-12-08T12:00:40.593 INFO:teuthology.orchestra.run.smithi079.stdout: * updates: mirror.math.princeton.edu 2019-12-08T12:00:41.182 INFO:teuthology.orchestra.run.smithi079.stdout:7 packages excluded due to repository priority protections 2019-12-08T12:00:41.506 INFO:teuthology.orchestra.run.smithi079.stdout:Resolving Dependencies 2019-12-08T12:00:41.507 INFO:teuthology.orchestra.run.smithi079.stdout:--> Running transaction check 2019-12-08T12:00:41.507 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package ceph.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-08T12:00:41.509 INFO:teuthology.orchestra.run.smithi079.stdout:--> Processing Dependency: ceph-mon = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-15.0.0-7900.g1351c81.el7.x86_64 2019-12-08T12:00:41.539 INFO:teuthology.orchestra.run.smithi079.stdout:--> Processing Dependency: ceph-mds = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-15.0.0-7900.g1351c81.el7.x86_64 2019-12-08T12:00:41.540 INFO:teuthology.orchestra.run.smithi079.stdout:--> Processing Dependency: ceph-mgr = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-15.0.0-7900.g1351c81.el7.x86_64 2019-12-08T12:00:41.541 INFO:teuthology.orchestra.run.smithi079.stdout:--> Processing Dependency: ceph-osd = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-15.0.0-7900.g1351c81.el7.x86_64 2019-12-08T12:00:41.542 INFO:teuthology.orchestra.run.smithi079.stdout:--> Running transaction check 2019-12-08T12:00:41.542 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package ceph-mds.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-08T12:00:41.552 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package ceph-mgr.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-08T12:00:41.554 INFO:teuthology.orchestra.run.smithi079.stdout:--> Processing Dependency: pyOpenSSL for package: 2:ceph-mgr-15.0.0-7900.g1351c81.el7.x86_64 2019-12-08T12:00:41.555 INFO:teuthology.orchestra.run.smithi079.stdout:--> Processing Dependency: python-requests for package: 2:ceph-mgr-15.0.0-7900.g1351c81.el7.x86_64 2019-12-08T12:00:41.557 INFO:teuthology.orchestra.run.smithi079.stdout:--> Processing Dependency: python-werkzeug for package: 2:ceph-mgr-15.0.0-7900.g1351c81.el7.x86_64 2019-12-08T12:00:41.557 INFO:teuthology.orchestra.run.smithi079.stdout:--> Processing Dependency: python-cherrypy for package: 2:ceph-mgr-15.0.0-7900.g1351c81.el7.x86_64 2019-12-08T12:00:41.558 INFO:teuthology.orchestra.run.smithi079.stdout:--> Processing Dependency: python-bcrypt for package: 2:ceph-mgr-15.0.0-7900.g1351c81.el7.x86_64 2019-12-08T12:00:41.559 INFO:teuthology.orchestra.run.smithi079.stdout:--> Processing Dependency: python-pecan for package: 2:ceph-mgr-15.0.0-7900.g1351c81.el7.x86_64 2019-12-08T12:00:41.560 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package ceph-mon.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-08T12:00:41.563 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package ceph-osd.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-08T12:00:41.567 INFO:teuthology.orchestra.run.smithi079.stdout:--> Running transaction check 2019-12-08T12:00:41.568 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package pyOpenSSL.x86_64 0:0.13.1-4.el7 will be installed 2019-12-08T12:00:41.568 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package python-cherrypy.noarch 0:3.2.2-4.el7 will be installed 2019-12-08T12:00:41.569 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package python-pecan.noarch 0:0.4.5-2.el7 will be installed 2019-12-08T12:00:41.570 INFO:teuthology.orchestra.run.smithi079.stdout:--> Processing Dependency: python-mako >= 0.4.0 for package: python-pecan-0.4.5-2.el7.noarch 2019-12-08T12:00:41.571 INFO:teuthology.orchestra.run.smithi079.stdout:--> Processing Dependency: python-simplegeneric >= 0.8 for package: python-pecan-0.4.5-2.el7.noarch 2019-12-08T12:00:41.571 INFO:teuthology.orchestra.run.smithi079.stdout:--> Processing Dependency: python-webob >= 1.2 for package: python-pecan-0.4.5-2.el7.noarch 2019-12-08T12:00:41.572 INFO:teuthology.orchestra.run.smithi079.stdout:--> Processing Dependency: python-webtest >= 1.3.1 for package: python-pecan-0.4.5-2.el7.noarch 2019-12-08T12:00:41.573 INFO:teuthology.orchestra.run.smithi079.stdout:--> Processing Dependency: python-singledispatch for package: python-pecan-0.4.5-2.el7.noarch 2019-12-08T12:00:41.574 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package python-requests.noarch 0:2.6.0-7.el7_7 will be installed 2019-12-08T12:00:41.575 INFO:teuthology.orchestra.run.smithi079.stdout:--> Processing Dependency: python-urllib3 >= 1.10.2-1 for package: python-requests-2.6.0-7.el7_7.noarch 2019-12-08T12:00:41.576 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package python-werkzeug.noarch 0:0.9.1-2.el7 will be installed 2019-12-08T12:00:41.576 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package python2-bcrypt.x86_64 0:3.1.6-2.el7 will be installed 2019-12-08T12:00:41.576 INFO:teuthology.orchestra.run.smithi079.stdout:--> Processing Dependency: python2-six for package: python2-bcrypt-3.1.6-2.el7.x86_64 2019-12-08T12:00:41.577 INFO:teuthology.orchestra.run.smithi079.stdout:--> Running transaction check 2019-12-08T12:00:41.577 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package python-mako.noarch 0:0.8.1-2.el7 will be installed 2019-12-08T12:00:41.578 INFO:teuthology.orchestra.run.smithi079.stdout:--> Processing Dependency: python-markupsafe for package: python-mako-0.8.1-2.el7.noarch 2019-12-08T12:00:41.578 INFO:teuthology.orchestra.run.smithi079.stdout:--> Processing Dependency: python-beaker for package: python-mako-0.8.1-2.el7.noarch 2019-12-08T12:00:41.579 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package python-simplegeneric.noarch 0:0.8-7.el7 will be installed 2019-12-08T12:00:41.579 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package python-singledispatch.noarch 0:3.4.0.2-2.el7 will be installed 2019-12-08T12:00:41.579 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package python-urllib3.noarch 0:1.10.2-7.el7 will be installed 2019-12-08T12:00:41.580 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package python-webob.noarch 0:1.2.3-7.el7 will be installed 2019-12-08T12:00:41.580 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package python-webtest.noarch 0:1.3.4-6.el7 will be installed 2019-12-08T12:00:41.581 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package python2-six.noarch 0:1.9.0-0.el7 will be installed 2019-12-08T12:00:41.581 INFO:teuthology.orchestra.run.smithi079.stdout:--> Running transaction check 2019-12-08T12:00:41.581 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package python-beaker.noarch 0:1.5.4-10.el7 will be installed 2019-12-08T12:00:41.581 INFO:teuthology.orchestra.run.smithi079.stdout:--> Processing Dependency: python-paste for package: python-beaker-1.5.4-10.el7.noarch 2019-12-08T12:00:41.582 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package python-markupsafe.x86_64 0:0.11-10.el7 will be installed 2019-12-08T12:00:41.582 INFO:teuthology.orchestra.run.smithi079.stdout:--> Running transaction check 2019-12-08T12:00:41.582 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package python-paste.noarch 0:1.7.5.1-9.20111221hg1498.el7 will be installed 2019-12-08T12:00:41.582 INFO:teuthology.orchestra.run.smithi079.stdout:--> Processing Dependency: python-tempita for package: python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 2019-12-08T12:00:41.583 INFO:teuthology.orchestra.run.smithi079.stdout:--> Running transaction check 2019-12-08T12:00:41.583 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package python-tempita.noarch 0:0.5.1-6.el7 will be installed 2019-12-08T12:00:41.941 INFO:teuthology.orchestra.run.smithi079.stdout:--> Finished Dependency Resolution 2019-12-08T12:00:42.158 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:00:42.158 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies Resolved 2019-12-08T12:00:42.161 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:00:42.161 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2019-12-08T12:00:42.161 INFO:teuthology.orchestra.run.smithi079.stdout: Package Arch Version Repository 2019-12-08T12:00:42.161 INFO:teuthology.orchestra.run.smithi079.stdout: Size 2019-12-08T12:00:42.162 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2019-12-08T12:00:42.162 INFO:teuthology.orchestra.run.smithi079.stdout:Installing: 2019-12-08T12:00:42.162 INFO:teuthology.orchestra.run.smithi079.stdout: ceph x86_64 2:15.0.0-7900.g1351c81.el7 ceph 2.0 k 2019-12-08T12:00:42.162 INFO:teuthology.orchestra.run.smithi079.stdout:Installing for dependencies: 2019-12-08T12:00:42.162 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mds x86_64 2:15.0.0-7900.g1351c81.el7 ceph 1.9 M 2019-12-08T12:00:42.162 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr x86_64 2:15.0.0-7900.g1351c81.el7 ceph 1.7 M 2019-12-08T12:00:42.162 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mon x86_64 2:15.0.0-7900.g1351c81.el7 ceph 4.4 M 2019-12-08T12:00:42.163 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-osd x86_64 2:15.0.0-7900.g1351c81.el7 ceph 16 M 2019-12-08T12:00:42.163 INFO:teuthology.orchestra.run.smithi079.stdout: pyOpenSSL x86_64 0.13.1-4.el7 base 135 k 2019-12-08T12:00:42.163 INFO:teuthology.orchestra.run.smithi079.stdout: python-beaker noarch 1.5.4-10.el7 base 80 k 2019-12-08T12:00:42.163 INFO:teuthology.orchestra.run.smithi079.stdout: python-cherrypy noarch 3.2.2-4.el7 base 422 k 2019-12-08T12:00:42.163 INFO:teuthology.orchestra.run.smithi079.stdout: python-mako noarch 0.8.1-2.el7 base 307 k 2019-12-08T12:00:42.163 INFO:teuthology.orchestra.run.smithi079.stdout: python-markupsafe x86_64 0.11-10.el7 base 25 k 2019-12-08T12:00:42.163 INFO:teuthology.orchestra.run.smithi079.stdout: python-paste noarch 1.7.5.1-9.20111221hg1498.el7 base 866 k 2019-12-08T12:00:42.164 INFO:teuthology.orchestra.run.smithi079.stdout: python-pecan noarch 0.4.5-2.el7 epel 255 k 2019-12-08T12:00:42.164 INFO:teuthology.orchestra.run.smithi079.stdout: python-requests noarch 2.6.0-7.el7_7 updates 95 k 2019-12-08T12:00:42.164 INFO:teuthology.orchestra.run.smithi079.stdout: python-simplegeneric noarch 0.8-7.el7 epel 12 k 2019-12-08T12:00:42.164 INFO:teuthology.orchestra.run.smithi079.stdout: python-singledispatch noarch 3.4.0.2-2.el7 epel 18 k 2019-12-08T12:00:42.164 INFO:teuthology.orchestra.run.smithi079.stdout: python-tempita noarch 0.5.1-6.el7 base 33 k 2019-12-08T12:00:42.164 INFO:teuthology.orchestra.run.smithi079.stdout: python-urllib3 noarch 1.10.2-7.el7 base 103 k 2019-12-08T12:00:42.164 INFO:teuthology.orchestra.run.smithi079.stdout: python-webob noarch 1.2.3-7.el7 base 202 k 2019-12-08T12:00:42.165 INFO:teuthology.orchestra.run.smithi079.stdout: python-webtest noarch 1.3.4-6.el7 base 102 k 2019-12-08T12:00:42.165 INFO:teuthology.orchestra.run.smithi079.stdout: python-werkzeug noarch 0.9.1-2.el7 extras 562 k 2019-12-08T12:00:42.165 INFO:teuthology.orchestra.run.smithi079.stdout: python2-bcrypt x86_64 3.1.6-2.el7 epel 39 k 2019-12-08T12:00:42.165 INFO:teuthology.orchestra.run.smithi079.stdout: python2-six noarch 1.9.0-0.el7 epel 2.9 k 2019-12-08T12:00:42.165 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:00:42.165 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction Summary 2019-12-08T12:00:42.165 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2019-12-08T12:00:42.166 INFO:teuthology.orchestra.run.smithi079.stdout:Install 1 Package (+21 Dependent packages) 2019-12-08T12:00:42.166 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:00:42.166 INFO:teuthology.orchestra.run.smithi079.stdout:Total download size: 28 M 2019-12-08T12:00:42.167 INFO:teuthology.orchestra.run.smithi079.stdout:Installed size: 87 M 2019-12-08T12:00:42.167 INFO:teuthology.orchestra.run.smithi079.stdout:Downloading packages: 2019-12-08T12:00:42.378 INFO:teuthology.orchestra.run.smithi013.stdout: Installing : jq-1.5-1.el7.x86_64 4/5 2019-12-08T12:00:42.705 INFO:teuthology.orchestra.run.smithi013.stdout: Installing : 2:ceph-test-15.0.0-7900.g1351c81.el7.x86_64 5/5 2019-12-08T12:00:42.797 INFO:teuthology.orchestra.run.smithi013.stdout: Verifying : 2:ceph-test-15.0.0-7900.g1351c81.el7.x86_64 1/5 2019-12-08T12:00:42.905 INFO:teuthology.orchestra.run.smithi013.stdout: Verifying : oniguruma-5.9.5-3.el7.x86_64 2/5 2019-12-08T12:00:43.048 INFO:teuthology.orchestra.run.smithi013.stdout: Verifying : socat-1.7.3.2-2.el7.x86_64 3/5 2019-12-08T12:00:43.123 INFO:teuthology.orchestra.run.smithi013.stdout: Verifying : jq-1.5-1.el7.x86_64 4/5 2019-12-08T12:00:43.575 INFO:teuthology.orchestra.run.smithi013.stdout: Verifying : xmlstarlet-1.6.1-1.el7.x86_64 5/5 2019-12-08T12:00:43.575 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T12:00:43.575 INFO:teuthology.orchestra.run.smithi013.stdout:Installed: 2019-12-08T12:00:43.575 INFO:teuthology.orchestra.run.smithi013.stdout: ceph-test.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-08T12:00:43.575 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T12:00:43.575 INFO:teuthology.orchestra.run.smithi013.stdout:Dependency Installed: 2019-12-08T12:00:43.576 INFO:teuthology.orchestra.run.smithi013.stdout: jq.x86_64 0:1.5-1.el7 oniguruma.x86_64 0:5.9.5-3.el7 2019-12-08T12:00:43.576 INFO:teuthology.orchestra.run.smithi013.stdout: socat.x86_64 0:1.7.3.2-2.el7 xmlstarlet.x86_64 0:1.6.1-1.el7 2019-12-08T12:00:43.576 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T12:00:43.576 INFO:teuthology.orchestra.run.smithi013.stdout:Complete! 2019-12-08T12:00:43.632 INFO:teuthology.orchestra.run.smithi079.stdout:-------------------------------------------------------------------------------- 2019-12-08T12:00:43.632 INFO:teuthology.orchestra.run.smithi079.stdout:Total 19 MB/s | 28 MB 00:01 2019-12-08T12:00:43.655 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction check 2019-12-08T12:00:43.698 INFO:teuthology.orchestra.run.smithi013:> sudo yum -y install ceph 2019-12-08T12:00:43.699 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction test 2019-12-08T12:00:43.986 INFO:teuthology.orchestra.run.smithi013.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-08T12:00:44.034 INFO:teuthology.orchestra.run.smithi013.stdout:Loading mirror speeds from cached hostfile 2019-12-08T12:00:44.034 INFO:teuthology.orchestra.run.smithi013.stdout: * base: mirrors.umflint.edu 2019-12-08T12:00:44.035 INFO:teuthology.orchestra.run.smithi013.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-08T12:00:44.036 INFO:teuthology.orchestra.run.smithi013.stdout: * extras: mirror.facebook.net 2019-12-08T12:00:44.036 INFO:teuthology.orchestra.run.smithi013.stdout: * updates: mirror.math.princeton.edu 2019-12-08T12:00:44.154 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction test succeeded 2019-12-08T12:00:44.156 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction 2019-12-08T12:00:44.705 INFO:teuthology.orchestra.run.smithi013.stdout:7 packages excluded due to repository priority protections 2019-12-08T12:00:45.056 INFO:teuthology.orchestra.run.smithi013.stdout:Resolving Dependencies 2019-12-08T12:00:45.057 INFO:teuthology.orchestra.run.smithi013.stdout:--> Running transaction check 2019-12-08T12:00:45.057 INFO:teuthology.orchestra.run.smithi013.stdout:---> Package ceph.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-08T12:00:45.059 INFO:teuthology.orchestra.run.smithi013.stdout:--> Processing Dependency: ceph-mon = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-15.0.0-7900.g1351c81.el7.x86_64 2019-12-08T12:00:45.091 INFO:teuthology.orchestra.run.smithi013.stdout:--> Processing Dependency: ceph-mds = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-15.0.0-7900.g1351c81.el7.x86_64 2019-12-08T12:00:45.092 INFO:teuthology.orchestra.run.smithi013.stdout:--> Processing Dependency: ceph-mgr = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-15.0.0-7900.g1351c81.el7.x86_64 2019-12-08T12:00:45.093 INFO:teuthology.orchestra.run.smithi013.stdout:--> Processing Dependency: ceph-osd = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-15.0.0-7900.g1351c81.el7.x86_64 2019-12-08T12:00:45.094 INFO:teuthology.orchestra.run.smithi013.stdout:--> Running transaction check 2019-12-08T12:00:45.094 INFO:teuthology.orchestra.run.smithi013.stdout:---> Package ceph-mds.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-08T12:00:45.105 INFO:teuthology.orchestra.run.smithi013.stdout:---> Package ceph-mgr.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-08T12:00:45.107 INFO:teuthology.orchestra.run.smithi013.stdout:--> Processing Dependency: pyOpenSSL for package: 2:ceph-mgr-15.0.0-7900.g1351c81.el7.x86_64 2019-12-08T12:00:45.108 INFO:teuthology.orchestra.run.smithi013.stdout:--> Processing Dependency: python-requests for package: 2:ceph-mgr-15.0.0-7900.g1351c81.el7.x86_64 2019-12-08T12:00:45.110 INFO:teuthology.orchestra.run.smithi013.stdout:--> Processing Dependency: python-werkzeug for package: 2:ceph-mgr-15.0.0-7900.g1351c81.el7.x86_64 2019-12-08T12:00:45.111 INFO:teuthology.orchestra.run.smithi013.stdout:--> Processing Dependency: python-cherrypy for package: 2:ceph-mgr-15.0.0-7900.g1351c81.el7.x86_64 2019-12-08T12:00:45.112 INFO:teuthology.orchestra.run.smithi013.stdout:--> Processing Dependency: python-bcrypt for package: 2:ceph-mgr-15.0.0-7900.g1351c81.el7.x86_64 2019-12-08T12:00:45.113 INFO:teuthology.orchestra.run.smithi013.stdout:--> Processing Dependency: python-pecan for package: 2:ceph-mgr-15.0.0-7900.g1351c81.el7.x86_64 2019-12-08T12:00:45.114 INFO:teuthology.orchestra.run.smithi013.stdout:---> Package ceph-mon.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-08T12:00:45.117 INFO:teuthology.orchestra.run.smithi013.stdout:---> Package ceph-osd.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-08T12:00:45.122 INFO:teuthology.orchestra.run.smithi013.stdout:--> Running transaction check 2019-12-08T12:00:45.122 INFO:teuthology.orchestra.run.smithi013.stdout:---> Package pyOpenSSL.x86_64 0:0.13.1-4.el7 will be installed 2019-12-08T12:00:45.124 INFO:teuthology.orchestra.run.smithi013.stdout:---> Package python-cherrypy.noarch 0:3.2.2-4.el7 will be installed 2019-12-08T12:00:45.124 INFO:teuthology.orchestra.run.smithi013.stdout:---> Package python-pecan.noarch 0:0.4.5-2.el7 will be installed 2019-12-08T12:00:45.125 INFO:teuthology.orchestra.run.smithi013.stdout:--> Processing Dependency: python-mako >= 0.4.0 for package: python-pecan-0.4.5-2.el7.noarch 2019-12-08T12:00:45.125 INFO:teuthology.orchestra.run.smithi013.stdout:--> Processing Dependency: python-simplegeneric >= 0.8 for package: python-pecan-0.4.5-2.el7.noarch 2019-12-08T12:00:45.126 INFO:teuthology.orchestra.run.smithi013.stdout:--> Processing Dependency: python-webob >= 1.2 for package: python-pecan-0.4.5-2.el7.noarch 2019-12-08T12:00:45.127 INFO:teuthology.orchestra.run.smithi013.stdout:--> Processing Dependency: python-webtest >= 1.3.1 for package: python-pecan-0.4.5-2.el7.noarch 2019-12-08T12:00:45.128 INFO:teuthology.orchestra.run.smithi013.stdout:--> Processing Dependency: python-singledispatch for package: python-pecan-0.4.5-2.el7.noarch 2019-12-08T12:00:45.131 INFO:teuthology.orchestra.run.smithi013.stdout:---> Package python-requests.noarch 0:2.6.0-7.el7_7 will be installed 2019-12-08T12:00:45.131 INFO:teuthology.orchestra.run.smithi013.stdout:--> Processing Dependency: python-urllib3 >= 1.10.2-1 for package: python-requests-2.6.0-7.el7_7.noarch 2019-12-08T12:00:45.131 INFO:teuthology.orchestra.run.smithi013.stdout:---> Package python-werkzeug.noarch 0:0.9.1-2.el7 will be installed 2019-12-08T12:00:45.131 INFO:teuthology.orchestra.run.smithi013.stdout:---> Package python2-bcrypt.x86_64 0:3.1.6-2.el7 will be installed 2019-12-08T12:00:45.132 INFO:teuthology.orchestra.run.smithi013.stdout:--> Processing Dependency: python2-six for package: python2-bcrypt-3.1.6-2.el7.x86_64 2019-12-08T12:00:45.133 INFO:teuthology.orchestra.run.smithi013.stdout:--> Running transaction check 2019-12-08T12:00:45.133 INFO:teuthology.orchestra.run.smithi013.stdout:---> Package python-mako.noarch 0:0.8.1-2.el7 will be installed 2019-12-08T12:00:45.133 INFO:teuthology.orchestra.run.smithi013.stdout:--> Processing Dependency: python-markupsafe for package: python-mako-0.8.1-2.el7.noarch 2019-12-08T12:00:45.134 INFO:teuthology.orchestra.run.smithi013.stdout:--> Processing Dependency: python-beaker for package: python-mako-0.8.1-2.el7.noarch 2019-12-08T12:00:45.136 INFO:teuthology.orchestra.run.smithi013.stdout:---> Package python-simplegeneric.noarch 0:0.8-7.el7 will be installed 2019-12-08T12:00:45.137 INFO:teuthology.orchestra.run.smithi013.stdout:---> Package python-singledispatch.noarch 0:3.4.0.2-2.el7 will be installed 2019-12-08T12:00:45.137 INFO:teuthology.orchestra.run.smithi013.stdout:---> Package python-urllib3.noarch 0:1.10.2-7.el7 will be installed 2019-12-08T12:00:45.137 INFO:teuthology.orchestra.run.smithi013.stdout:---> Package python-webob.noarch 0:1.2.3-7.el7 will be installed 2019-12-08T12:00:45.137 INFO:teuthology.orchestra.run.smithi013.stdout:---> Package python-webtest.noarch 0:1.3.4-6.el7 will be installed 2019-12-08T12:00:45.137 INFO:teuthology.orchestra.run.smithi013.stdout:---> Package python2-six.noarch 0:1.9.0-0.el7 will be installed 2019-12-08T12:00:45.138 INFO:teuthology.orchestra.run.smithi013.stdout:--> Running transaction check 2019-12-08T12:00:45.138 INFO:teuthology.orchestra.run.smithi013.stdout:---> Package python-beaker.noarch 0:1.5.4-10.el7 will be installed 2019-12-08T12:00:45.138 INFO:teuthology.orchestra.run.smithi013.stdout:--> Processing Dependency: python-paste for package: python-beaker-1.5.4-10.el7.noarch 2019-12-08T12:00:45.138 INFO:teuthology.orchestra.run.smithi013.stdout:---> Package python-markupsafe.x86_64 0:0.11-10.el7 will be installed 2019-12-08T12:00:45.138 INFO:teuthology.orchestra.run.smithi013.stdout:--> Running transaction check 2019-12-08T12:00:45.139 INFO:teuthology.orchestra.run.smithi013.stdout:---> Package python-paste.noarch 0:1.7.5.1-9.20111221hg1498.el7 will be installed 2019-12-08T12:00:45.139 INFO:teuthology.orchestra.run.smithi013.stdout:--> Processing Dependency: python-tempita for package: python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 2019-12-08T12:00:45.139 INFO:teuthology.orchestra.run.smithi013.stdout:--> Running transaction check 2019-12-08T12:00:45.140 INFO:teuthology.orchestra.run.smithi013.stdout:---> Package python-tempita.noarch 0:0.5.1-6.el7 will be installed 2019-12-08T12:00:45.290 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python-webob-1.2.3-7.el7.noarch 1/22 2019-12-08T12:00:45.516 INFO:teuthology.orchestra.run.smithi013.stdout:--> Finished Dependency Resolution 2019-12-08T12:00:45.618 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : pyOpenSSL-0.13.1-4.el7.x86_64 2/22 2019-12-08T12:00:45.746 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T12:00:45.747 INFO:teuthology.orchestra.run.smithi013.stdout:Dependencies Resolved 2019-12-08T12:00:45.750 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T12:00:45.750 INFO:teuthology.orchestra.run.smithi013.stdout:================================================================================ 2019-12-08T12:00:45.750 INFO:teuthology.orchestra.run.smithi013.stdout: Package Arch Version Repository 2019-12-08T12:00:45.750 INFO:teuthology.orchestra.run.smithi013.stdout: Size 2019-12-08T12:00:45.750 INFO:teuthology.orchestra.run.smithi013.stdout:================================================================================ 2019-12-08T12:00:45.751 INFO:teuthology.orchestra.run.smithi013.stdout:Installing: 2019-12-08T12:00:45.751 INFO:teuthology.orchestra.run.smithi013.stdout: ceph x86_64 2:15.0.0-7900.g1351c81.el7 ceph 2.0 k 2019-12-08T12:00:45.751 INFO:teuthology.orchestra.run.smithi013.stdout:Installing for dependencies: 2019-12-08T12:00:45.751 INFO:teuthology.orchestra.run.smithi013.stdout: ceph-mds x86_64 2:15.0.0-7900.g1351c81.el7 ceph 1.9 M 2019-12-08T12:00:45.751 INFO:teuthology.orchestra.run.smithi013.stdout: ceph-mgr x86_64 2:15.0.0-7900.g1351c81.el7 ceph 1.7 M 2019-12-08T12:00:45.751 INFO:teuthology.orchestra.run.smithi013.stdout: ceph-mon x86_64 2:15.0.0-7900.g1351c81.el7 ceph 4.4 M 2019-12-08T12:00:45.751 INFO:teuthology.orchestra.run.smithi013.stdout: ceph-osd x86_64 2:15.0.0-7900.g1351c81.el7 ceph 16 M 2019-12-08T12:00:45.751 INFO:teuthology.orchestra.run.smithi013.stdout: pyOpenSSL x86_64 0.13.1-4.el7 base 135 k 2019-12-08T12:00:45.752 INFO:teuthology.orchestra.run.smithi013.stdout: python-beaker noarch 1.5.4-10.el7 base 80 k 2019-12-08T12:00:45.752 INFO:teuthology.orchestra.run.smithi013.stdout: python-cherrypy noarch 3.2.2-4.el7 base 422 k 2019-12-08T12:00:45.752 INFO:teuthology.orchestra.run.smithi013.stdout: python-mako noarch 0.8.1-2.el7 base 307 k 2019-12-08T12:00:45.752 INFO:teuthology.orchestra.run.smithi013.stdout: python-markupsafe x86_64 0.11-10.el7 base 25 k 2019-12-08T12:00:45.752 INFO:teuthology.orchestra.run.smithi013.stdout: python-paste noarch 1.7.5.1-9.20111221hg1498.el7 base 866 k 2019-12-08T12:00:45.752 INFO:teuthology.orchestra.run.smithi013.stdout: python-pecan noarch 0.4.5-2.el7 epel 255 k 2019-12-08T12:00:45.752 INFO:teuthology.orchestra.run.smithi013.stdout: python-requests noarch 2.6.0-7.el7_7 updates 95 k 2019-12-08T12:00:45.753 INFO:teuthology.orchestra.run.smithi013.stdout: python-simplegeneric noarch 0.8-7.el7 epel 12 k 2019-12-08T12:00:45.753 INFO:teuthology.orchestra.run.smithi013.stdout: python-singledispatch noarch 3.4.0.2-2.el7 epel 18 k 2019-12-08T12:00:45.753 INFO:teuthology.orchestra.run.smithi013.stdout: python-tempita noarch 0.5.1-6.el7 base 33 k 2019-12-08T12:00:45.753 INFO:teuthology.orchestra.run.smithi013.stdout: python-urllib3 noarch 1.10.2-7.el7 base 103 k 2019-12-08T12:00:45.753 INFO:teuthology.orchestra.run.smithi013.stdout: python-webob noarch 1.2.3-7.el7 base 202 k 2019-12-08T12:00:45.753 INFO:teuthology.orchestra.run.smithi013.stdout: python-webtest noarch 1.3.4-6.el7 base 102 k 2019-12-08T12:00:45.753 INFO:teuthology.orchestra.run.smithi013.stdout: python-werkzeug noarch 0.9.1-2.el7 extras 562 k 2019-12-08T12:00:45.754 INFO:teuthology.orchestra.run.smithi013.stdout: python2-bcrypt x86_64 3.1.6-2.el7 epel 39 k 2019-12-08T12:00:45.754 INFO:teuthology.orchestra.run.smithi013.stdout: python2-six noarch 1.9.0-0.el7 epel 2.9 k 2019-12-08T12:00:45.755 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T12:00:45.755 INFO:teuthology.orchestra.run.smithi013.stdout:Transaction Summary 2019-12-08T12:00:45.755 INFO:teuthology.orchestra.run.smithi013.stdout:================================================================================ 2019-12-08T12:00:45.755 INFO:teuthology.orchestra.run.smithi013.stdout:Install 1 Package (+21 Dependent packages) 2019-12-08T12:00:45.755 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T12:00:45.756 INFO:teuthology.orchestra.run.smithi013.stdout:Total download size: 28 M 2019-12-08T12:00:45.756 INFO:teuthology.orchestra.run.smithi013.stdout:Installed size: 87 M 2019-12-08T12:00:45.756 INFO:teuthology.orchestra.run.smithi013.stdout:Downloading packages: 2019-12-08T12:00:45.891 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python-webtest-1.3.4-6.el7.noarch 3/22 2019-12-08T12:00:46.351 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python-tempita-0.5.1-6.el7.noarch 4/22 2019-12-08T12:00:46.696 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 5/22 2019-12-08T12:00:47.122 INFO:teuthology.orchestra.run.smithi013.stdout:-------------------------------------------------------------------------------- 2019-12-08T12:00:47.122 INFO:teuthology.orchestra.run.smithi013.stdout:Total 20 MB/s | 28 MB 00:01 2019-12-08T12:00:47.145 INFO:teuthology.orchestra.run.smithi013.stdout:Running transaction check 2019-12-08T12:00:47.162 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python-beaker-1.5.4-10.el7.noarch 6/22 2019-12-08T12:00:47.189 INFO:teuthology.orchestra.run.smithi013.stdout:Running transaction test 2019-12-08T12:00:47.492 INFO:teuthology.orchestra.run.smithi013.stdout:Transaction test succeeded 2019-12-08T12:00:47.492 INFO:teuthology.orchestra.run.smithi013.stdout:Running transaction 2019-12-08T12:00:47.699 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python-cherrypy-3.2.2-4.el7.noarch 7/22 2019-12-08T12:00:48.349 INFO:teuthology.orchestra.run.smithi013.stdout: Installing : python-webob-1.2.3-7.el7.noarch 1/22 2019-12-08T12:00:48.676 INFO:teuthology.orchestra.run.smithi013.stdout: Installing : pyOpenSSL-0.13.1-4.el7.x86_64 2/22 2019-12-08T12:00:48.959 INFO:teuthology.orchestra.run.smithi013.stdout: Installing : python-webtest-1.3.4-6.el7.noarch 3/22 2019-12-08T12:00:49.458 INFO:teuthology.orchestra.run.smithi013.stdout: Installing : python-tempita-0.5.1-6.el7.noarch 4/22 2019-12-08T12:00:49.597 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python-werkzeug-0.9.1-2.el7.noarch 8/22 2019-12-08T12:00:49.840 INFO:teuthology.orchestra.run.smithi013.stdout: Installing : python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 5/22 2019-12-08T12:00:50.074 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : 2:ceph-osd-15.0.0-7900.g1351c81.el7.x86_64 9/22 2019-12-08T12:00:50.307 INFO:teuthology.orchestra.run.smithi013.stdout: Installing : python-beaker-1.5.4-10.el7.noarch 6/22 2019-12-08T12:00:50.489 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python-markupsafe-0.11-10.el7.x86_64 10/22 2019-12-08T12:00:50.849 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python-mako-0.8.1-2.el7.noarch 11/22 2019-12-08T12:00:50.854 INFO:teuthology.orchestra.run.smithi013.stdout: Installing : python-cherrypy-3.2.2-4.el7.noarch 7/22 2019-12-08T12:00:51.639 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python-singledispatch-3.4.0.2-2.el7.noarch 12/22 2019-12-08T12:00:52.079 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : 2:ceph-mon-15.0.0-7900.g1351c81.el7.x86_64 13/22 2019-12-08T12:00:52.379 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python-urllib3-1.10.2-7.el7.noarch 14/22 2019-12-08T12:00:52.963 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python-requests-2.6.0-7.el7_7.noarch 15/22 2019-12-08T12:00:53.017 INFO:teuthology.orchestra.run.smithi013.stdout: Installing : python-werkzeug-0.9.1-2.el7.noarch 8/22 2019-12-08T12:00:53.350 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : 2:ceph-mds-15.0.0-7900.g1351c81.el7.x86_64 16/22 2019-12-08T12:00:53.474 INFO:teuthology.orchestra.run.smithi013.stdout: Installing : 2:ceph-osd-15.0.0-7900.g1351c81.el7.x86_64 9/22 2019-12-08T12:00:53.621 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python2-six-1.9.0-0.el7.noarch 17/22 2019-12-08T12:00:53.882 INFO:teuthology.orchestra.run.smithi013.stdout: Installing : python-markupsafe-0.11-10.el7.x86_64 10/22 2019-12-08T12:00:53.986 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python2-bcrypt-3.1.6-2.el7.x86_64 18/22 2019-12-08T12:00:54.234 INFO:teuthology.orchestra.run.smithi013.stdout: Installing : python-mako-0.8.1-2.el7.noarch 11/22 2019-12-08T12:00:54.383 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python-simplegeneric-0.8-7.el7.noarch 19/22 2019-12-08T12:00:55.012 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python-pecan-0.4.5-2.el7.noarch 20/22 2019-12-08T12:00:55.038 INFO:teuthology.orchestra.run.smithi013.stdout: Installing : python-singledispatch-3.4.0.2-2.el7.noarch 12/22 2019-12-08T12:00:55.440 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : 2:ceph-mgr-15.0.0-7900.g1351c81.el7.x86_64 21/22 2019-12-08T12:00:55.479 INFO:teuthology.orchestra.run.smithi013.stdout: Installing : 2:ceph-mon-15.0.0-7900.g1351c81.el7.x86_64 13/22 2019-12-08T12:00:55.753 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : 2:ceph-15.0.0-7900.g1351c81.el7.x86_64 22/22 2019-12-08T12:00:55.811 INFO:teuthology.orchestra.run.smithi013.stdout: Installing : python-urllib3-1.10.2-7.el7.noarch 14/22 2019-12-08T12:00:55.881 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python-simplegeneric-0.8-7.el7.noarch 1/22 2019-12-08T12:00:55.989 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python2-six-1.9.0-0.el7.noarch 2/22 2019-12-08T12:00:56.132 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : pyOpenSSL-0.13.1-4.el7.x86_64 3/22 2019-12-08T12:00:56.266 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python2-bcrypt-3.1.6-2.el7.x86_64 4/22 2019-12-08T12:00:56.369 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : 2:ceph-mds-15.0.0-7900.g1351c81.el7.x86_64 5/22 2019-12-08T12:00:56.392 INFO:teuthology.orchestra.run.smithi013.stdout: Installing : python-requests-2.6.0-7.el7_7.noarch 15/22 2019-12-08T12:00:56.493 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python-urllib3-1.10.2-7.el7.noarch 6/22 2019-12-08T12:00:56.617 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : 2:ceph-mon-15.0.0-7900.g1351c81.el7.x86_64 7/22 2019-12-08T12:00:56.734 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : 2:ceph-15.0.0-7900.g1351c81.el7.x86_64 8/22 2019-12-08T12:00:56.777 INFO:teuthology.orchestra.run.smithi013.stdout: Installing : 2:ceph-mds-15.0.0-7900.g1351c81.el7.x86_64 16/22 2019-12-08T12:00:56.851 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python-requests-2.6.0-7.el7_7.noarch 9/22 2019-12-08T12:00:56.935 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python-pecan-0.4.5-2.el7.noarch 10/22 2019-12-08T12:00:57.018 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python-singledispatch-3.4.0.2-2.el7.noarch 11/22 2019-12-08T12:00:57.038 INFO:teuthology.orchestra.run.smithi013.stdout: Installing : python2-six-1.9.0-0.el7.noarch 17/22 2019-12-08T12:00:57.128 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python-markupsafe-0.11-10.el7.x86_64 12/22 2019-12-08T12:00:57.228 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : 2:ceph-osd-15.0.0-7900.g1351c81.el7.x86_64 13/22 2019-12-08T12:00:57.345 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : 2:ceph-mgr-15.0.0-7900.g1351c81.el7.x86_64 14/22 2019-12-08T12:00:57.386 INFO:teuthology.orchestra.run.smithi013.stdout: Installing : python2-bcrypt-3.1.6-2.el7.x86_64 18/22 2019-12-08T12:00:57.470 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 15/22 2019-12-08T12:00:57.579 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python-webob-1.2.3-7.el7.noarch 16/22 2019-12-08T12:00:57.738 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python-werkzeug-0.9.1-2.el7.noarch 17/22 2019-12-08T12:00:57.838 INFO:teuthology.orchestra.run.smithi013.stdout: Installing : python-simplegeneric-0.8-7.el7.noarch 19/22 2019-12-08T12:00:57.884 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python-mako-0.8.1-2.el7.noarch 18/22 2019-12-08T12:00:58.006 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python-cherrypy-3.2.2-4.el7.noarch 19/22 2019-12-08T12:00:58.115 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python-beaker-1.5.4-10.el7.noarch 20/22 2019-12-08T12:00:58.223 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python-tempita-0.5.1-6.el7.noarch 21/22 2019-12-08T12:00:58.498 INFO:teuthology.orchestra.run.smithi013.stdout: Installing : python-pecan-0.4.5-2.el7.noarch 20/22 2019-12-08T12:00:58.736 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python-webtest-1.3.4-6.el7.noarch 22/22 2019-12-08T12:00:58.736 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:00:58.736 INFO:teuthology.orchestra.run.smithi079.stdout:Installed: 2019-12-08T12:00:58.736 INFO:teuthology.orchestra.run.smithi079.stdout: ceph.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-08T12:00:58.737 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:00:58.737 INFO:teuthology.orchestra.run.smithi079.stdout:Dependency Installed: 2019-12-08T12:00:58.737 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mds.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-08T12:00:58.737 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-08T12:00:58.737 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mon.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-08T12:00:58.737 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-osd.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-08T12:00:58.737 INFO:teuthology.orchestra.run.smithi079.stdout: pyOpenSSL.x86_64 0:0.13.1-4.el7 2019-12-08T12:00:58.738 INFO:teuthology.orchestra.run.smithi079.stdout: python-beaker.noarch 0:1.5.4-10.el7 2019-12-08T12:00:58.738 INFO:teuthology.orchestra.run.smithi079.stdout: python-cherrypy.noarch 0:3.2.2-4.el7 2019-12-08T12:00:58.738 INFO:teuthology.orchestra.run.smithi079.stdout: python-mako.noarch 0:0.8.1-2.el7 2019-12-08T12:00:58.738 INFO:teuthology.orchestra.run.smithi079.stdout: python-markupsafe.x86_64 0:0.11-10.el7 2019-12-08T12:00:58.738 INFO:teuthology.orchestra.run.smithi079.stdout: python-paste.noarch 0:1.7.5.1-9.20111221hg1498.el7 2019-12-08T12:00:58.738 INFO:teuthology.orchestra.run.smithi079.stdout: python-pecan.noarch 0:0.4.5-2.el7 2019-12-08T12:00:58.739 INFO:teuthology.orchestra.run.smithi079.stdout: python-requests.noarch 0:2.6.0-7.el7_7 2019-12-08T12:00:58.739 INFO:teuthology.orchestra.run.smithi079.stdout: python-simplegeneric.noarch 0:0.8-7.el7 2019-12-08T12:00:58.739 INFO:teuthology.orchestra.run.smithi079.stdout: python-singledispatch.noarch 0:3.4.0.2-2.el7 2019-12-08T12:00:58.739 INFO:teuthology.orchestra.run.smithi079.stdout: python-tempita.noarch 0:0.5.1-6.el7 2019-12-08T12:00:58.739 INFO:teuthology.orchestra.run.smithi079.stdout: python-urllib3.noarch 0:1.10.2-7.el7 2019-12-08T12:00:58.739 INFO:teuthology.orchestra.run.smithi079.stdout: python-webob.noarch 0:1.2.3-7.el7 2019-12-08T12:00:58.739 INFO:teuthology.orchestra.run.smithi079.stdout: python-webtest.noarch 0:1.3.4-6.el7 2019-12-08T12:00:58.740 INFO:teuthology.orchestra.run.smithi079.stdout: python-werkzeug.noarch 0:0.9.1-2.el7 2019-12-08T12:00:58.740 INFO:teuthology.orchestra.run.smithi079.stdout: python2-bcrypt.x86_64 0:3.1.6-2.el7 2019-12-08T12:00:58.740 INFO:teuthology.orchestra.run.smithi079.stdout: python2-six.noarch 0:1.9.0-0.el7 2019-12-08T12:00:58.740 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:00:58.740 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2019-12-08T12:00:58.967 INFO:teuthology.orchestra.run.smithi013.stdout: Installing : 2:ceph-mgr-15.0.0-7900.g1351c81.el7.x86_64 21/22 2019-12-08T12:00:59.176 INFO:teuthology.orchestra.run.smithi079:> sudo yum -y install ceph-daemon 2019-12-08T12:00:59.237 INFO:teuthology.orchestra.run.smithi013.stdout: Installing : 2:ceph-15.0.0-7900.g1351c81.el7.x86_64 22/22 2019-12-08T12:00:59.365 INFO:teuthology.orchestra.run.smithi013.stdout: Verifying : python-simplegeneric-0.8-7.el7.noarch 1/22 2019-12-08T12:00:59.414 INFO:teuthology.orchestra.run.smithi079.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-08T12:00:59.454 INFO:teuthology.orchestra.run.smithi079.stdout:Loading mirror speeds from cached hostfile 2019-12-08T12:00:59.455 INFO:teuthology.orchestra.run.smithi079.stdout: * base: mirrors.umflint.edu 2019-12-08T12:00:59.455 INFO:teuthology.orchestra.run.smithi079.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-08T12:00:59.455 INFO:teuthology.orchestra.run.smithi079.stdout: * extras: mirror.facebook.net 2019-12-08T12:00:59.456 INFO:teuthology.orchestra.run.smithi079.stdout: * updates: mirror.math.princeton.edu 2019-12-08T12:00:59.465 INFO:teuthology.orchestra.run.smithi013.stdout: Verifying : python2-six-1.9.0-0.el7.noarch 2/22 2019-12-08T12:00:59.641 INFO:teuthology.orchestra.run.smithi013.stdout: Verifying : pyOpenSSL-0.13.1-4.el7.x86_64 3/22 2019-12-08T12:00:59.758 INFO:teuthology.orchestra.run.smithi013.stdout: Verifying : python2-bcrypt-3.1.6-2.el7.x86_64 4/22 2019-12-08T12:00:59.859 INFO:teuthology.orchestra.run.smithi013.stdout: Verifying : 2:ceph-mds-15.0.0-7900.g1351c81.el7.x86_64 5/22 2019-12-08T12:01:00.009 INFO:teuthology.orchestra.run.smithi013.stdout: Verifying : python-urllib3-1.10.2-7.el7.noarch 6/22 2019-12-08T12:01:00.108 INFO:teuthology.orchestra.run.smithi079.stdout:7 packages excluded due to repository priority protections 2019-12-08T12:01:00.126 INFO:teuthology.orchestra.run.smithi013.stdout: Verifying : 2:ceph-mon-15.0.0-7900.g1351c81.el7.x86_64 7/22 2019-12-08T12:01:00.218 INFO:teuthology.orchestra.run.smithi013.stdout: Verifying : 2:ceph-15.0.0-7900.g1351c81.el7.x86_64 8/22 2019-12-08T12:01:00.352 INFO:teuthology.orchestra.run.smithi013.stdout: Verifying : python-requests-2.6.0-7.el7_7.noarch 9/22 2019-12-08T12:01:00.428 INFO:teuthology.orchestra.run.smithi013.stdout: Verifying : python-pecan-0.4.5-2.el7.noarch 10/22 2019-12-08T12:01:00.436 INFO:teuthology.orchestra.run.smithi079.stdout:Resolving Dependencies 2019-12-08T12:01:00.436 INFO:teuthology.orchestra.run.smithi079.stdout:--> Running transaction check 2019-12-08T12:01:00.436 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package ceph-daemon.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-08T12:01:00.503 INFO:teuthology.orchestra.run.smithi013.stdout: Verifying : python-singledispatch-3.4.0.2-2.el7.noarch 11/22 2019-12-08T12:01:00.629 INFO:teuthology.orchestra.run.smithi013.stdout: Verifying : python-markupsafe-0.11-10.el7.x86_64 12/22 2019-12-08T12:01:00.712 INFO:teuthology.orchestra.run.smithi013.stdout: Verifying : 2:ceph-osd-15.0.0-7900.g1351c81.el7.x86_64 13/22 2019-12-08T12:01:00.801 INFO:teuthology.orchestra.run.smithi079.stdout:--> Finished Dependency Resolution 2019-12-08T12:01:00.804 INFO:teuthology.orchestra.run.smithi013.stdout: Verifying : 2:ceph-mgr-15.0.0-7900.g1351c81.el7.x86_64 14/22 2019-12-08T12:01:01.022 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:01:01.023 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies Resolved 2019-12-08T12:01:01.024 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:01:01.024 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2019-12-08T12:01:01.024 INFO:teuthology.orchestra.run.smithi079.stdout: Package Arch Version Repository 2019-12-08T12:01:01.024 INFO:teuthology.orchestra.run.smithi079.stdout: Size 2019-12-08T12:01:01.025 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2019-12-08T12:01:01.025 INFO:teuthology.orchestra.run.smithi079.stdout:Installing: 2019-12-08T12:01:01.025 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-daemon x86_64 2:15.0.0-7900.g1351c81.el7 ceph 17 k 2019-12-08T12:01:01.025 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:01:01.026 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction Summary 2019-12-08T12:01:01.026 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2019-12-08T12:01:01.026 INFO:teuthology.orchestra.run.smithi079.stdout:Install 1 Package 2019-12-08T12:01:01.026 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:01:01.026 INFO:teuthology.orchestra.run.smithi079.stdout:Total download size: 17 k 2019-12-08T12:01:01.027 INFO:teuthology.orchestra.run.smithi079.stdout:Installed size: 68 k 2019-12-08T12:01:01.027 INFO:teuthology.orchestra.run.smithi079.stdout:Downloading packages: 2019-12-08T12:01:01.305 INFO:teuthology.orchestra.run.smithi013.stdout: Verifying : python-paste-1.7.5.1-9.20111221hg1498.el7.noarch 15/22 2019-12-08T12:01:01.344 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction check 2019-12-08T12:01:01.352 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction test 2019-12-08T12:01:01.353 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction test succeeded 2019-12-08T12:01:01.353 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction 2019-12-08T12:01:01.405 INFO:teuthology.orchestra.run.smithi013.stdout: Verifying : python-webob-1.2.3-7.el7.noarch 16/22 2019-12-08T12:01:01.556 INFO:teuthology.orchestra.run.smithi013.stdout: Verifying : python-werkzeug-0.9.1-2.el7.noarch 17/22 2019-12-08T12:01:01.673 INFO:teuthology.orchestra.run.smithi013.stdout: Verifying : python-mako-0.8.1-2.el7.noarch 18/22 2019-12-08T12:01:01.790 INFO:teuthology.orchestra.run.smithi013.stdout: Verifying : python-cherrypy-3.2.2-4.el7.noarch 19/22 2019-12-08T12:01:01.941 INFO:teuthology.orchestra.run.smithi013.stdout: Verifying : python-beaker-1.5.4-10.el7.noarch 20/22 2019-12-08T12:01:02.075 INFO:teuthology.orchestra.run.smithi013.stdout: Verifying : python-tempita-0.5.1-6.el7.noarch 21/22 2019-12-08T12:01:02.237 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : 2:ceph-daemon-15.0.0-7900.g1351c81.el7.x86_64 1/1 2019-12-08T12:01:02.611 INFO:teuthology.orchestra.run.smithi013.stdout: Verifying : python-webtest-1.3.4-6.el7.noarch 22/22 2019-12-08T12:01:02.611 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T12:01:02.611 INFO:teuthology.orchestra.run.smithi013.stdout:Installed: 2019-12-08T12:01:02.611 INFO:teuthology.orchestra.run.smithi013.stdout: ceph.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-08T12:01:02.611 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T12:01:02.612 INFO:teuthology.orchestra.run.smithi013.stdout:Dependency Installed: 2019-12-08T12:01:02.612 INFO:teuthology.orchestra.run.smithi013.stdout: ceph-mds.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-08T12:01:02.612 INFO:teuthology.orchestra.run.smithi013.stdout: ceph-mgr.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-08T12:01:02.612 INFO:teuthology.orchestra.run.smithi013.stdout: ceph-mon.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-08T12:01:02.612 INFO:teuthology.orchestra.run.smithi013.stdout: ceph-osd.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-08T12:01:02.612 INFO:teuthology.orchestra.run.smithi013.stdout: pyOpenSSL.x86_64 0:0.13.1-4.el7 2019-12-08T12:01:02.612 INFO:teuthology.orchestra.run.smithi013.stdout: python-beaker.noarch 0:1.5.4-10.el7 2019-12-08T12:01:02.613 INFO:teuthology.orchestra.run.smithi013.stdout: python-cherrypy.noarch 0:3.2.2-4.el7 2019-12-08T12:01:02.613 INFO:teuthology.orchestra.run.smithi013.stdout: python-mako.noarch 0:0.8.1-2.el7 2019-12-08T12:01:02.613 INFO:teuthology.orchestra.run.smithi013.stdout: python-markupsafe.x86_64 0:0.11-10.el7 2019-12-08T12:01:02.613 INFO:teuthology.orchestra.run.smithi013.stdout: python-paste.noarch 0:1.7.5.1-9.20111221hg1498.el7 2019-12-08T12:01:02.613 INFO:teuthology.orchestra.run.smithi013.stdout: python-pecan.noarch 0:0.4.5-2.el7 2019-12-08T12:01:02.613 INFO:teuthology.orchestra.run.smithi013.stdout: python-requests.noarch 0:2.6.0-7.el7_7 2019-12-08T12:01:02.613 INFO:teuthology.orchestra.run.smithi013.stdout: python-simplegeneric.noarch 0:0.8-7.el7 2019-12-08T12:01:02.614 INFO:teuthology.orchestra.run.smithi013.stdout: python-singledispatch.noarch 0:3.4.0.2-2.el7 2019-12-08T12:01:02.614 INFO:teuthology.orchestra.run.smithi013.stdout: python-tempita.noarch 0:0.5.1-6.el7 2019-12-08T12:01:02.614 INFO:teuthology.orchestra.run.smithi013.stdout: python-urllib3.noarch 0:1.10.2-7.el7 2019-12-08T12:01:02.614 INFO:teuthology.orchestra.run.smithi013.stdout: python-webob.noarch 0:1.2.3-7.el7 2019-12-08T12:01:02.614 INFO:teuthology.orchestra.run.smithi013.stdout: python-webtest.noarch 0:1.3.4-6.el7 2019-12-08T12:01:02.614 INFO:teuthology.orchestra.run.smithi013.stdout: python-werkzeug.noarch 0:0.9.1-2.el7 2019-12-08T12:01:02.614 INFO:teuthology.orchestra.run.smithi013.stdout: python2-bcrypt.x86_64 0:3.1.6-2.el7 2019-12-08T12:01:02.615 INFO:teuthology.orchestra.run.smithi013.stdout: python2-six.noarch 0:1.9.0-0.el7 2019-12-08T12:01:02.615 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T12:01:02.615 INFO:teuthology.orchestra.run.smithi013.stdout:Complete! 2019-12-08T12:01:02.723 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : 2:ceph-daemon-15.0.0-7900.g1351c81.el7.x86_64 1/1 2019-12-08T12:01:02.723 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:01:02.723 INFO:teuthology.orchestra.run.smithi079.stdout:Installed: 2019-12-08T12:01:02.723 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-daemon.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-08T12:01:02.723 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:01:02.723 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2019-12-08T12:01:02.729 INFO:teuthology.orchestra.run.smithi013:> sudo yum -y install ceph-daemon 2019-12-08T12:01:02.842 INFO:teuthology.orchestra.run.smithi079:> sudo yum -y install ceph-mgr 2019-12-08T12:01:02.998 INFO:teuthology.orchestra.run.smithi013.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-08T12:01:03.043 INFO:teuthology.orchestra.run.smithi013.stdout:Loading mirror speeds from cached hostfile 2019-12-08T12:01:03.044 INFO:teuthology.orchestra.run.smithi013.stdout: * base: mirrors.umflint.edu 2019-12-08T12:01:03.045 INFO:teuthology.orchestra.run.smithi013.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-08T12:01:03.045 INFO:teuthology.orchestra.run.smithi013.stdout: * extras: mirror.facebook.net 2019-12-08T12:01:03.045 INFO:teuthology.orchestra.run.smithi013.stdout: * updates: mirror.math.princeton.edu 2019-12-08T12:01:03.093 INFO:teuthology.orchestra.run.smithi079.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-08T12:01:03.136 INFO:teuthology.orchestra.run.smithi079.stdout:Loading mirror speeds from cached hostfile 2019-12-08T12:01:03.137 INFO:teuthology.orchestra.run.smithi079.stdout: * base: mirrors.umflint.edu 2019-12-08T12:01:03.138 INFO:teuthology.orchestra.run.smithi079.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-08T12:01:03.138 INFO:teuthology.orchestra.run.smithi079.stdout: * extras: mirror.facebook.net 2019-12-08T12:01:03.138 INFO:teuthology.orchestra.run.smithi079.stdout: * updates: mirror.math.princeton.edu 2019-12-08T12:01:03.716 INFO:teuthology.orchestra.run.smithi013.stdout:7 packages excluded due to repository priority protections 2019-12-08T12:01:03.786 INFO:teuthology.orchestra.run.smithi079.stdout:7 packages excluded due to repository priority protections 2019-12-08T12:01:04.065 INFO:teuthology.orchestra.run.smithi013.stdout:Resolving Dependencies 2019-12-08T12:01:04.066 INFO:teuthology.orchestra.run.smithi013.stdout:--> Running transaction check 2019-12-08T12:01:04.066 INFO:teuthology.orchestra.run.smithi013.stdout:---> Package ceph-daemon.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-08T12:01:04.118 INFO:teuthology.orchestra.run.smithi079.stdout:Package 2:ceph-mgr-15.0.0-7900.g1351c81.el7.x86_64 already installed and latest version 2019-12-08T12:01:04.119 INFO:teuthology.orchestra.run.smithi079.stdout:Nothing to do 2019-12-08T12:01:04.179 INFO:teuthology.orchestra.run.smithi079:> sudo yum -y install ceph-mgr-dashboard 2019-12-08T12:01:04.335 INFO:teuthology.orchestra.run.smithi079.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-08T12:01:04.369 INFO:teuthology.orchestra.run.smithi079.stdout:Loading mirror speeds from cached hostfile 2019-12-08T12:01:04.370 INFO:teuthology.orchestra.run.smithi079.stdout: * base: mirrors.umflint.edu 2019-12-08T12:01:04.371 INFO:teuthology.orchestra.run.smithi079.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-08T12:01:04.371 INFO:teuthology.orchestra.run.smithi079.stdout: * extras: mirror.facebook.net 2019-12-08T12:01:04.372 INFO:teuthology.orchestra.run.smithi079.stdout: * updates: mirror.math.princeton.edu 2019-12-08T12:01:04.451 INFO:teuthology.orchestra.run.smithi013.stdout:--> Finished Dependency Resolution 2019-12-08T12:01:04.681 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T12:01:04.681 INFO:teuthology.orchestra.run.smithi013.stdout:Dependencies Resolved 2019-12-08T12:01:04.682 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T12:01:04.682 INFO:teuthology.orchestra.run.smithi013.stdout:================================================================================ 2019-12-08T12:01:04.682 INFO:teuthology.orchestra.run.smithi013.stdout: Package Arch Version Repository 2019-12-08T12:01:04.682 INFO:teuthology.orchestra.run.smithi013.stdout: Size 2019-12-08T12:01:04.682 INFO:teuthology.orchestra.run.smithi013.stdout:================================================================================ 2019-12-08T12:01:04.682 INFO:teuthology.orchestra.run.smithi013.stdout:Installing: 2019-12-08T12:01:04.683 INFO:teuthology.orchestra.run.smithi013.stdout: ceph-daemon x86_64 2:15.0.0-7900.g1351c81.el7 ceph 17 k 2019-12-08T12:01:04.683 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T12:01:04.683 INFO:teuthology.orchestra.run.smithi013.stdout:Transaction Summary 2019-12-08T12:01:04.683 INFO:teuthology.orchestra.run.smithi013.stdout:================================================================================ 2019-12-08T12:01:04.683 INFO:teuthology.orchestra.run.smithi013.stdout:Install 1 Package 2019-12-08T12:01:04.684 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T12:01:04.684 INFO:teuthology.orchestra.run.smithi013.stdout:Total download size: 17 k 2019-12-08T12:01:04.684 INFO:teuthology.orchestra.run.smithi013.stdout:Installed size: 68 k 2019-12-08T12:01:04.684 INFO:teuthology.orchestra.run.smithi013.stdout:Downloading packages: 2019-12-08T12:01:04.957 INFO:teuthology.orchestra.run.smithi079.stdout:7 packages excluded due to repository priority protections 2019-12-08T12:01:04.973 INFO:teuthology.orchestra.run.smithi013.stdout:Running transaction check 2019-12-08T12:01:04.979 INFO:teuthology.orchestra.run.smithi013.stdout:Running transaction test 2019-12-08T12:01:04.980 INFO:teuthology.orchestra.run.smithi013.stdout:Transaction test succeeded 2019-12-08T12:01:04.981 INFO:teuthology.orchestra.run.smithi013.stdout:Running transaction 2019-12-08T12:01:05.281 INFO:teuthology.orchestra.run.smithi079.stdout:Resolving Dependencies 2019-12-08T12:01:05.281 INFO:teuthology.orchestra.run.smithi079.stdout:--> Running transaction check 2019-12-08T12:01:05.281 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package ceph-mgr-dashboard.noarch 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-08T12:01:05.284 INFO:teuthology.orchestra.run.smithi079.stdout:--> Processing Dependency: ceph-grafana-dashboards = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-mgr-dashboard-15.0.0-7900.g1351c81.el7.noarch 2019-12-08T12:01:05.314 INFO:teuthology.orchestra.run.smithi079.stdout:--> Processing Dependency: python-routes for package: 2:ceph-mgr-dashboard-15.0.0-7900.g1351c81.el7.noarch 2019-12-08T12:01:05.315 INFO:teuthology.orchestra.run.smithi079.stdout:--> Running transaction check 2019-12-08T12:01:05.315 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package ceph-grafana-dashboards.noarch 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-08T12:01:05.315 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package python-routes.noarch 0:1.13-2.el7 will be installed 2019-12-08T12:01:05.315 INFO:teuthology.orchestra.run.smithi079.stdout:--> Processing Dependency: python-repoze-lru for package: python-routes-1.13-2.el7.noarch 2019-12-08T12:01:05.316 INFO:teuthology.orchestra.run.smithi079.stdout:--> Running transaction check 2019-12-08T12:01:05.316 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package python-repoze-lru.noarch 0:0.4-3.el7 will be installed 2019-12-08T12:01:05.682 INFO:teuthology.orchestra.run.smithi079.stdout:--> Finished Dependency Resolution 2019-12-08T12:01:05.760 INFO:teuthology.orchestra.run.smithi013.stdout: Installing : 2:ceph-daemon-15.0.0-7900.g1351c81.el7.x86_64 1/1 2019-12-08T12:01:05.902 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:01:05.902 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies Resolved 2019-12-08T12:01:05.903 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:01:05.903 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2019-12-08T12:01:05.903 INFO:teuthology.orchestra.run.smithi079.stdout: Package Arch Version Repository Size 2019-12-08T12:01:05.903 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2019-12-08T12:01:05.903 INFO:teuthology.orchestra.run.smithi079.stdout:Installing: 2019-12-08T12:01:05.904 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-dashboard noarch 2:15.0.0-7900.g1351c81.el7 ceph-noarch 3.9 M 2019-12-08T12:01:05.904 INFO:teuthology.orchestra.run.smithi079.stdout:Installing for dependencies: 2019-12-08T12:01:05.904 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-grafana-dashboards noarch 2:15.0.0-7900.g1351c81.el7 ceph-noarch 18 k 2019-12-08T12:01:05.904 INFO:teuthology.orchestra.run.smithi079.stdout: python-repoze-lru noarch 0.4-3.el7 epel 13 k 2019-12-08T12:01:05.904 INFO:teuthology.orchestra.run.smithi079.stdout: python-routes noarch 1.13-2.el7 epel 640 k 2019-12-08T12:01:05.904 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:01:05.904 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction Summary 2019-12-08T12:01:05.904 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2019-12-08T12:01:05.905 INFO:teuthology.orchestra.run.smithi079.stdout:Install 1 Package (+3 Dependent packages) 2019-12-08T12:01:05.905 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:01:05.905 INFO:teuthology.orchestra.run.smithi079.stdout:Total download size: 4.6 M 2019-12-08T12:01:05.905 INFO:teuthology.orchestra.run.smithi079.stdout:Installed size: 20 M 2019-12-08T12:01:05.905 INFO:teuthology.orchestra.run.smithi079.stdout:Downloading packages: 2019-12-08T12:01:06.273 INFO:teuthology.orchestra.run.smithi013.stdout: Verifying : 2:ceph-daemon-15.0.0-7900.g1351c81.el7.x86_64 1/1 2019-12-08T12:01:06.274 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T12:01:06.274 INFO:teuthology.orchestra.run.smithi013.stdout:Installed: 2019-12-08T12:01:06.274 INFO:teuthology.orchestra.run.smithi013.stdout: ceph-daemon.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-08T12:01:06.274 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T12:01:06.274 INFO:teuthology.orchestra.run.smithi013.stdout:Complete! 2019-12-08T12:01:06.392 INFO:teuthology.orchestra.run.smithi013:> sudo yum -y install ceph-mgr 2019-12-08T12:01:06.686 INFO:teuthology.orchestra.run.smithi013.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-08T12:01:06.734 INFO:teuthology.orchestra.run.smithi013.stdout:Loading mirror speeds from cached hostfile 2019-12-08T12:01:06.734 INFO:teuthology.orchestra.run.smithi013.stdout: * base: mirrors.umflint.edu 2019-12-08T12:01:06.735 INFO:teuthology.orchestra.run.smithi013.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-08T12:01:06.735 INFO:teuthology.orchestra.run.smithi013.stdout: * extras: mirror.facebook.net 2019-12-08T12:01:06.735 INFO:teuthology.orchestra.run.smithi013.stdout: * updates: mirror.math.princeton.edu 2019-12-08T12:01:06.742 INFO:teuthology.orchestra.run.smithi079.stdout:-------------------------------------------------------------------------------- 2019-12-08T12:01:06.742 INFO:teuthology.orchestra.run.smithi079.stdout:Total 5.4 MB/s | 4.6 MB 00:00 2019-12-08T12:01:06.750 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction check 2019-12-08T12:01:06.759 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction test 2019-12-08T12:01:06.921 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction test succeeded 2019-12-08T12:01:06.921 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction 2019-12-08T12:01:07.419 INFO:teuthology.orchestra.run.smithi013.stdout:7 packages excluded due to repository priority protections 2019-12-08T12:01:07.584 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : 2:ceph-grafana-dashboards-15.0.0-7900.g1351c81.el7.noarch 1/4 2019-12-08T12:01:07.772 INFO:teuthology.orchestra.run.smithi013.stdout:Package 2:ceph-mgr-15.0.0-7900.g1351c81.el7.x86_64 already installed and latest version 2019-12-08T12:01:07.772 INFO:teuthology.orchestra.run.smithi013.stdout:Nothing to do 2019-12-08T12:01:07.834 INFO:teuthology.orchestra.run.smithi013:> sudo yum -y install ceph-mgr-dashboard 2019-12-08T12:01:08.002 INFO:teuthology.orchestra.run.smithi013.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-08T12:01:08.029 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python-repoze-lru-0.4-3.el7.noarch 2/4 2019-12-08T12:01:08.040 INFO:teuthology.orchestra.run.smithi013.stdout:Loading mirror speeds from cached hostfile 2019-12-08T12:01:08.043 INFO:teuthology.orchestra.run.smithi013.stdout: * base: mirrors.umflint.edu 2019-12-08T12:01:08.044 INFO:teuthology.orchestra.run.smithi013.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-08T12:01:08.044 INFO:teuthology.orchestra.run.smithi013.stdout: * extras: mirror.facebook.net 2019-12-08T12:01:08.044 INFO:teuthology.orchestra.run.smithi013.stdout: * updates: mirror.math.princeton.edu 2019-12-08T12:01:08.689 INFO:teuthology.orchestra.run.smithi013.stdout:7 packages excluded due to repository priority protections 2019-12-08T12:01:09.030 INFO:teuthology.orchestra.run.smithi013.stdout:Resolving Dependencies 2019-12-08T12:01:09.030 INFO:teuthology.orchestra.run.smithi013.stdout:--> Running transaction check 2019-12-08T12:01:09.030 INFO:teuthology.orchestra.run.smithi013.stdout:---> Package ceph-mgr-dashboard.noarch 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-08T12:01:09.036 INFO:teuthology.orchestra.run.smithi013.stdout:--> Processing Dependency: ceph-grafana-dashboards = 2:15.0.0-7900.g1351c81.el7 for package: 2:ceph-mgr-dashboard-15.0.0-7900.g1351c81.el7.noarch 2019-12-08T12:01:09.064 INFO:teuthology.orchestra.run.smithi013.stdout:--> Processing Dependency: python-routes for package: 2:ceph-mgr-dashboard-15.0.0-7900.g1351c81.el7.noarch 2019-12-08T12:01:09.065 INFO:teuthology.orchestra.run.smithi013.stdout:--> Running transaction check 2019-12-08T12:01:09.065 INFO:teuthology.orchestra.run.smithi013.stdout:---> Package ceph-grafana-dashboards.noarch 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-08T12:01:09.066 INFO:teuthology.orchestra.run.smithi013.stdout:---> Package python-routes.noarch 0:1.13-2.el7 will be installed 2019-12-08T12:01:09.066 INFO:teuthology.orchestra.run.smithi013.stdout:--> Processing Dependency: python-repoze-lru for package: python-routes-1.13-2.el7.noarch 2019-12-08T12:01:09.067 INFO:teuthology.orchestra.run.smithi013.stdout:--> Running transaction check 2019-12-08T12:01:09.067 INFO:teuthology.orchestra.run.smithi013.stdout:---> Package python-repoze-lru.noarch 0:0.4-3.el7 will be installed 2019-12-08T12:01:09.210 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python-routes-1.13-2.el7.noarch 3/4 2019-12-08T12:01:09.449 INFO:teuthology.orchestra.run.smithi013.stdout:--> Finished Dependency Resolution 2019-12-08T12:01:09.678 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T12:01:09.678 INFO:teuthology.orchestra.run.smithi013.stdout:Dependencies Resolved 2019-12-08T12:01:09.679 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T12:01:09.679 INFO:teuthology.orchestra.run.smithi013.stdout:================================================================================ 2019-12-08T12:01:09.679 INFO:teuthology.orchestra.run.smithi013.stdout: Package Arch Version Repository Size 2019-12-08T12:01:09.680 INFO:teuthology.orchestra.run.smithi013.stdout:================================================================================ 2019-12-08T12:01:09.680 INFO:teuthology.orchestra.run.smithi013.stdout:Installing: 2019-12-08T12:01:09.680 INFO:teuthology.orchestra.run.smithi013.stdout: ceph-mgr-dashboard noarch 2:15.0.0-7900.g1351c81.el7 ceph-noarch 3.9 M 2019-12-08T12:01:09.680 INFO:teuthology.orchestra.run.smithi013.stdout:Installing for dependencies: 2019-12-08T12:01:09.680 INFO:teuthology.orchestra.run.smithi013.stdout: ceph-grafana-dashboards noarch 2:15.0.0-7900.g1351c81.el7 ceph-noarch 18 k 2019-12-08T12:01:09.680 INFO:teuthology.orchestra.run.smithi013.stdout: python-repoze-lru noarch 0.4-3.el7 epel 13 k 2019-12-08T12:01:09.680 INFO:teuthology.orchestra.run.smithi013.stdout: python-routes noarch 1.13-2.el7 epel 640 k 2019-12-08T12:01:09.681 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T12:01:09.681 INFO:teuthology.orchestra.run.smithi013.stdout:Transaction Summary 2019-12-08T12:01:09.681 INFO:teuthology.orchestra.run.smithi013.stdout:================================================================================ 2019-12-08T12:01:09.681 INFO:teuthology.orchestra.run.smithi013.stdout:Install 1 Package (+3 Dependent packages) 2019-12-08T12:01:09.681 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T12:01:09.681 INFO:teuthology.orchestra.run.smithi013.stdout:Total download size: 4.6 M 2019-12-08T12:01:09.681 INFO:teuthology.orchestra.run.smithi013.stdout:Installed size: 20 M 2019-12-08T12:01:09.682 INFO:teuthology.orchestra.run.smithi013.stdout:Downloading packages: 2019-12-08T12:01:10.316 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : 2:ceph-mgr-dashboard-15.0.0-7900.g1351c81.el7.noarch 4/4 2019-12-08T12:01:10.460 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python-repoze-lru-0.4-3.el7.noarch 1/4 2019-12-08T12:01:10.507 INFO:teuthology.orchestra.run.smithi013.stdout:-------------------------------------------------------------------------------- 2019-12-08T12:01:10.508 INFO:teuthology.orchestra.run.smithi013.stdout:Total 5.5 MB/s | 4.6 MB 00:00 2019-12-08T12:01:10.513 INFO:teuthology.orchestra.run.smithi013.stdout:Running transaction check 2019-12-08T12:01:10.523 INFO:teuthology.orchestra.run.smithi013.stdout:Running transaction test 2019-12-08T12:01:10.602 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : 2:ceph-mgr-dashboard-15.0.0-7900.g1351c81.el7.noarch 2/4 2019-12-08T12:01:10.705 INFO:teuthology.orchestra.run.smithi013.stdout:Transaction test succeeded 2019-12-08T12:01:10.705 INFO:teuthology.orchestra.run.smithi013.stdout:Running transaction 2019-12-08T12:01:10.719 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : 2:ceph-grafana-dashboards-15.0.0-7900.g1351c81.el7.noarch 3/4 2019-12-08T12:01:11.221 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python-routes-1.13-2.el7.noarch 4/4 2019-12-08T12:01:11.221 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:01:11.222 INFO:teuthology.orchestra.run.smithi079.stdout:Installed: 2019-12-08T12:01:11.222 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-dashboard.noarch 2:15.0.0-7900.g1351c81.el7 2019-12-08T12:01:11.222 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:01:11.222 INFO:teuthology.orchestra.run.smithi079.stdout:Dependency Installed: 2019-12-08T12:01:11.222 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-grafana-dashboards.noarch 2:15.0.0-7900.g1351c81.el7 2019-12-08T12:01:11.222 INFO:teuthology.orchestra.run.smithi079.stdout: python-repoze-lru.noarch 0:0.4-3.el7 2019-12-08T12:01:11.222 INFO:teuthology.orchestra.run.smithi079.stdout: python-routes.noarch 0:1.13-2.el7 2019-12-08T12:01:11.223 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:01:11.223 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2019-12-08T12:01:11.355 INFO:teuthology.orchestra.run.smithi079:> sudo yum -y install ceph-mgr-diskprediction-cloud 2019-12-08T12:01:11.616 INFO:teuthology.orchestra.run.smithi079.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-08T12:01:11.657 INFO:teuthology.orchestra.run.smithi079.stdout:Loading mirror speeds from cached hostfile 2019-12-08T12:01:11.658 INFO:teuthology.orchestra.run.smithi079.stdout: * base: mirrors.umflint.edu 2019-12-08T12:01:11.660 INFO:teuthology.orchestra.run.smithi079.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-08T12:01:11.660 INFO:teuthology.orchestra.run.smithi079.stdout: * extras: mirror.facebook.net 2019-12-08T12:01:11.660 INFO:teuthology.orchestra.run.smithi079.stdout: * updates: mirror.math.princeton.edu 2019-12-08T12:01:12.081 INFO:teuthology.orchestra.run.smithi013.stdout: Installing : 2:ceph-grafana-dashboards-15.0.0-7900.g1351c81.el7.noarch 1/4 2019-12-08T12:01:12.305 INFO:teuthology.orchestra.run.smithi079.stdout:7 packages excluded due to repository priority protections 2019-12-08T12:01:12.514 INFO:teuthology.orchestra.run.smithi013.stdout: Installing : python-repoze-lru-0.4-3.el7.noarch 2/4 2019-12-08T12:01:12.639 INFO:teuthology.orchestra.run.smithi079.stdout:Resolving Dependencies 2019-12-08T12:01:12.640 INFO:teuthology.orchestra.run.smithi079.stdout:--> Running transaction check 2019-12-08T12:01:12.640 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package ceph-mgr-diskprediction-cloud.noarch 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-08T12:01:13.004 INFO:teuthology.orchestra.run.smithi079.stdout:--> Finished Dependency Resolution 2019-12-08T12:01:13.226 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:01:13.226 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies Resolved 2019-12-08T12:01:13.227 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:01:13.227 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2019-12-08T12:01:13.227 INFO:teuthology.orchestra.run.smithi079.stdout: Package Arch Version Repository Size 2019-12-08T12:01:13.228 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2019-12-08T12:01:13.228 INFO:teuthology.orchestra.run.smithi079.stdout:Installing: 2019-12-08T12:01:13.228 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-diskprediction-cloud 2019-12-08T12:01:13.228 INFO:teuthology.orchestra.run.smithi079.stdout: noarch 2:15.0.0-7900.g1351c81.el7 ceph-noarch 82 k 2019-12-08T12:01:13.228 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:01:13.228 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction Summary 2019-12-08T12:01:13.229 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2019-12-08T12:01:13.229 INFO:teuthology.orchestra.run.smithi079.stdout:Install 1 Package 2019-12-08T12:01:13.229 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:01:13.229 INFO:teuthology.orchestra.run.smithi079.stdout:Total download size: 82 k 2019-12-08T12:01:13.229 INFO:teuthology.orchestra.run.smithi079.stdout:Installed size: 411 k 2019-12-08T12:01:13.229 INFO:teuthology.orchestra.run.smithi079.stdout:Downloading packages: 2019-12-08T12:01:13.532 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction check 2019-12-08T12:01:13.536 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction test 2019-12-08T12:01:13.592 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction test succeeded 2019-12-08T12:01:13.592 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction 2019-12-08T12:01:13.748 INFO:teuthology.orchestra.run.smithi013.stdout: Installing : python-routes-1.13-2.el7.noarch 3/4 2019-12-08T12:01:14.177 INFO:teuthology.orchestra.run.smithi013.stdout: Installing : 2:ceph-mgr-dashboard-15.0.0-7900.g1351c81.el7.noarch 4/4 2019-12-08T12:01:14.256 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : 2:ceph-mgr-diskprediction-cloud-15.0.0-7900.g1351c81.el7.n 1/1 2019-12-08T12:01:14.295 INFO:teuthology.orchestra.run.smithi013.stdout: Verifying : python-repoze-lru-0.4-3.el7.noarch 1/4 2019-12-08T12:01:14.462 INFO:teuthology.orchestra.run.smithi013.stdout: Verifying : 2:ceph-mgr-dashboard-15.0.0-7900.g1351c81.el7.noarch 2/4 2019-12-08T12:01:14.563 INFO:teuthology.orchestra.run.smithi013.stdout: Verifying : 2:ceph-grafana-dashboards-15.0.0-7900.g1351c81.el7.noarch 3/4 2019-12-08T12:01:14.691 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : 2:ceph-mgr-diskprediction-cloud-15.0.0-7900.g1351c81.el7.n 1/1 2019-12-08T12:01:14.691 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:01:14.691 INFO:teuthology.orchestra.run.smithi079.stdout:Installed: 2019-12-08T12:01:14.691 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-diskprediction-cloud.noarch 2:15.0.0-7900.g1351c81.el7 2019-12-08T12:01:14.691 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:01:14.691 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2019-12-08T12:01:14.816 INFO:teuthology.orchestra.run.smithi079:> sudo yum -y install ceph-mgr-diskprediction-local 2019-12-08T12:01:15.082 INFO:teuthology.orchestra.run.smithi079.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-08T12:01:15.089 INFO:teuthology.orchestra.run.smithi013.stdout: Verifying : python-routes-1.13-2.el7.noarch 4/4 2019-12-08T12:01:15.089 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T12:01:15.089 INFO:teuthology.orchestra.run.smithi013.stdout:Installed: 2019-12-08T12:01:15.090 INFO:teuthology.orchestra.run.smithi013.stdout: ceph-mgr-dashboard.noarch 2:15.0.0-7900.g1351c81.el7 2019-12-08T12:01:15.090 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T12:01:15.090 INFO:teuthology.orchestra.run.smithi013.stdout:Dependency Installed: 2019-12-08T12:01:15.090 INFO:teuthology.orchestra.run.smithi013.stdout: ceph-grafana-dashboards.noarch 2:15.0.0-7900.g1351c81.el7 2019-12-08T12:01:15.090 INFO:teuthology.orchestra.run.smithi013.stdout: python-repoze-lru.noarch 0:0.4-3.el7 2019-12-08T12:01:15.090 INFO:teuthology.orchestra.run.smithi013.stdout: python-routes.noarch 0:1.13-2.el7 2019-12-08T12:01:15.090 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T12:01:15.090 INFO:teuthology.orchestra.run.smithi013.stdout:Complete! 2019-12-08T12:01:15.126 INFO:teuthology.orchestra.run.smithi079.stdout:Loading mirror speeds from cached hostfile 2019-12-08T12:01:15.127 INFO:teuthology.orchestra.run.smithi079.stdout: * base: mirrors.umflint.edu 2019-12-08T12:01:15.128 INFO:teuthology.orchestra.run.smithi079.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-08T12:01:15.128 INFO:teuthology.orchestra.run.smithi079.stdout: * extras: mirror.facebook.net 2019-12-08T12:01:15.129 INFO:teuthology.orchestra.run.smithi079.stdout: * updates: mirror.math.princeton.edu 2019-12-08T12:01:15.203 INFO:teuthology.orchestra.run.smithi013:> sudo yum -y install ceph-mgr-diskprediction-cloud 2019-12-08T12:01:15.483 INFO:teuthology.orchestra.run.smithi013.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-08T12:01:15.530 INFO:teuthology.orchestra.run.smithi013.stdout:Loading mirror speeds from cached hostfile 2019-12-08T12:01:15.531 INFO:teuthology.orchestra.run.smithi013.stdout: * base: mirrors.umflint.edu 2019-12-08T12:01:15.532 INFO:teuthology.orchestra.run.smithi013.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-08T12:01:15.532 INFO:teuthology.orchestra.run.smithi013.stdout: * extras: mirror.facebook.net 2019-12-08T12:01:15.532 INFO:teuthology.orchestra.run.smithi013.stdout: * updates: mirror.math.princeton.edu 2019-12-08T12:01:15.773 INFO:teuthology.orchestra.run.smithi079.stdout:7 packages excluded due to repository priority protections 2019-12-08T12:01:16.110 INFO:teuthology.orchestra.run.smithi079.stdout:Resolving Dependencies 2019-12-08T12:01:16.110 INFO:teuthology.orchestra.run.smithi079.stdout:--> Running transaction check 2019-12-08T12:01:16.110 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package ceph-mgr-diskprediction-local.noarch 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-08T12:01:16.112 INFO:teuthology.orchestra.run.smithi079.stdout:--> Processing Dependency: scipy for package: 2:ceph-mgr-diskprediction-local-15.0.0-7900.g1351c81.el7.noarch 2019-12-08T12:01:16.142 INFO:teuthology.orchestra.run.smithi079.stdout:--> Running transaction check 2019-12-08T12:01:16.142 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package scipy.x86_64 0:0.12.1-6.el7 will be installed 2019-12-08T12:01:16.149 INFO:teuthology.orchestra.run.smithi079.stdout:--> Processing Dependency: f2py for package: scipy-0.12.1-6.el7.x86_64 2019-12-08T12:01:16.150 INFO:teuthology.orchestra.run.smithi079.stdout:--> Processing Dependency: libumfpack.so.5()(64bit) for package: scipy-0.12.1-6.el7.x86_64 2019-12-08T12:01:16.152 INFO:teuthology.orchestra.run.smithi079.stdout:--> Processing Dependency: libamd.so.2()(64bit) for package: scipy-0.12.1-6.el7.x86_64 2019-12-08T12:01:16.152 INFO:teuthology.orchestra.run.smithi079.stdout:--> Running transaction check 2019-12-08T12:01:16.152 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package numpy-f2py.x86_64 1:1.7.1-13.el7 will be installed 2019-12-08T12:01:16.153 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package suitesparse.x86_64 0:4.0.2-10.el7 will be installed 2019-12-08T12:01:16.154 INFO:teuthology.orchestra.run.smithi079.stdout:--> Processing Dependency: libtbbmalloc.so.2()(64bit) for package: suitesparse-4.0.2-10.el7.x86_64 2019-12-08T12:01:16.156 INFO:teuthology.orchestra.run.smithi079.stdout:--> Processing Dependency: libtbb.so.2()(64bit) for package: suitesparse-4.0.2-10.el7.x86_64 2019-12-08T12:01:16.157 INFO:teuthology.orchestra.run.smithi079.stdout:--> Running transaction check 2019-12-08T12:01:16.157 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package tbb.x86_64 0:4.1-9.20130314.el7 will be installed 2019-12-08T12:01:16.222 INFO:teuthology.orchestra.run.smithi013.stdout:7 packages excluded due to repository priority protections 2019-12-08T12:01:16.520 INFO:teuthology.orchestra.run.smithi079.stdout:--> Finished Dependency Resolution 2019-12-08T12:01:16.593 INFO:teuthology.orchestra.run.smithi013.stdout:Resolving Dependencies 2019-12-08T12:01:16.593 INFO:teuthology.orchestra.run.smithi013.stdout:--> Running transaction check 2019-12-08T12:01:16.594 INFO:teuthology.orchestra.run.smithi013.stdout:---> Package ceph-mgr-diskprediction-cloud.noarch 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-08T12:01:16.742 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:01:16.742 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies Resolved 2019-12-08T12:01:16.743 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:01:16.743 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2019-12-08T12:01:16.744 INFO:teuthology.orchestra.run.smithi079.stdout: Package Arch Version Repository Size 2019-12-08T12:01:16.744 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2019-12-08T12:01:16.744 INFO:teuthology.orchestra.run.smithi079.stdout:Installing: 2019-12-08T12:01:16.744 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-diskprediction-local 2019-12-08T12:01:16.744 INFO:teuthology.orchestra.run.smithi079.stdout: noarch 2:15.0.0-7900.g1351c81.el7 ceph-noarch 8.6 M 2019-12-08T12:01:16.744 INFO:teuthology.orchestra.run.smithi079.stdout:Installing for dependencies: 2019-12-08T12:01:16.745 INFO:teuthology.orchestra.run.smithi079.stdout: numpy-f2py x86_64 1:1.7.1-13.el7 base 206 k 2019-12-08T12:01:16.745 INFO:teuthology.orchestra.run.smithi079.stdout: scipy x86_64 0.12.1-6.el7 base 9.3 M 2019-12-08T12:01:16.745 INFO:teuthology.orchestra.run.smithi079.stdout: suitesparse x86_64 4.0.2-10.el7 base 928 k 2019-12-08T12:01:16.745 INFO:teuthology.orchestra.run.smithi079.stdout: tbb x86_64 4.1-9.20130314.el7 base 124 k 2019-12-08T12:01:16.745 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:01:16.745 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction Summary 2019-12-08T12:01:16.745 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2019-12-08T12:01:16.746 INFO:teuthology.orchestra.run.smithi079.stdout:Install 1 Package (+4 Dependent packages) 2019-12-08T12:01:16.746 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:01:16.746 INFO:teuthology.orchestra.run.smithi079.stdout:Total download size: 19 M 2019-12-08T12:01:16.746 INFO:teuthology.orchestra.run.smithi079.stdout:Installed size: 104 M 2019-12-08T12:01:16.746 INFO:teuthology.orchestra.run.smithi079.stdout:Downloading packages: 2019-12-08T12:01:16.980 INFO:teuthology.orchestra.run.smithi013.stdout:--> Finished Dependency Resolution 2019-12-08T12:01:17.212 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T12:01:17.212 INFO:teuthology.orchestra.run.smithi013.stdout:Dependencies Resolved 2019-12-08T12:01:17.213 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T12:01:17.213 INFO:teuthology.orchestra.run.smithi013.stdout:================================================================================ 2019-12-08T12:01:17.213 INFO:teuthology.orchestra.run.smithi013.stdout: Package Arch Version Repository Size 2019-12-08T12:01:17.213 INFO:teuthology.orchestra.run.smithi013.stdout:================================================================================ 2019-12-08T12:01:17.214 INFO:teuthology.orchestra.run.smithi013.stdout:Installing: 2019-12-08T12:01:17.214 INFO:teuthology.orchestra.run.smithi013.stdout: ceph-mgr-diskprediction-cloud 2019-12-08T12:01:17.214 INFO:teuthology.orchestra.run.smithi013.stdout: noarch 2:15.0.0-7900.g1351c81.el7 ceph-noarch 82 k 2019-12-08T12:01:17.214 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T12:01:17.214 INFO:teuthology.orchestra.run.smithi013.stdout:Transaction Summary 2019-12-08T12:01:17.214 INFO:teuthology.orchestra.run.smithi013.stdout:================================================================================ 2019-12-08T12:01:17.214 INFO:teuthology.orchestra.run.smithi013.stdout:Install 1 Package 2019-12-08T12:01:17.215 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T12:01:17.215 INFO:teuthology.orchestra.run.smithi013.stdout:Total download size: 82 k 2019-12-08T12:01:17.215 INFO:teuthology.orchestra.run.smithi013.stdout:Installed size: 411 k 2019-12-08T12:01:17.215 INFO:teuthology.orchestra.run.smithi013.stdout:Downloading packages: 2019-12-08T12:01:17.439 INFO:teuthology.orchestra.run.smithi079.stdout:-------------------------------------------------------------------------------- 2019-12-08T12:01:17.439 INFO:teuthology.orchestra.run.smithi079.stdout:Total 28 MB/s | 19 MB 00:00 2019-12-08T12:01:17.449 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction check 2019-12-08T12:01:17.476 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction test 2019-12-08T12:01:17.549 INFO:teuthology.orchestra.run.smithi013.stdout:Running transaction check 2019-12-08T12:01:17.552 INFO:teuthology.orchestra.run.smithi013.stdout:Running transaction test 2019-12-08T12:01:17.599 INFO:teuthology.orchestra.run.smithi013.stdout:Transaction test succeeded 2019-12-08T12:01:17.599 INFO:teuthology.orchestra.run.smithi013.stdout:Running transaction 2019-12-08T12:01:17.621 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction test succeeded 2019-12-08T12:01:17.622 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction 2019-12-08T12:01:18.330 INFO:teuthology.orchestra.run.smithi013.stdout: Installing : 2:ceph-mgr-diskprediction-cloud-15.0.0-7900.g1351c81.el7.n 1/1 2019-12-08T12:01:18.515 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : tbb-4.1-9.20130314.el7.x86_64 1/5 2019-12-08T12:01:18.877 INFO:teuthology.orchestra.run.smithi013.stdout: Verifying : 2:ceph-mgr-diskprediction-cloud-15.0.0-7900.g1351c81.el7.n 1/1 2019-12-08T12:01:18.877 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T12:01:18.877 INFO:teuthology.orchestra.run.smithi013.stdout:Installed: 2019-12-08T12:01:18.877 INFO:teuthology.orchestra.run.smithi013.stdout: ceph-mgr-diskprediction-cloud.noarch 2:15.0.0-7900.g1351c81.el7 2019-12-08T12:01:18.877 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T12:01:18.878 INFO:teuthology.orchestra.run.smithi013.stdout:Complete! 2019-12-08T12:01:18.981 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : suitesparse-4.0.2-10.el7.x86_64 2/5 2019-12-08T12:01:18.993 INFO:teuthology.orchestra.run.smithi013:> sudo yum -y install ceph-mgr-diskprediction-local 2019-12-08T12:01:19.233 INFO:teuthology.orchestra.run.smithi013.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-08T12:01:19.280 INFO:teuthology.orchestra.run.smithi013.stdout:Loading mirror speeds from cached hostfile 2019-12-08T12:01:19.281 INFO:teuthology.orchestra.run.smithi013.stdout: * base: mirrors.umflint.edu 2019-12-08T12:01:19.282 INFO:teuthology.orchestra.run.smithi013.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-08T12:01:19.282 INFO:teuthology.orchestra.run.smithi013.stdout: * extras: mirror.facebook.net 2019-12-08T12:01:19.282 INFO:teuthology.orchestra.run.smithi013.stdout: * updates: mirror.math.princeton.edu 2019-12-08T12:01:19.956 INFO:teuthology.orchestra.run.smithi013.stdout:7 packages excluded due to repository priority protections 2019-12-08T12:01:20.307 INFO:teuthology.orchestra.run.smithi013.stdout:Resolving Dependencies 2019-12-08T12:01:20.308 INFO:teuthology.orchestra.run.smithi013.stdout:--> Running transaction check 2019-12-08T12:01:20.308 INFO:teuthology.orchestra.run.smithi013.stdout:---> Package ceph-mgr-diskprediction-local.noarch 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-08T12:01:20.310 INFO:teuthology.orchestra.run.smithi013.stdout:--> Processing Dependency: scipy for package: 2:ceph-mgr-diskprediction-local-15.0.0-7900.g1351c81.el7.noarch 2019-12-08T12:01:20.342 INFO:teuthology.orchestra.run.smithi013.stdout:--> Running transaction check 2019-12-08T12:01:20.342 INFO:teuthology.orchestra.run.smithi013.stdout:---> Package scipy.x86_64 0:0.12.1-6.el7 will be installed 2019-12-08T12:01:20.349 INFO:teuthology.orchestra.run.smithi013.stdout:--> Processing Dependency: f2py for package: scipy-0.12.1-6.el7.x86_64 2019-12-08T12:01:20.350 INFO:teuthology.orchestra.run.smithi013.stdout:--> Processing Dependency: libumfpack.so.5()(64bit) for package: scipy-0.12.1-6.el7.x86_64 2019-12-08T12:01:20.353 INFO:teuthology.orchestra.run.smithi013.stdout:--> Processing Dependency: libamd.so.2()(64bit) for package: scipy-0.12.1-6.el7.x86_64 2019-12-08T12:01:20.353 INFO:teuthology.orchestra.run.smithi013.stdout:--> Running transaction check 2019-12-08T12:01:20.353 INFO:teuthology.orchestra.run.smithi013.stdout:---> Package numpy-f2py.x86_64 1:1.7.1-13.el7 will be installed 2019-12-08T12:01:20.354 INFO:teuthology.orchestra.run.smithi013.stdout:---> Package suitesparse.x86_64 0:4.0.2-10.el7 will be installed 2019-12-08T12:01:20.355 INFO:teuthology.orchestra.run.smithi013.stdout:--> Processing Dependency: libtbbmalloc.so.2()(64bit) for package: suitesparse-4.0.2-10.el7.x86_64 2019-12-08T12:01:20.357 INFO:teuthology.orchestra.run.smithi013.stdout:--> Processing Dependency: libtbb.so.2()(64bit) for package: suitesparse-4.0.2-10.el7.x86_64 2019-12-08T12:01:20.357 INFO:teuthology.orchestra.run.smithi013.stdout:--> Running transaction check 2019-12-08T12:01:20.357 INFO:teuthology.orchestra.run.smithi013.stdout:---> Package tbb.x86_64 0:4.1-9.20130314.el7 will be installed 2019-12-08T12:01:20.740 INFO:teuthology.orchestra.run.smithi013.stdout:--> Finished Dependency Resolution 2019-12-08T12:01:20.970 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T12:01:20.970 INFO:teuthology.orchestra.run.smithi013.stdout:Dependencies Resolved 2019-12-08T12:01:20.971 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T12:01:20.971 INFO:teuthology.orchestra.run.smithi013.stdout:================================================================================ 2019-12-08T12:01:20.971 INFO:teuthology.orchestra.run.smithi013.stdout: Package Arch Version Repository Size 2019-12-08T12:01:20.971 INFO:teuthology.orchestra.run.smithi013.stdout:================================================================================ 2019-12-08T12:01:20.971 INFO:teuthology.orchestra.run.smithi013.stdout:Installing: 2019-12-08T12:01:20.972 INFO:teuthology.orchestra.run.smithi013.stdout: ceph-mgr-diskprediction-local 2019-12-08T12:01:20.972 INFO:teuthology.orchestra.run.smithi013.stdout: noarch 2:15.0.0-7900.g1351c81.el7 ceph-noarch 8.6 M 2019-12-08T12:01:20.972 INFO:teuthology.orchestra.run.smithi013.stdout:Installing for dependencies: 2019-12-08T12:01:20.972 INFO:teuthology.orchestra.run.smithi013.stdout: numpy-f2py x86_64 1:1.7.1-13.el7 base 206 k 2019-12-08T12:01:20.973 INFO:teuthology.orchestra.run.smithi013.stdout: scipy x86_64 0.12.1-6.el7 base 9.3 M 2019-12-08T12:01:20.973 INFO:teuthology.orchestra.run.smithi013.stdout: suitesparse x86_64 4.0.2-10.el7 base 928 k 2019-12-08T12:01:20.973 INFO:teuthology.orchestra.run.smithi013.stdout: tbb x86_64 4.1-9.20130314.el7 base 124 k 2019-12-08T12:01:20.973 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T12:01:20.973 INFO:teuthology.orchestra.run.smithi013.stdout:Transaction Summary 2019-12-08T12:01:20.974 INFO:teuthology.orchestra.run.smithi013.stdout:================================================================================ 2019-12-08T12:01:20.974 INFO:teuthology.orchestra.run.smithi013.stdout:Install 1 Package (+4 Dependent packages) 2019-12-08T12:01:20.974 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T12:01:20.974 INFO:teuthology.orchestra.run.smithi013.stdout:Total download size: 19 M 2019-12-08T12:01:20.974 INFO:teuthology.orchestra.run.smithi013.stdout:Installed size: 104 M 2019-12-08T12:01:20.974 INFO:teuthology.orchestra.run.smithi013.stdout:Downloading packages: 2019-12-08T12:01:21.243 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : 1:numpy-f2py-1.7.1-13.el7.x86_64 3/5 2019-12-08T12:01:22.931 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : scipy-0.12.1-6.el7.x86_64 4/5 2019-12-08T12:01:22.960 INFO:teuthology.orchestra.run.smithi013.stdout:-------------------------------------------------------------------------------- 2019-12-08T12:01:22.960 INFO:teuthology.orchestra.run.smithi013.stdout:Total 9.6 MB/s | 19 MB 00:01 2019-12-08T12:01:22.977 INFO:teuthology.orchestra.run.smithi013.stdout:Running transaction check 2019-12-08T12:01:23.004 INFO:teuthology.orchestra.run.smithi013.stdout:Running transaction test 2019-12-08T12:01:23.140 INFO:teuthology.orchestra.run.smithi013.stdout:Transaction test succeeded 2019-12-08T12:01:23.140 INFO:teuthology.orchestra.run.smithi013.stdout:Running transaction 2019-12-08T12:01:23.201 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : 2:ceph-mgr-diskprediction-local-15.0.0-7900.g1351c81.el7.n 5/5 2019-12-08T12:01:23.321 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : suitesparse-4.0.2-10.el7.x86_64 1/5 2019-12-08T12:01:23.421 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : 2:ceph-mgr-diskprediction-local-15.0.0-7900.g1351c81.el7.n 2/5 2019-12-08T12:01:23.522 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : scipy-0.12.1-6.el7.x86_64 3/5 2019-12-08T12:01:23.606 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : 1:numpy-f2py-1.7.1-13.el7.x86_64 4/5 2019-12-08T12:01:24.071 INFO:teuthology.orchestra.run.smithi013.stdout: Installing : tbb-4.1-9.20130314.el7.x86_64 1/5 2019-12-08T12:01:24.075 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : tbb-4.1-9.20130314.el7.x86_64 5/5 2019-12-08T12:01:24.075 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:01:24.075 INFO:teuthology.orchestra.run.smithi079.stdout:Installed: 2019-12-08T12:01:24.075 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-diskprediction-local.noarch 2:15.0.0-7900.g1351c81.el7 2019-12-08T12:01:24.075 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:01:24.075 INFO:teuthology.orchestra.run.smithi079.stdout:Dependency Installed: 2019-12-08T12:01:24.076 INFO:teuthology.orchestra.run.smithi079.stdout: numpy-f2py.x86_64 1:1.7.1-13.el7 scipy.x86_64 0:0.12.1-6.el7 2019-12-08T12:01:24.076 INFO:teuthology.orchestra.run.smithi079.stdout: suitesparse.x86_64 0:4.0.2-10.el7 tbb.x86_64 0:4.1-9.20130314.el7 2019-12-08T12:01:24.076 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:01:24.076 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2019-12-08T12:01:24.208 INFO:teuthology.orchestra.run.smithi079:> sudo yum -y install ceph-mgr-rook 2019-12-08T12:01:24.413 INFO:teuthology.orchestra.run.smithi079.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-08T12:01:24.453 INFO:teuthology.orchestra.run.smithi079.stdout:Loading mirror speeds from cached hostfile 2019-12-08T12:01:24.454 INFO:teuthology.orchestra.run.smithi079.stdout: * base: mirrors.umflint.edu 2019-12-08T12:01:24.454 INFO:teuthology.orchestra.run.smithi079.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-08T12:01:24.454 INFO:teuthology.orchestra.run.smithi079.stdout: * extras: mirror.facebook.net 2019-12-08T12:01:24.455 INFO:teuthology.orchestra.run.smithi079.stdout: * updates: mirror.math.princeton.edu 2019-12-08T12:01:24.538 INFO:teuthology.orchestra.run.smithi013.stdout: Installing : suitesparse-4.0.2-10.el7.x86_64 2/5 2019-12-08T12:01:25.096 INFO:teuthology.orchestra.run.smithi079.stdout:7 packages excluded due to repository priority protections 2019-12-08T12:01:25.419 INFO:teuthology.orchestra.run.smithi079.stdout:Resolving Dependencies 2019-12-08T12:01:25.420 INFO:teuthology.orchestra.run.smithi079.stdout:--> Running transaction check 2019-12-08T12:01:25.420 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package ceph-mgr-rook.noarch 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-08T12:01:25.421 INFO:teuthology.orchestra.run.smithi079.stdout:--> Processing Dependency: python-kubernetes for package: 2:ceph-mgr-rook-15.0.0-7900.g1351c81.el7.noarch 2019-12-08T12:01:25.451 INFO:teuthology.orchestra.run.smithi079.stdout:--> Running transaction check 2019-12-08T12:01:25.452 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package python2-kubernetes.noarch 0:10.0.1-1.el7 will be installed 2019-12-08T12:01:25.454 INFO:teuthology.orchestra.run.smithi079.stdout:--> Processing Dependency: python-certifi for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-12-08T12:01:25.459 INFO:teuthology.orchestra.run.smithi079.stdout:--> Processing Dependency: python-google-auth for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-12-08T12:01:25.459 INFO:teuthology.orchestra.run.smithi079.stdout:--> Processing Dependency: python-requests-oauthlib for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-12-08T12:01:25.459 INFO:teuthology.orchestra.run.smithi079.stdout:--> Processing Dependency: python-websocket-client for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-12-08T12:01:25.460 INFO:teuthology.orchestra.run.smithi079.stdout:--> Running transaction check 2019-12-08T12:01:25.460 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package python-websocket-client.noarch 0:0.56.0-3.git3c25814.el7 will be installed 2019-12-08T12:01:25.460 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package python2-certifi.noarch 0:2018.10.15-5.el7 will be installed 2019-12-08T12:01:25.460 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package python2-google-auth.noarch 1:1.1.1-5.el7 will be installed 2019-12-08T12:01:25.460 INFO:teuthology.orchestra.run.smithi079.stdout:--> Processing Dependency: python-cachetools for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-12-08T12:01:25.461 INFO:teuthology.orchestra.run.smithi079.stdout:--> Processing Dependency: python2-pyasn1-modules for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-12-08T12:01:25.461 INFO:teuthology.orchestra.run.smithi079.stdout:--> Processing Dependency: python2-rsa for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-12-08T12:01:25.462 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package python2-requests-oauthlib.noarch 0:0.8.0-5.el7 will be installed 2019-12-08T12:01:25.462 INFO:teuthology.orchestra.run.smithi079.stdout:--> Processing Dependency: python2-oauthlib for package: python2-requests-oauthlib-0.8.0-5.el7.noarch 2019-12-08T12:01:25.463 INFO:teuthology.orchestra.run.smithi079.stdout:--> Running transaction check 2019-12-08T12:01:25.463 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package python-cachetools.noarch 0:1.0.3-1.el7 will be installed 2019-12-08T12:01:25.463 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package python2-oauthlib.noarch 0:2.0.1-8.el7 will be installed 2019-12-08T12:01:25.464 INFO:teuthology.orchestra.run.smithi079.stdout:--> Processing Dependency: python-jwcrypto for package: python2-oauthlib-2.0.1-8.el7.noarch 2019-12-08T12:01:25.467 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package python2-pyasn1-modules.noarch 0:0.1.9-7.el7 will be installed 2019-12-08T12:01:25.467 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package python2-rsa.noarch 0:3.4.1-1.el7 will be installed 2019-12-08T12:01:25.467 INFO:teuthology.orchestra.run.smithi079.stdout:--> Running transaction check 2019-12-08T12:01:25.468 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package python-jwcrypto.noarch 0:0.4.2-1.el7 will be installed 2019-12-08T12:01:25.828 INFO:teuthology.orchestra.run.smithi079.stdout:--> Finished Dependency Resolution 2019-12-08T12:01:26.059 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:01:26.059 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies Resolved 2019-12-08T12:01:26.059 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:01:26.059 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2019-12-08T12:01:26.059 INFO:teuthology.orchestra.run.smithi079.stdout: Package Arch Version Repository Size 2019-12-08T12:01:26.059 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2019-12-08T12:01:26.060 INFO:teuthology.orchestra.run.smithi079.stdout:Installing: 2019-12-08T12:01:26.060 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-rook noarch 2:15.0.0-7900.g1351c81.el7 ceph-noarch 23 k 2019-12-08T12:01:26.060 INFO:teuthology.orchestra.run.smithi079.stdout:Installing for dependencies: 2019-12-08T12:01:26.060 INFO:teuthology.orchestra.run.smithi079.stdout: python-cachetools noarch 1.0.3-1.el7 epel 22 k 2019-12-08T12:01:26.060 INFO:teuthology.orchestra.run.smithi079.stdout: python-jwcrypto noarch 0.4.2-1.el7 base 57 k 2019-12-08T12:01:26.060 INFO:teuthology.orchestra.run.smithi079.stdout: python-websocket-client noarch 0.56.0-3.git3c25814.el7 extras 66 k 2019-12-08T12:01:26.061 INFO:teuthology.orchestra.run.smithi079.stdout: python2-certifi noarch 2018.10.15-5.el7 epel 12 k 2019-12-08T12:01:26.061 INFO:teuthology.orchestra.run.smithi079.stdout: python2-google-auth noarch 1:1.1.1-5.el7 epel 76 k 2019-12-08T12:01:26.061 INFO:teuthology.orchestra.run.smithi079.stdout: python2-kubernetes noarch 10.0.1-1.el7 epel 1.1 M 2019-12-08T12:01:26.061 INFO:teuthology.orchestra.run.smithi079.stdout: python2-oauthlib noarch 2.0.1-8.el7 base 146 k 2019-12-08T12:01:26.061 INFO:teuthology.orchestra.run.smithi079.stdout: python2-pyasn1-modules noarch 0.1.9-7.el7 base 59 k 2019-12-08T12:01:26.061 INFO:teuthology.orchestra.run.smithi079.stdout: python2-requests-oauthlib noarch 0.8.0-5.el7 base 35 k 2019-12-08T12:01:26.061 INFO:teuthology.orchestra.run.smithi079.stdout: python2-rsa noarch 3.4.1-1.el7 epel 67 k 2019-12-08T12:01:26.062 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:01:26.062 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction Summary 2019-12-08T12:01:26.062 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2019-12-08T12:01:26.062 INFO:teuthology.orchestra.run.smithi079.stdout:Install 1 Package (+10 Dependent packages) 2019-12-08T12:01:26.062 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:01:26.062 INFO:teuthology.orchestra.run.smithi079.stdout:Total download size: 1.6 M 2019-12-08T12:01:26.062 INFO:teuthology.orchestra.run.smithi079.stdout:Installed size: 24 M 2019-12-08T12:01:26.062 INFO:teuthology.orchestra.run.smithi079.stdout:Downloading packages: 2019-12-08T12:01:26.333 INFO:teuthology.orchestra.run.smithi013.stdout: Installing : 1:numpy-f2py-1.7.1-13.el7.x86_64 3/5 2019-12-08T12:01:26.786 INFO:teuthology.orchestra.run.smithi079.stdout:-------------------------------------------------------------------------------- 2019-12-08T12:01:26.786 INFO:teuthology.orchestra.run.smithi079.stdout:Total 2.3 MB/s | 1.6 MB 00:00 2019-12-08T12:01:26.802 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction check 2019-12-08T12:01:26.814 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction test 2019-12-08T12:01:26.882 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction test succeeded 2019-12-08T12:01:26.883 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction 2019-12-08T12:01:27.598 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python-websocket-client-0.56.0-3.git3c25814.el7.noarch 1/11 2019-12-08T12:01:27.951 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python-jwcrypto-0.4.2-1.el7.noarch 2/11 2019-12-08T12:01:28.292 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python2-oauthlib-2.0.1-8.el7.noarch 3/11 2019-12-08T12:01:28.493 INFO:teuthology.orchestra.run.smithi013.stdout: Installing : scipy-0.12.1-6.el7.x86_64 4/5 2019-12-08T12:01:28.597 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python2-requests-oauthlib-0.8.0-5.el7.noarch 4/11 2019-12-08T12:01:28.771 INFO:teuthology.orchestra.run.smithi013.stdout: Installing : 2:ceph-mgr-diskprediction-local-15.0.0-7900.g1351c81.el7.n 5/5 2019-12-08T12:01:28.902 INFO:teuthology.orchestra.run.smithi013.stdout: Verifying : suitesparse-4.0.2-10.el7.x86_64 1/5 2019-12-08T12:01:28.929 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python2-certifi-2018.10.15-5.el7.noarch 5/11 2019-12-08T12:01:28.992 INFO:teuthology.orchestra.run.smithi013.stdout: Verifying : 2:ceph-mgr-diskprediction-local-15.0.0-7900.g1351c81.el7.n 2/5 2019-12-08T12:01:29.101 INFO:teuthology.orchestra.run.smithi013.stdout: Verifying : scipy-0.12.1-6.el7.x86_64 3/5 2019-12-08T12:01:29.234 INFO:teuthology.orchestra.run.smithi013.stdout: Verifying : 1:numpy-f2py-1.7.1-13.el7.x86_64 4/5 2019-12-08T12:01:29.310 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python-cachetools-1.0.3-1.el7.noarch 6/11 2019-12-08T12:01:29.703 INFO:teuthology.orchestra.run.smithi013.stdout: Verifying : tbb-4.1-9.20130314.el7.x86_64 5/5 2019-12-08T12:01:29.703 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T12:01:29.703 INFO:teuthology.orchestra.run.smithi013.stdout:Installed: 2019-12-08T12:01:29.703 INFO:teuthology.orchestra.run.smithi013.stdout: ceph-mgr-diskprediction-local.noarch 2:15.0.0-7900.g1351c81.el7 2019-12-08T12:01:29.703 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T12:01:29.703 INFO:teuthology.orchestra.run.smithi013.stdout:Dependency Installed: 2019-12-08T12:01:29.704 INFO:teuthology.orchestra.run.smithi013.stdout: numpy-f2py.x86_64 1:1.7.1-13.el7 scipy.x86_64 0:0.12.1-6.el7 2019-12-08T12:01:29.704 INFO:teuthology.orchestra.run.smithi013.stdout: suitesparse.x86_64 0:4.0.2-10.el7 tbb.x86_64 0:4.1-9.20130314.el7 2019-12-08T12:01:29.704 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T12:01:29.704 INFO:teuthology.orchestra.run.smithi013.stdout:Complete! 2019-12-08T12:01:29.833 INFO:teuthology.orchestra.run.smithi013:> sudo yum -y install ceph-mgr-rook 2019-12-08T12:01:29.835 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python2-rsa-3.4.1-1.el7.noarch 7/11 2019-12-08T12:01:30.088 INFO:teuthology.orchestra.run.smithi013.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-08T12:01:30.133 INFO:teuthology.orchestra.run.smithi013.stdout:Loading mirror speeds from cached hostfile 2019-12-08T12:01:30.134 INFO:teuthology.orchestra.run.smithi013.stdout: * base: mirrors.umflint.edu 2019-12-08T12:01:30.135 INFO:teuthology.orchestra.run.smithi013.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-08T12:01:30.135 INFO:teuthology.orchestra.run.smithi013.stdout: * extras: mirror.facebook.net 2019-12-08T12:01:30.135 INFO:teuthology.orchestra.run.smithi013.stdout: * updates: mirror.math.princeton.edu 2019-12-08T12:01:30.141 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python2-pyasn1-modules-0.1.9-7.el7.noarch 8/11 2019-12-08T12:01:30.818 INFO:teuthology.orchestra.run.smithi013.stdout:7 packages excluded due to repository priority protections 2019-12-08T12:01:31.167 INFO:teuthology.orchestra.run.smithi013.stdout:Resolving Dependencies 2019-12-08T12:01:31.167 INFO:teuthology.orchestra.run.smithi013.stdout:--> Running transaction check 2019-12-08T12:01:31.167 INFO:teuthology.orchestra.run.smithi013.stdout:---> Package ceph-mgr-rook.noarch 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-08T12:01:31.169 INFO:teuthology.orchestra.run.smithi013.stdout:--> Processing Dependency: python-kubernetes for package: 2:ceph-mgr-rook-15.0.0-7900.g1351c81.el7.noarch 2019-12-08T12:01:31.202 INFO:teuthology.orchestra.run.smithi013.stdout:--> Running transaction check 2019-12-08T12:01:31.202 INFO:teuthology.orchestra.run.smithi013.stdout:---> Package python2-kubernetes.noarch 0:10.0.1-1.el7 will be installed 2019-12-08T12:01:31.204 INFO:teuthology.orchestra.run.smithi013.stdout:--> Processing Dependency: python-certifi for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-12-08T12:01:31.205 INFO:teuthology.orchestra.run.smithi013.stdout:--> Processing Dependency: python-google-auth for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-12-08T12:01:31.206 INFO:teuthology.orchestra.run.smithi013.stdout:--> Processing Dependency: python-requests-oauthlib for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-12-08T12:01:31.207 INFO:teuthology.orchestra.run.smithi013.stdout:--> Processing Dependency: python-websocket-client for package: python2-kubernetes-10.0.1-1.el7.noarch 2019-12-08T12:01:31.208 INFO:teuthology.orchestra.run.smithi013.stdout:--> Running transaction check 2019-12-08T12:01:31.208 INFO:teuthology.orchestra.run.smithi013.stdout:---> Package python-websocket-client.noarch 0:0.56.0-3.git3c25814.el7 will be installed 2019-12-08T12:01:31.209 INFO:teuthology.orchestra.run.smithi013.stdout:---> Package python2-certifi.noarch 0:2018.10.15-5.el7 will be installed 2019-12-08T12:01:31.209 INFO:teuthology.orchestra.run.smithi013.stdout:---> Package python2-google-auth.noarch 1:1.1.1-5.el7 will be installed 2019-12-08T12:01:31.210 INFO:teuthology.orchestra.run.smithi013.stdout:--> Processing Dependency: python-cachetools for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-12-08T12:01:31.210 INFO:teuthology.orchestra.run.smithi013.stdout:--> Processing Dependency: python2-pyasn1-modules for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-12-08T12:01:31.211 INFO:teuthology.orchestra.run.smithi013.stdout:--> Processing Dependency: python2-rsa for package: 1:python2-google-auth-1.1.1-5.el7.noarch 2019-12-08T12:01:31.221 INFO:teuthology.orchestra.run.smithi013.stdout:---> Package python2-requests-oauthlib.noarch 0:0.8.0-5.el7 will be installed 2019-12-08T12:01:31.221 INFO:teuthology.orchestra.run.smithi013.stdout:--> Processing Dependency: python2-oauthlib for package: python2-requests-oauthlib-0.8.0-5.el7.noarch 2019-12-08T12:01:31.221 INFO:teuthology.orchestra.run.smithi013.stdout:--> Running transaction check 2019-12-08T12:01:31.221 INFO:teuthology.orchestra.run.smithi013.stdout:---> Package python-cachetools.noarch 0:1.0.3-1.el7 will be installed 2019-12-08T12:01:31.222 INFO:teuthology.orchestra.run.smithi013.stdout:---> Package python2-oauthlib.noarch 0:2.0.1-8.el7 will be installed 2019-12-08T12:01:31.222 INFO:teuthology.orchestra.run.smithi013.stdout:--> Processing Dependency: python-jwcrypto for package: python2-oauthlib-2.0.1-8.el7.noarch 2019-12-08T12:01:31.222 INFO:teuthology.orchestra.run.smithi013.stdout:---> Package python2-pyasn1-modules.noarch 0:0.1.9-7.el7 will be installed 2019-12-08T12:01:31.222 INFO:teuthology.orchestra.run.smithi013.stdout:---> Package python2-rsa.noarch 0:3.4.1-1.el7 will be installed 2019-12-08T12:01:31.222 INFO:teuthology.orchestra.run.smithi013.stdout:--> Running transaction check 2019-12-08T12:01:31.222 INFO:teuthology.orchestra.run.smithi013.stdout:---> Package python-jwcrypto.noarch 0:0.4.2-1.el7 will be installed 2019-12-08T12:01:31.441 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : 1:python2-google-auth-1.1.1-5.el7.noarch 9/11 2019-12-08T12:01:31.601 INFO:teuthology.orchestra.run.smithi013.stdout:--> Finished Dependency Resolution 2019-12-08T12:01:31.776 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python2-kubernetes-10.0.1-1.el7.noarch 10/11 2019-12-08T12:01:31.835 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T12:01:31.835 INFO:teuthology.orchestra.run.smithi013.stdout:Dependencies Resolved 2019-12-08T12:01:31.838 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T12:01:31.839 INFO:teuthology.orchestra.run.smithi013.stdout:================================================================================ 2019-12-08T12:01:31.839 INFO:teuthology.orchestra.run.smithi013.stdout: Package Arch Version Repository Size 2019-12-08T12:01:31.839 INFO:teuthology.orchestra.run.smithi013.stdout:================================================================================ 2019-12-08T12:01:31.839 INFO:teuthology.orchestra.run.smithi013.stdout:Installing: 2019-12-08T12:01:31.839 INFO:teuthology.orchestra.run.smithi013.stdout: ceph-mgr-rook noarch 2:15.0.0-7900.g1351c81.el7 ceph-noarch 23 k 2019-12-08T12:01:31.839 INFO:teuthology.orchestra.run.smithi013.stdout:Installing for dependencies: 2019-12-08T12:01:31.840 INFO:teuthology.orchestra.run.smithi013.stdout: python-cachetools noarch 1.0.3-1.el7 epel 22 k 2019-12-08T12:01:31.840 INFO:teuthology.orchestra.run.smithi013.stdout: python-jwcrypto noarch 0.4.2-1.el7 base 57 k 2019-12-08T12:01:31.840 INFO:teuthology.orchestra.run.smithi013.stdout: python-websocket-client noarch 0.56.0-3.git3c25814.el7 extras 66 k 2019-12-08T12:01:31.840 INFO:teuthology.orchestra.run.smithi013.stdout: python2-certifi noarch 2018.10.15-5.el7 epel 12 k 2019-12-08T12:01:31.840 INFO:teuthology.orchestra.run.smithi013.stdout: python2-google-auth noarch 1:1.1.1-5.el7 epel 76 k 2019-12-08T12:01:31.840 INFO:teuthology.orchestra.run.smithi013.stdout: python2-kubernetes noarch 10.0.1-1.el7 epel 1.1 M 2019-12-08T12:01:31.840 INFO:teuthology.orchestra.run.smithi013.stdout: python2-oauthlib noarch 2.0.1-8.el7 base 146 k 2019-12-08T12:01:31.841 INFO:teuthology.orchestra.run.smithi013.stdout: python2-pyasn1-modules noarch 0.1.9-7.el7 base 59 k 2019-12-08T12:01:31.841 INFO:teuthology.orchestra.run.smithi013.stdout: python2-requests-oauthlib noarch 0.8.0-5.el7 base 35 k 2019-12-08T12:01:31.841 INFO:teuthology.orchestra.run.smithi013.stdout: python2-rsa noarch 3.4.1-1.el7 epel 67 k 2019-12-08T12:01:31.841 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T12:01:31.841 INFO:teuthology.orchestra.run.smithi013.stdout:Transaction Summary 2019-12-08T12:01:31.841 INFO:teuthology.orchestra.run.smithi013.stdout:================================================================================ 2019-12-08T12:01:31.842 INFO:teuthology.orchestra.run.smithi013.stdout:Install 1 Package (+10 Dependent packages) 2019-12-08T12:01:31.842 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T12:01:31.842 INFO:teuthology.orchestra.run.smithi013.stdout:Total download size: 1.6 M 2019-12-08T12:01:31.842 INFO:teuthology.orchestra.run.smithi013.stdout:Installed size: 24 M 2019-12-08T12:01:31.842 INFO:teuthology.orchestra.run.smithi013.stdout:Downloading packages: 2019-12-08T12:01:32.080 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : 2:ceph-mgr-rook-15.0.0-7900.g1351c81.el7.noarch 11/11 2019-12-08T12:01:32.179 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python2-requests-oauthlib-0.8.0-5.el7.noarch 1/11 2019-12-08T12:01:32.287 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python2-pyasn1-modules-0.1.9-7.el7.noarch 2/11 2019-12-08T12:01:32.397 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python2-rsa-3.4.1-1.el7.noarch 3/11 2019-12-08T12:01:32.528 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python2-oauthlib-2.0.1-8.el7.noarch 4/11 2019-12-08T12:01:32.631 INFO:teuthology.orchestra.run.smithi013.stdout:-------------------------------------------------------------------------------- 2019-12-08T12:01:32.632 INFO:teuthology.orchestra.run.smithi013.stdout:Total 2.1 MB/s | 1.6 MB 00:00 2019-12-08T12:01:32.647 INFO:teuthology.orchestra.run.smithi013.stdout:Running transaction check 2019-12-08T12:01:32.647 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python-cachetools-1.0.3-1.el7.noarch 5/11 2019-12-08T12:01:32.659 INFO:teuthology.orchestra.run.smithi013.stdout:Running transaction test 2019-12-08T12:01:32.729 INFO:teuthology.orchestra.run.smithi013.stdout:Transaction test succeeded 2019-12-08T12:01:32.730 INFO:teuthology.orchestra.run.smithi013.stdout:Running transaction 2019-12-08T12:01:32.765 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : 1:python2-google-auth-1.1.1-5.el7.noarch 6/11 2019-12-08T12:01:32.882 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python2-certifi-2018.10.15-5.el7.noarch 7/11 2019-12-08T12:01:33.008 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python2-kubernetes-10.0.1-1.el7.noarch 8/11 2019-12-08T12:01:33.133 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python-jwcrypto-0.4.2-1.el7.noarch 9/11 2019-12-08T12:01:33.233 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : 2:ceph-mgr-rook-15.0.0-7900.g1351c81.el7.noarch 10/11 2019-12-08T12:01:33.494 INFO:teuthology.orchestra.run.smithi013.stdout: Installing : python-websocket-client-0.56.0-3.git3c25814.el7.noarch 1/11 2019-12-08T12:01:33.721 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python-websocket-client-0.56.0-3.git3c25814.el7.noarch 11/11 2019-12-08T12:01:33.721 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:01:33.721 INFO:teuthology.orchestra.run.smithi079.stdout:Installed: 2019-12-08T12:01:33.721 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-rook.noarch 2:15.0.0-7900.g1351c81.el7 2019-12-08T12:01:33.722 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:01:33.722 INFO:teuthology.orchestra.run.smithi079.stdout:Dependency Installed: 2019-12-08T12:01:33.722 INFO:teuthology.orchestra.run.smithi079.stdout: python-cachetools.noarch 0:1.0.3-1.el7 2019-12-08T12:01:33.722 INFO:teuthology.orchestra.run.smithi079.stdout: python-jwcrypto.noarch 0:0.4.2-1.el7 2019-12-08T12:01:33.722 INFO:teuthology.orchestra.run.smithi079.stdout: python-websocket-client.noarch 0:0.56.0-3.git3c25814.el7 2019-12-08T12:01:33.722 INFO:teuthology.orchestra.run.smithi079.stdout: python2-certifi.noarch 0:2018.10.15-5.el7 2019-12-08T12:01:33.722 INFO:teuthology.orchestra.run.smithi079.stdout: python2-google-auth.noarch 1:1.1.1-5.el7 2019-12-08T12:01:33.723 INFO:teuthology.orchestra.run.smithi079.stdout: python2-kubernetes.noarch 0:10.0.1-1.el7 2019-12-08T12:01:33.723 INFO:teuthology.orchestra.run.smithi079.stdout: python2-oauthlib.noarch 0:2.0.1-8.el7 2019-12-08T12:01:33.723 INFO:teuthology.orchestra.run.smithi079.stdout: python2-pyasn1-modules.noarch 0:0.1.9-7.el7 2019-12-08T12:01:33.723 INFO:teuthology.orchestra.run.smithi079.stdout: python2-requests-oauthlib.noarch 0:0.8.0-5.el7 2019-12-08T12:01:33.723 INFO:teuthology.orchestra.run.smithi079.stdout: python2-rsa.noarch 0:3.4.1-1.el7 2019-12-08T12:01:33.723 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:01:33.723 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2019-12-08T12:01:33.839 INFO:teuthology.orchestra.run.smithi079:> sudo yum -y install ceph-mgr-ssh 2019-12-08T12:01:33.892 INFO:teuthology.orchestra.run.smithi013.stdout: Installing : python-jwcrypto-0.4.2-1.el7.noarch 2/11 2019-12-08T12:01:34.055 INFO:teuthology.orchestra.run.smithi079.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-08T12:01:34.097 INFO:teuthology.orchestra.run.smithi079.stdout:Loading mirror speeds from cached hostfile 2019-12-08T12:01:34.102 INFO:teuthology.orchestra.run.smithi079.stdout: * base: mirrors.umflint.edu 2019-12-08T12:01:34.102 INFO:teuthology.orchestra.run.smithi079.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-08T12:01:34.102 INFO:teuthology.orchestra.run.smithi079.stdout: * extras: mirror.facebook.net 2019-12-08T12:01:34.103 INFO:teuthology.orchestra.run.smithi079.stdout: * updates: mirror.math.princeton.edu 2019-12-08T12:01:34.241 INFO:teuthology.orchestra.run.smithi013.stdout: Installing : python2-oauthlib-2.0.1-8.el7.noarch 3/11 2019-12-08T12:01:34.547 INFO:teuthology.orchestra.run.smithi013.stdout: Installing : python2-requests-oauthlib-0.8.0-5.el7.noarch 4/11 2019-12-08T12:01:34.683 INFO:teuthology.orchestra.run.smithi079.stdout:7 packages excluded due to repository priority protections 2019-12-08T12:01:34.926 INFO:teuthology.orchestra.run.smithi013.stdout: Installing : python2-certifi-2018.10.15-5.el7.noarch 5/11 2019-12-08T12:01:35.009 INFO:teuthology.orchestra.run.smithi079.stdout:Resolving Dependencies 2019-12-08T12:01:35.009 INFO:teuthology.orchestra.run.smithi079.stdout:--> Running transaction check 2019-12-08T12:01:35.009 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package ceph-mgr-ssh.noarch 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-08T12:01:35.012 INFO:teuthology.orchestra.run.smithi079.stdout:--> Processing Dependency: python-remoto for package: 2:ceph-mgr-ssh-15.0.0-7900.g1351c81.el7.noarch 2019-12-08T12:01:35.042 INFO:teuthology.orchestra.run.smithi079.stdout:--> Running transaction check 2019-12-08T12:01:35.042 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package python-remoto.noarch 0:0.0.25-1.el7 will be installed 2019-12-08T12:01:35.042 INFO:teuthology.orchestra.run.smithi079.stdout:--> Processing Dependency: python-execnet >= 1.2.0 for package: python-remoto-0.0.25-1.el7.noarch 2019-12-08T12:01:35.043 INFO:teuthology.orchestra.run.smithi079.stdout:--> Running transaction check 2019-12-08T12:01:35.043 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package python-execnet.noarch 0:1.2.0-7.el7 will be installed 2019-12-08T12:01:35.321 INFO:teuthology.orchestra.run.smithi013.stdout: Installing : python-cachetools-1.0.3-1.el7.noarch 6/11 2019-12-08T12:01:35.410 INFO:teuthology.orchestra.run.smithi079.stdout:--> Finished Dependency Resolution 2019-12-08T12:01:35.630 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:01:35.630 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies Resolved 2019-12-08T12:01:35.631 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:01:35.631 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2019-12-08T12:01:35.631 INFO:teuthology.orchestra.run.smithi079.stdout: Package Arch Version Repository Size 2019-12-08T12:01:35.631 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2019-12-08T12:01:35.631 INFO:teuthology.orchestra.run.smithi079.stdout:Installing: 2019-12-08T12:01:35.632 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-ssh noarch 2:15.0.0-7900.g1351c81.el7 ceph-noarch 33 k 2019-12-08T12:01:35.632 INFO:teuthology.orchestra.run.smithi079.stdout:Installing for dependencies: 2019-12-08T12:01:35.632 INFO:teuthology.orchestra.run.smithi079.stdout: python-execnet noarch 1.2.0-7.el7 epel 261 k 2019-12-08T12:01:35.632 INFO:teuthology.orchestra.run.smithi079.stdout: python-remoto noarch 0.0.25-1.el7 epel 22 k 2019-12-08T12:01:35.632 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:01:35.632 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction Summary 2019-12-08T12:01:35.632 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2019-12-08T12:01:35.633 INFO:teuthology.orchestra.run.smithi079.stdout:Install 1 Package (+2 Dependent packages) 2019-12-08T12:01:35.633 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:01:35.633 INFO:teuthology.orchestra.run.smithi079.stdout:Total download size: 316 k 2019-12-08T12:01:35.633 INFO:teuthology.orchestra.run.smithi079.stdout:Installed size: 1.1 M 2019-12-08T12:01:35.633 INFO:teuthology.orchestra.run.smithi079.stdout:Downloading packages: 2019-12-08T12:01:35.717 INFO:teuthology.orchestra.run.smithi013.stdout: Installing : python2-rsa-3.4.1-1.el7.noarch 7/11 2019-12-08T12:01:36.059 INFO:teuthology.orchestra.run.smithi013.stdout: Installing : python2-pyasn1-modules-0.1.9-7.el7.noarch 8/11 2019-12-08T12:01:36.167 INFO:teuthology.orchestra.run.smithi079.stdout:-------------------------------------------------------------------------------- 2019-12-08T12:01:36.168 INFO:teuthology.orchestra.run.smithi079.stdout:Total 590 kB/s | 316 kB 00:00 2019-12-08T12:01:36.171 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction check 2019-12-08T12:01:36.181 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction test 2019-12-08T12:01:36.254 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction test succeeded 2019-12-08T12:01:36.255 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction 2019-12-08T12:01:37.014 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python-execnet-1.2.0-7.el7.noarch 1/3 2019-12-08T12:01:37.328 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python-remoto-0.0.25-1.el7.noarch 2/3 2019-12-08T12:01:37.621 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : 2:ceph-mgr-ssh-15.0.0-7900.g1351c81.el7.noarch 3/3 2019-12-08T12:01:37.734 INFO:teuthology.orchestra.run.smithi013.stdout: Installing : 1:python2-google-auth-1.1.1-5.el7.noarch 9/11 2019-12-08T12:01:37.766 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python-remoto-0.0.25-1.el7.noarch 1/3 2019-12-08T12:01:37.876 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python-execnet-1.2.0-7.el7.noarch 2/3 2019-12-08T12:01:38.127 INFO:teuthology.orchestra.run.smithi013.stdout: Installing : python2-kubernetes-10.0.1-1.el7.noarch 10/11 2019-12-08T12:01:38.320 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : 2:ceph-mgr-ssh-15.0.0-7900.g1351c81.el7.noarch 3/3 2019-12-08T12:01:38.320 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:01:38.320 INFO:teuthology.orchestra.run.smithi079.stdout:Installed: 2019-12-08T12:01:38.321 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-mgr-ssh.noarch 2:15.0.0-7900.g1351c81.el7 2019-12-08T12:01:38.321 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:01:38.321 INFO:teuthology.orchestra.run.smithi079.stdout:Dependency Installed: 2019-12-08T12:01:38.321 INFO:teuthology.orchestra.run.smithi079.stdout: python-execnet.noarch 0:1.2.0-7.el7 python-remoto.noarch 0:0.0.25-1.el7 2019-12-08T12:01:38.321 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:01:38.321 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2019-12-08T12:01:38.431 INFO:teuthology.orchestra.run.smithi013.stdout: Installing : 2:ceph-mgr-rook-15.0.0-7900.g1351c81.el7.noarch 11/11 2019-12-08T12:01:38.454 INFO:teuthology.orchestra.run.smithi079:> sudo yum -y install ceph-fuse 2019-12-08T12:01:38.562 INFO:teuthology.orchestra.run.smithi013.stdout: Verifying : python2-requests-oauthlib-0.8.0-5.el7.noarch 1/11 2019-12-08T12:01:38.693 INFO:teuthology.orchestra.run.smithi079.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-08T12:01:38.721 INFO:teuthology.orchestra.run.smithi013.stdout: Verifying : python2-pyasn1-modules-0.1.9-7.el7.noarch 2/11 2019-12-08T12:01:38.735 INFO:teuthology.orchestra.run.smithi079.stdout:Loading mirror speeds from cached hostfile 2019-12-08T12:01:38.736 INFO:teuthology.orchestra.run.smithi079.stdout: * base: mirrors.umflint.edu 2019-12-08T12:01:38.736 INFO:teuthology.orchestra.run.smithi079.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-08T12:01:38.737 INFO:teuthology.orchestra.run.smithi079.stdout: * extras: mirror.facebook.net 2019-12-08T12:01:38.737 INFO:teuthology.orchestra.run.smithi079.stdout: * updates: mirror.math.princeton.edu 2019-12-08T12:01:38.822 INFO:teuthology.orchestra.run.smithi013.stdout: Verifying : python2-rsa-3.4.1-1.el7.noarch 3/11 2019-12-08T12:01:38.897 INFO:teuthology.orchestra.run.smithi013.stdout: Verifying : python2-oauthlib-2.0.1-8.el7.noarch 4/11 2019-12-08T12:01:38.998 INFO:teuthology.orchestra.run.smithi013.stdout: Verifying : python-cachetools-1.0.3-1.el7.noarch 5/11 2019-12-08T12:01:39.090 INFO:teuthology.orchestra.run.smithi013.stdout: Verifying : 1:python2-google-auth-1.1.1-5.el7.noarch 6/11 2019-12-08T12:01:39.174 INFO:teuthology.orchestra.run.smithi013.stdout: Verifying : python2-certifi-2018.10.15-5.el7.noarch 7/11 2019-12-08T12:01:39.316 INFO:teuthology.orchestra.run.smithi013.stdout: Verifying : python2-kubernetes-10.0.1-1.el7.noarch 8/11 2019-12-08T12:01:39.382 INFO:teuthology.orchestra.run.smithi079.stdout:7 packages excluded due to repository priority protections 2019-12-08T12:01:39.416 INFO:teuthology.orchestra.run.smithi013.stdout: Verifying : python-jwcrypto-0.4.2-1.el7.noarch 9/11 2019-12-08T12:01:39.508 INFO:teuthology.orchestra.run.smithi013.stdout: Verifying : 2:ceph-mgr-rook-15.0.0-7900.g1351c81.el7.noarch 10/11 2019-12-08T12:01:39.716 INFO:teuthology.orchestra.run.smithi079.stdout:Resolving Dependencies 2019-12-08T12:01:39.716 INFO:teuthology.orchestra.run.smithi079.stdout:--> Running transaction check 2019-12-08T12:01:39.716 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package ceph-fuse.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-08T12:01:39.726 INFO:teuthology.orchestra.run.smithi079.stdout:--> Processing Dependency: /usr/bin/python3 for package: 2:ceph-fuse-15.0.0-7900.g1351c81.el7.x86_64 2019-12-08T12:01:39.759 INFO:teuthology.orchestra.run.smithi079.stdout:--> Processing Dependency: python3 for package: 2:ceph-fuse-15.0.0-7900.g1351c81.el7.x86_64 2019-12-08T12:01:39.760 INFO:teuthology.orchestra.run.smithi079.stdout:--> Running transaction check 2019-12-08T12:01:39.760 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package python3.x86_64 0:3.6.8-10.el7 will be installed 2019-12-08T12:01:39.760 INFO:teuthology.orchestra.run.smithi079.stdout:--> Processing Dependency: python3-libs(x86-64) = 3.6.8-10.el7 for package: python3-3.6.8-10.el7.x86_64 2019-12-08T12:01:39.761 INFO:teuthology.orchestra.run.smithi079.stdout:--> Processing Dependency: python3-setuptools for package: python3-3.6.8-10.el7.x86_64 2019-12-08T12:01:39.762 INFO:teuthology.orchestra.run.smithi079.stdout:--> Processing Dependency: python3-pip for package: python3-3.6.8-10.el7.x86_64 2019-12-08T12:01:39.763 INFO:teuthology.orchestra.run.smithi079.stdout:--> Processing Dependency: libpython3.6m.so.1.0()(64bit) for package: python3-3.6.8-10.el7.x86_64 2019-12-08T12:01:39.764 INFO:teuthology.orchestra.run.smithi079.stdout:--> Running transaction check 2019-12-08T12:01:39.764 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package python3-libs.x86_64 0:3.6.8-10.el7 will be installed 2019-12-08T12:01:39.770 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package python3-pip.noarch 0:9.0.3-5.el7 will be installed 2019-12-08T12:01:39.770 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package python3-setuptools.noarch 0:39.2.0-10.el7 will be installed 2019-12-08T12:01:40.069 INFO:teuthology.orchestra.run.smithi013.stdout: Verifying : python-websocket-client-0.56.0-3.git3c25814.el7.noarch 11/11 2019-12-08T12:01:40.070 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T12:01:40.070 INFO:teuthology.orchestra.run.smithi013.stdout:Installed: 2019-12-08T12:01:40.070 INFO:teuthology.orchestra.run.smithi013.stdout: ceph-mgr-rook.noarch 2:15.0.0-7900.g1351c81.el7 2019-12-08T12:01:40.070 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T12:01:40.070 INFO:teuthology.orchestra.run.smithi013.stdout:Dependency Installed: 2019-12-08T12:01:40.070 INFO:teuthology.orchestra.run.smithi013.stdout: python-cachetools.noarch 0:1.0.3-1.el7 2019-12-08T12:01:40.070 INFO:teuthology.orchestra.run.smithi013.stdout: python-jwcrypto.noarch 0:0.4.2-1.el7 2019-12-08T12:01:40.071 INFO:teuthology.orchestra.run.smithi013.stdout: python-websocket-client.noarch 0:0.56.0-3.git3c25814.el7 2019-12-08T12:01:40.071 INFO:teuthology.orchestra.run.smithi013.stdout: python2-certifi.noarch 0:2018.10.15-5.el7 2019-12-08T12:01:40.071 INFO:teuthology.orchestra.run.smithi013.stdout: python2-google-auth.noarch 1:1.1.1-5.el7 2019-12-08T12:01:40.071 INFO:teuthology.orchestra.run.smithi013.stdout: python2-kubernetes.noarch 0:10.0.1-1.el7 2019-12-08T12:01:40.071 INFO:teuthology.orchestra.run.smithi013.stdout: python2-oauthlib.noarch 0:2.0.1-8.el7 2019-12-08T12:01:40.071 INFO:teuthology.orchestra.run.smithi013.stdout: python2-pyasn1-modules.noarch 0:0.1.9-7.el7 2019-12-08T12:01:40.071 INFO:teuthology.orchestra.run.smithi013.stdout: python2-requests-oauthlib.noarch 0:0.8.0-5.el7 2019-12-08T12:01:40.072 INFO:teuthology.orchestra.run.smithi013.stdout: python2-rsa.noarch 0:3.4.1-1.el7 2019-12-08T12:01:40.072 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T12:01:40.072 INFO:teuthology.orchestra.run.smithi013.stdout:Complete! 2019-12-08T12:01:40.134 INFO:teuthology.orchestra.run.smithi079.stdout:--> Finished Dependency Resolution 2019-12-08T12:01:40.189 INFO:teuthology.orchestra.run.smithi013:> sudo yum -y install ceph-mgr-ssh 2019-12-08T12:01:40.356 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:01:40.357 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies Resolved 2019-12-08T12:01:40.357 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:01:40.358 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2019-12-08T12:01:40.358 INFO:teuthology.orchestra.run.smithi079.stdout: Package Arch Version Repository 2019-12-08T12:01:40.358 INFO:teuthology.orchestra.run.smithi079.stdout: Size 2019-12-08T12:01:40.358 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2019-12-08T12:01:40.358 INFO:teuthology.orchestra.run.smithi079.stdout:Installing: 2019-12-08T12:01:40.358 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-fuse x86_64 2:15.0.0-7900.g1351c81.el7 ceph 566 k 2019-12-08T12:01:40.359 INFO:teuthology.orchestra.run.smithi079.stdout:Installing for dependencies: 2019-12-08T12:01:40.359 INFO:teuthology.orchestra.run.smithi079.stdout: python3 x86_64 3.6.8-10.el7 base 69 k 2019-12-08T12:01:40.359 INFO:teuthology.orchestra.run.smithi079.stdout: python3-libs x86_64 3.6.8-10.el7 base 7.0 M 2019-12-08T12:01:40.359 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pip noarch 9.0.3-5.el7 base 1.8 M 2019-12-08T12:01:40.359 INFO:teuthology.orchestra.run.smithi079.stdout: python3-setuptools noarch 39.2.0-10.el7 base 629 k 2019-12-08T12:01:40.359 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:01:40.359 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction Summary 2019-12-08T12:01:40.360 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2019-12-08T12:01:40.360 INFO:teuthology.orchestra.run.smithi079.stdout:Install 1 Package (+4 Dependent packages) 2019-12-08T12:01:40.360 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:01:40.360 INFO:teuthology.orchestra.run.smithi079.stdout:Total download size: 10 M 2019-12-08T12:01:40.360 INFO:teuthology.orchestra.run.smithi079.stdout:Installed size: 49 M 2019-12-08T12:01:40.360 INFO:teuthology.orchestra.run.smithi079.stdout:Downloading packages: 2019-12-08T12:01:40.449 INFO:teuthology.orchestra.run.smithi013.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-08T12:01:40.495 INFO:teuthology.orchestra.run.smithi013.stdout:Loading mirror speeds from cached hostfile 2019-12-08T12:01:40.496 INFO:teuthology.orchestra.run.smithi013.stdout: * base: mirrors.umflint.edu 2019-12-08T12:01:40.497 INFO:teuthology.orchestra.run.smithi013.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-08T12:01:40.497 INFO:teuthology.orchestra.run.smithi013.stdout: * extras: mirror.facebook.net 2019-12-08T12:01:40.497 INFO:teuthology.orchestra.run.smithi013.stdout: * updates: mirror.math.princeton.edu 2019-12-08T12:01:41.161 INFO:teuthology.orchestra.run.smithi013.stdout:7 packages excluded due to repository priority protections 2019-12-08T12:01:41.335 INFO:teuthology.orchestra.run.smithi079.stdout:-------------------------------------------------------------------------------- 2019-12-08T12:01:41.335 INFO:teuthology.orchestra.run.smithi079.stdout:Total 10 MB/s | 10 MB 00:00 2019-12-08T12:01:41.357 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction check 2019-12-08T12:01:41.388 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction test 2019-12-08T12:01:41.511 INFO:teuthology.orchestra.run.smithi013.stdout:Resolving Dependencies 2019-12-08T12:01:41.512 INFO:teuthology.orchestra.run.smithi013.stdout:--> Running transaction check 2019-12-08T12:01:41.512 INFO:teuthology.orchestra.run.smithi013.stdout:---> Package ceph-mgr-ssh.noarch 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-08T12:01:41.515 INFO:teuthology.orchestra.run.smithi013.stdout:--> Processing Dependency: python-remoto for package: 2:ceph-mgr-ssh-15.0.0-7900.g1351c81.el7.noarch 2019-12-08T12:01:41.524 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction test succeeded 2019-12-08T12:01:41.525 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction 2019-12-08T12:01:41.546 INFO:teuthology.orchestra.run.smithi013.stdout:--> Running transaction check 2019-12-08T12:01:41.546 INFO:teuthology.orchestra.run.smithi013.stdout:---> Package python-remoto.noarch 0:0.0.25-1.el7 will be installed 2019-12-08T12:01:41.547 INFO:teuthology.orchestra.run.smithi013.stdout:--> Processing Dependency: python-execnet >= 1.2.0 for package: python-remoto-0.0.25-1.el7.noarch 2019-12-08T12:01:41.547 INFO:teuthology.orchestra.run.smithi013.stdout:--> Running transaction check 2019-12-08T12:01:41.548 INFO:teuthology.orchestra.run.smithi013.stdout:---> Package python-execnet.noarch 0:1.2.0-7.el7 will be installed 2019-12-08T12:01:41.935 INFO:teuthology.orchestra.run.smithi013.stdout:--> Finished Dependency Resolution 2019-12-08T12:01:42.170 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T12:01:42.170 INFO:teuthology.orchestra.run.smithi013.stdout:Dependencies Resolved 2019-12-08T12:01:42.171 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T12:01:42.171 INFO:teuthology.orchestra.run.smithi013.stdout:================================================================================ 2019-12-08T12:01:42.172 INFO:teuthology.orchestra.run.smithi013.stdout: Package Arch Version Repository Size 2019-12-08T12:01:42.172 INFO:teuthology.orchestra.run.smithi013.stdout:================================================================================ 2019-12-08T12:01:42.172 INFO:teuthology.orchestra.run.smithi013.stdout:Installing: 2019-12-08T12:01:42.172 INFO:teuthology.orchestra.run.smithi013.stdout: ceph-mgr-ssh noarch 2:15.0.0-7900.g1351c81.el7 ceph-noarch 33 k 2019-12-08T12:01:42.173 INFO:teuthology.orchestra.run.smithi013.stdout:Installing for dependencies: 2019-12-08T12:01:42.173 INFO:teuthology.orchestra.run.smithi013.stdout: python-execnet noarch 1.2.0-7.el7 epel 261 k 2019-12-08T12:01:42.173 INFO:teuthology.orchestra.run.smithi013.stdout: python-remoto noarch 0.0.25-1.el7 epel 22 k 2019-12-08T12:01:42.173 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T12:01:42.174 INFO:teuthology.orchestra.run.smithi013.stdout:Transaction Summary 2019-12-08T12:01:42.174 INFO:teuthology.orchestra.run.smithi013.stdout:================================================================================ 2019-12-08T12:01:42.174 INFO:teuthology.orchestra.run.smithi013.stdout:Install 1 Package (+2 Dependent packages) 2019-12-08T12:01:42.174 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T12:01:42.175 INFO:teuthology.orchestra.run.smithi013.stdout:Total download size: 316 k 2019-12-08T12:01:42.175 INFO:teuthology.orchestra.run.smithi013.stdout:Installed size: 1.1 M 2019-12-08T12:01:42.175 INFO:teuthology.orchestra.run.smithi013.stdout:Downloading packages: 2019-12-08T12:01:42.700 INFO:teuthology.orchestra.run.smithi013.stdout:-------------------------------------------------------------------------------- 2019-12-08T12:01:42.700 INFO:teuthology.orchestra.run.smithi013.stdout:Total 597 kB/s | 316 kB 00:00 2019-12-08T12:01:42.704 INFO:teuthology.orchestra.run.smithi013.stdout:Running transaction check 2019-12-08T12:01:42.713 INFO:teuthology.orchestra.run.smithi013.stdout:Running transaction test 2019-12-08T12:01:42.802 INFO:teuthology.orchestra.run.smithi013.stdout:Transaction test succeeded 2019-12-08T12:01:42.802 INFO:teuthology.orchestra.run.smithi013.stdout:Running transaction 2019-12-08T12:01:43.638 INFO:teuthology.orchestra.run.smithi013.stdout: Installing : python-execnet-1.2.0-7.el7.noarch 1/3 2019-12-08T12:01:43.829 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-libs-3.6.8-10.el7.x86_64 1/5 2019-12-08T12:01:43.918 INFO:teuthology.orchestra.run.smithi013.stdout: Installing : python-remoto-0.0.25-1.el7.noarch 2/3 2019-12-08T12:01:44.219 INFO:teuthology.orchestra.run.smithi013.stdout: Installing : 2:ceph-mgr-ssh-15.0.0-7900.g1351c81.el7.noarch 3/3 2019-12-08T12:01:44.324 INFO:teuthology.orchestra.run.smithi013.stdout: Verifying : python-remoto-0.0.25-1.el7.noarch 1/3 2019-12-08T12:01:44.331 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-3.6.8-10.el7.x86_64 2/5 2019-12-08T12:01:44.474 INFO:teuthology.orchestra.run.smithi013.stdout: Verifying : python-execnet-1.2.0-7.el7.noarch 2/3 2019-12-08T12:01:44.933 INFO:teuthology.orchestra.run.smithi013.stdout: Verifying : 2:ceph-mgr-ssh-15.0.0-7900.g1351c81.el7.noarch 3/3 2019-12-08T12:01:44.934 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T12:01:44.934 INFO:teuthology.orchestra.run.smithi013.stdout:Installed: 2019-12-08T12:01:44.934 INFO:teuthology.orchestra.run.smithi013.stdout: ceph-mgr-ssh.noarch 2:15.0.0-7900.g1351c81.el7 2019-12-08T12:01:44.934 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T12:01:44.934 INFO:teuthology.orchestra.run.smithi013.stdout:Dependency Installed: 2019-12-08T12:01:44.934 INFO:teuthology.orchestra.run.smithi013.stdout: python-execnet.noarch 0:1.2.0-7.el7 python-remoto.noarch 0:0.0.25-1.el7 2019-12-08T12:01:44.935 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T12:01:44.935 INFO:teuthology.orchestra.run.smithi013.stdout:Complete! 2019-12-08T12:01:45.066 INFO:teuthology.orchestra.run.smithi013:> sudo yum -y install ceph-fuse 2019-12-08T12:01:45.223 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-setuptools-39.2.0-10.el7.noarch 3/5 2019-12-08T12:01:45.313 INFO:teuthology.orchestra.run.smithi013.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-08T12:01:45.357 INFO:teuthology.orchestra.run.smithi013.stdout:Loading mirror speeds from cached hostfile 2019-12-08T12:01:45.358 INFO:teuthology.orchestra.run.smithi013.stdout: * base: mirrors.umflint.edu 2019-12-08T12:01:45.358 INFO:teuthology.orchestra.run.smithi013.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-08T12:01:45.358 INFO:teuthology.orchestra.run.smithi013.stdout: * extras: mirror.facebook.net 2019-12-08T12:01:45.359 INFO:teuthology.orchestra.run.smithi013.stdout: * updates: mirror.math.princeton.edu 2019-12-08T12:01:45.713 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : python3-pip-9.0.3-5.el7.noarch 4/5 2019-12-08T12:01:46.015 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : 2:ceph-fuse-15.0.0-7900.g1351c81.el7.x86_64 5/5 2019-12-08T12:01:46.050 INFO:teuthology.orchestra.run.smithi013.stdout:7 packages excluded due to repository priority protections 2019-12-08T12:01:46.131 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : 2:ceph-fuse-15.0.0-7900.g1351c81.el7.x86_64 1/5 2019-12-08T12:01:46.231 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-setuptools-39.2.0-10.el7.noarch 2/5 2019-12-08T12:01:46.332 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-libs-3.6.8-10.el7.x86_64 3/5 2019-12-08T12:01:46.398 INFO:teuthology.orchestra.run.smithi013.stdout:Resolving Dependencies 2019-12-08T12:01:46.398 INFO:teuthology.orchestra.run.smithi013.stdout:--> Running transaction check 2019-12-08T12:01:46.398 INFO:teuthology.orchestra.run.smithi013.stdout:---> Package ceph-fuse.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-08T12:01:46.409 INFO:teuthology.orchestra.run.smithi013.stdout:--> Processing Dependency: /usr/bin/python3 for package: 2:ceph-fuse-15.0.0-7900.g1351c81.el7.x86_64 2019-12-08T12:01:46.433 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-3.6.8-10.el7.x86_64 4/5 2019-12-08T12:01:46.443 INFO:teuthology.orchestra.run.smithi013.stdout:--> Processing Dependency: python3 for package: 2:ceph-fuse-15.0.0-7900.g1351c81.el7.x86_64 2019-12-08T12:01:46.444 INFO:teuthology.orchestra.run.smithi013.stdout:--> Running transaction check 2019-12-08T12:01:46.444 INFO:teuthology.orchestra.run.smithi013.stdout:---> Package python3.x86_64 0:3.6.8-10.el7 will be installed 2019-12-08T12:01:46.444 INFO:teuthology.orchestra.run.smithi013.stdout:--> Processing Dependency: python3-libs(x86-64) = 3.6.8-10.el7 for package: python3-3.6.8-10.el7.x86_64 2019-12-08T12:01:46.446 INFO:teuthology.orchestra.run.smithi013.stdout:--> Processing Dependency: python3-setuptools for package: python3-3.6.8-10.el7.x86_64 2019-12-08T12:01:46.448 INFO:teuthology.orchestra.run.smithi013.stdout:--> Processing Dependency: python3-pip for package: python3-3.6.8-10.el7.x86_64 2019-12-08T12:01:46.448 INFO:teuthology.orchestra.run.smithi013.stdout:--> Processing Dependency: libpython3.6m.so.1.0()(64bit) for package: python3-3.6.8-10.el7.x86_64 2019-12-08T12:01:46.449 INFO:teuthology.orchestra.run.smithi013.stdout:--> Running transaction check 2019-12-08T12:01:46.449 INFO:teuthology.orchestra.run.smithi013.stdout:---> Package python3-libs.x86_64 0:3.6.8-10.el7 will be installed 2019-12-08T12:01:46.455 INFO:teuthology.orchestra.run.smithi013.stdout:---> Package python3-pip.noarch 0:9.0.3-5.el7 will be installed 2019-12-08T12:01:46.455 INFO:teuthology.orchestra.run.smithi013.stdout:---> Package python3-setuptools.noarch 0:39.2.0-10.el7 will be installed 2019-12-08T12:01:46.845 INFO:teuthology.orchestra.run.smithi013.stdout:--> Finished Dependency Resolution 2019-12-08T12:01:46.909 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : python3-pip-9.0.3-5.el7.noarch 5/5 2019-12-08T12:01:46.912 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:01:46.912 INFO:teuthology.orchestra.run.smithi079.stdout:Installed: 2019-12-08T12:01:46.912 INFO:teuthology.orchestra.run.smithi079.stdout: ceph-fuse.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-08T12:01:46.912 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:01:46.913 INFO:teuthology.orchestra.run.smithi079.stdout:Dependency Installed: 2019-12-08T12:01:46.913 INFO:teuthology.orchestra.run.smithi079.stdout: python3.x86_64 0:3.6.8-10.el7 python3-libs.x86_64 0:3.6.8-10.el7 2019-12-08T12:01:46.913 INFO:teuthology.orchestra.run.smithi079.stdout: python3-pip.noarch 0:9.0.3-5.el7 python3-setuptools.noarch 0:39.2.0-10.el7 2019-12-08T12:01:46.913 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:01:46.914 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2019-12-08T12:01:47.033 INFO:teuthology.orchestra.run.smithi079:> sudo yum -y install libcephfs2 2019-12-08T12:01:47.077 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T12:01:47.077 INFO:teuthology.orchestra.run.smithi013.stdout:Dependencies Resolved 2019-12-08T12:01:47.078 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T12:01:47.079 INFO:teuthology.orchestra.run.smithi013.stdout:================================================================================ 2019-12-08T12:01:47.079 INFO:teuthology.orchestra.run.smithi013.stdout: Package Arch Version Repository 2019-12-08T12:01:47.079 INFO:teuthology.orchestra.run.smithi013.stdout: Size 2019-12-08T12:01:47.079 INFO:teuthology.orchestra.run.smithi013.stdout:================================================================================ 2019-12-08T12:01:47.080 INFO:teuthology.orchestra.run.smithi013.stdout:Installing: 2019-12-08T12:01:47.080 INFO:teuthology.orchestra.run.smithi013.stdout: ceph-fuse x86_64 2:15.0.0-7900.g1351c81.el7 ceph 566 k 2019-12-08T12:01:47.080 INFO:teuthology.orchestra.run.smithi013.stdout:Installing for dependencies: 2019-12-08T12:01:47.080 INFO:teuthology.orchestra.run.smithi013.stdout: python3 x86_64 3.6.8-10.el7 base 69 k 2019-12-08T12:01:47.080 INFO:teuthology.orchestra.run.smithi013.stdout: python3-libs x86_64 3.6.8-10.el7 base 7.0 M 2019-12-08T12:01:47.081 INFO:teuthology.orchestra.run.smithi013.stdout: python3-pip noarch 9.0.3-5.el7 base 1.8 M 2019-12-08T12:01:47.081 INFO:teuthology.orchestra.run.smithi013.stdout: python3-setuptools noarch 39.2.0-10.el7 base 629 k 2019-12-08T12:01:47.081 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T12:01:47.081 INFO:teuthology.orchestra.run.smithi013.stdout:Transaction Summary 2019-12-08T12:01:47.081 INFO:teuthology.orchestra.run.smithi013.stdout:================================================================================ 2019-12-08T12:01:47.082 INFO:teuthology.orchestra.run.smithi013.stdout:Install 1 Package (+4 Dependent packages) 2019-12-08T12:01:47.082 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T12:01:47.083 INFO:teuthology.orchestra.run.smithi013.stdout:Total download size: 10 M 2019-12-08T12:01:47.083 INFO:teuthology.orchestra.run.smithi013.stdout:Installed size: 49 M 2019-12-08T12:01:47.084 INFO:teuthology.orchestra.run.smithi013.stdout:Downloading packages: 2019-12-08T12:01:47.257 INFO:teuthology.orchestra.run.smithi079.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-08T12:01:47.296 INFO:teuthology.orchestra.run.smithi079.stdout:Loading mirror speeds from cached hostfile 2019-12-08T12:01:47.297 INFO:teuthology.orchestra.run.smithi079.stdout: * base: mirrors.umflint.edu 2019-12-08T12:01:47.298 INFO:teuthology.orchestra.run.smithi079.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-08T12:01:47.298 INFO:teuthology.orchestra.run.smithi079.stdout: * extras: mirror.facebook.net 2019-12-08T12:01:47.299 INFO:teuthology.orchestra.run.smithi079.stdout: * updates: mirror.math.princeton.edu 2019-12-08T12:01:47.526 INFO:teuthology.orchestra.run.smithi013.stdout:-------------------------------------------------------------------------------- 2019-12-08T12:01:47.526 INFO:teuthology.orchestra.run.smithi013.stdout:Total 22 MB/s | 10 MB 00:00 2019-12-08T12:01:47.543 INFO:teuthology.orchestra.run.smithi013.stdout:Running transaction check 2019-12-08T12:01:47.566 INFO:teuthology.orchestra.run.smithi013.stdout:Running transaction test 2019-12-08T12:01:47.693 INFO:teuthology.orchestra.run.smithi013.stdout:Transaction test succeeded 2019-12-08T12:01:47.694 INFO:teuthology.orchestra.run.smithi013.stdout:Running transaction 2019-12-08T12:01:47.935 INFO:teuthology.orchestra.run.smithi079.stdout:7 packages excluded due to repository priority protections 2019-12-08T12:01:48.258 INFO:teuthology.orchestra.run.smithi079.stdout:Package 2:libcephfs2-15.0.0-7900.g1351c81.el7.x86_64 already installed and latest version 2019-12-08T12:01:48.258 INFO:teuthology.orchestra.run.smithi079.stdout:Nothing to do 2019-12-08T12:01:48.318 INFO:teuthology.orchestra.run.smithi079:> sudo yum -y install libcephfs-devel 2019-12-08T12:01:48.494 INFO:teuthology.orchestra.run.smithi079.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-08T12:01:48.528 INFO:teuthology.orchestra.run.smithi079.stdout:Loading mirror speeds from cached hostfile 2019-12-08T12:01:48.529 INFO:teuthology.orchestra.run.smithi079.stdout: * base: mirrors.umflint.edu 2019-12-08T12:01:48.530 INFO:teuthology.orchestra.run.smithi079.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-08T12:01:48.530 INFO:teuthology.orchestra.run.smithi079.stdout: * extras: mirror.facebook.net 2019-12-08T12:01:48.530 INFO:teuthology.orchestra.run.smithi079.stdout: * updates: mirror.math.princeton.edu 2019-12-08T12:01:49.113 INFO:teuthology.orchestra.run.smithi079.stdout:7 packages excluded due to repository priority protections 2019-12-08T12:01:49.437 INFO:teuthology.orchestra.run.smithi079.stdout:Resolving Dependencies 2019-12-08T12:01:49.438 INFO:teuthology.orchestra.run.smithi079.stdout:--> Running transaction check 2019-12-08T12:01:49.438 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package libcephfs-devel.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-08T12:01:49.438 INFO:teuthology.orchestra.run.smithi079.stdout:--> Processing Dependency: librados-devel = 2:15.0.0-7900.g1351c81.el7 for package: 2:libcephfs-devel-15.0.0-7900.g1351c81.el7.x86_64 2019-12-08T12:01:49.469 INFO:teuthology.orchestra.run.smithi079.stdout:--> Running transaction check 2019-12-08T12:01:49.469 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package librados-devel.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-08T12:01:49.839 INFO:teuthology.orchestra.run.smithi079.stdout:--> Finished Dependency Resolution 2019-12-08T12:01:50.062 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:01:50.062 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies Resolved 2019-12-08T12:01:50.063 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:01:50.063 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2019-12-08T12:01:50.063 INFO:teuthology.orchestra.run.smithi079.stdout: Package Arch Version Repository 2019-12-08T12:01:50.063 INFO:teuthology.orchestra.run.smithi079.stdout: Size 2019-12-08T12:01:50.063 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2019-12-08T12:01:50.064 INFO:teuthology.orchestra.run.smithi079.stdout:Installing: 2019-12-08T12:01:50.064 INFO:teuthology.orchestra.run.smithi079.stdout: libcephfs-devel x86_64 2:15.0.0-7900.g1351c81.el7 ceph 17 k 2019-12-08T12:01:50.064 INFO:teuthology.orchestra.run.smithi079.stdout:Installing for dependencies: 2019-12-08T12:01:50.064 INFO:teuthology.orchestra.run.smithi079.stdout: librados-devel x86_64 2:15.0.0-7900.g1351c81.el7 ceph 153 k 2019-12-08T12:01:50.064 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:01:50.064 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction Summary 2019-12-08T12:01:50.064 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2019-12-08T12:01:50.065 INFO:teuthology.orchestra.run.smithi079.stdout:Install 1 Package (+1 Dependent package) 2019-12-08T12:01:50.065 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:01:50.065 INFO:teuthology.orchestra.run.smithi079.stdout:Total download size: 170 k 2019-12-08T12:01:50.065 INFO:teuthology.orchestra.run.smithi079.stdout:Installed size: 679 k 2019-12-08T12:01:50.065 INFO:teuthology.orchestra.run.smithi079.stdout:Downloading packages: 2019-12-08T12:01:50.134 INFO:teuthology.orchestra.run.smithi013.stdout: Installing : python3-libs-3.6.8-10.el7.x86_64 1/5 2019-12-08T12:01:50.456 INFO:teuthology.orchestra.run.smithi079.stdout:-------------------------------------------------------------------------------- 2019-12-08T12:01:50.456 INFO:teuthology.orchestra.run.smithi079.stdout:Total 433 kB/s | 170 kB 00:00 2019-12-08T12:01:50.459 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction check 2019-12-08T12:01:50.471 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction test 2019-12-08T12:01:50.474 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction test succeeded 2019-12-08T12:01:50.474 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction 2019-12-08T12:01:50.620 INFO:teuthology.orchestra.run.smithi013.stdout: Installing : python3-3.6.8-10.el7.x86_64 2/5 2019-12-08T12:01:51.093 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : 2:librados-devel-15.0.0-7900.g1351c81.el7.x86_64 1/2 2019-12-08T12:01:51.382 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : 2:libcephfs-devel-15.0.0-7900.g1351c81.el7.x86_64 2/2 2019-12-08T12:01:51.488 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : 2:librados-devel-15.0.0-7900.g1351c81.el7.x86_64 1/2 2019-12-08T12:01:51.492 INFO:teuthology.orchestra.run.smithi013.stdout: Installing : python3-setuptools-39.2.0-10.el7.noarch 3/5 2019-12-08T12:01:51.897 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : 2:libcephfs-devel-15.0.0-7900.g1351c81.el7.x86_64 2/2 2019-12-08T12:01:51.898 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:01:51.898 INFO:teuthology.orchestra.run.smithi079.stdout:Installed: 2019-12-08T12:01:51.898 INFO:teuthology.orchestra.run.smithi079.stdout: libcephfs-devel.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-08T12:01:51.898 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:01:51.898 INFO:teuthology.orchestra.run.smithi079.stdout:Dependency Installed: 2019-12-08T12:01:51.899 INFO:teuthology.orchestra.run.smithi079.stdout: librados-devel.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-08T12:01:51.899 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:01:51.899 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2019-12-08T12:01:52.004 INFO:teuthology.orchestra.run.smithi013.stdout: Installing : python3-pip-9.0.3-5.el7.noarch 4/5 2019-12-08T12:01:52.012 INFO:teuthology.orchestra.run.smithi079:> sudo yum -y install librados2 2019-12-08T12:01:52.248 INFO:teuthology.orchestra.run.smithi079.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-08T12:01:52.290 INFO:teuthology.orchestra.run.smithi079.stdout:Loading mirror speeds from cached hostfile 2019-12-08T12:01:52.291 INFO:teuthology.orchestra.run.smithi079.stdout: * base: mirrors.umflint.edu 2019-12-08T12:01:52.291 INFO:teuthology.orchestra.run.smithi079.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-08T12:01:52.291 INFO:teuthology.orchestra.run.smithi079.stdout: * extras: mirror.facebook.net 2019-12-08T12:01:52.292 INFO:teuthology.orchestra.run.smithi079.stdout: * updates: mirror.math.princeton.edu 2019-12-08T12:01:52.319 INFO:teuthology.orchestra.run.smithi013.stdout: Installing : 2:ceph-fuse-15.0.0-7900.g1351c81.el7.x86_64 5/5 2019-12-08T12:01:52.428 INFO:teuthology.orchestra.run.smithi013.stdout: Verifying : 2:ceph-fuse-15.0.0-7900.g1351c81.el7.x86_64 1/5 2019-12-08T12:01:52.545 INFO:teuthology.orchestra.run.smithi013.stdout: Verifying : python3-setuptools-39.2.0-10.el7.noarch 2/5 2019-12-08T12:01:52.645 INFO:teuthology.orchestra.run.smithi013.stdout: Verifying : python3-libs-3.6.8-10.el7.x86_64 3/5 2019-12-08T12:01:52.746 INFO:teuthology.orchestra.run.smithi013.stdout: Verifying : python3-3.6.8-10.el7.x86_64 4/5 2019-12-08T12:01:52.936 INFO:teuthology.orchestra.run.smithi079.stdout:7 packages excluded due to repository priority protections 2019-12-08T12:01:53.240 INFO:teuthology.orchestra.run.smithi013.stdout: Verifying : python3-pip-9.0.3-5.el7.noarch 5/5 2019-12-08T12:01:53.240 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T12:01:53.240 INFO:teuthology.orchestra.run.smithi013.stdout:Installed: 2019-12-08T12:01:53.240 INFO:teuthology.orchestra.run.smithi013.stdout: ceph-fuse.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-08T12:01:53.241 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T12:01:53.241 INFO:teuthology.orchestra.run.smithi013.stdout:Dependency Installed: 2019-12-08T12:01:53.241 INFO:teuthology.orchestra.run.smithi013.stdout: python3.x86_64 0:3.6.8-10.el7 python3-libs.x86_64 0:3.6.8-10.el7 2019-12-08T12:01:53.241 INFO:teuthology.orchestra.run.smithi013.stdout: python3-pip.noarch 0:9.0.3-5.el7 python3-setuptools.noarch 0:39.2.0-10.el7 2019-12-08T12:01:53.241 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T12:01:53.241 INFO:teuthology.orchestra.run.smithi013.stdout:Complete! 2019-12-08T12:01:53.266 INFO:teuthology.orchestra.run.smithi079.stdout:Package 2:librados2-15.0.0-7900.g1351c81.el7.x86_64 already installed and latest version 2019-12-08T12:01:53.266 INFO:teuthology.orchestra.run.smithi079.stdout:Nothing to do 2019-12-08T12:01:53.326 INFO:teuthology.orchestra.run.smithi079:> sudo yum -y install librbd1 2019-12-08T12:01:53.375 INFO:teuthology.orchestra.run.smithi013:> sudo yum -y install libcephfs2 2019-12-08T12:01:53.584 INFO:teuthology.orchestra.run.smithi079.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-08T12:01:53.627 INFO:teuthology.orchestra.run.smithi079.stdout:Loading mirror speeds from cached hostfile 2019-12-08T12:01:53.628 INFO:teuthology.orchestra.run.smithi079.stdout: * base: mirrors.umflint.edu 2019-12-08T12:01:53.628 INFO:teuthology.orchestra.run.smithi079.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-08T12:01:53.628 INFO:teuthology.orchestra.run.smithi079.stdout: * extras: mirror.facebook.net 2019-12-08T12:01:53.629 INFO:teuthology.orchestra.run.smithi079.stdout: * updates: mirror.math.princeton.edu 2019-12-08T12:01:53.643 INFO:teuthology.orchestra.run.smithi013.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-08T12:01:53.689 INFO:teuthology.orchestra.run.smithi013.stdout:Loading mirror speeds from cached hostfile 2019-12-08T12:01:53.690 INFO:teuthology.orchestra.run.smithi013.stdout: * base: mirrors.umflint.edu 2019-12-08T12:01:53.690 INFO:teuthology.orchestra.run.smithi013.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-08T12:01:53.691 INFO:teuthology.orchestra.run.smithi013.stdout: * extras: mirror.facebook.net 2019-12-08T12:01:53.691 INFO:teuthology.orchestra.run.smithi013.stdout: * updates: mirror.math.princeton.edu 2019-12-08T12:01:54.273 INFO:teuthology.orchestra.run.smithi079.stdout:7 packages excluded due to repository priority protections 2019-12-08T12:01:54.358 INFO:teuthology.orchestra.run.smithi013.stdout:7 packages excluded due to repository priority protections 2019-12-08T12:01:54.610 INFO:teuthology.orchestra.run.smithi079.stdout:Package 2:librbd1-15.0.0-7900.g1351c81.el7.x86_64 already installed and latest version 2019-12-08T12:01:54.610 INFO:teuthology.orchestra.run.smithi079.stdout:Nothing to do 2019-12-08T12:01:54.673 INFO:teuthology.orchestra.run.smithi079:> sudo yum -y install python-ceph 2019-12-08T12:01:54.706 INFO:teuthology.orchestra.run.smithi013.stdout:Package 2:libcephfs2-15.0.0-7900.g1351c81.el7.x86_64 already installed and latest version 2019-12-08T12:01:54.706 INFO:teuthology.orchestra.run.smithi013.stdout:Nothing to do 2019-12-08T12:01:54.768 INFO:teuthology.orchestra.run.smithi013:> sudo yum -y install libcephfs-devel 2019-12-08T12:01:54.890 INFO:teuthology.orchestra.run.smithi079.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-08T12:01:54.930 INFO:teuthology.orchestra.run.smithi079.stdout:Loading mirror speeds from cached hostfile 2019-12-08T12:01:54.931 INFO:teuthology.orchestra.run.smithi079.stdout: * base: mirrors.umflint.edu 2019-12-08T12:01:54.932 INFO:teuthology.orchestra.run.smithi079.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-08T12:01:54.932 INFO:teuthology.orchestra.run.smithi079.stdout: * extras: mirror.facebook.net 2019-12-08T12:01:54.932 INFO:teuthology.orchestra.run.smithi079.stdout: * updates: mirror.math.princeton.edu 2019-12-08T12:01:54.986 INFO:teuthology.orchestra.run.smithi013.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-08T12:01:55.030 INFO:teuthology.orchestra.run.smithi013.stdout:Loading mirror speeds from cached hostfile 2019-12-08T12:01:55.032 INFO:teuthology.orchestra.run.smithi013.stdout: * base: mirrors.umflint.edu 2019-12-08T12:01:55.032 INFO:teuthology.orchestra.run.smithi013.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-08T12:01:55.032 INFO:teuthology.orchestra.run.smithi013.stdout: * extras: mirror.facebook.net 2019-12-08T12:01:55.032 INFO:teuthology.orchestra.run.smithi013.stdout: * updates: mirror.math.princeton.edu 2019-12-08T12:01:55.575 INFO:teuthology.orchestra.run.smithi079.stdout:7 packages excluded due to repository priority protections 2019-12-08T12:01:55.709 INFO:teuthology.orchestra.run.smithi013.stdout:7 packages excluded due to repository priority protections 2019-12-08T12:01:55.902 INFO:teuthology.orchestra.run.smithi079.stdout:Resolving Dependencies 2019-12-08T12:01:55.903 INFO:teuthology.orchestra.run.smithi079.stdout:--> Running transaction check 2019-12-08T12:01:55.903 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package python-ceph-compat.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-08T12:01:56.055 INFO:teuthology.orchestra.run.smithi013.stdout:Resolving Dependencies 2019-12-08T12:01:56.056 INFO:teuthology.orchestra.run.smithi013.stdout:--> Running transaction check 2019-12-08T12:01:56.056 INFO:teuthology.orchestra.run.smithi013.stdout:---> Package libcephfs-devel.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-08T12:01:56.056 INFO:teuthology.orchestra.run.smithi013.stdout:--> Processing Dependency: librados-devel = 2:15.0.0-7900.g1351c81.el7 for package: 2:libcephfs-devel-15.0.0-7900.g1351c81.el7.x86_64 2019-12-08T12:01:56.088 INFO:teuthology.orchestra.run.smithi013.stdout:--> Running transaction check 2019-12-08T12:01:56.088 INFO:teuthology.orchestra.run.smithi013.stdout:---> Package librados-devel.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-08T12:01:56.270 INFO:teuthology.orchestra.run.smithi079.stdout:--> Finished Dependency Resolution 2019-12-08T12:01:56.454 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:01:56.455 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies Resolved 2019-12-08T12:01:56.456 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:01:56.456 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2019-12-08T12:01:56.456 INFO:teuthology.orchestra.run.smithi079.stdout: Package Arch Version Repository 2019-12-08T12:01:56.457 INFO:teuthology.orchestra.run.smithi079.stdout: Size 2019-12-08T12:01:56.457 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2019-12-08T12:01:56.457 INFO:teuthology.orchestra.run.smithi079.stdout:Installing: 2019-12-08T12:01:56.457 INFO:teuthology.orchestra.run.smithi079.stdout: python-ceph-compat x86_64 2:15.0.0-7900.g1351c81.el7 ceph 2.2 k 2019-12-08T12:01:56.458 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:01:56.458 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction Summary 2019-12-08T12:01:56.458 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2019-12-08T12:01:56.459 INFO:teuthology.orchestra.run.smithi079.stdout:Install 1 Package 2019-12-08T12:01:56.459 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:01:56.459 INFO:teuthology.orchestra.run.smithi079.stdout:Total download size: 2.2 k 2019-12-08T12:01:56.459 INFO:teuthology.orchestra.run.smithi079.stdout:Installed size: 0 2019-12-08T12:01:56.459 INFO:teuthology.orchestra.run.smithi079.stdout:Downloading packages: 2019-12-08T12:01:56.485 INFO:teuthology.orchestra.run.smithi013.stdout:--> Finished Dependency Resolution 2019-12-08T12:01:56.720 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction check 2019-12-08T12:01:56.721 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction test 2019-12-08T12:01:56.722 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction test succeeded 2019-12-08T12:01:56.722 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction 2019-12-08T12:01:56.729 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T12:01:56.729 INFO:teuthology.orchestra.run.smithi013.stdout:Dependencies Resolved 2019-12-08T12:01:56.730 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T12:01:56.730 INFO:teuthology.orchestra.run.smithi013.stdout:================================================================================ 2019-12-08T12:01:56.731 INFO:teuthology.orchestra.run.smithi013.stdout: Package Arch Version Repository 2019-12-08T12:01:56.731 INFO:teuthology.orchestra.run.smithi013.stdout: Size 2019-12-08T12:01:56.731 INFO:teuthology.orchestra.run.smithi013.stdout:================================================================================ 2019-12-08T12:01:56.731 INFO:teuthology.orchestra.run.smithi013.stdout:Installing: 2019-12-08T12:01:56.731 INFO:teuthology.orchestra.run.smithi013.stdout: libcephfs-devel x86_64 2:15.0.0-7900.g1351c81.el7 ceph 17 k 2019-12-08T12:01:56.731 INFO:teuthology.orchestra.run.smithi013.stdout:Installing for dependencies: 2019-12-08T12:01:56.731 INFO:teuthology.orchestra.run.smithi013.stdout: librados-devel x86_64 2:15.0.0-7900.g1351c81.el7 ceph 153 k 2019-12-08T12:01:56.732 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T12:01:56.732 INFO:teuthology.orchestra.run.smithi013.stdout:Transaction Summary 2019-12-08T12:01:56.732 INFO:teuthology.orchestra.run.smithi013.stdout:================================================================================ 2019-12-08T12:01:56.732 INFO:teuthology.orchestra.run.smithi013.stdout:Install 1 Package (+1 Dependent package) 2019-12-08T12:01:56.732 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T12:01:56.732 INFO:teuthology.orchestra.run.smithi013.stdout:Total download size: 170 k 2019-12-08T12:01:56.732 INFO:teuthology.orchestra.run.smithi013.stdout:Installed size: 679 k 2019-12-08T12:01:56.733 INFO:teuthology.orchestra.run.smithi013.stdout:Downloading packages: 2019-12-08T12:01:57.111 INFO:teuthology.orchestra.run.smithi013.stdout:-------------------------------------------------------------------------------- 2019-12-08T12:01:57.112 INFO:teuthology.orchestra.run.smithi013.stdout:Total 446 kB/s | 170 kB 00:00 2019-12-08T12:01:57.115 INFO:teuthology.orchestra.run.smithi013.stdout:Running transaction check 2019-12-08T12:01:57.127 INFO:teuthology.orchestra.run.smithi013.stdout:Running transaction test 2019-12-08T12:01:57.130 INFO:teuthology.orchestra.run.smithi013.stdout:Transaction test succeeded 2019-12-08T12:01:57.131 INFO:teuthology.orchestra.run.smithi013.stdout:Running transaction 2019-12-08T12:01:57.335 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : 2:python-ceph-compat-15.0.0-7900.g1351c81.el7.x86_64 1/1 2019-12-08T12:01:57.778 INFO:teuthology.orchestra.run.smithi013.stdout: Installing : 2:librados-devel-15.0.0-7900.g1351c81.el7.x86_64 1/2 2019-12-08T12:01:57.812 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : 2:python-ceph-compat-15.0.0-7900.g1351c81.el7.x86_64 1/1 2019-12-08T12:01:57.813 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:01:57.813 INFO:teuthology.orchestra.run.smithi079.stdout:Installed: 2019-12-08T12:01:57.813 INFO:teuthology.orchestra.run.smithi079.stdout: python-ceph-compat.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-08T12:01:57.813 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:01:57.813 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2019-12-08T12:01:57.932 INFO:teuthology.orchestra.run.smithi079:> sudo yum -y install rbd-fuse 2019-12-08T12:01:58.048 INFO:teuthology.orchestra.run.smithi013.stdout: Installing : 2:libcephfs-devel-15.0.0-7900.g1351c81.el7.x86_64 2/2 2019-12-08T12:01:58.149 INFO:teuthology.orchestra.run.smithi013.stdout: Verifying : 2:librados-devel-15.0.0-7900.g1351c81.el7.x86_64 1/2 2019-12-08T12:01:58.157 INFO:teuthology.orchestra.run.smithi079.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-08T12:01:58.199 INFO:teuthology.orchestra.run.smithi079.stdout:Loading mirror speeds from cached hostfile 2019-12-08T12:01:58.201 INFO:teuthology.orchestra.run.smithi079.stdout: * base: mirrors.umflint.edu 2019-12-08T12:01:58.201 INFO:teuthology.orchestra.run.smithi079.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-08T12:01:58.202 INFO:teuthology.orchestra.run.smithi079.stdout: * extras: mirror.facebook.net 2019-12-08T12:01:58.202 INFO:teuthology.orchestra.run.smithi079.stdout: * updates: mirror.math.princeton.edu 2019-12-08T12:01:58.657 INFO:teuthology.orchestra.run.smithi013.stdout: Verifying : 2:libcephfs-devel-15.0.0-7900.g1351c81.el7.x86_64 2/2 2019-12-08T12:01:58.657 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T12:01:58.657 INFO:teuthology.orchestra.run.smithi013.stdout:Installed: 2019-12-08T12:01:58.657 INFO:teuthology.orchestra.run.smithi013.stdout: libcephfs-devel.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-08T12:01:58.658 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T12:01:58.658 INFO:teuthology.orchestra.run.smithi013.stdout:Dependency Installed: 2019-12-08T12:01:58.658 INFO:teuthology.orchestra.run.smithi013.stdout: librados-devel.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-08T12:01:58.658 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T12:01:58.658 INFO:teuthology.orchestra.run.smithi013.stdout:Complete! 2019-12-08T12:01:58.774 INFO:teuthology.orchestra.run.smithi013:> sudo yum -y install librados2 2019-12-08T12:01:58.847 INFO:teuthology.orchestra.run.smithi079.stdout:7 packages excluded due to repository priority protections 2019-12-08T12:01:59.047 INFO:teuthology.orchestra.run.smithi013.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-08T12:01:59.093 INFO:teuthology.orchestra.run.smithi013.stdout:Loading mirror speeds from cached hostfile 2019-12-08T12:01:59.094 INFO:teuthology.orchestra.run.smithi013.stdout: * base: mirrors.umflint.edu 2019-12-08T12:01:59.095 INFO:teuthology.orchestra.run.smithi013.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-08T12:01:59.095 INFO:teuthology.orchestra.run.smithi013.stdout: * extras: mirror.facebook.net 2019-12-08T12:01:59.096 INFO:teuthology.orchestra.run.smithi013.stdout: * updates: mirror.math.princeton.edu 2019-12-08T12:01:59.179 INFO:teuthology.orchestra.run.smithi079.stdout:Resolving Dependencies 2019-12-08T12:01:59.180 INFO:teuthology.orchestra.run.smithi079.stdout:--> Running transaction check 2019-12-08T12:01:59.180 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package rbd-fuse.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-08T12:01:59.552 INFO:teuthology.orchestra.run.smithi079.stdout:--> Finished Dependency Resolution 2019-12-08T12:01:59.736 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:01:59.737 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies Resolved 2019-12-08T12:01:59.737 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:01:59.738 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2019-12-08T12:01:59.738 INFO:teuthology.orchestra.run.smithi079.stdout: Package Arch Version Repository Size 2019-12-08T12:01:59.738 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2019-12-08T12:01:59.738 INFO:teuthology.orchestra.run.smithi079.stdout:Installing: 2019-12-08T12:01:59.738 INFO:teuthology.orchestra.run.smithi079.stdout: rbd-fuse x86_64 2:15.0.0-7900.g1351c81.el7 ceph 76 k 2019-12-08T12:01:59.738 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:01:59.739 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction Summary 2019-12-08T12:01:59.739 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2019-12-08T12:01:59.739 INFO:teuthology.orchestra.run.smithi079.stdout:Install 1 Package 2019-12-08T12:01:59.739 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:01:59.739 INFO:teuthology.orchestra.run.smithi079.stdout:Total download size: 76 k 2019-12-08T12:01:59.739 INFO:teuthology.orchestra.run.smithi079.stdout:Installed size: 200 k 2019-12-08T12:01:59.739 INFO:teuthology.orchestra.run.smithi079.stdout:Downloading packages: 2019-12-08T12:01:59.766 INFO:teuthology.orchestra.run.smithi013.stdout:7 packages excluded due to repository priority protections 2019-12-08T12:02:00.063 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction check 2019-12-08T12:02:00.083 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction test 2019-12-08T12:02:00.085 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction test succeeded 2019-12-08T12:02:00.085 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction 2019-12-08T12:02:00.120 INFO:teuthology.orchestra.run.smithi013.stdout:Package 2:librados2-15.0.0-7900.g1351c81.el7.x86_64 already installed and latest version 2019-12-08T12:02:00.121 INFO:teuthology.orchestra.run.smithi013.stdout:Nothing to do 2019-12-08T12:02:00.182 INFO:teuthology.orchestra.run.smithi013:> sudo yum -y install librbd1 2019-12-08T12:02:00.369 INFO:teuthology.orchestra.run.smithi013.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-08T12:02:00.410 INFO:teuthology.orchestra.run.smithi013.stdout:Loading mirror speeds from cached hostfile 2019-12-08T12:02:00.411 INFO:teuthology.orchestra.run.smithi013.stdout: * base: mirrors.umflint.edu 2019-12-08T12:02:00.411 INFO:teuthology.orchestra.run.smithi013.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-08T12:02:00.411 INFO:teuthology.orchestra.run.smithi013.stdout: * extras: mirror.facebook.net 2019-12-08T12:02:00.412 INFO:teuthology.orchestra.run.smithi013.stdout: * updates: mirror.math.princeton.edu 2019-12-08T12:02:00.732 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : 2:rbd-fuse-15.0.0-7900.g1351c81.el7.x86_64 1/1 2019-12-08T12:02:01.040 INFO:teuthology.orchestra.run.smithi013.stdout:7 packages excluded due to repository priority protections 2019-12-08T12:02:01.217 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : 2:rbd-fuse-15.0.0-7900.g1351c81.el7.x86_64 1/1 2019-12-08T12:02:01.217 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:02:01.217 INFO:teuthology.orchestra.run.smithi079.stdout:Installed: 2019-12-08T12:02:01.217 INFO:teuthology.orchestra.run.smithi079.stdout: rbd-fuse.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-08T12:02:01.218 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:02:01.218 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2019-12-08T12:02:01.326 DEBUG:teuthology.parallel:result is None 2019-12-08T12:02:01.380 INFO:teuthology.orchestra.run.smithi013.stdout:Package 2:librbd1-15.0.0-7900.g1351c81.el7.x86_64 already installed and latest version 2019-12-08T12:02:01.380 INFO:teuthology.orchestra.run.smithi013.stdout:Nothing to do 2019-12-08T12:02:01.442 INFO:teuthology.orchestra.run.smithi013:> sudo yum -y install python-ceph 2019-12-08T12:02:01.697 INFO:teuthology.orchestra.run.smithi013.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-08T12:02:01.744 INFO:teuthology.orchestra.run.smithi013.stdout:Loading mirror speeds from cached hostfile 2019-12-08T12:02:01.745 INFO:teuthology.orchestra.run.smithi013.stdout: * base: mirrors.umflint.edu 2019-12-08T12:02:01.745 INFO:teuthology.orchestra.run.smithi013.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-08T12:02:01.746 INFO:teuthology.orchestra.run.smithi013.stdout: * extras: mirror.facebook.net 2019-12-08T12:02:01.746 INFO:teuthology.orchestra.run.smithi013.stdout: * updates: mirror.math.princeton.edu 2019-12-08T12:02:02.412 INFO:teuthology.orchestra.run.smithi013.stdout:7 packages excluded due to repository priority protections 2019-12-08T12:02:02.762 INFO:teuthology.orchestra.run.smithi013.stdout:Resolving Dependencies 2019-12-08T12:02:02.762 INFO:teuthology.orchestra.run.smithi013.stdout:--> Running transaction check 2019-12-08T12:02:02.762 INFO:teuthology.orchestra.run.smithi013.stdout:---> Package python-ceph-compat.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-08T12:02:03.152 INFO:teuthology.orchestra.run.smithi013.stdout:--> Finished Dependency Resolution 2019-12-08T12:02:03.344 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T12:02:03.345 INFO:teuthology.orchestra.run.smithi013.stdout:Dependencies Resolved 2019-12-08T12:02:03.346 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T12:02:03.346 INFO:teuthology.orchestra.run.smithi013.stdout:================================================================================ 2019-12-08T12:02:03.346 INFO:teuthology.orchestra.run.smithi013.stdout: Package Arch Version Repository 2019-12-08T12:02:03.347 INFO:teuthology.orchestra.run.smithi013.stdout: Size 2019-12-08T12:02:03.347 INFO:teuthology.orchestra.run.smithi013.stdout:================================================================================ 2019-12-08T12:02:03.347 INFO:teuthology.orchestra.run.smithi013.stdout:Installing: 2019-12-08T12:02:03.347 INFO:teuthology.orchestra.run.smithi013.stdout: python-ceph-compat x86_64 2:15.0.0-7900.g1351c81.el7 ceph 2.2 k 2019-12-08T12:02:03.348 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T12:02:03.348 INFO:teuthology.orchestra.run.smithi013.stdout:Transaction Summary 2019-12-08T12:02:03.348 INFO:teuthology.orchestra.run.smithi013.stdout:================================================================================ 2019-12-08T12:02:03.348 INFO:teuthology.orchestra.run.smithi013.stdout:Install 1 Package 2019-12-08T12:02:03.348 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T12:02:03.349 INFO:teuthology.orchestra.run.smithi013.stdout:Total download size: 2.2 k 2019-12-08T12:02:03.349 INFO:teuthology.orchestra.run.smithi013.stdout:Installed size: 0 2019-12-08T12:02:03.349 INFO:teuthology.orchestra.run.smithi013.stdout:Downloading packages: 2019-12-08T12:02:03.654 INFO:teuthology.orchestra.run.smithi013.stdout:Running transaction check 2019-12-08T12:02:03.655 INFO:teuthology.orchestra.run.smithi013.stdout:Running transaction test 2019-12-08T12:02:03.657 INFO:teuthology.orchestra.run.smithi013.stdout:Transaction test succeeded 2019-12-08T12:02:03.658 INFO:teuthology.orchestra.run.smithi013.stdout:Running transaction 2019-12-08T12:02:04.251 INFO:teuthology.orchestra.run.smithi013.stdout: Installing : 2:python-ceph-compat-15.0.0-7900.g1351c81.el7.x86_64 1/1 2019-12-08T12:02:04.776 INFO:teuthology.orchestra.run.smithi013.stdout: Verifying : 2:python-ceph-compat-15.0.0-7900.g1351c81.el7.x86_64 1/1 2019-12-08T12:02:04.777 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T12:02:04.777 INFO:teuthology.orchestra.run.smithi013.stdout:Installed: 2019-12-08T12:02:04.777 INFO:teuthology.orchestra.run.smithi013.stdout: python-ceph-compat.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-08T12:02:04.777 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T12:02:04.777 INFO:teuthology.orchestra.run.smithi013.stdout:Complete! 2019-12-08T12:02:04.885 INFO:teuthology.orchestra.run.smithi013:> sudo yum -y install rbd-fuse 2019-12-08T12:02:05.133 INFO:teuthology.orchestra.run.smithi013.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-08T12:02:05.177 INFO:teuthology.orchestra.run.smithi013.stdout:Loading mirror speeds from cached hostfile 2019-12-08T12:02:05.178 INFO:teuthology.orchestra.run.smithi013.stdout: * base: mirrors.umflint.edu 2019-12-08T12:02:05.178 INFO:teuthology.orchestra.run.smithi013.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-08T12:02:05.179 INFO:teuthology.orchestra.run.smithi013.stdout: * extras: mirror.facebook.net 2019-12-08T12:02:05.179 INFO:teuthology.orchestra.run.smithi013.stdout: * updates: mirror.math.princeton.edu 2019-12-08T12:02:05.845 INFO:teuthology.orchestra.run.smithi013.stdout:7 packages excluded due to repository priority protections 2019-12-08T12:02:06.198 INFO:teuthology.orchestra.run.smithi013.stdout:Resolving Dependencies 2019-12-08T12:02:06.198 INFO:teuthology.orchestra.run.smithi013.stdout:--> Running transaction check 2019-12-08T12:02:06.198 INFO:teuthology.orchestra.run.smithi013.stdout:---> Package rbd-fuse.x86_64 2:15.0.0-7900.g1351c81.el7 will be installed 2019-12-08T12:02:06.593 INFO:teuthology.orchestra.run.smithi013.stdout:--> Finished Dependency Resolution 2019-12-08T12:02:06.785 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T12:02:06.785 INFO:teuthology.orchestra.run.smithi013.stdout:Dependencies Resolved 2019-12-08T12:02:06.786 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T12:02:06.786 INFO:teuthology.orchestra.run.smithi013.stdout:================================================================================ 2019-12-08T12:02:06.786 INFO:teuthology.orchestra.run.smithi013.stdout: Package Arch Version Repository Size 2019-12-08T12:02:06.786 INFO:teuthology.orchestra.run.smithi013.stdout:================================================================================ 2019-12-08T12:02:06.786 INFO:teuthology.orchestra.run.smithi013.stdout:Installing: 2019-12-08T12:02:06.786 INFO:teuthology.orchestra.run.smithi013.stdout: rbd-fuse x86_64 2:15.0.0-7900.g1351c81.el7 ceph 76 k 2019-12-08T12:02:06.787 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T12:02:06.787 INFO:teuthology.orchestra.run.smithi013.stdout:Transaction Summary 2019-12-08T12:02:06.787 INFO:teuthology.orchestra.run.smithi013.stdout:================================================================================ 2019-12-08T12:02:06.787 INFO:teuthology.orchestra.run.smithi013.stdout:Install 1 Package 2019-12-08T12:02:06.787 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T12:02:06.787 INFO:teuthology.orchestra.run.smithi013.stdout:Total download size: 76 k 2019-12-08T12:02:06.787 INFO:teuthology.orchestra.run.smithi013.stdout:Installed size: 200 k 2019-12-08T12:02:06.787 INFO:teuthology.orchestra.run.smithi013.stdout:Downloading packages: 2019-12-08T12:02:07.119 INFO:teuthology.orchestra.run.smithi013.stdout:Running transaction check 2019-12-08T12:02:07.134 INFO:teuthology.orchestra.run.smithi013.stdout:Running transaction test 2019-12-08T12:02:07.136 INFO:teuthology.orchestra.run.smithi013.stdout:Transaction test succeeded 2019-12-08T12:02:07.137 INFO:teuthology.orchestra.run.smithi013.stdout:Running transaction 2019-12-08T12:02:07.747 INFO:teuthology.orchestra.run.smithi013.stdout: Installing : 2:rbd-fuse-15.0.0-7900.g1351c81.el7.x86_64 1/1 2019-12-08T12:02:08.214 INFO:teuthology.orchestra.run.smithi013.stdout: Verifying : 2:rbd-fuse-15.0.0-7900.g1351c81.el7.x86_64 1/1 2019-12-08T12:02:08.214 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T12:02:08.214 INFO:teuthology.orchestra.run.smithi013.stdout:Installed: 2019-12-08T12:02:08.215 INFO:teuthology.orchestra.run.smithi013.stdout: rbd-fuse.x86_64 2:15.0.0-7900.g1351c81.el7 2019-12-08T12:02:08.215 INFO:teuthology.orchestra.run.smithi013.stdout: 2019-12-08T12:02:08.215 INFO:teuthology.orchestra.run.smithi013.stdout:Complete! 2019-12-08T12:02:08.338 DEBUG:teuthology.parallel:result is None 2019-12-08T12:02:08.338 INFO:teuthology.orchestra.run.smithi013:> sudo lsb_release -is 2019-12-08T12:02:08.485 INFO:teuthology.orchestra.run.smithi013.stdout:CentOS 2019-12-08T12:02:08.487 DEBUG:teuthology.misc:System to be installed: CentOS 2019-12-08T12:02:08.487 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=notcmalloc&distros=centos%2F7%2Fx86_64&sha1=1351c819e1a9518cde4c8b12d645782009028360 2019-12-08T12:02:08.655 INFO:teuthology.orchestra.run.smithi013:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2019-12-08T12:02:08.795 INFO:teuthology.orchestra.run.smithi013.stdout:15.0.0-7900.g1351c81.el7 2019-12-08T12:02:08.796 INFO:teuthology.packaging:The installed version of ceph is 15.0.0-7900.g1351c81.el7 2019-12-08T12:02:08.796 INFO:teuthology.task.install:The correct ceph version 15.0.0-7900.g1351c81 is installed. 2019-12-08T12:02:08.796 INFO:teuthology.orchestra.run.smithi079:> sudo lsb_release -is 2019-12-08T12:02:08.946 INFO:teuthology.orchestra.run.smithi079.stdout:CentOS 2019-12-08T12:02:08.948 DEBUG:teuthology.misc:System to be installed: CentOS 2019-12-08T12:02:08.948 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=notcmalloc&distros=centos%2F7%2Fx86_64&sha1=1351c819e1a9518cde4c8b12d645782009028360 2019-12-08T12:02:09.132 INFO:teuthology.orchestra.run.smithi079:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2019-12-08T12:02:09.266 INFO:teuthology.orchestra.run.smithi079.stdout:15.0.0-7900.g1351c81.el7 2019-12-08T12:02:09.266 INFO:teuthology.packaging:The installed version of ceph is 15.0.0-7900.g1351c81.el7 2019-12-08T12:02:09.267 INFO:teuthology.task.install:The correct ceph version 15.0.0-7900.g1351c81 is installed. 2019-12-08T12:02:09.267 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2019-12-08T12:02:09.267 INFO:teuthology.orchestra.run.smithi013:> sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp' 2019-12-08T12:02:09.394 INFO:teuthology.orchestra.run.smithi079:> sudo sh -c 'cat > /home/ubuntu/cephtest/valgrind.supp' 2019-12-08T12:02:09.516 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2019-12-08T12:02:09.516 INFO:teuthology.orchestra.run.smithi013:> sudo sh -c 'cat > /usr/bin/daemon-helper' 2019-12-08T12:02:09.646 INFO:teuthology.orchestra.run.smithi013:> sudo chmod a=rx -- /usr/bin/daemon-helper 2019-12-08T12:02:09.754 INFO:teuthology.orchestra.run.smithi079:> sudo sh -c 'cat > /usr/bin/daemon-helper' 2019-12-08T12:02:09.873 INFO:teuthology.orchestra.run.smithi079:> sudo chmod a=rx -- /usr/bin/daemon-helper 2019-12-08T12:02:09.984 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2019-12-08T12:02:09.984 INFO:teuthology.orchestra.run.smithi013:> sudo sh -c 'cat > /usr/bin/adjust-ulimits' 2019-12-08T12:02:10.108 INFO:teuthology.orchestra.run.smithi013:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2019-12-08T12:02:10.222 INFO:teuthology.orchestra.run.smithi079:> sudo sh -c 'cat > /usr/bin/adjust-ulimits' 2019-12-08T12:02:10.344 INFO:teuthology.orchestra.run.smithi079:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2019-12-08T12:02:10.453 INFO:teuthology.run_tasks:Running task ceph... 2019-12-08T12:02:10.529 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2019-12-08T12:02:10.530 INFO:teuthology.orchestra.run.smithi013:> sudo chmod 777 /var/log/ceph 2019-12-08T12:02:10.534 INFO:teuthology.orchestra.run.smithi079:> sudo chmod 777 /var/log/ceph 2019-12-08T12:02:10.652 INFO:tasks.ceph:Disabling ceph logrotate... 2019-12-08T12:02:10.653 INFO:teuthology.orchestra.run.smithi013:> sudo rm -f -- /etc/logrotate.d/ceph 2019-12-08T12:02:10.656 INFO:teuthology.orchestra.run.smithi079:> sudo rm -f -- /etc/logrotate.d/ceph 2019-12-08T12:02:10.775 INFO:tasks.ceph:Creating extra log directories... 2019-12-08T12:02:10.775 INFO:teuthology.orchestra.run.smithi013:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2019-12-08T12:02:10.779 INFO:teuthology.orchestra.run.smithi079:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2019-12-08T12:02:10.888 INFO:tasks.ceph:Creating ceph cluster ceph... 2019-12-08T12:02:10.888 INFO:tasks.ceph:config {'mon_bind_addrvec': True, 'block_journal': None, 'fs': 'xfs', 'log_whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME'], 'skip_mgr_daemons': False, 'cpu_profile': set([]), 'mkfs_options': None, 'tmpfs_journal': None, 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mount_options': None, 'conf': {'global': {'osd heartbeat grace': 40, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'mon client directed command retry': 5, 'osd_min_pg_log_entries': 10}, 'osd': {'debug ms': 1, 'debug journal': 20, 'osd fast shutdown': False, 'debug osd': 25, 'osd objectstore': 'filestore', 'osd sloppy crc': True, 'debug filestore': 20, 'osd shutdown pgref assert': True}, 'mon': {'debug mon': 20, 'debug paxos': 20, 'mon osd crush smoke test': False, 'debug ms': 1}, 'client': {'debug rgw': 20, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt require ssl': False, 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw lc debug interval': 10}}} 2019-12-08T12:02:10.888 INFO:tasks.ceph:ctx.config {'kernel': {'sha1': 'distro', 'kdb': True}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.lock_machines': (2, 'smithi')}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'sha1': 'distro', 'kdb': True}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'flavor': 'notcmalloc', 'sha1': '1351c819e1a9518cde4c8b12d645782009028360'}}, {'ceph': None}, {'openssl_keys': None}, {'rgw': {'client.0': {'valgrind': ['--tool=memcheck', '--max-threads=1024']}}}, {'workunit': {'clients': {'client.0': ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'rgw/test_rgw_gc_log.sh']}}}, {'ragweed': {'client.0': {'rgw_server': 'client.0', 'stages': 'prepare,check', 'default-branch': 'ceph-master'}}}, {'s3tests-java': {'client.0': {'force-repo': 'https://github.com/ceph/java_s3tests.git', 'force-branch': 'master'}}}, {'s3tests': {'client.0': {'rgw_server': 'client.0', 'force-branch': 'ceph-master'}}}, {'swift': {'client.0': {'rgw_server': 'client.0'}}}], 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_wip-ofriedma-dynamic-disable/qa', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/worker.smithi.8221', 'owner': 'scheduled_ofriedma@teuthology', 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'targets': {'smithi079.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQDK3FF9LXJUxI2LJnN2FGurplJHQTejs1aTDdq0n1HhR7SjH4kdcyQ5vI7akCyilK0+e4eOdRh+ugdWM5PjcUdkxEiJZUxTaoMzjn2LvIMUZQIaveaRj5qzBtXFaQ2xE1xvVfG+Obd4cwwGJwrpPFIdhkTP1jMGh5YuEkOCPR3Xm79jqZGtoRSaCh/YDy7HJguGy7vLKvcIPLqn35342GELG+IvmybsZbt2Y+qQsuLTi68WJ8DP7+yhc4e1pZQCquklFP+rKfsolL+61T4/fle1cDWQNTLAJxzOMfyHCaKU37aHh/5hFvOwLPfr1n2AYyZZAPODpNfMjwA30H7LRt35', 'smithi013.front.sepia.ceph.com': 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABAQCs8CHTlkGGVUhK//xeIq/ZW6yThV7qdcRIBVUKV4O1J78xgmAW1sHJ1fJuRGHTyrJwYUID1fPeXF6S/PmOyJ3xV+SmEoCWULez987CTkznkBihsGvv2VCxvVgiOlT0dUx7O70x5sHvjhvWPdE7EJQQfaB9iOdq4Bbgnbnh04qNlPJ+JbcfszwgfXZEBhpJ3pJSVrkvgG+uX2LhSeHSjBaUkQ/xJ1EGHMD6r+Z/XzqJnOfqaEy2WUZNSd10Pmcs6Z0YMjzygfzV2LzI6agbraLpj5RHJc4z4McqbMxdMr1tQuaBTNTFmu78zKWLE8qA9g+ZcEAt19gkM+o2M3hI40p5'}, 'job_id': '4581733', 'tube': 'smithi', 'suite_branch': 'wip-ofriedma-dynamic-disable', 'priority': 30, 'first_in_suite': False, 'branch': 'wip-ofriedma-dynamic-disable', 'suite': 'rgw', 'email': 'ofriedma@redhat.com', 'archive_path': '/home/teuthworker/archive/ofriedma-2019-12-08_11:30:09-rgw-wip-ofriedma-dynamic-disable-distro-basic-smithi/4581733', 'description': 'rgw/verify/{clusters/fixed-2.yaml frontend/civetweb.yaml msgr-failures/few.yaml objectstore/filestore-xfs.yaml overrides.yaml proto/http.yaml rgw_pool_type/ec-profile.yaml tasks/{0-install.yaml cls.yaml ragweed.yaml s3tests-java.yaml s3tests.yaml swift.yaml} validater/valgrind.yaml}', 'nuke-on-error': True, 'repo': 'https://github.com/ceph/ceph-ci.git', 'last_in_suite': False, 'machine_type': 'smithi', 'teuthology_branch': 'master', 'sha1': '1351c819e1a9518cde4c8b12d645782009028360', 'name': 'ofriedma-2019-12-08_11:30:09-rgw-wip-ofriedma-dynamic-disable-distro-basic-smithi', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1']], 'suite_relpath': 'qa', 'suite_repo': 'git://git.ceph.com/ceph-ci.git', 'suite_sha1': '1351c819e1a9518cde4c8b12d645782009028360', 'os_type': 'centos', 'overrides': {'ceph': {'conf': {'global': {'osd heartbeat grace': 40, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'mon client directed command retry': 5, 'osd_min_pg_log_entries': 10}, 'osd': {'debug ms': 1, 'debug journal': 20, 'osd fast shutdown': False, 'debug osd': 25, 'osd objectstore': 'filestore', 'osd sloppy crc': True, 'debug filestore': 20, 'osd shutdown pgref assert': True}, 'mon': {'debug mon': 20, 'debug paxos': 20, 'mon osd crush smoke test': False, 'debug ms': 1}, 'client': {'debug rgw': 20, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt require ssl': False, 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw lc debug interval': 10}}, 'log-whitelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME'], 'valgrind': {'mds': ['--tool=memcheck'], 'mon': ['--tool=memcheck', '--leak-check=full', '--show-reachable=yes'], 'osd': ['--tool=memcheck']}, 'fs': 'xfs', 'sha1': '1351c819e1a9518cde4c8b12d645782009028360'}, 's3tests': {'slow_backend': True}, 'ceph-deploy': {'fs': 'xfs', 'filestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'osd sloppy crc': True, 'osd objectstore': 'filestore'}}}, 'install': {'ceph': {'flavor': 'notcmalloc', 'sha1': '1351c819e1a9518cde4c8b12d645782009028360'}}, 'rgw': {'frontend': 'civetweb', 'compression type': 'random', 'storage classes': 'LUKEWARM, FROZEN', 'erasure_code_profile': {'crush-failure-domain': 'osd', 'k': 3, 'm': 1, 'name': 'testprofile'}, 'ec-data-pool': True}, 'admin_socket': {'branch': 'wip-ofriedma-dynamic-disable'}, 'workunit': {'sha1': '1351c819e1a9518cde4c8b12d645782009028360', 'branch': 'wip-ofriedma-dynamic-disable'}}} 2019-12-08T12:02:10.889 INFO:teuthology.orchestra.run.smithi013:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2019-12-08T12:02:10.895 INFO:teuthology.orchestra.run.smithi079:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2019-12-08T12:02:10.970 INFO:teuthology.orchestra.run.smithi013:> sudo install -d -m0777 -- /var/run/ceph 2019-12-08T12:02:10.974 INFO:teuthology.orchestra.run.smithi079:> sudo install -d -m0777 -- /var/run/ceph 2019-12-08T12:02:11.151 DEBUG:teuthology.orchestra.remote:smithi013:/scratch_devs is 72B 2019-12-08T12:02:11.230 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2019-12-08T12:02:11.231 INFO:teuthology.orchestra.run.smithi013:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2019-12-08T12:02:11.307 INFO:teuthology.orchestra.run.smithi013.stdout: File: ‘/dev/vg_nvme/lv_4’ -> ‘../dm-1’ 2019-12-08T12:02:11.307 INFO:teuthology.orchestra.run.smithi013.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-12-08T12:02:11.307 INFO:teuthology.orchestra.run.smithi013.stdout:Device: 5h/5d Inode: 106657 Links: 1 2019-12-08T12:02:11.307 INFO:teuthology.orchestra.run.smithi013.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-12-08T12:02:11.307 INFO:teuthology.orchestra.run.smithi013.stdout:Context: system_u:object_r:device_t:s0 2019-12-08T12:02:11.307 INFO:teuthology.orchestra.run.smithi013.stdout:Access: 2019-12-08 12:00:58.817132238 +0000 2019-12-08T12:02:11.308 INFO:teuthology.orchestra.run.smithi013.stdout:Modify: 2019-12-08 11:59:09.139618091 +0000 2019-12-08T12:02:11.308 INFO:teuthology.orchestra.run.smithi013.stdout:Change: 2019-12-08 11:59:09.139618091 +0000 2019-12-08T12:02:11.308 INFO:teuthology.orchestra.run.smithi013.stdout: Birth: - 2019-12-08T12:02:11.332 INFO:teuthology.orchestra.run.smithi013.stderr:1+0 records in 2019-12-08T12:02:11.332 INFO:teuthology.orchestra.run.smithi013.stderr:1+0 records out 2019-12-08T12:02:11.332 INFO:teuthology.orchestra.run.smithi013.stderr:512 bytes (512 B) copied, 0.000453718 s, 1.1 MB/s 2019-12-08T12:02:11.337 INFO:teuthology.orchestra.run.smithi013:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2019-12-08T12:02:11.403 INFO:teuthology.orchestra.run.smithi013.stdout: File: ‘/dev/vg_nvme/lv_3’ -> ‘../dm-2’ 2019-12-08T12:02:11.403 INFO:teuthology.orchestra.run.smithi013.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-12-08T12:02:11.403 INFO:teuthology.orchestra.run.smithi013.stdout:Device: 5h/5d Inode: 108607 Links: 1 2019-12-08T12:02:11.404 INFO:teuthology.orchestra.run.smithi013.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-12-08T12:02:11.404 INFO:teuthology.orchestra.run.smithi013.stdout:Context: system_u:object_r:device_t:s0 2019-12-08T12:02:11.404 INFO:teuthology.orchestra.run.smithi013.stdout:Access: 2019-12-08 12:00:58.817132238 +0000 2019-12-08T12:02:11.404 INFO:teuthology.orchestra.run.smithi013.stdout:Modify: 2019-12-08 11:59:09.633600737 +0000 2019-12-08T12:02:11.404 INFO:teuthology.orchestra.run.smithi013.stdout:Change: 2019-12-08 11:59:09.633600737 +0000 2019-12-08T12:02:11.404 INFO:teuthology.orchestra.run.smithi013.stdout: Birth: - 2019-12-08T12:02:11.438 INFO:teuthology.orchestra.run.smithi013.stderr:1+0 records in 2019-12-08T12:02:11.438 INFO:teuthology.orchestra.run.smithi013.stderr:1+0 records out 2019-12-08T12:02:11.439 INFO:teuthology.orchestra.run.smithi013.stderr:512 bytes (512 B) copied, 0.000443444 s, 1.2 MB/s 2019-12-08T12:02:11.439 INFO:teuthology.orchestra.run.smithi013:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2019-12-08T12:02:11.503 INFO:teuthology.orchestra.run.smithi013.stdout: File: ‘/dev/vg_nvme/lv_2’ -> ‘../dm-3’ 2019-12-08T12:02:11.503 INFO:teuthology.orchestra.run.smithi013.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-12-08T12:02:11.503 INFO:teuthology.orchestra.run.smithi013.stdout:Device: 5h/5d Inode: 108656 Links: 1 2019-12-08T12:02:11.504 INFO:teuthology.orchestra.run.smithi013.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-12-08T12:02:11.504 INFO:teuthology.orchestra.run.smithi013.stdout:Context: system_u:object_r:device_t:s0 2019-12-08T12:02:11.504 INFO:teuthology.orchestra.run.smithi013.stdout:Access: 2019-12-08 12:00:58.818132238 +0000 2019-12-08T12:02:11.504 INFO:teuthology.orchestra.run.smithi013.stdout:Modify: 2019-12-08 11:59:10.140582926 +0000 2019-12-08T12:02:11.504 INFO:teuthology.orchestra.run.smithi013.stdout:Change: 2019-12-08 11:59:10.140582926 +0000 2019-12-08T12:02:11.504 INFO:teuthology.orchestra.run.smithi013.stdout: Birth: - 2019-12-08T12:02:11.524 INFO:teuthology.orchestra.run.smithi013.stderr:1+0 records in 2019-12-08T12:02:11.525 INFO:teuthology.orchestra.run.smithi013.stderr:1+0 records out 2019-12-08T12:02:11.525 INFO:teuthology.orchestra.run.smithi013.stderr:512 bytes (512 B) copied, 0.000434308 s, 1.2 MB/s 2019-12-08T12:02:11.530 INFO:teuthology.orchestra.run.smithi013:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2019-12-08T12:02:11.593 INFO:teuthology.orchestra.run.smithi013.stdout: File: ‘/dev/vg_nvme/lv_1’ -> ‘../dm-4’ 2019-12-08T12:02:11.593 INFO:teuthology.orchestra.run.smithi013.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-12-08T12:02:11.593 INFO:teuthology.orchestra.run.smithi013.stdout:Device: 5h/5d Inode: 106707 Links: 1 2019-12-08T12:02:11.593 INFO:teuthology.orchestra.run.smithi013.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-12-08T12:02:11.593 INFO:teuthology.orchestra.run.smithi013.stdout:Context: system_u:object_r:device_t:s0 2019-12-08T12:02:11.593 INFO:teuthology.orchestra.run.smithi013.stdout:Access: 2019-12-08 12:00:58.818132238 +0000 2019-12-08T12:02:11.594 INFO:teuthology.orchestra.run.smithi013.stdout:Modify: 2019-12-08 11:59:10.631565678 +0000 2019-12-08T12:02:11.594 INFO:teuthology.orchestra.run.smithi013.stdout:Change: 2019-12-08 11:59:10.631565678 +0000 2019-12-08T12:02:11.594 INFO:teuthology.orchestra.run.smithi013.stdout: Birth: - 2019-12-08T12:02:11.610 INFO:teuthology.orchestra.run.smithi013.stderr:1+0 records in 2019-12-08T12:02:11.610 INFO:teuthology.orchestra.run.smithi013.stderr:1+0 records out 2019-12-08T12:02:11.610 INFO:teuthology.orchestra.run.smithi013.stderr:512 bytes (512 B) copied, 0.000372806 s, 1.4 MB/s 2019-12-08T12:02:11.613 INFO:tasks.ceph:fs option selected, checking for scratch devs 2019-12-08T12:02:11.613 INFO:tasks.ceph:found devs: ['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2019-12-08T12:02:11.613 WARNING:teuthology.misc:Entering get_wwn_id_map, a deprecated function that will be removed 2019-12-08T12:02:11.614 INFO:tasks.ceph:dev map: {'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'} 2019-12-08T12:02:11.706 DEBUG:teuthology.orchestra.remote:smithi079:/scratch_devs is 72B 2019-12-08T12:02:11.798 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2019-12-08T12:02:11.798 INFO:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_4 && sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_4 2019-12-08T12:02:11.869 INFO:teuthology.orchestra.run.smithi079.stdout: File: ‘/dev/vg_nvme/lv_4’ -> ‘../dm-1’ 2019-12-08T12:02:11.869 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-12-08T12:02:11.869 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 5h/5d Inode: 98773 Links: 1 2019-12-08T12:02:11.870 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-12-08T12:02:11.870 INFO:teuthology.orchestra.run.smithi079.stdout:Context: system_u:object_r:device_t:s0 2019-12-08T12:02:11.870 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2019-12-08 12:00:55.316621712 +0000 2019-12-08T12:02:11.870 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2019-12-08 11:59:01.259087312 +0000 2019-12-08T12:02:11.870 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2019-12-08 11:59:01.259087312 +0000 2019-12-08T12:02:11.870 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: - 2019-12-08T12:02:11.899 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2019-12-08T12:02:11.899 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2019-12-08T12:02:11.899 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes (512 B) copied, 0.000453303 s, 1.1 MB/s 2019-12-08T12:02:11.904 INFO:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_3 && sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_3 2019-12-08T12:02:11.987 INFO:teuthology.orchestra.run.smithi079.stdout: File: ‘/dev/vg_nvme/lv_3’ -> ‘../dm-2’ 2019-12-08T12:02:11.987 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-12-08T12:02:11.987 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 5h/5d Inode: 98803 Links: 1 2019-12-08T12:02:11.988 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-12-08T12:02:11.988 INFO:teuthology.orchestra.run.smithi079.stdout:Context: system_u:object_r:device_t:s0 2019-12-08T12:02:11.988 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2019-12-08 12:00:55.316621712 +0000 2019-12-08T12:02:11.988 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2019-12-08 11:59:01.724074804 +0000 2019-12-08T12:02:11.988 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2019-12-08 11:59:01.724074804 +0000 2019-12-08T12:02:11.988 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: - 2019-12-08T12:02:12.012 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2019-12-08T12:02:12.012 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2019-12-08T12:02:12.012 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes (512 B) copied, 0.000343205 s, 1.5 MB/s 2019-12-08T12:02:12.016 INFO:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_2 && sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_2 2019-12-08T12:02:12.078 INFO:teuthology.orchestra.run.smithi079.stdout: File: ‘/dev/vg_nvme/lv_2’ -> ‘../dm-3’ 2019-12-08T12:02:12.078 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-12-08T12:02:12.079 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 5h/5d Inode: 108679 Links: 1 2019-12-08T12:02:12.079 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-12-08T12:02:12.079 INFO:teuthology.orchestra.run.smithi079.stdout:Context: system_u:object_r:device_t:s0 2019-12-08T12:02:12.079 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2019-12-08 12:00:55.316621712 +0000 2019-12-08T12:02:12.079 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2019-12-08 11:59:02.206061839 +0000 2019-12-08T12:02:12.079 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2019-12-08 11:59:02.206061839 +0000 2019-12-08T12:02:12.079 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: - 2019-12-08T12:02:12.101 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2019-12-08T12:02:12.101 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2019-12-08T12:02:12.102 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes (512 B) copied, 0.000342808 s, 1.5 MB/s 2019-12-08T12:02:12.102 INFO:teuthology.orchestra.run.smithi079:> stat /dev/vg_nvme/lv_1 && sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 && ! mount | grep -q /dev/vg_nvme/lv_1 2019-12-08T12:02:12.153 INFO:teuthology.orchestra.run.smithi079.stdout: File: ‘/dev/vg_nvme/lv_1’ -> ‘../dm-4’ 2019-12-08T12:02:12.154 INFO:teuthology.orchestra.run.smithi079.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2019-12-08T12:02:12.154 INFO:teuthology.orchestra.run.smithi079.stdout:Device: 5h/5d Inode: 98860 Links: 1 2019-12-08T12:02:12.154 INFO:teuthology.orchestra.run.smithi079.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2019-12-08T12:02:12.154 INFO:teuthology.orchestra.run.smithi079.stdout:Context: system_u:object_r:device_t:s0 2019-12-08T12:02:12.154 INFO:teuthology.orchestra.run.smithi079.stdout:Access: 2019-12-08 12:00:55.316621712 +0000 2019-12-08T12:02:12.154 INFO:teuthology.orchestra.run.smithi079.stdout:Modify: 2019-12-08 11:59:02.665049493 +0000 2019-12-08T12:02:12.154 INFO:teuthology.orchestra.run.smithi079.stdout:Change: 2019-12-08 11:59:02.665049493 +0000 2019-12-08T12:02:12.155 INFO:teuthology.orchestra.run.smithi079.stdout: Birth: - 2019-12-08T12:02:12.170 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records in 2019-12-08T12:02:12.170 INFO:teuthology.orchestra.run.smithi079.stderr:1+0 records out 2019-12-08T12:02:12.170 INFO:teuthology.orchestra.run.smithi079.stderr:512 bytes (512 B) copied, 0.000371395 s, 1.4 MB/s 2019-12-08T12:02:12.173 INFO:tasks.ceph:fs option selected, checking for scratch devs 2019-12-08T12:02:12.173 INFO:tasks.ceph:found devs: ['/dev/vg_nvme/lv_4', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_1'] 2019-12-08T12:02:12.173 WARNING:teuthology.misc:Entering get_wwn_id_map, a deprecated function that will be removed 2019-12-08T12:02:12.173 INFO:tasks.ceph:dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2019-12-08T12:02:12.173 INFO:tasks.ceph:Generating config... 2019-12-08T12:02:12.174 INFO:tasks.ceph:[global] osd heartbeat grace = 40 2019-12-08T12:02:12.175 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2019-12-08T12:02:12.175 INFO:tasks.ceph:[global] osd_max_pg_log_entries = 10 2019-12-08T12:02:12.175 INFO:tasks.ceph:[global] mon client directed command retry = 5 2019-12-08T12:02:12.175 INFO:tasks.ceph:[global] osd_min_pg_log_entries = 10 2019-12-08T12:02:12.175 INFO:tasks.ceph:[osd] debug ms = 1 2019-12-08T12:02:12.175 INFO:tasks.ceph:[osd] debug journal = 20 2019-12-08T12:02:12.175 INFO:tasks.ceph:[osd] osd fast shutdown = False 2019-12-08T12:02:12.176 INFO:tasks.ceph:[osd] debug osd = 25 2019-12-08T12:02:12.176 INFO:tasks.ceph:[osd] osd objectstore = filestore 2019-12-08T12:02:12.176 INFO:tasks.ceph:[osd] osd sloppy crc = True 2019-12-08T12:02:12.176 INFO:tasks.ceph:[osd] debug filestore = 20 2019-12-08T12:02:12.176 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2019-12-08T12:02:12.176 INFO:tasks.ceph:[mon] debug mon = 20 2019-12-08T12:02:12.176 INFO:tasks.ceph:[mon] debug paxos = 20 2019-12-08T12:02:12.176 INFO:tasks.ceph:[mon] mon osd crush smoke test = False 2019-12-08T12:02:12.177 INFO:tasks.ceph:[mon] debug ms = 1 2019-12-08T12:02:12.177 INFO:tasks.ceph:[client] debug rgw = 20 2019-12-08T12:02:12.177 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2019-12-08T12:02:12.177 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2019-12-08T12:02:12.177 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2019-12-08T12:02:12.177 INFO:tasks.ceph:[client] rgw lc debug interval = 10 2019-12-08T12:02:12.177 INFO:tasks.ceph:Setting up mon.a... 2019-12-08T12:02:12.178 INFO:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2019-12-08T12:02:12.328 INFO:teuthology.orchestra.run.smithi079.stdout:creating /etc/ceph/ceph.keyring 2019-12-08T12:02:12.333 INFO:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2019-12-08T12:02:12.470 INFO:teuthology.orchestra.run.smithi079:> sudo chmod 0644 /etc/ceph/ceph.keyring 2019-12-08T12:02:12.585 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.79'), ('mon.c', '[v2:172.21.15.79:3301,v1:172.21.15.79:6790]'), ('mon.b', '172.21.15.13')] 2019-12-08T12:02:12.585 INFO:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool --create --clobber --enable-all-features --add a 172.21.15.79 --addv c '[v2:172.21.15.79:3301,v1:172.21.15.79:6790]' --add b 172.21.15.13 --print /home/ubuntu/cephtest/ceph.monmap 2019-12-08T12:02:12.723 INFO:teuthology.orchestra.run.smithi079.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2019-12-08T12:02:12.723 INFO:teuthology.orchestra.run.smithi079.stdout:monmaptool: generated fsid 1a1450cf-cae7-41b0-ba4a-fe494bbfc59f 2019-12-08T12:02:12.723 INFO:teuthology.orchestra.run.smithi079.stdout:epoch 0 2019-12-08T12:02:12.723 INFO:teuthology.orchestra.run.smithi079.stdout:fsid 1a1450cf-cae7-41b0-ba4a-fe494bbfc59f 2019-12-08T12:02:12.723 INFO:teuthology.orchestra.run.smithi079.stdout:last_changed 2019-12-08T12:02:12.711477+0000 2019-12-08T12:02:12.723 INFO:teuthology.orchestra.run.smithi079.stdout:created 2019-12-08T12:02:12.711477+0000 2019-12-08T12:02:12.724 INFO:teuthology.orchestra.run.smithi079.stdout:min_mon_release 0 (unknown) 2019-12-08T12:02:12.724 INFO:teuthology.orchestra.run.smithi079.stdout:0: [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] mon.a 2019-12-08T12:02:12.724 INFO:teuthology.orchestra.run.smithi079.stdout:1: [v2:172.21.15.13:3300/0,v1:172.21.15.13:6789/0] mon.b 2019-12-08T12:02:12.724 INFO:teuthology.orchestra.run.smithi079.stdout:2: [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] mon.c 2019-12-08T12:02:12.724 INFO:teuthology.orchestra.run.smithi079.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2019-12-08T12:02:12.725 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 1a1450cf-cae7-41b0-ba4a-fe494bbfc59f... 2019-12-08T12:02:12.726 INFO:teuthology.orchestra.run.smithi013:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo python -c 'import shutil, sys; shutil.copyfileobj(sys.stdin, file(sys.argv[1], "wb"))' /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf 2019-12-08T12:02:12.730 INFO:teuthology.orchestra.run.smithi079:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo python -c 'import shutil, sys; shutil.copyfileobj(sys.stdin, file(sys.argv[1], "wb"))' /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf 2019-12-08T12:02:12.960 INFO:tasks.ceph:Creating admin key on mon.a... 2019-12-08T12:02:12.961 INFO:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2019-12-08T12:02:13.142 INFO:tasks.ceph:Copying monmap to all nodes... 2019-12-08T12:02:13.231 DEBUG:teuthology.orchestra.remote:smithi079:/etc/ceph/ceph.keyring is 206B 2019-12-08T12:02:13.406 DEBUG:teuthology.orchestra.remote:smithi079:/home/ubuntu/cephtest/ceph.monmap is 379B 2019-12-08T12:02:13.484 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi013.front.sepia.ceph.com 2019-12-08T12:02:13.484 INFO:teuthology.orchestra.run.smithi013:> sudo sh -c 'cat > /etc/ceph/ceph.keyring' && sudo chmod 0644 /etc/ceph/ceph.keyring 2019-12-08T12:02:13.642 INFO:teuthology.orchestra.run.smithi013:> cat > /home/ubuntu/cephtest/ceph.monmap 2019-12-08T12:02:13.726 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi079.front.sepia.ceph.com 2019-12-08T12:02:13.726 INFO:teuthology.orchestra.run.smithi079:> sudo sh -c 'cat > /etc/ceph/ceph.keyring' && sudo chmod 0644 /etc/ceph/ceph.keyring 2019-12-08T12:02:13.864 INFO:teuthology.orchestra.run.smithi079:> cat > /home/ubuntu/cephtest/ceph.monmap 2019-12-08T12:02:13.930 INFO:tasks.ceph:Setting up mon nodes... 2019-12-08T12:02:13.930 INFO:tasks.ceph:Setting up mgr nodes... 2019-12-08T12:02:13.930 INFO:teuthology.orchestra.run.smithi013:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2019-12-08T12:02:14.148 INFO:teuthology.orchestra.run.smithi013.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2019-12-08T12:02:14.154 INFO:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2019-12-08T12:02:14.327 INFO:teuthology.orchestra.run.smithi079.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2019-12-08T12:02:14.333 INFO:tasks.ceph:Setting up mds nodes... 2019-12-08T12:02:14.333 INFO:tasks.ceph_client:Setting up client nodes... 2019-12-08T12:02:14.334 INFO:teuthology.orchestra.run.smithi013:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2019-12-08T12:02:14.494 INFO:teuthology.orchestra.run.smithi013.stdout:creating /etc/ceph/ceph.client.1.keyring 2019-12-08T12:02:14.531 INFO:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2019-12-08T12:02:14.682 INFO:teuthology.orchestra.run.smithi079.stdout:creating /etc/ceph/ceph.client.0.keyring 2019-12-08T12:02:14.716 INFO:tasks.ceph:Running mkfs on osd nodes... 2019-12-08T12:02:14.716 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi013.front.sepia.ceph.com'): {'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'}, Remote(name='ubuntu@smithi079.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'}} 2019-12-08T12:02:14.716 INFO:teuthology.orchestra.run.smithi013:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2019-12-08T12:02:14.838 INFO:tasks.ceph:{'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'} 2019-12-08T12:02:14.838 INFO:tasks.ceph:{} 2019-12-08T12:02:14.838 INFO:tasks.ceph:osd.4 2019-12-08T12:02:14.838 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi013.front.sepia.ceph.com 2019-12-08T12:02:14.838 INFO:teuthology.orchestra.run.smithi013:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2019-12-08T12:02:15.615 INFO:teuthology.orchestra.run.smithi013.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2019-12-08T12:02:15.616 INFO:teuthology.orchestra.run.smithi013.stdout: = sectsz=512 attr=2, projid32bit=1 2019-12-08T12:02:15.616 INFO:teuthology.orchestra.run.smithi013.stdout: = crc=1 finobt=0, sparse=0 2019-12-08T12:02:15.616 INFO:teuthology.orchestra.run.smithi013.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-12-08T12:02:15.616 INFO:teuthology.orchestra.run.smithi013.stdout: = sunit=0 swidth=0 blks 2019-12-08T12:02:15.616 INFO:teuthology.orchestra.run.smithi013.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-12-08T12:02:15.616 INFO:teuthology.orchestra.run.smithi013.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-12-08T12:02:15.616 INFO:teuthology.orchestra.run.smithi013.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-12-08T12:02:15.617 INFO:teuthology.orchestra.run.smithi013.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-12-08T12:02:15.618 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi013.front.sepia.ceph.com -o noatime 2019-12-08T12:02:15.618 INFO:teuthology.orchestra.run.smithi013:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-4 2019-12-08T12:02:15.803 INFO:teuthology.orchestra.run.smithi013:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2019-12-08T12:02:15.927 INFO:teuthology.orchestra.run.smithi013:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2019-12-08T12:02:16.042 INFO:tasks.ceph:{'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'} 2019-12-08T12:02:16.043 INFO:tasks.ceph:{} 2019-12-08T12:02:16.043 INFO:tasks.ceph:osd.5 2019-12-08T12:02:16.043 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi013.front.sepia.ceph.com 2019-12-08T12:02:16.043 INFO:teuthology.orchestra.run.smithi013:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2019-12-08T12:02:16.770 INFO:teuthology.orchestra.run.smithi013.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2019-12-08T12:02:16.771 INFO:teuthology.orchestra.run.smithi013.stdout: = sectsz=512 attr=2, projid32bit=1 2019-12-08T12:02:16.771 INFO:teuthology.orchestra.run.smithi013.stdout: = crc=1 finobt=0, sparse=0 2019-12-08T12:02:16.771 INFO:teuthology.orchestra.run.smithi013.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-12-08T12:02:16.771 INFO:teuthology.orchestra.run.smithi013.stdout: = sunit=0 swidth=0 blks 2019-12-08T12:02:16.771 INFO:teuthology.orchestra.run.smithi013.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-12-08T12:02:16.772 INFO:teuthology.orchestra.run.smithi013.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-12-08T12:02:16.772 INFO:teuthology.orchestra.run.smithi013.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-12-08T12:02:16.772 INFO:teuthology.orchestra.run.smithi013.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-12-08T12:02:16.773 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi013.front.sepia.ceph.com -o noatime 2019-12-08T12:02:16.774 INFO:teuthology.orchestra.run.smithi013:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-5 2019-12-08T12:02:16.921 INFO:teuthology.orchestra.run.smithi013:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2019-12-08T12:02:17.035 INFO:teuthology.orchestra.run.smithi013:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2019-12-08T12:02:17.140 INFO:tasks.ceph:{'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'} 2019-12-08T12:02:17.140 INFO:tasks.ceph:{} 2019-12-08T12:02:17.140 INFO:tasks.ceph:osd.6 2019-12-08T12:02:17.140 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi013.front.sepia.ceph.com 2019-12-08T12:02:17.141 INFO:teuthology.orchestra.run.smithi013:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2019-12-08T12:02:17.837 INFO:teuthology.orchestra.run.smithi013.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2019-12-08T12:02:17.837 INFO:teuthology.orchestra.run.smithi013.stdout: = sectsz=512 attr=2, projid32bit=1 2019-12-08T12:02:17.838 INFO:teuthology.orchestra.run.smithi013.stdout: = crc=1 finobt=0, sparse=0 2019-12-08T12:02:17.838 INFO:teuthology.orchestra.run.smithi013.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-12-08T12:02:17.838 INFO:teuthology.orchestra.run.smithi013.stdout: = sunit=0 swidth=0 blks 2019-12-08T12:02:17.838 INFO:teuthology.orchestra.run.smithi013.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-12-08T12:02:17.838 INFO:teuthology.orchestra.run.smithi013.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-12-08T12:02:17.838 INFO:teuthology.orchestra.run.smithi013.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-12-08T12:02:17.838 INFO:teuthology.orchestra.run.smithi013.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-12-08T12:02:17.840 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi013.front.sepia.ceph.com -o noatime 2019-12-08T12:02:17.840 INFO:teuthology.orchestra.run.smithi013:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-6 2019-12-08T12:02:18.010 INFO:teuthology.orchestra.run.smithi013:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2019-12-08T12:02:18.126 INFO:teuthology.orchestra.run.smithi013:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2019-12-08T12:02:18.236 INFO:tasks.ceph:{'osd.5': '/dev/vg_nvme/lv_1', 'osd.4': '/dev/vg_nvme/lv_4', 'osd.7': '/dev/vg_nvme/lv_3', 'osd.6': '/dev/vg_nvme/lv_2'} 2019-12-08T12:02:18.236 INFO:tasks.ceph:{} 2019-12-08T12:02:18.236 INFO:tasks.ceph:osd.7 2019-12-08T12:02:18.236 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi013.front.sepia.ceph.com 2019-12-08T12:02:18.237 INFO:teuthology.orchestra.run.smithi013:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2019-12-08T12:02:18.982 INFO:teuthology.orchestra.run.smithi013.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2019-12-08T12:02:18.983 INFO:teuthology.orchestra.run.smithi013.stdout: = sectsz=512 attr=2, projid32bit=1 2019-12-08T12:02:18.983 INFO:teuthology.orchestra.run.smithi013.stdout: = crc=1 finobt=0, sparse=0 2019-12-08T12:02:18.983 INFO:teuthology.orchestra.run.smithi013.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-12-08T12:02:18.983 INFO:teuthology.orchestra.run.smithi013.stdout: = sunit=0 swidth=0 blks 2019-12-08T12:02:18.983 INFO:teuthology.orchestra.run.smithi013.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-12-08T12:02:18.983 INFO:teuthology.orchestra.run.smithi013.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-12-08T12:02:18.984 INFO:teuthology.orchestra.run.smithi013.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-12-08T12:02:18.984 INFO:teuthology.orchestra.run.smithi013.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-12-08T12:02:18.985 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi013.front.sepia.ceph.com -o noatime 2019-12-08T12:02:18.986 INFO:teuthology.orchestra.run.smithi013:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-7 2019-12-08T12:02:19.157 INFO:teuthology.orchestra.run.smithi013:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2019-12-08T12:02:19.272 INFO:teuthology.orchestra.run.smithi013:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-12-08T12:02:19.547 INFO:teuthology.orchestra.run.smithi013.stderr:2019-12-08T12:02:19.548+0000 7f97dde5ab40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2019-12-08T12:02:19.547 INFO:teuthology.orchestra.run.smithi013.stderr:2019-12-08T12:02:19.549+0000 7f97dde5ab40 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2019-12-08T12:02:19.562 INFO:teuthology.orchestra.run.smithi013.stderr:2019-12-08T12:02:19.563+0000 7f97dde5ab40 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-12-08T12:02:19.562 INFO:teuthology.orchestra.run.smithi013.stderr:2019-12-08T12:02:19.563+0000 7f97dde5ab40 -1 journal FileJournal::_open_file : zeroing journal 2019-12-08T12:02:19.686 INFO:teuthology.orchestra.run.smithi013.stderr:2019-12-08T12:02:19.687+0000 7f97dde5ab40 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-12-08T12:02:19.687 INFO:teuthology.orchestra.run.smithi013.stderr:2019-12-08T12:02:19.688+0000 7f97dde5ab40 -1 journal do_read_entry(4096): bad header magic 2019-12-08T12:02:19.687 INFO:teuthology.orchestra.run.smithi013.stderr:2019-12-08T12:02:19.688+0000 7f97dde5ab40 -1 journal do_read_entry(4096): bad header magic 2019-12-08T12:02:19.702 INFO:teuthology.orchestra.run.smithi013:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2019-12-08T12:02:19.807 INFO:teuthology.orchestra.run.smithi013:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-12-08T12:02:19.925 INFO:teuthology.orchestra.run.smithi013.stderr:2019-12-08T12:02:19.922+0000 7f0b3d01db40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2019-12-08T12:02:19.925 INFO:teuthology.orchestra.run.smithi013.stderr:2019-12-08T12:02:19.923+0000 7f0b3d01db40 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2019-12-08T12:02:19.935 INFO:teuthology.orchestra.run.smithi013.stderr:2019-12-08T12:02:19.936+0000 7f0b3d01db40 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-12-08T12:02:19.935 INFO:teuthology.orchestra.run.smithi013.stderr:2019-12-08T12:02:19.936+0000 7f0b3d01db40 -1 journal FileJournal::_open_file : zeroing journal 2019-12-08T12:02:20.059 INFO:teuthology.orchestra.run.smithi013.stderr:2019-12-08T12:02:20.060+0000 7f0b3d01db40 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-12-08T12:02:20.059 INFO:teuthology.orchestra.run.smithi013.stderr:2019-12-08T12:02:20.060+0000 7f0b3d01db40 -1 journal do_read_entry(4096): bad header magic 2019-12-08T12:02:20.059 INFO:teuthology.orchestra.run.smithi013.stderr:2019-12-08T12:02:20.060+0000 7f0b3d01db40 -1 journal do_read_entry(4096): bad header magic 2019-12-08T12:02:20.073 INFO:teuthology.orchestra.run.smithi013:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2019-12-08T12:02:20.180 INFO:teuthology.orchestra.run.smithi013:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-12-08T12:02:20.337 INFO:teuthology.orchestra.run.smithi013.stderr:2019-12-08T12:02:20.338+0000 7fe7572e8b40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2019-12-08T12:02:20.338 INFO:teuthology.orchestra.run.smithi013.stderr:2019-12-08T12:02:20.339+0000 7fe7572e8b40 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2019-12-08T12:02:20.352 INFO:teuthology.orchestra.run.smithi013.stderr:2019-12-08T12:02:20.353+0000 7fe7572e8b40 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-12-08T12:02:20.352 INFO:teuthology.orchestra.run.smithi013.stderr:2019-12-08T12:02:20.353+0000 7fe7572e8b40 -1 journal FileJournal::_open_file : zeroing journal 2019-12-08T12:02:20.476 INFO:teuthology.orchestra.run.smithi013.stderr:2019-12-08T12:02:20.477+0000 7fe7572e8b40 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-12-08T12:02:20.476 INFO:teuthology.orchestra.run.smithi013.stderr:2019-12-08T12:02:20.477+0000 7fe7572e8b40 -1 journal do_read_entry(4096): bad header magic 2019-12-08T12:02:20.476 INFO:teuthology.orchestra.run.smithi013.stderr:2019-12-08T12:02:20.477+0000 7fe7572e8b40 -1 journal do_read_entry(4096): bad header magic 2019-12-08T12:02:20.488 INFO:teuthology.orchestra.run.smithi013:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2019-12-08T12:02:20.571 INFO:teuthology.orchestra.run.smithi013:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-12-08T12:02:20.721 INFO:teuthology.orchestra.run.smithi013.stderr:2019-12-08T12:02:20.722+0000 7fb6a7f70b40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2019-12-08T12:02:20.722 INFO:teuthology.orchestra.run.smithi013.stderr:2019-12-08T12:02:20.723+0000 7fb6a7f70b40 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2019-12-08T12:02:20.738 INFO:teuthology.orchestra.run.smithi013.stderr:2019-12-08T12:02:20.739+0000 7fb6a7f70b40 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-12-08T12:02:20.738 INFO:teuthology.orchestra.run.smithi013.stderr:2019-12-08T12:02:20.739+0000 7fb6a7f70b40 -1 journal FileJournal::_open_file : zeroing journal 2019-12-08T12:02:20.862 INFO:teuthology.orchestra.run.smithi013.stderr:2019-12-08T12:02:20.863+0000 7fb6a7f70b40 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-12-08T12:02:20.862 INFO:teuthology.orchestra.run.smithi013.stderr:2019-12-08T12:02:20.863+0000 7fb6a7f70b40 -1 journal do_read_entry(4096): bad header magic 2019-12-08T12:02:20.862 INFO:teuthology.orchestra.run.smithi013.stderr:2019-12-08T12:02:20.863+0000 7fb6a7f70b40 -1 journal do_read_entry(4096): bad header magic 2019-12-08T12:02:20.874 INFO:teuthology.orchestra.run.smithi013:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2019-12-08T12:02:20.978 INFO:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2019-12-08T12:02:21.100 INFO:tasks.ceph:{'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2019-12-08T12:02:21.100 INFO:tasks.ceph:{} 2019-12-08T12:02:21.100 INFO:tasks.ceph:osd.0 2019-12-08T12:02:21.100 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi079.front.sepia.ceph.com 2019-12-08T12:02:21.100 INFO:teuthology.orchestra.run.smithi079:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2019-12-08T12:02:21.699 INFO:teuthology.orchestra.run.smithi079.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2019-12-08T12:02:21.700 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 attr=2, projid32bit=1 2019-12-08T12:02:21.700 INFO:teuthology.orchestra.run.smithi079.stdout: = crc=1 finobt=0, sparse=0 2019-12-08T12:02:21.700 INFO:teuthology.orchestra.run.smithi079.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-12-08T12:02:21.700 INFO:teuthology.orchestra.run.smithi079.stdout: = sunit=0 swidth=0 blks 2019-12-08T12:02:21.700 INFO:teuthology.orchestra.run.smithi079.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-12-08T12:02:21.700 INFO:teuthology.orchestra.run.smithi079.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-12-08T12:02:21.701 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-12-08T12:02:21.701 INFO:teuthology.orchestra.run.smithi079.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-12-08T12:02:21.702 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi079.front.sepia.ceph.com -o noatime 2019-12-08T12:02:21.702 INFO:teuthology.orchestra.run.smithi079:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-0 2019-12-08T12:02:21.870 INFO:teuthology.orchestra.run.smithi079:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2019-12-08T12:02:21.970 INFO:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2019-12-08T12:02:22.059 INFO:tasks.ceph:{'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2019-12-08T12:02:22.059 INFO:tasks.ceph:{} 2019-12-08T12:02:22.059 INFO:tasks.ceph:osd.1 2019-12-08T12:02:22.059 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi079.front.sepia.ceph.com 2019-12-08T12:02:22.060 INFO:teuthology.orchestra.run.smithi079:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2019-12-08T12:02:22.608 INFO:teuthology.orchestra.run.smithi079.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2019-12-08T12:02:22.609 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 attr=2, projid32bit=1 2019-12-08T12:02:22.609 INFO:teuthology.orchestra.run.smithi079.stdout: = crc=1 finobt=0, sparse=0 2019-12-08T12:02:22.609 INFO:teuthology.orchestra.run.smithi079.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-12-08T12:02:22.609 INFO:teuthology.orchestra.run.smithi079.stdout: = sunit=0 swidth=0 blks 2019-12-08T12:02:22.610 INFO:teuthology.orchestra.run.smithi079.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-12-08T12:02:22.610 INFO:teuthology.orchestra.run.smithi079.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-12-08T12:02:22.610 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-12-08T12:02:22.611 INFO:teuthology.orchestra.run.smithi079.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-12-08T12:02:22.612 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi079.front.sepia.ceph.com -o noatime 2019-12-08T12:02:22.612 INFO:teuthology.orchestra.run.smithi079:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2019-12-08T12:02:22.756 INFO:teuthology.orchestra.run.smithi079:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2019-12-08T12:02:22.841 INFO:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2019-12-08T12:02:22.907 INFO:tasks.ceph:{'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2019-12-08T12:02:22.907 INFO:tasks.ceph:{} 2019-12-08T12:02:22.908 INFO:tasks.ceph:osd.2 2019-12-08T12:02:22.908 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi079.front.sepia.ceph.com 2019-12-08T12:02:22.908 INFO:teuthology.orchestra.run.smithi079:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2019-12-08T12:02:23.476 INFO:teuthology.orchestra.run.smithi079.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2019-12-08T12:02:23.477 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 attr=2, projid32bit=1 2019-12-08T12:02:23.477 INFO:teuthology.orchestra.run.smithi079.stdout: = crc=1 finobt=0, sparse=0 2019-12-08T12:02:23.477 INFO:teuthology.orchestra.run.smithi079.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-12-08T12:02:23.477 INFO:teuthology.orchestra.run.smithi079.stdout: = sunit=0 swidth=0 blks 2019-12-08T12:02:23.477 INFO:teuthology.orchestra.run.smithi079.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-12-08T12:02:23.477 INFO:teuthology.orchestra.run.smithi079.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-12-08T12:02:23.478 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-12-08T12:02:23.478 INFO:teuthology.orchestra.run.smithi079.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-12-08T12:02:23.479 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi079.front.sepia.ceph.com -o noatime 2019-12-08T12:02:23.479 INFO:teuthology.orchestra.run.smithi079:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2019-12-08T12:02:23.641 INFO:teuthology.orchestra.run.smithi079:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2019-12-08T12:02:23.740 INFO:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2019-12-08T12:02:23.840 INFO:tasks.ceph:{'osd.1': '/dev/vg_nvme/lv_1', 'osd.0': '/dev/vg_nvme/lv_4', 'osd.3': '/dev/vg_nvme/lv_3', 'osd.2': '/dev/vg_nvme/lv_2'} 2019-12-08T12:02:23.841 INFO:tasks.ceph:{} 2019-12-08T12:02:23.841 INFO:tasks.ceph:osd.3 2019-12-08T12:02:23.841 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi079.front.sepia.ceph.com 2019-12-08T12:02:23.841 INFO:teuthology.orchestra.run.smithi079:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2019-12-08T12:02:24.382 INFO:teuthology.orchestra.run.smithi079.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2019-12-08T12:02:24.382 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 attr=2, projid32bit=1 2019-12-08T12:02:24.382 INFO:teuthology.orchestra.run.smithi079.stdout: = crc=1 finobt=0, sparse=0 2019-12-08T12:02:24.382 INFO:teuthology.orchestra.run.smithi079.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2019-12-08T12:02:24.383 INFO:teuthology.orchestra.run.smithi079.stdout: = sunit=0 swidth=0 blks 2019-12-08T12:02:24.383 INFO:teuthology.orchestra.run.smithi079.stdout:naming =version 2 bsize=4096 ascii-ci=0 ftype=1 2019-12-08T12:02:24.383 INFO:teuthology.orchestra.run.smithi079.stdout:log =internal log bsize=4096 blocks=11443, version=2 2019-12-08T12:02:24.383 INFO:teuthology.orchestra.run.smithi079.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2019-12-08T12:02:24.383 INFO:teuthology.orchestra.run.smithi079.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2019-12-08T12:02:24.384 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi079.front.sepia.ceph.com -o noatime 2019-12-08T12:02:24.384 INFO:teuthology.orchestra.run.smithi079:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-3 2019-12-08T12:02:24.508 INFO:teuthology.orchestra.run.smithi079:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2019-12-08T12:02:24.615 INFO:teuthology.orchestra.run.smithi079:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-12-08T12:02:24.771 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:02:24.757+0000 7f1393954b40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2019-12-08T12:02:24.772 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:02:24.758+0000 7f1393954b40 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2019-12-08T12:02:24.787 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:02:24.771+0000 7f1393954b40 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-12-08T12:02:24.787 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:02:24.771+0000 7f1393954b40 -1 journal FileJournal::_open_file : zeroing journal 2019-12-08T12:02:24.929 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:02:24.915+0000 7f1393954b40 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-12-08T12:02:24.930 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:02:24.915+0000 7f1393954b40 -1 journal do_read_entry(4096): bad header magic 2019-12-08T12:02:24.930 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:02:24.915+0000 7f1393954b40 -1 journal do_read_entry(4096): bad header magic 2019-12-08T12:02:24.942 INFO:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2019-12-08T12:02:25.037 INFO:teuthology.orchestra.run.smithi079:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-12-08T12:02:25.151 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:02:25.137+0000 7fad50d48b40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2019-12-08T12:02:25.151 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:02:25.138+0000 7fad50d48b40 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2019-12-08T12:02:25.166 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:02:25.152+0000 7fad50d48b40 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-12-08T12:02:25.166 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:02:25.152+0000 7fad50d48b40 -1 journal FileJournal::_open_file : zeroing journal 2019-12-08T12:02:25.304 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:02:25.290+0000 7fad50d48b40 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-12-08T12:02:25.304 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:02:25.290+0000 7fad50d48b40 -1 journal do_read_entry(4096): bad header magic 2019-12-08T12:02:25.304 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:02:25.290+0000 7fad50d48b40 -1 journal do_read_entry(4096): bad header magic 2019-12-08T12:02:25.319 INFO:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2019-12-08T12:02:25.428 INFO:teuthology.orchestra.run.smithi079:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-12-08T12:02:25.582 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:02:25.569+0000 7ff0e9985b40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2019-12-08T12:02:25.583 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:02:25.569+0000 7ff0e9985b40 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2019-12-08T12:02:25.599 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:02:25.585+0000 7ff0e9985b40 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-12-08T12:02:25.599 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:02:25.585+0000 7ff0e9985b40 -1 journal FileJournal::_open_file : zeroing journal 2019-12-08T12:02:25.738 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:02:25.725+0000 7ff0e9985b40 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-12-08T12:02:25.739 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:02:25.725+0000 7ff0e9985b40 -1 journal do_read_entry(4096): bad header magic 2019-12-08T12:02:25.739 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:02:25.725+0000 7ff0e9985b40 -1 journal do_read_entry(4096): bad header magic 2019-12-08T12:02:25.752 INFO:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2019-12-08T12:02:25.853 INFO:teuthology.orchestra.run.smithi079:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2019-12-08T12:02:25.967 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:02:25.953+0000 7f9f0e8f4b40 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2019-12-08T12:02:25.990 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:02:25.954+0000 7f9f0e8f4b40 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2019-12-08T12:02:25.990 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:02:25.967+0000 7f9f0e8f4b40 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-12-08T12:02:25.990 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:02:25.967+0000 7f9f0e8f4b40 -1 journal FileJournal::_open_file : zeroing journal 2019-12-08T12:02:26.120 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:02:26.106+0000 7f9f0e8f4b40 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-12-08T12:02:26.120 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:02:26.107+0000 7f9f0e8f4b40 -1 journal do_read_entry(4096): bad header magic 2019-12-08T12:02:26.120 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:02:26.107+0000 7f9f0e8f4b40 -1 journal do_read_entry(4096): bad header magic 2019-12-08T12:02:26.133 INFO:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2019-12-08T12:02:26.213 INFO:tasks.ceph:Reading keys from all nodes... 2019-12-08T12:02:26.213 INFO:teuthology.orchestra.run.smithi013:> mktemp 2019-12-08T12:02:26.307 INFO:teuthology.orchestra.run.smithi013.stdout:/tmp/tmp.71pte4cQx2 2019-12-08T12:02:26.307 INFO:teuthology.orchestra.run.smithi013:> sudo cp /var/lib/ceph/mgr/ceph-x/keyring /tmp/tmp.71pte4cQx2 2019-12-08T12:02:26.420 INFO:teuthology.orchestra.run.smithi013:> sudo chmod 0666 /tmp/tmp.71pte4cQx2 2019-12-08T12:02:26.600 DEBUG:teuthology.orchestra.remote:smithi013:/tmp/tmp.71pte4cQx2 is 56B 2019-12-08T12:02:26.668 INFO:teuthology.orchestra.run.smithi013:> rm -fr /tmp/tmp.71pte4cQx2 2019-12-08T12:02:26.746 INFO:teuthology.orchestra.run.smithi013:> mktemp 2019-12-08T12:02:26.826 INFO:teuthology.orchestra.run.smithi013.stdout:/tmp/tmp.vJkr1x6KSp 2019-12-08T12:02:26.826 INFO:teuthology.orchestra.run.smithi013:> sudo cp /var/lib/ceph/osd/ceph-4/keyring /tmp/tmp.vJkr1x6KSp 2019-12-08T12:02:26.947 INFO:teuthology.orchestra.run.smithi013:> sudo chmod 0666 /tmp/tmp.vJkr1x6KSp 2019-12-08T12:02:27.153 DEBUG:teuthology.orchestra.remote:smithi013:/tmp/tmp.vJkr1x6KSp is 56B 2019-12-08T12:02:27.237 INFO:teuthology.orchestra.run.smithi013:> rm -fr /tmp/tmp.vJkr1x6KSp 2019-12-08T12:02:27.306 INFO:teuthology.orchestra.run.smithi013:> mktemp 2019-12-08T12:02:27.428 INFO:teuthology.orchestra.run.smithi013.stdout:/tmp/tmp.UGNTu3Xmdw 2019-12-08T12:02:27.428 INFO:teuthology.orchestra.run.smithi013:> sudo cp /var/lib/ceph/osd/ceph-5/keyring /tmp/tmp.UGNTu3Xmdw 2019-12-08T12:02:27.522 INFO:teuthology.orchestra.run.smithi013:> sudo chmod 0666 /tmp/tmp.UGNTu3Xmdw 2019-12-08T12:02:27.685 DEBUG:teuthology.orchestra.remote:smithi013:/tmp/tmp.UGNTu3Xmdw is 56B 2019-12-08T12:02:27.751 INFO:teuthology.orchestra.run.smithi013:> rm -fr /tmp/tmp.UGNTu3Xmdw 2019-12-08T12:02:27.817 INFO:teuthology.orchestra.run.smithi013:> mktemp 2019-12-08T12:02:27.879 INFO:teuthology.orchestra.run.smithi013.stdout:/tmp/tmp.QCHnTPbrE4 2019-12-08T12:02:27.880 INFO:teuthology.orchestra.run.smithi013:> sudo cp /var/lib/ceph/osd/ceph-6/keyring /tmp/tmp.QCHnTPbrE4 2019-12-08T12:02:27.968 INFO:teuthology.orchestra.run.smithi013:> sudo chmod 0666 /tmp/tmp.QCHnTPbrE4 2019-12-08T12:02:28.125 DEBUG:teuthology.orchestra.remote:smithi013:/tmp/tmp.QCHnTPbrE4 is 56B 2019-12-08T12:02:28.189 INFO:teuthology.orchestra.run.smithi013:> rm -fr /tmp/tmp.QCHnTPbrE4 2019-12-08T12:02:28.249 INFO:teuthology.orchestra.run.smithi013:> mktemp 2019-12-08T12:02:28.308 INFO:teuthology.orchestra.run.smithi013.stdout:/tmp/tmp.1r2unLQX8a 2019-12-08T12:02:28.308 INFO:teuthology.orchestra.run.smithi013:> sudo cp /var/lib/ceph/osd/ceph-7/keyring /tmp/tmp.1r2unLQX8a 2019-12-08T12:02:28.392 INFO:teuthology.orchestra.run.smithi013:> sudo chmod 0666 /tmp/tmp.1r2unLQX8a 2019-12-08T12:02:28.536 DEBUG:teuthology.orchestra.remote:smithi013:/tmp/tmp.1r2unLQX8a is 56B 2019-12-08T12:02:28.610 INFO:teuthology.orchestra.run.smithi013:> rm -fr /tmp/tmp.1r2unLQX8a 2019-12-08T12:02:28.676 INFO:teuthology.orchestra.run.smithi079:> mktemp 2019-12-08T12:02:28.769 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/tmp.LzAqhUsGsH 2019-12-08T12:02:28.770 INFO:teuthology.orchestra.run.smithi079:> sudo cp /var/lib/ceph/mgr/ceph-y/keyring /tmp/tmp.LzAqhUsGsH 2019-12-08T12:02:28.885 INFO:teuthology.orchestra.run.smithi079:> sudo chmod 0666 /tmp/tmp.LzAqhUsGsH 2019-12-08T12:02:29.083 DEBUG:teuthology.orchestra.remote:smithi079:/tmp/tmp.LzAqhUsGsH is 56B 2019-12-08T12:02:29.176 INFO:teuthology.orchestra.run.smithi079:> rm -fr /tmp/tmp.LzAqhUsGsH 2019-12-08T12:02:29.263 INFO:teuthology.orchestra.run.smithi079:> mktemp 2019-12-08T12:02:29.334 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/tmp.wIbWptdY4F 2019-12-08T12:02:29.335 INFO:teuthology.orchestra.run.smithi079:> sudo cp /var/lib/ceph/osd/ceph-0/keyring /tmp/tmp.wIbWptdY4F 2019-12-08T12:02:29.419 INFO:teuthology.orchestra.run.smithi079:> sudo chmod 0666 /tmp/tmp.wIbWptdY4F 2019-12-08T12:02:29.595 DEBUG:teuthology.orchestra.remote:smithi079:/tmp/tmp.wIbWptdY4F is 56B 2019-12-08T12:02:29.674 INFO:teuthology.orchestra.run.smithi079:> rm -fr /tmp/tmp.wIbWptdY4F 2019-12-08T12:02:29.744 INFO:teuthology.orchestra.run.smithi079:> mktemp 2019-12-08T12:02:29.809 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/tmp.4DKDvDZL8F 2019-12-08T12:02:29.810 INFO:teuthology.orchestra.run.smithi079:> sudo cp /var/lib/ceph/osd/ceph-1/keyring /tmp/tmp.4DKDvDZL8F 2019-12-08T12:02:29.897 INFO:teuthology.orchestra.run.smithi079:> sudo chmod 0666 /tmp/tmp.4DKDvDZL8F 2019-12-08T12:02:30.045 DEBUG:teuthology.orchestra.remote:smithi079:/tmp/tmp.4DKDvDZL8F is 56B 2019-12-08T12:02:30.107 INFO:teuthology.orchestra.run.smithi079:> rm -fr /tmp/tmp.4DKDvDZL8F 2019-12-08T12:02:30.171 INFO:teuthology.orchestra.run.smithi079:> mktemp 2019-12-08T12:02:30.300 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/tmp.pmrsHiF7rV 2019-12-08T12:02:30.301 INFO:teuthology.orchestra.run.smithi079:> sudo cp /var/lib/ceph/osd/ceph-2/keyring /tmp/tmp.pmrsHiF7rV 2019-12-08T12:02:30.417 INFO:teuthology.orchestra.run.smithi079:> sudo chmod 0666 /tmp/tmp.pmrsHiF7rV 2019-12-08T12:02:30.622 DEBUG:teuthology.orchestra.remote:smithi079:/tmp/tmp.pmrsHiF7rV is 56B 2019-12-08T12:02:30.710 INFO:teuthology.orchestra.run.smithi079:> rm -fr /tmp/tmp.pmrsHiF7rV 2019-12-08T12:02:30.776 INFO:teuthology.orchestra.run.smithi079:> mktemp 2019-12-08T12:02:30.905 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/tmp.A6umz8xbTT 2019-12-08T12:02:30.906 INFO:teuthology.orchestra.run.smithi079:> sudo cp /var/lib/ceph/osd/ceph-3/keyring /tmp/tmp.A6umz8xbTT 2019-12-08T12:02:31.005 INFO:teuthology.orchestra.run.smithi079:> sudo chmod 0666 /tmp/tmp.A6umz8xbTT 2019-12-08T12:02:31.147 DEBUG:teuthology.orchestra.remote:smithi079:/tmp/tmp.A6umz8xbTT is 56B 2019-12-08T12:02:31.204 INFO:teuthology.orchestra.run.smithi079:> rm -fr /tmp/tmp.A6umz8xbTT 2019-12-08T12:02:31.359 DEBUG:teuthology.orchestra.remote:smithi013:/etc/ceph/ceph.client.1.keyring is 59B 2019-12-08T12:02:31.549 DEBUG:teuthology.orchestra.remote:smithi079:/etc/ceph/ceph.client.0.keyring is 59B 2019-12-08T12:02:31.645 INFO:tasks.ceph:Adding keys to all mons... 2019-12-08T12:02:31.645 INFO:teuthology.orchestra.run.smithi013:> sudo tee -a /etc/ceph/ceph.keyring 2019-12-08T12:02:31.649 INFO:teuthology.orchestra.run.smithi079:> sudo tee -a /etc/ceph/ceph.keyring 2019-12-08T12:02:31.755 INFO:teuthology.orchestra.run.smithi079.stdout:[mgr.x] 2019-12-08T12:02:31.755 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQBG5uxdoXn3CBAA7JKucWi7werL6SK1NgT1uw== 2019-12-08T12:02:31.756 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.4] 2019-12-08T12:02:31.756 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQBL5uxdkwa7IBAAnj5gYmS4RlCNWVuOtuFSiA== 2019-12-08T12:02:31.756 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.5] 2019-12-08T12:02:31.756 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQBL5uxddHAHNxAA7qHuCmiAg3bZCpLr+CJEvg== 2019-12-08T12:02:31.757 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.6] 2019-12-08T12:02:31.757 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQBM5uxdtDg4FBAAkaJ7aFUPj74Rks9zT5odmw== 2019-12-08T12:02:31.757 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.7] 2019-12-08T12:02:31.757 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQBM5uxdqBgiKxAAFpt3+XMqRZEpqaJBG3blSw== 2019-12-08T12:02:31.761 INFO:teuthology.orchestra.run.smithi079.stdout:[mgr.y] 2019-12-08T12:02:31.761 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQBG5uxdWL/REhAAa0Lu1k+22JJXGZasIumc8g== 2019-12-08T12:02:31.761 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.0] 2019-12-08T12:02:31.761 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQBQ5uxdVpE9LRAAqlpX7iNYkZoOrvas/sNj/w== 2019-12-08T12:02:31.762 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.1] 2019-12-08T12:02:31.762 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQBR5uxdJmpGCBAABSLJSb6GSOLtyeG2hXIQ2g== 2019-12-08T12:02:31.762 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.2] 2019-12-08T12:02:31.762 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQBR5uxd7aj8IRAAEQj21iTglRX691htBps7wg== 2019-12-08T12:02:31.762 INFO:teuthology.orchestra.run.smithi079.stdout:[osd.3] 2019-12-08T12:02:31.763 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQBR5uxdljPpOBAAFlgNvnjUf6dWRwyR8RRciw== 2019-12-08T12:02:31.763 INFO:teuthology.orchestra.run.smithi079.stdout:[client.1] 2019-12-08T12:02:31.763 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQBG5uxdC9OQHRAAQCZNh0Wt8xsvLqczDIBhiQ== 2019-12-08T12:02:31.763 INFO:teuthology.orchestra.run.smithi079.stdout:[client.0] 2019-12-08T12:02:31.764 INFO:teuthology.orchestra.run.smithi079.stdout: key = AQBG5uxdyFIEKBAARW5XXB7JIJseNWMvK9TjWw== 2019-12-08T12:02:31.769 INFO:teuthology.orchestra.run.smithi013.stdout:[mgr.x] 2019-12-08T12:02:31.770 INFO:teuthology.orchestra.run.smithi013.stdout: key = AQBG5uxdoXn3CBAA7JKucWi7werL6SK1NgT1uw== 2019-12-08T12:02:31.770 INFO:teuthology.orchestra.run.smithi013.stdout:[osd.4] 2019-12-08T12:02:31.770 INFO:teuthology.orchestra.run.smithi013.stdout: key = AQBL5uxdkwa7IBAAnj5gYmS4RlCNWVuOtuFSiA== 2019-12-08T12:02:31.771 INFO:teuthology.orchestra.run.smithi013.stdout:[osd.5] 2019-12-08T12:02:31.771 INFO:teuthology.orchestra.run.smithi013.stdout: key = AQBL5uxddHAHNxAA7qHuCmiAg3bZCpLr+CJEvg== 2019-12-08T12:02:31.771 INFO:teuthology.orchestra.run.smithi013.stdout:[osd.6] 2019-12-08T12:02:31.771 INFO:teuthology.orchestra.run.smithi013.stdout: key = AQBM5uxdtDg4FBAAkaJ7aFUPj74Rks9zT5odmw== 2019-12-08T12:02:31.772 INFO:teuthology.orchestra.run.smithi013.stdout:[osd.7] 2019-12-08T12:02:31.772 INFO:teuthology.orchestra.run.smithi013.stdout: key = AQBM5uxdqBgiKxAAFpt3+XMqRZEpqaJBG3blSw== 2019-12-08T12:02:31.772 INFO:teuthology.orchestra.run.smithi013.stdout:[mgr.y] 2019-12-08T12:02:31.772 INFO:teuthology.orchestra.run.smithi013.stdout: key = AQBG5uxdWL/REhAAa0Lu1k+22JJXGZasIumc8g== 2019-12-08T12:02:31.773 INFO:teuthology.orchestra.run.smithi013.stdout:[osd.0] 2019-12-08T12:02:31.773 INFO:teuthology.orchestra.run.smithi013.stdout: key = AQBQ5uxdVpE9LRAAqlpX7iNYkZoOrvas/sNj/w== 2019-12-08T12:02:31.773 INFO:teuthology.orchestra.run.smithi013.stdout:[osd.1] 2019-12-08T12:02:31.773 INFO:teuthology.orchestra.run.smithi013.stdout: key = AQBR5uxdJmpGCBAABSLJSb6GSOLtyeG2hXIQ2g== 2019-12-08T12:02:31.774 INFO:teuthology.orchestra.run.smithi013.stdout:[osd.2] 2019-12-08T12:02:31.774 INFO:teuthology.orchestra.run.smithi013.stdout: key = AQBR5uxd7aj8IRAAEQj21iTglRX691htBps7wg== 2019-12-08T12:02:31.774 INFO:teuthology.orchestra.run.smithi013.stdout:[osd.3] 2019-12-08T12:02:31.774 INFO:teuthology.orchestra.run.smithi013.stdout: key = AQBR5uxdljPpOBAAFlgNvnjUf6dWRwyR8RRciw== 2019-12-08T12:02:31.774 INFO:teuthology.orchestra.run.smithi013.stdout:[client.1] 2019-12-08T12:02:31.774 INFO:teuthology.orchestra.run.smithi013.stdout: key = AQBG5uxdC9OQHRAAQCZNh0Wt8xsvLqczDIBhiQ== 2019-12-08T12:02:31.774 INFO:teuthology.orchestra.run.smithi013.stdout:[client.0] 2019-12-08T12:02:31.775 INFO:teuthology.orchestra.run.smithi013.stdout: key = AQBG5uxdyFIEKBAARW5XXB7JIJseNWMvK9TjWw== 2019-12-08T12:02:31.775 INFO:teuthology.orchestra.run.smithi013:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2019-12-08T12:02:31.783 INFO:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2019-12-08T12:02:31.950 INFO:teuthology.orchestra.run.smithi013:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-08T12:02:31.954 INFO:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-08T12:02:32.120 INFO:teuthology.orchestra.run.smithi013:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-08T12:02:32.123 INFO:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-08T12:02:32.289 INFO:teuthology.orchestra.run.smithi013:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-08T12:02:32.292 INFO:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-08T12:02:32.457 INFO:teuthology.orchestra.run.smithi013:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-08T12:02:32.460 INFO:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-08T12:02:32.626 INFO:teuthology.orchestra.run.smithi013:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2019-12-08T12:02:32.631 INFO:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mds 'allow *' --cap osd 'allow *' --cap mon 'allow profile mgr' 2019-12-08T12:02:32.797 INFO:teuthology.orchestra.run.smithi013:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-08T12:02:32.808 INFO:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-08T12:02:32.973 INFO:teuthology.orchestra.run.smithi013:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-08T12:02:32.977 INFO:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-08T12:02:33.142 INFO:teuthology.orchestra.run.smithi013:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-08T12:02:33.146 INFO:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-08T12:02:33.313 INFO:teuthology.orchestra.run.smithi013:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-08T12:02:33.317 INFO:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mgr 'allow *' --cap osd 'allow *' --cap mon 'allow *' 2019-12-08T12:02:33.473 INFO:teuthology.orchestra.run.smithi013:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2019-12-08T12:02:33.477 INFO:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2019-12-08T12:02:33.654 INFO:teuthology.orchestra.run.smithi013:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2019-12-08T12:02:33.658 INFO:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mds allow --cap osd 'allow rwx' --cap mgr 'allow r' --cap mon 'allow rw' 2019-12-08T12:02:33.829 INFO:tasks.ceph:Running mkfs on mon nodes... 2019-12-08T12:02:33.830 INFO:teuthology.orchestra.run.smithi013:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2019-12-08T12:02:33.949 INFO:teuthology.orchestra.run.smithi013:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2019-12-08T12:02:34.137 INFO:teuthology.orchestra.run.smithi013:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2019-12-08T12:02:34.252 INFO:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2019-12-08T12:02:34.371 INFO:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2019-12-08T12:02:34.554 INFO:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2019-12-08T12:02:34.643 INFO:teuthology.orchestra.run.smithi079:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2019-12-08T12:02:34.744 INFO:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2019-12-08T12:02:34.885 INFO:teuthology.orchestra.run.smithi079:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2019-12-08T12:02:34.977 INFO:teuthology.orchestra.run.smithi013:> rm -- /home/ubuntu/cephtest/ceph.monmap 2019-12-08T12:02:34.981 INFO:teuthology.orchestra.run.smithi079:> rm -- /home/ubuntu/cephtest/ceph.monmap 2019-12-08T12:02:35.068 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2019-12-08T12:02:35.068 DEBUG:teuthology.misc:running mon.b under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.b.log', '--time-stamp=yes', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2019-12-08T12:02:35.069 INFO:tasks.ceph.mon.b:Restarting daemon 2019-12-08T12:02:35.069 INFO:teuthology.orchestra.run.smithi013:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.b.log --time-stamp=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i b 2019-12-08T12:02:35.073 INFO:tasks.ceph.mon.b:Started 2019-12-08T12:02:35.073 DEBUG:teuthology.misc:running mon.a under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.a.log', '--time-stamp=yes', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2019-12-08T12:02:35.074 INFO:tasks.ceph.mon.a:Restarting daemon 2019-12-08T12:02:35.075 INFO:teuthology.orchestra.run.smithi079:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.a.log --time-stamp=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i a 2019-12-08T12:02:35.079 INFO:tasks.ceph.mon.a:Started 2019-12-08T12:02:35.079 DEBUG:teuthology.misc:running mon.c under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/mon.c.log', '--time-stamp=yes', '--tool=memcheck', '--leak-check=full', '--show-reachable=yes'] 2019-12-08T12:02:35.079 INFO:tasks.ceph.mon.c:Restarting daemon 2019-12-08T12:02:35.080 INFO:teuthology.orchestra.run.smithi079:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/mon.c.log --time-stamp=yes --tool=memcheck --leak-check=full --show-reachable=yes ceph-mon -f --cluster ceph -i c 2019-12-08T12:02:35.083 INFO:tasks.ceph.mon.c:Started 2019-12-08T12:02:35.083 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2019-12-08T12:02:35.084 INFO:tasks.ceph.mgr.x:Restarting daemon 2019-12-08T12:02:35.084 INFO:teuthology.orchestra.run.smithi013:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i x 2019-12-08T12:02:35.091 INFO:tasks.ceph.mgr.x:Started 2019-12-08T12:02:35.091 INFO:tasks.ceph.mgr.y:Restarting daemon 2019-12-08T12:02:35.092 INFO:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term ceph-mgr -f --cluster ceph -i y 2019-12-08T12:02:35.097 INFO:tasks.ceph.mgr.y:Started 2019-12-08T12:02:35.098 INFO:tasks.ceph:Setting crush tunables to default 2019-12-08T12:02:35.099 INFO:teuthology.orchestra.run.smithi079:> sudo ceph --cluster ceph osd crush tunables default 2019-12-08T12:02:38.979 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:00:00:03.698 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T12:02:39.054 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:00:00:03.773 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T12:02:39.545 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:00:00:04.243 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T12:02:52.047 INFO:teuthology.orchestra.run.smithi079.stderr:adjusted tunables profile to default 2019-12-08T12:02:52.061 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2019-12-08T12:02:52.061 INFO:teuthology.orchestra.run.smithi013:> mktemp 2019-12-08T12:02:52.120 INFO:teuthology.orchestra.run.smithi013.stdout:/tmp/tmp.VbAtyHuTKv 2019-12-08T12:02:52.121 INFO:teuthology.orchestra.run.smithi013:> sudo cp /var/lib/ceph/osd/ceph-4/fsid /tmp/tmp.VbAtyHuTKv 2019-12-08T12:02:52.193 INFO:teuthology.orchestra.run.smithi013:> sudo chmod 0666 /tmp/tmp.VbAtyHuTKv 2019-12-08T12:02:52.308 DEBUG:teuthology.orchestra.remote:smithi013:/tmp/tmp.VbAtyHuTKv is 37B 2019-12-08T12:02:52.354 INFO:teuthology.orchestra.run.smithi013:> rm -fr /tmp/tmp.VbAtyHuTKv 2019-12-08T12:02:52.396 INFO:teuthology.orchestra.run.smithi013:> mktemp 2019-12-08T12:02:52.487 INFO:teuthology.orchestra.run.smithi013.stdout:/tmp/tmp.shxiVm7QE7 2019-12-08T12:02:52.488 INFO:teuthology.orchestra.run.smithi013:> sudo cp /var/lib/ceph/osd/ceph-5/fsid /tmp/tmp.shxiVm7QE7 2019-12-08T12:02:52.552 INFO:teuthology.orchestra.run.smithi013:> sudo chmod 0666 /tmp/tmp.shxiVm7QE7 2019-12-08T12:02:52.662 DEBUG:teuthology.orchestra.remote:smithi013:/tmp/tmp.shxiVm7QE7 is 37B 2019-12-08T12:02:52.709 INFO:teuthology.orchestra.run.smithi013:> rm -fr /tmp/tmp.shxiVm7QE7 2019-12-08T12:02:52.754 INFO:teuthology.orchestra.run.smithi013:> mktemp 2019-12-08T12:02:52.796 INFO:teuthology.orchestra.run.smithi013.stdout:/tmp/tmp.PM6UtSDlMO 2019-12-08T12:02:52.796 INFO:teuthology.orchestra.run.smithi013:> sudo cp /var/lib/ceph/osd/ceph-6/fsid /tmp/tmp.PM6UtSDlMO 2019-12-08T12:02:52.929 INFO:teuthology.orchestra.run.smithi013:> sudo chmod 0666 /tmp/tmp.PM6UtSDlMO 2019-12-08T12:02:53.120 DEBUG:teuthology.orchestra.remote:smithi013:/tmp/tmp.PM6UtSDlMO is 37B 2019-12-08T12:02:53.210 INFO:teuthology.orchestra.run.smithi013:> rm -fr /tmp/tmp.PM6UtSDlMO 2019-12-08T12:02:53.273 INFO:teuthology.orchestra.run.smithi013:> mktemp 2019-12-08T12:02:53.327 INFO:teuthology.orchestra.run.smithi013.stdout:/tmp/tmp.MyWEz6jyHB 2019-12-08T12:02:53.327 INFO:teuthology.orchestra.run.smithi013:> sudo cp /var/lib/ceph/osd/ceph-7/fsid /tmp/tmp.MyWEz6jyHB 2019-12-08T12:02:53.389 INFO:teuthology.orchestra.run.smithi013:> sudo chmod 0666 /tmp/tmp.MyWEz6jyHB 2019-12-08T12:02:53.492 DEBUG:teuthology.orchestra.remote:smithi013:/tmp/tmp.MyWEz6jyHB is 37B 2019-12-08T12:02:53.542 INFO:teuthology.orchestra.run.smithi013:> rm -fr /tmp/tmp.MyWEz6jyHB 2019-12-08T12:02:53.585 INFO:teuthology.orchestra.run.smithi079:> mktemp 2019-12-08T12:02:53.645 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/tmp.CAWoENMNln 2019-12-08T12:02:53.645 INFO:teuthology.orchestra.run.smithi079:> sudo cp /var/lib/ceph/osd/ceph-0/fsid /tmp/tmp.CAWoENMNln 2019-12-08T12:02:53.708 INFO:teuthology.orchestra.run.smithi079:> sudo chmod 0666 /tmp/tmp.CAWoENMNln 2019-12-08T12:02:53.811 DEBUG:teuthology.orchestra.remote:smithi079:/tmp/tmp.CAWoENMNln is 37B 2019-12-08T12:02:53.859 INFO:teuthology.orchestra.run.smithi079:> rm -fr /tmp/tmp.CAWoENMNln 2019-12-08T12:02:53.908 INFO:teuthology.orchestra.run.smithi079:> mktemp 2019-12-08T12:02:53.992 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/tmp.aAmJguS1MI 2019-12-08T12:02:53.993 INFO:teuthology.orchestra.run.smithi079:> sudo cp /var/lib/ceph/osd/ceph-1/fsid /tmp/tmp.aAmJguS1MI 2019-12-08T12:02:54.109 INFO:teuthology.orchestra.run.smithi079:> sudo chmod 0666 /tmp/tmp.aAmJguS1MI 2019-12-08T12:02:54.225 DEBUG:teuthology.orchestra.remote:smithi079:/tmp/tmp.aAmJguS1MI is 37B 2019-12-08T12:02:54.273 INFO:teuthology.orchestra.run.smithi079:> rm -fr /tmp/tmp.aAmJguS1MI 2019-12-08T12:02:54.318 INFO:teuthology.orchestra.run.smithi079:> mktemp 2019-12-08T12:02:54.419 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/tmp.nJYXk8eb4i 2019-12-08T12:02:54.419 INFO:teuthology.orchestra.run.smithi079:> sudo cp /var/lib/ceph/osd/ceph-2/fsid /tmp/tmp.nJYXk8eb4i 2019-12-08T12:02:54.486 INFO:teuthology.orchestra.run.smithi079:> sudo chmod 0666 /tmp/tmp.nJYXk8eb4i 2019-12-08T12:02:54.604 DEBUG:teuthology.orchestra.remote:smithi079:/tmp/tmp.nJYXk8eb4i is 37B 2019-12-08T12:02:54.656 INFO:teuthology.orchestra.run.smithi079:> rm -fr /tmp/tmp.nJYXk8eb4i 2019-12-08T12:02:54.704 INFO:teuthology.orchestra.run.smithi079:> mktemp 2019-12-08T12:02:54.821 INFO:teuthology.orchestra.run.smithi079.stdout:/tmp/tmp.uOEQbzioSg 2019-12-08T12:02:54.821 INFO:teuthology.orchestra.run.smithi079:> sudo cp /var/lib/ceph/osd/ceph-3/fsid /tmp/tmp.uOEQbzioSg 2019-12-08T12:02:54.920 INFO:teuthology.orchestra.run.smithi079:> sudo chmod 0666 /tmp/tmp.uOEQbzioSg 2019-12-08T12:02:55.049 DEBUG:teuthology.orchestra.remote:smithi079:/tmp/tmp.uOEQbzioSg is 37B 2019-12-08T12:02:55.107 INFO:teuthology.orchestra.run.smithi079:> rm -fr /tmp/tmp.uOEQbzioSg 2019-12-08T12:02:55.157 INFO:teuthology.orchestra.run.smithi079:> sudo ceph --cluster ceph osd new f1c8b96a-9f83-44de-8e62-bab5a6b81b93 0 2019-12-08T12:02:56.552 INFO:teuthology.orchestra.run.smithi079.stdout:0 2019-12-08T12:02:56.573 INFO:teuthology.orchestra.run.smithi079:> sudo ceph --cluster ceph osd new 5f14fc3e-9253-4fb1-9ccf-7e4a66e1fc25 1 2019-12-08T12:02:57.813 INFO:teuthology.orchestra.run.smithi079.stdout:1 2019-12-08T12:02:57.831 INFO:teuthology.orchestra.run.smithi079:> sudo ceph --cluster ceph osd new 5c7b7343-4ac8-4f04-bf6f-19ac3ed1f5ca 2 2019-12-08T12:02:58.786 INFO:teuthology.orchestra.run.smithi079.stdout:2 2019-12-08T12:02:58.810 INFO:teuthology.orchestra.run.smithi079:> sudo ceph --cluster ceph osd new e0d53023-e3b6-49e9-8c73-29d0fcd77cba 3 2019-12-08T12:02:59.970 INFO:teuthology.orchestra.run.smithi079.stdout:3 2019-12-08T12:02:59.990 INFO:teuthology.orchestra.run.smithi079:> sudo ceph --cluster ceph osd new 0a924035-4dce-4225-a497-31aa9e14ef7e 4 2019-12-08T12:03:00.830 INFO:teuthology.orchestra.run.smithi079.stdout:4 2019-12-08T12:03:00.848 INFO:teuthology.orchestra.run.smithi079:> sudo ceph --cluster ceph osd new 4dbcde75-1cc7-49cb-8664-f839ad1e3921 5 2019-12-08T12:03:01.664 INFO:teuthology.orchestra.run.smithi079.stdout:5 2019-12-08T12:03:01.689 INFO:teuthology.orchestra.run.smithi079:> sudo ceph --cluster ceph osd new 855cdc06-23e3-450f-86bc-b7b0029f3226 6 2019-12-08T12:03:02.686 INFO:teuthology.orchestra.run.smithi079.stdout:6 2019-12-08T12:03:02.706 INFO:teuthology.orchestra.run.smithi079:> sudo ceph --cluster ceph osd new 3163caee-ba1d-42b2-b777-2fcc023ca436 7 2019-12-08T12:03:03.737 INFO:teuthology.orchestra.run.smithi079.stdout:7 2019-12-08T12:03:03.757 DEBUG:teuthology.misc:running osd.4 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.4.log', '--time-stamp=yes', '--tool=memcheck'] 2019-12-08T12:03:03.757 INFO:tasks.ceph.osd.4:Restarting daemon 2019-12-08T12:03:03.757 INFO:teuthology.orchestra.run.smithi013:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.4.log --time-stamp=yes --tool=memcheck ceph-osd -f --cluster ceph -i 4 2019-12-08T12:03:03.762 INFO:tasks.ceph.osd.4:Started 2019-12-08T12:03:03.762 DEBUG:teuthology.misc:running osd.5 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.5.log', '--time-stamp=yes', '--tool=memcheck'] 2019-12-08T12:03:03.763 INFO:tasks.ceph.osd.5:Restarting daemon 2019-12-08T12:03:03.763 INFO:teuthology.orchestra.run.smithi013:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.5.log --time-stamp=yes --tool=memcheck ceph-osd -f --cluster ceph -i 5 2019-12-08T12:03:03.767 INFO:tasks.ceph.osd.5:Started 2019-12-08T12:03:03.768 DEBUG:teuthology.misc:running osd.6 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.6.log', '--time-stamp=yes', '--tool=memcheck'] 2019-12-08T12:03:03.768 INFO:tasks.ceph.osd.6:Restarting daemon 2019-12-08T12:03:03.768 INFO:teuthology.orchestra.run.smithi013:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.6.log --time-stamp=yes --tool=memcheck ceph-osd -f --cluster ceph -i 6 2019-12-08T12:03:03.772 INFO:tasks.ceph.osd.6:Started 2019-12-08T12:03:03.772 DEBUG:teuthology.misc:running osd.7 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.7.log', '--time-stamp=yes', '--tool=memcheck'] 2019-12-08T12:03:03.772 INFO:tasks.ceph.osd.7:Restarting daemon 2019-12-08T12:03:03.773 INFO:teuthology.orchestra.run.smithi013:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.7.log --time-stamp=yes --tool=memcheck ceph-osd -f --cluster ceph -i 7 2019-12-08T12:03:03.776 INFO:tasks.ceph.osd.7:Started 2019-12-08T12:03:03.776 DEBUG:teuthology.misc:running osd.0 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.0.log', '--time-stamp=yes', '--tool=memcheck'] 2019-12-08T12:03:03.777 INFO:tasks.ceph.osd.0:Restarting daemon 2019-12-08T12:03:03.777 INFO:teuthology.orchestra.run.smithi079:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.0.log --time-stamp=yes --tool=memcheck ceph-osd -f --cluster ceph -i 0 2019-12-08T12:03:03.787 INFO:tasks.ceph.osd.0:Started 2019-12-08T12:03:03.788 DEBUG:teuthology.misc:running osd.1 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.1.log', '--time-stamp=yes', '--tool=memcheck'] 2019-12-08T12:03:03.788 INFO:tasks.ceph.osd.1:Restarting daemon 2019-12-08T12:03:03.788 INFO:teuthology.orchestra.run.smithi079:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.1.log --time-stamp=yes --tool=memcheck ceph-osd -f --cluster ceph -i 1 2019-12-08T12:03:03.792 INFO:tasks.ceph.osd.1:Started 2019-12-08T12:03:03.792 DEBUG:teuthology.misc:running osd.2 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.2.log', '--time-stamp=yes', '--tool=memcheck'] 2019-12-08T12:03:03.794 INFO:tasks.ceph.osd.2:Restarting daemon 2019-12-08T12:03:03.795 INFO:teuthology.orchestra.run.smithi079:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.2.log --time-stamp=yes --tool=memcheck ceph-osd -f --cluster ceph -i 2 2019-12-08T12:03:03.798 INFO:tasks.ceph.osd.2:Started 2019-12-08T12:03:03.799 DEBUG:teuthology.misc:running osd.3 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/osd.3.log', '--time-stamp=yes', '--tool=memcheck'] 2019-12-08T12:03:03.799 INFO:tasks.ceph.osd.3:Restarting daemon 2019-12-08T12:03:03.799 INFO:teuthology.orchestra.run.smithi079:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/osd.3.log --time-stamp=yes --tool=memcheck ceph-osd -f --cluster ceph -i 3 2019-12-08T12:03:03.803 INFO:tasks.ceph.osd.3:Started 2019-12-08T12:03:03.803 INFO:tasks.ceph:Waiting for OSDs to come up 2019-12-08T12:03:04.609 INFO:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2019-12-08T12:03:05.509 INFO:teuthology.misc.health.smithi079.stdout: 2019-12-08T12:03:05.510 INFO:teuthology.misc.health.smithi079.stdout:{"epoch":10,"fsid":"1a1450cf-cae7-41b0-ba4a-fe494bbfc59f","created":"2019-12-08T12:02:48.944092+0000","modified":"2019-12-08T12:03:03.546863+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"f1c8b96a-9f83-44de-8e62-bab5a6b81b93","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5f14fc3e-9253-4fb1-9ccf-7e4a66e1fc25","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"5c7b7343-4ac8-4f04-bf6f-19ac3ed1f5ca","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e0d53023-e3b6-49e9-8c73-29d0fcd77cba","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"0a924035-4dce-4225-a497-31aa9e14ef7e","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"4dbcde75-1cc7-49cb-8664-f839ad1e3921","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"855cdc06-23e3-450f-86bc-b7b0029f3226","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"3163caee-ba1d-42b2-b777-2fcc023ca436","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-08T12:03:05.530 DEBUG:teuthology.misc:0 of 8 OSDs are up 2019-12-08T12:03:07.685 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T12:03:07.676+0000 9b13800 -1 Falling back to public interface 2019-12-08T12:03:07.700 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T12:03:07.688+0000 9b13800 -1 Falling back to public interface 2019-12-08T12:03:07.753 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T12:03:07.744+0000 9b13800 -1 Falling back to public interface 2019-12-08T12:03:07.829 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T12:03:07.802+0000 9b13800 -1 Falling back to public interface 2019-12-08T12:03:07.878 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T12:03:07.863+0000 9b13800 -1 Falling back to public interface 2019-12-08T12:03:07.879 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T12:03:07.850+0000 9b13800 -1 Falling back to public interface 2019-12-08T12:03:08.411 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T12:03:08.384+0000 9b13800 -1 Falling back to public interface 2019-12-08T12:03:08.655 INFO:tasks.ceph.osd.5.smithi013.stderr:==00:00:00:04.766 9325== Warning: unimplemented fcntl command: 1036 2019-12-08T12:03:08.723 INFO:tasks.ceph.osd.4.smithi013.stderr:==00:00:00:04.826 9326== Warning: unimplemented fcntl command: 1036 2019-12-08T12:03:08.753 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T12:03:08.721+0000 9b13800 -1 Falling back to public interface 2019-12-08T12:03:08.935 INFO:tasks.ceph.osd.7.smithi013.stderr:==00:00:00:05.024 9327== Warning: unimplemented fcntl command: 1036 2019-12-08T12:03:08.940 INFO:tasks.ceph.osd.1.smithi079.stderr:==00:00:00:05.009 10449== Warning: unimplemented fcntl command: 1036 2019-12-08T12:03:08.977 INFO:tasks.ceph.osd.2.smithi079.stderr:==00:00:00:05.047 10448== Warning: unimplemented fcntl command: 1036 2019-12-08T12:03:09.041 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T12:03:09.029+0000 9b13800 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-12-08T12:03:09.057 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T12:03:09.044+0000 9b13800 -1 journal do_read_entry(8192): bad header magic 2019-12-08T12:03:09.064 INFO:tasks.ceph.osd.6.smithi013.stderr:==00:00:00:05.150 9328== Warning: unimplemented fcntl command: 1036 2019-12-08T12:03:09.065 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T12:03:09.047+0000 9b13800 -1 journal do_read_entry(8192): bad header magic 2019-12-08T12:03:09.149 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T12:03:09.139+0000 9b13800 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-12-08T12:03:09.164 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T12:03:09.159+0000 9b13800 -1 journal do_read_entry(8192): bad header magic 2019-12-08T12:03:09.181 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T12:03:09.163+0000 9b13800 -1 journal do_read_entry(8192): bad header magic 2019-12-08T12:03:09.377 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T12:03:09.352+0000 9b13800 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-12-08T12:03:09.389 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T12:03:09.348+0000 9b13800 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-12-08T12:03:09.410 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T12:03:09.365+0000 9b13800 -1 journal do_read_entry(8192): bad header magic 2019-12-08T12:03:09.414 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T12:03:09.377+0000 9b13800 -1 journal do_read_entry(8192): bad header magic 2019-12-08T12:03:09.430 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T12:03:09.425+0000 9b13800 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-12-08T12:03:09.436 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T12:03:09.382+0000 9b13800 -1 journal do_read_entry(8192): bad header magic 2019-12-08T12:03:09.436 INFO:tasks.ceph.osd.3.smithi079.stderr:==00:00:00:05.499 10450== Warning: unimplemented fcntl command: 1036 2019-12-08T12:03:09.437 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T12:03:09.422+0000 9b13800 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-12-08T12:03:09.444 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T12:03:09.368+0000 9b13800 -1 journal do_read_entry(8192): bad header magic 2019-12-08T12:03:09.446 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T12:03:09.439+0000 9b13800 -1 journal do_read_entry(8192): bad header magic 2019-12-08T12:03:09.446 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T12:03:09.441+0000 9b13800 -1 journal do_read_entry(8192): bad header magic 2019-12-08T12:03:09.469 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T12:03:09.444+0000 9b13800 -1 journal do_read_entry(8192): bad header magic 2019-12-08T12:03:09.476 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T12:03:09.442+0000 9b13800 -1 journal do_read_entry(8192): bad header magic 2019-12-08T12:03:09.634 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T12:03:09.632+0000 9b13800 -1 osd.5 0 log_to_monitors {default=true} 2019-12-08T12:03:09.686 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T12:03:09.683+0000 9b13800 -1 osd.4 0 log_to_monitors {default=true} 2019-12-08T12:03:09.744 INFO:tasks.ceph.osd.0.smithi079.stderr:==00:00:00:05.822 10447== Warning: unimplemented fcntl command: 1036 2019-12-08T12:03:09.836 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T12:03:09.805+0000 9b13800 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-12-08T12:03:09.845 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T12:03:09.821+0000 9b13800 -1 journal do_read_entry(8192): bad header magic 2019-12-08T12:03:09.866 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T12:03:09.824+0000 9b13800 -1 journal do_read_entry(8192): bad header magic 2019-12-08T12:03:09.953 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T12:03:09.933+0000 9b13800 -1 osd.1 0 log_to_monitors {default=true} 2019-12-08T12:03:10.009 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T12:03:09.989+0000 9b13800 -1 osd.6 0 log_to_monitors {default=true} 2019-12-08T12:03:10.033 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T12:03:10.029+0000 9b13800 -1 osd.7 0 log_to_monitors {default=true} 2019-12-08T12:03:10.035 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T12:03:10.015+0000 9b13800 -1 osd.2 0 log_to_monitors {default=true} 2019-12-08T12:03:10.190 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T12:03:10.154+0000 9b13800 -1 journal FileJournal::_open: disabling aio for non-block journal. Use journal_force_aio to force use of aio anyway 2019-12-08T12:03:10.204 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T12:03:10.170+0000 9b13800 -1 journal do_read_entry(8192): bad header magic 2019-12-08T12:03:10.218 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T12:03:10.173+0000 9b13800 -1 journal do_read_entry(8192): bad header magic 2019-12-08T12:03:10.413 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T12:03:10.394+0000 9b13800 -1 osd.3 0 log_to_monitors {default=true} 2019-12-08T12:03:10.745 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T12:03:10.685+0000 9b13800 -1 osd.0 0 log_to_monitors {default=true} 2019-12-08T12:03:11.803 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T12:03:11.801+0000 29a5f700 -1 osd.5 0 waiting for initial osdmap 2019-12-08T12:03:11.805 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T12:03:11.793+0000 29a5f700 -1 osd.4 0 waiting for initial osdmap 2019-12-08T12:03:12.338 INFO:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2019-12-08T12:03:12.653 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T12:03:12.632+0000 29a5f700 -1 osd.3 0 waiting for initial osdmap 2019-12-08T12:03:12.719 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T12:03:12.694+0000 29a5f700 -1 osd.1 0 waiting for initial osdmap 2019-12-08T12:03:12.752 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T12:03:12.731+0000 29a5f700 -1 osd.0 0 waiting for initial osdmap 2019-12-08T12:03:12.755 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T12:03:12.733+0000 29a5f700 -1 osd.2 0 waiting for initial osdmap 2019-12-08T12:03:12.784 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T12:03:12.781+0000 29a5f700 -1 osd.6 0 waiting for initial osdmap 2019-12-08T12:03:12.793 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T12:03:12.789+0000 29a5f700 -1 osd.7 0 waiting for initial osdmap 2019-12-08T12:03:13.094 INFO:teuthology.misc.health.smithi079.stdout: 2019-12-08T12:03:13.094 INFO:teuthology.misc.health.smithi079.stdout:{"epoch":13,"fsid":"1a1450cf-cae7-41b0-ba4a-fe494bbfc59f","created":"2019-12-08T12:02:48.944092+0000","modified":"2019-12-08T12:03:12.318851+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"f1c8b96a-9f83-44de-8e62-bab5a6b81b93","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5f14fc3e-9253-4fb1-9ccf-7e4a66e1fc25","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"5c7b7343-4ac8-4f04-bf6f-19ac3ed1f5ca","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e0d53023-e3b6-49e9-8c73-29d0fcd77cba","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"0a924035-4dce-4225-a497-31aa9e14ef7e","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"4dbcde75-1cc7-49cb-8664-f839ad1e3921","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"855cdc06-23e3-450f-86bc-b7b0029f3226","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"3163caee-ba1d-42b2-b777-2fcc023ca436","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-08T12:03:13.105 DEBUG:teuthology.misc:0 of 8 OSDs are up 2019-12-08T12:03:19.914 INFO:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2019-12-08T12:03:20.733 INFO:teuthology.misc.health.smithi079.stdout: 2019-12-08T12:03:20.733 INFO:teuthology.misc.health.smithi079.stdout:{"epoch":16,"fsid":"1a1450cf-cae7-41b0-ba4a-fe494bbfc59f","created":"2019-12-08T12:02:48.944092+0000","modified":"2019-12-08T12:03:15.565492+0000","last_up_change":"2019-12-08T12:03:13.354607+0000","last_in_change":"2019-12-08T12:03:13.354607+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"f1c8b96a-9f83-44de-8e62-bab5a6b81b93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":10447},{"type":"v1","addr":"172.21.15.79:6827","nonce":10447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":10447},{"type":"v1","addr":"172.21.15.79:6829","nonce":10447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":10447},{"type":"v1","addr":"172.21.15.79:6833","nonce":10447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":10447},{"type":"v1","addr":"172.21.15.79:6831","nonce":10447}]},"public_addr":"172.21.15.79:6827/10447","cluster_addr":"172.21.15.79:6829/10447","heartbeat_back_addr":"172.21.15.79:6833/10447","heartbeat_front_addr":"172.21.15.79:6831/10447","state":["exists","up"]},{"osd":1,"uuid":"5f14fc3e-9253-4fb1-9ccf-7e4a66e1fc25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":10449},{"type":"v1","addr":"172.21.15.79:6811","nonce":10449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":10449},{"type":"v1","addr":"172.21.15.79:6813","nonce":10449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":10449},{"type":"v1","addr":"172.21.15.79:6817","nonce":10449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":10449},{"type":"v1","addr":"172.21.15.79:6815","nonce":10449}]},"public_addr":"172.21.15.79:6811/10449","cluster_addr":"172.21.15.79:6813/10449","heartbeat_back_addr":"172.21.15.79:6817/10449","heartbeat_front_addr":"172.21.15.79:6815/10449","state":["exists","up"]},{"osd":2,"uuid":"5c7b7343-4ac8-4f04-bf6f-19ac3ed1f5ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":10448},{"type":"v1","addr":"172.21.15.79:6803","nonce":10448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":10448},{"type":"v1","addr":"172.21.15.79:6805","nonce":10448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":10448},{"type":"v1","addr":"172.21.15.79:6809","nonce":10448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":10448},{"type":"v1","addr":"172.21.15.79:6807","nonce":10448}]},"public_addr":"172.21.15.79:6803/10448","cluster_addr":"172.21.15.79:6805/10448","heartbeat_back_addr":"172.21.15.79:6809/10448","heartbeat_front_addr":"172.21.15.79:6807/10448","state":["exists","up"]},{"osd":3,"uuid":"e0d53023-e3b6-49e9-8c73-29d0fcd77cba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":10450},{"type":"v1","addr":"172.21.15.79:6819","nonce":10450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":10450},{"type":"v1","addr":"172.21.15.79:6821","nonce":10450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":10450},{"type":"v1","addr":"172.21.15.79:6825","nonce":10450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":10450},{"type":"v1","addr":"172.21.15.79:6823","nonce":10450}]},"public_addr":"172.21.15.79:6819/10450","cluster_addr":"172.21.15.79:6821/10450","heartbeat_back_addr":"172.21.15.79:6825/10450","heartbeat_front_addr":"172.21.15.79:6823/10450","state":["exists","up"]},{"osd":4,"uuid":"0a924035-4dce-4225-a497-31aa9e14ef7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.13:6816","nonce":9326},{"type":"v1","addr":"172.21.15.13:6817","nonce":9326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.13:6818","nonce":9326},{"type":"v1","addr":"172.21.15.13:6819","nonce":9326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.13:6822","nonce":9326},{"type":"v1","addr":"172.21.15.13:6823","nonce":9326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.13:6820","nonce":9326},{"type":"v1","addr":"172.21.15.13:6821","nonce":9326}]},"public_addr":"172.21.15.13:6817/9326","cluster_addr":"172.21.15.13:6819/9326","heartbeat_back_addr":"172.21.15.13:6823/9326","heartbeat_front_addr":"172.21.15.13:6821/9326","state":["exists","up"]},{"osd":5,"uuid":"4dbcde75-1cc7-49cb-8664-f839ad1e3921","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.13:6800","nonce":9325},{"type":"v1","addr":"172.21.15.13:6801","nonce":9325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.13:6802","nonce":9325},{"type":"v1","addr":"172.21.15.13:6803","nonce":9325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.13:6808","nonce":9325},{"type":"v1","addr":"172.21.15.13:6809","nonce":9325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.13:6805","nonce":9325},{"type":"v1","addr":"172.21.15.13:6807","nonce":9325}]},"public_addr":"172.21.15.13:6801/9325","cluster_addr":"172.21.15.13:6803/9325","heartbeat_back_addr":"172.21.15.13:6809/9325","heartbeat_front_addr":"172.21.15.13:6807/9325","state":["exists","up"]},{"osd":6,"uuid":"855cdc06-23e3-450f-86bc-b7b0029f3226","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.13:6824","nonce":9328},{"type":"v1","addr":"172.21.15.13:6825","nonce":9328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.13:6826","nonce":9328},{"type":"v1","addr":"172.21.15.13:6827","nonce":9328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.13:6830","nonce":9328},{"type":"v1","addr":"172.21.15.13:6831","nonce":9328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.13:6828","nonce":9328},{"type":"v1","addr":"172.21.15.13:6829","nonce":9328}]},"public_addr":"172.21.15.13:6825/9328","cluster_addr":"172.21.15.13:6827/9328","heartbeat_back_addr":"172.21.15.13:6831/9328","heartbeat_front_addr":"172.21.15.13:6829/9328","state":["exists","up"]},{"osd":7,"uuid":"3163caee-ba1d-42b2-b777-2fcc023ca436","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.13:6804","nonce":9327},{"type":"v1","addr":"172.21.15.13:6806","nonce":9327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.13:6810","nonce":9327},{"type":"v1","addr":"172.21.15.13:6811","nonce":9327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.13:6814","nonce":9327},{"type":"v1","addr":"172.21.15.13:6815","nonce":9327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.13:6812","nonce":9327},{"type":"v1","addr":"172.21.15.13:6813","nonce":9327}]},"public_addr":"172.21.15.13:6806/9327","cluster_addr":"172.21.15.13:6811/9327","heartbeat_back_addr":"172.21.15.13:6815/9327","heartbeat_front_addr":"172.21.15.13:6813/9327","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-08T12:03:11.815122+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-08T12:03:11.096175+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-08T12:03:11.159909+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-08T12:03:11.537107+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-08T12:03:10.846349+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-08T12:03:10.779121+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-08T12:03:11.096093+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-08T12:03:11.160034+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-08T12:03:20.746 DEBUG:teuthology.misc:8 of 8 OSDs are up 2019-12-08T12:03:20.746 INFO:tasks.ceph:Creating RBD pool 2019-12-08T12:03:20.746 INFO:teuthology.orchestra.run.smithi079:> sudo ceph --cluster ceph osd pool create rbd 8 2019-12-08T12:03:22.902 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'rbd' created 2019-12-08T12:03:22.915 INFO:teuthology.orchestra.run.smithi079:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2019-12-08T12:03:24.209 INFO:teuthology.orchestra.run.smithi079.stderr:enabled application 'rbd' on pool 'rbd' 2019-12-08T12:03:24.229 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2019-12-08T12:03:24.230 INFO:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-12-08T12:03:24.230 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2019-12-08T12:03:25.047 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:03:25.047 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":18,"fsid":"1a1450cf-cae7-41b0-ba4a-fe494bbfc59f","created":"2019-12-08T12:02:48.944092+0000","modified":"2019-12-08T12:03:23.915713+0000","last_up_change":"2019-12-08T12:03:13.354607+0000","last_in_change":"2019-12-08T12:03:13.354607+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-12-08T12:03:21.494467+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"f1c8b96a-9f83-44de-8e62-bab5a6b81b93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":10447},{"type":"v1","addr":"172.21.15.79:6827","nonce":10447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":10447},{"type":"v1","addr":"172.21.15.79:6829","nonce":10447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":10447},{"type":"v1","addr":"172.21.15.79:6833","nonce":10447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":10447},{"type":"v1","addr":"172.21.15.79:6831","nonce":10447}]},"public_addr":"172.21.15.79:6827/10447","cluster_addr":"172.21.15.79:6829/10447","heartbeat_back_addr":"172.21.15.79:6833/10447","heartbeat_front_addr":"172.21.15.79:6831/10447","state":["exists","up"]},{"osd":1,"uuid":"5f14fc3e-9253-4fb1-9ccf-7e4a66e1fc25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":10449},{"type":"v1","addr":"172.21.15.79:6811","nonce":10449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":10449},{"type":"v1","addr":"172.21.15.79:6813","nonce":10449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":10449},{"type":"v1","addr":"172.21.15.79:6817","nonce":10449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":10449},{"type":"v1","addr":"172.21.15.79:6815","nonce":10449}]},"public_addr":"172.21.15.79:6811/10449","cluster_addr":"172.21.15.79:6813/10449","heartbeat_back_addr":"172.21.15.79:6817/10449","heartbeat_front_addr":"172.21.15.79:6815/10449","state":["exists","up"]},{"osd":2,"uuid":"5c7b7343-4ac8-4f04-bf6f-19ac3ed1f5ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":10448},{"type":"v1","addr":"172.21.15.79:6803","nonce":10448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":10448},{"type":"v1","addr":"172.21.15.79:6805","nonce":10448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":10448},{"type":"v1","addr":"172.21.15.79:6809","nonce":10448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":10448},{"type":"v1","addr":"172.21.15.79:6807","nonce":10448}]},"public_addr":"172.21.15.79:6803/10448","cluster_addr":"172.21.15.79:6805/10448","heartbeat_back_addr":"172.21.15.79:6809/10448","heartbeat_front_addr":"172.21.15.79:6807/10448","state":["exists","up"]},{"osd":3,"uuid":"e0d53023-e3b6-49e9-8c73-29d0fcd77cba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":10450},{"type":"v1","addr":"172.21.15.79:6819","nonce":10450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":10450},{"type":"v1","addr":"172.21.15.79:6821","nonce":10450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":10450},{"type":"v1","addr":"172.21.15.79:6825","nonce":10450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":10450},{"type":"v1","addr":"172.21.15.79:6823","nonce":10450}]},"public_addr":"172.21.15.79:6819/10450","cluster_addr":"172.21.15.79:6821/10450","heartbeat_back_addr":"172.21.15.79:6825/10450","heartbeat_front_addr":"172.21.15.79:6823/10450","state":["exists","up"]},{"osd":4,"uuid":"0a924035-4dce-4225-a497-31aa9e14ef7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.13:6816","nonce":9326},{"type":"v1","addr":"172.21.15.13:6817","nonce":9326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.13:6818","nonce":9326},{"type":"v1","addr":"172.21.15.13:6819","nonce":9326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.13:6822","nonce":9326},{"type":"v1","addr":"172.21.15.13:6823","nonce":9326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.13:6820","nonce":9326},{"type":"v1","addr":"172.21.15.13:6821","nonce":9326}]},"public_addr":"172.21.15.13:6817/9326","cluster_addr":"172.21.15.13:6819/9326","heartbeat_back_addr":"172.21.15.13:6823/9326","heartbeat_front_addr":"172.21.15.13:6821/9326","state":["exists","up"]},{"osd":5,"uuid":"4dbcde75-1cc7-49cb-8664-f839ad1e3921","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.13:6800","nonce":9325},{"type":"v1","addr":"172.21.15.13:6801","nonce":9325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.13:6802","nonce":9325},{"type":"v1","addr":"172.21.15.13:6803","nonce":9325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.13:6808","nonce":9325},{"type":"v1","addr":"172.21.15.13:6809","nonce":9325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.13:6805","nonce":9325},{"type":"v1","addr":"172.21.15.13:6807","nonce":9325}]},"public_addr":"172.21.15.13:6801/9325","cluster_addr":"172.21.15.13:6803/9325","heartbeat_back_addr":"172.21.15.13:6809/9325","heartbeat_front_addr":"172.21.15.13:6807/9325","state":["exists","up"]},{"osd":6,"uuid":"855cdc06-23e3-450f-86bc-b7b0029f3226","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.13:6824","nonce":9328},{"type":"v1","addr":"172.21.15.13:6825","nonce":9328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.13:6826","nonce":9328},{"type":"v1","addr":"172.21.15.13:6827","nonce":9328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.13:6830","nonce":9328},{"type":"v1","addr":"172.21.15.13:6831","nonce":9328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.13:6828","nonce":9328},{"type":"v1","addr":"172.21.15.13:6829","nonce":9328}]},"public_addr":"172.21.15.13:6825/9328","cluster_addr":"172.21.15.13:6827/9328","heartbeat_back_addr":"172.21.15.13:6831/9328","heartbeat_front_addr":"172.21.15.13:6829/9328","state":["exists","up"]},{"osd":7,"uuid":"3163caee-ba1d-42b2-b777-2fcc023ca436","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.13:6804","nonce":9327},{"type":"v1","addr":"172.21.15.13:6806","nonce":9327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.13:6810","nonce":9327},{"type":"v1","addr":"172.21.15.13:6811","nonce":9327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.13:6814","nonce":9327},{"type":"v1","addr":"172.21.15.13:6815","nonce":9327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.13:6812","nonce":9327},{"type":"v1","addr":"172.21.15.13:6813","nonce":9327}]},"public_addr":"172.21.15.13:6806/9327","cluster_addr":"172.21.15.13:6811/9327","heartbeat_back_addr":"172.21.15.13:6815/9327","heartbeat_front_addr":"172.21.15.13:6813/9327","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-08T12:03:11.815122+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-08T12:03:11.096175+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-08T12:03:11.159909+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-08T12:03:11.537107+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-08T12:03:10.846349+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-08T12:03:10.779121+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-08T12:03:11.096093+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-08T12:03:11.160034+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-08T12:03:25.073 INFO:tasks.ceph.ceph_manager.ceph:[{u'cache_target_full_ratio_micro': 800000, u'fast_read': False, u'stripe_width': 0, u'flags_names': u'hashpspool,creating', u'tier_of': -1, u'hit_set_grade_decay_rate': 0, u'pg_placement_num': 8, u'use_gmt_hitset': True, u'cache_target_dirty_ratio_micro': 400000, u'create_time': u'2019-12-08T12:03:21.494467+0000', u'snap_epoch': 0, u'erasure_code_profile': u'', u'pg_autoscale_mode': u'off', u'snap_seq': 0, u'expected_num_objects': 0, u'size': 2, u'pg_num_pending': 8, u'auid': 0, u'cache_min_flush_age': 0, u'hit_set_period': 0, u'min_read_recency_for_promote': 0, u'target_max_objects': 0, u'pg_placement_num_target': 8, u'pg_num': 8, u'type': 1, u'grade_table': [], u'pool_name': u'rbd', u'cache_min_evict_age': 0, u'snap_mode': u'selfmanaged', u'pg_num_target': 8, u'cache_mode': u'none', u'min_size': 1, u'cache_target_dirty_high_ratio_micro': 600000, u'object_hash': 2, u'last_pg_merge_meta': {u'ready_epoch': 0, u'source_version': u"0'0", u'source_pgid': u'0.0', u'last_epoch_clean': 0, u'target_version': u"0'0", u'last_epoch_started': 0}, u'write_tier': -1, u'last_force_op_resend_preluminous': u'0', u'pool': 1, u'removed_snaps': u'[]', u'crush_rule': 0, u'tiers': [], u'hit_set_params': {u'type': u'none'}, u'last_force_op_resend': u'0', u'pool_snaps': [], u'quota_max_objects': 0, u'last_force_op_resend_prenautilus': u'0', u'application_metadata': {u'rbd': {}}, u'options': {}, u'hit_set_count': 0, u'flags': 32769, u'target_max_bytes': 0, u'quota_max_bytes': 0, u'hit_set_search_last_n': 0, u'last_change': u'18', u'min_write_recency_for_promote': 0, u'read_tier': -1}] 2019-12-08T12:03:25.073 INFO:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2019-12-08T12:03:25.928 INFO:teuthology.orchestra.run.smithi079.stdout:pg_num: 8 2019-12-08T12:03:25.943 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2019-12-08T12:03:25.944 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2019-12-08T12:03:25.944 INFO:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2019-12-08T12:03:26.844 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:03:26.869 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":3,"active_gid":4104,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6800","nonce":9057},{"type":"v1","addr":"172.21.15.79:6801","nonce":9057}]},"active_addr":"172.21.15.79:6801/9057","active_change":"2019-12-08T12:02:52.474437+0000","active_mgr_features":4540138292836696063,"available":true,"standbys":[{"gid":4100,"name":"x","mgr_features":4540138292836696063,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"str","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"ansible","can_run":true,"error_string":"","module_options":{"ca_bundle":{"name":"ca_bundle","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_location":{"name":"server_location","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_server":{"name":"verify_server","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"1","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"str","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"str","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"str","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"str","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"deepsea","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_eauth":{"name":"salt_api_eauth","type":"str","level":"advanced","flags":0,"default_value":"sharedsecret","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_password":{"name":"salt_api_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_url":{"name":"salt_api_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_username":{"name":"salt_api_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_cloud","can_run":true,"error_string":"","module_options":{"diskprediction_cert_context":{"name":"diskprediction_cert_context","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_default_authority":{"name":"diskprediction_default_authority","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_password":{"name":"diskprediction_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_port":{"name":"diskprediction_port","type":"str","level":"advanced","flags":0,"default_value":"31400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_retrieve_prediction_interval":{"name":"diskprediction_retrieve_prediction_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_server":{"name":"diskprediction_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_ssl_target_name_override":{"name":"diskprediction_ssl_target_name_override","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_metrics_interval":{"name":"diskprediction_upload_metrics_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_smart_interval":{"name":"diskprediction_upload_smart_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_user":{"name":"diskprediction_user","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator_cli","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"ssh","can_run":true,"error_string":"","module_options":{"inventory_cache_timeout":{"name":"inventory_cache_timeout","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["ceph-daemon-package","root"],"desc":"mode for remote execution of ceph-daemon","long_desc":"","tags":[],"see_also":[]},"service_cache_timeout":{"name":"service_cache_timeout","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"str","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"ansible","can_run":true,"error_string":"","module_options":{"ca_bundle":{"name":"ca_bundle","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_location":{"name":"server_location","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_server":{"name":"verify_server","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"1","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"str","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_cephfs":{"name":"FEATURE_TOGGLE_cephfs","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_iscsi":{"name":"FEATURE_TOGGLE_iscsi","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_mirroring":{"name":"FEATURE_TOGGLE_mirroring","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rbd":{"name":"FEATURE_TOGGLE_rbd","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_rgw":{"name":"FEATURE_TOGGLE_rgw","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"str","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"str","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_HOST":{"name":"RGW_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_PORT":{"name":"RGW_API_PORT","type":"str","level":"advanced","flags":0,"default_value":"80","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SCHEME":{"name":"RGW_API_SCHEME","type":"str","level":"advanced","flags":0,"default_value":"http","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"str","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_USER_ID":{"name":"RGW_API_USER_ID","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"deepsea","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_eauth":{"name":"salt_api_eauth","type":"str","level":"advanced","flags":0,"default_value":"sharedsecret","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_password":{"name":"salt_api_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_url":{"name":"salt_api_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"salt_api_username":{"name":"salt_api_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_cloud","can_run":true,"error_string":"","module_options":{"diskprediction_cert_context":{"name":"diskprediction_cert_context","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_default_authority":{"name":"diskprediction_default_authority","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_password":{"name":"diskprediction_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_port":{"name":"diskprediction_port","type":"str","level":"advanced","flags":0,"default_value":"31400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_retrieve_prediction_interval":{"name":"diskprediction_retrieve_prediction_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_server":{"name":"diskprediction_server","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_ssl_target_name_override":{"name":"diskprediction_ssl_target_name_override","type":"str","level":"advanced","flags":0,"default_value":"localhost","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_metrics_interval":{"name":"diskprediction_upload_metrics_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_upload_smart_interval":{"name":"diskprediction_upload_smart_interval","type":"str","level":"advanced","flags":0,"default_value":"43200","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"diskprediction_user":{"name":"diskprediction_user","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator_cli","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"ssh","can_run":true,"error_string":"","module_options":{"inventory_cache_timeout":{"name":"inventory_cache_timeout","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["ceph-daemon-package","root"],"desc":"mode for remote execution of ceph-daemon","long_desc":"","tags":[],"see_also":[]},"service_cache_timeout":{"name":"service_cache_timeout","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator_cli","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]}} 2019-12-08T12:03:26.886 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2019-12-08T12:03:26.886 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2019-12-08T12:03:26.887 INFO:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-12-08T12:03:27.817 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:03:27.818 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":20,"fsid":"1a1450cf-cae7-41b0-ba4a-fe494bbfc59f","created":"2019-12-08T12:02:48.944092+0000","modified":"2019-12-08T12:03:26.363272+0000","last_up_change":"2019-12-08T12:03:13.354607+0000","last_in_change":"2019-12-08T12:03:13.354607+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-12-08T12:03:21.494467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"f1c8b96a-9f83-44de-8e62-bab5a6b81b93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":10447},{"type":"v1","addr":"172.21.15.79:6827","nonce":10447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":10447},{"type":"v1","addr":"172.21.15.79:6829","nonce":10447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":10447},{"type":"v1","addr":"172.21.15.79:6833","nonce":10447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":10447},{"type":"v1","addr":"172.21.15.79:6831","nonce":10447}]},"public_addr":"172.21.15.79:6827/10447","cluster_addr":"172.21.15.79:6829/10447","heartbeat_back_addr":"172.21.15.79:6833/10447","heartbeat_front_addr":"172.21.15.79:6831/10447","state":["exists","up"]},{"osd":1,"uuid":"5f14fc3e-9253-4fb1-9ccf-7e4a66e1fc25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":10449},{"type":"v1","addr":"172.21.15.79:6811","nonce":10449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":10449},{"type":"v1","addr":"172.21.15.79:6813","nonce":10449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":10449},{"type":"v1","addr":"172.21.15.79:6817","nonce":10449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":10449},{"type":"v1","addr":"172.21.15.79:6815","nonce":10449}]},"public_addr":"172.21.15.79:6811/10449","cluster_addr":"172.21.15.79:6813/10449","heartbeat_back_addr":"172.21.15.79:6817/10449","heartbeat_front_addr":"172.21.15.79:6815/10449","state":["exists","up"]},{"osd":2,"uuid":"5c7b7343-4ac8-4f04-bf6f-19ac3ed1f5ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":10448},{"type":"v1","addr":"172.21.15.79:6803","nonce":10448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":10448},{"type":"v1","addr":"172.21.15.79:6805","nonce":10448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":10448},{"type":"v1","addr":"172.21.15.79:6809","nonce":10448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":10448},{"type":"v1","addr":"172.21.15.79:6807","nonce":10448}]},"public_addr":"172.21.15.79:6803/10448","cluster_addr":"172.21.15.79:6805/10448","heartbeat_back_addr":"172.21.15.79:6809/10448","heartbeat_front_addr":"172.21.15.79:6807/10448","state":["exists","up"]},{"osd":3,"uuid":"e0d53023-e3b6-49e9-8c73-29d0fcd77cba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":10450},{"type":"v1","addr":"172.21.15.79:6819","nonce":10450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":10450},{"type":"v1","addr":"172.21.15.79:6821","nonce":10450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":10450},{"type":"v1","addr":"172.21.15.79:6825","nonce":10450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":10450},{"type":"v1","addr":"172.21.15.79:6823","nonce":10450}]},"public_addr":"172.21.15.79:6819/10450","cluster_addr":"172.21.15.79:6821/10450","heartbeat_back_addr":"172.21.15.79:6825/10450","heartbeat_front_addr":"172.21.15.79:6823/10450","state":["exists","up"]},{"osd":4,"uuid":"0a924035-4dce-4225-a497-31aa9e14ef7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.13:6816","nonce":9326},{"type":"v1","addr":"172.21.15.13:6817","nonce":9326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.13:6818","nonce":9326},{"type":"v1","addr":"172.21.15.13:6819","nonce":9326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.13:6822","nonce":9326},{"type":"v1","addr":"172.21.15.13:6823","nonce":9326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.13:6820","nonce":9326},{"type":"v1","addr":"172.21.15.13:6821","nonce":9326}]},"public_addr":"172.21.15.13:6817/9326","cluster_addr":"172.21.15.13:6819/9326","heartbeat_back_addr":"172.21.15.13:6823/9326","heartbeat_front_addr":"172.21.15.13:6821/9326","state":["exists","up"]},{"osd":5,"uuid":"4dbcde75-1cc7-49cb-8664-f839ad1e3921","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.13:6800","nonce":9325},{"type":"v1","addr":"172.21.15.13:6801","nonce":9325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.13:6802","nonce":9325},{"type":"v1","addr":"172.21.15.13:6803","nonce":9325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.13:6808","nonce":9325},{"type":"v1","addr":"172.21.15.13:6809","nonce":9325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.13:6805","nonce":9325},{"type":"v1","addr":"172.21.15.13:6807","nonce":9325}]},"public_addr":"172.21.15.13:6801/9325","cluster_addr":"172.21.15.13:6803/9325","heartbeat_back_addr":"172.21.15.13:6809/9325","heartbeat_front_addr":"172.21.15.13:6807/9325","state":["exists","up"]},{"osd":6,"uuid":"855cdc06-23e3-450f-86bc-b7b0029f3226","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.13:6824","nonce":9328},{"type":"v1","addr":"172.21.15.13:6825","nonce":9328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.13:6826","nonce":9328},{"type":"v1","addr":"172.21.15.13:6827","nonce":9328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.13:6830","nonce":9328},{"type":"v1","addr":"172.21.15.13:6831","nonce":9328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.13:6828","nonce":9328},{"type":"v1","addr":"172.21.15.13:6829","nonce":9328}]},"public_addr":"172.21.15.13:6825/9328","cluster_addr":"172.21.15.13:6827/9328","heartbeat_back_addr":"172.21.15.13:6831/9328","heartbeat_front_addr":"172.21.15.13:6829/9328","state":["exists","up"]},{"osd":7,"uuid":"3163caee-ba1d-42b2-b777-2fcc023ca436","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.13:6804","nonce":9327},{"type":"v1","addr":"172.21.15.13:6806","nonce":9327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.13:6810","nonce":9327},{"type":"v1","addr":"172.21.15.13:6811","nonce":9327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.13:6814","nonce":9327},{"type":"v1","addr":"172.21.15.13:6815","nonce":9327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.13:6812","nonce":9327},{"type":"v1","addr":"172.21.15.13:6813","nonce":9327}]},"public_addr":"172.21.15.13:6806/9327","cluster_addr":"172.21.15.13:6811/9327","heartbeat_back_addr":"172.21.15.13:6815/9327","heartbeat_front_addr":"172.21.15.13:6813/9327","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-08T12:03:11.815122+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-08T12:03:11.096175+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-08T12:03:11.159909+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-08T12:03:11.537107+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-08T12:03:10.846349+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-08T12:03:10.779121+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-08T12:03:11.096093+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-08T12:03:11.160034+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-08T12:03:27.834 INFO:tasks.ceph.ceph_manager.ceph:all up! 2019-12-08T12:03:27.834 INFO:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2019-12-08T12:03:28.749 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:03:28.749 INFO:teuthology.orchestra.run.smithi079.stdout:{"epoch":20,"fsid":"1a1450cf-cae7-41b0-ba4a-fe494bbfc59f","created":"2019-12-08T12:02:48.944092+0000","modified":"2019-12-08T12:03:26.363272+0000","last_up_change":"2019-12-08T12:03:13.354607+0000","last_in_change":"2019-12-08T12:03:13.354607+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"rbd","create_time":"2019-12-08T12:03:21.494467+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"f1c8b96a-9f83-44de-8e62-bab5a6b81b93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6826","nonce":10447},{"type":"v1","addr":"172.21.15.79:6827","nonce":10447}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6828","nonce":10447},{"type":"v1","addr":"172.21.15.79:6829","nonce":10447}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6832","nonce":10447},{"type":"v1","addr":"172.21.15.79:6833","nonce":10447}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6830","nonce":10447},{"type":"v1","addr":"172.21.15.79:6831","nonce":10447}]},"public_addr":"172.21.15.79:6827/10447","cluster_addr":"172.21.15.79:6829/10447","heartbeat_back_addr":"172.21.15.79:6833/10447","heartbeat_front_addr":"172.21.15.79:6831/10447","state":["exists","up"]},{"osd":1,"uuid":"5f14fc3e-9253-4fb1-9ccf-7e4a66e1fc25","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6810","nonce":10449},{"type":"v1","addr":"172.21.15.79:6811","nonce":10449}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6812","nonce":10449},{"type":"v1","addr":"172.21.15.79:6813","nonce":10449}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6816","nonce":10449},{"type":"v1","addr":"172.21.15.79:6817","nonce":10449}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6814","nonce":10449},{"type":"v1","addr":"172.21.15.79:6815","nonce":10449}]},"public_addr":"172.21.15.79:6811/10449","cluster_addr":"172.21.15.79:6813/10449","heartbeat_back_addr":"172.21.15.79:6817/10449","heartbeat_front_addr":"172.21.15.79:6815/10449","state":["exists","up"]},{"osd":2,"uuid":"5c7b7343-4ac8-4f04-bf6f-19ac3ed1f5ca","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6802","nonce":10448},{"type":"v1","addr":"172.21.15.79:6803","nonce":10448}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6804","nonce":10448},{"type":"v1","addr":"172.21.15.79:6805","nonce":10448}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6808","nonce":10448},{"type":"v1","addr":"172.21.15.79:6809","nonce":10448}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6806","nonce":10448},{"type":"v1","addr":"172.21.15.79:6807","nonce":10448}]},"public_addr":"172.21.15.79:6803/10448","cluster_addr":"172.21.15.79:6805/10448","heartbeat_back_addr":"172.21.15.79:6809/10448","heartbeat_front_addr":"172.21.15.79:6807/10448","state":["exists","up"]},{"osd":3,"uuid":"e0d53023-e3b6-49e9-8c73-29d0fcd77cba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6818","nonce":10450},{"type":"v1","addr":"172.21.15.79:6819","nonce":10450}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6820","nonce":10450},{"type":"v1","addr":"172.21.15.79:6821","nonce":10450}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6824","nonce":10450},{"type":"v1","addr":"172.21.15.79:6825","nonce":10450}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.79:6822","nonce":10450},{"type":"v1","addr":"172.21.15.79:6823","nonce":10450}]},"public_addr":"172.21.15.79:6819/10450","cluster_addr":"172.21.15.79:6821/10450","heartbeat_back_addr":"172.21.15.79:6825/10450","heartbeat_front_addr":"172.21.15.79:6823/10450","state":["exists","up"]},{"osd":4,"uuid":"0a924035-4dce-4225-a497-31aa9e14ef7e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.13:6816","nonce":9326},{"type":"v1","addr":"172.21.15.13:6817","nonce":9326}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.13:6818","nonce":9326},{"type":"v1","addr":"172.21.15.13:6819","nonce":9326}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.13:6822","nonce":9326},{"type":"v1","addr":"172.21.15.13:6823","nonce":9326}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.13:6820","nonce":9326},{"type":"v1","addr":"172.21.15.13:6821","nonce":9326}]},"public_addr":"172.21.15.13:6817/9326","cluster_addr":"172.21.15.13:6819/9326","heartbeat_back_addr":"172.21.15.13:6823/9326","heartbeat_front_addr":"172.21.15.13:6821/9326","state":["exists","up"]},{"osd":5,"uuid":"4dbcde75-1cc7-49cb-8664-f839ad1e3921","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.13:6800","nonce":9325},{"type":"v1","addr":"172.21.15.13:6801","nonce":9325}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.13:6802","nonce":9325},{"type":"v1","addr":"172.21.15.13:6803","nonce":9325}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.13:6808","nonce":9325},{"type":"v1","addr":"172.21.15.13:6809","nonce":9325}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.13:6805","nonce":9325},{"type":"v1","addr":"172.21.15.13:6807","nonce":9325}]},"public_addr":"172.21.15.13:6801/9325","cluster_addr":"172.21.15.13:6803/9325","heartbeat_back_addr":"172.21.15.13:6809/9325","heartbeat_front_addr":"172.21.15.13:6807/9325","state":["exists","up"]},{"osd":6,"uuid":"855cdc06-23e3-450f-86bc-b7b0029f3226","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.13:6824","nonce":9328},{"type":"v1","addr":"172.21.15.13:6825","nonce":9328}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.13:6826","nonce":9328},{"type":"v1","addr":"172.21.15.13:6827","nonce":9328}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.13:6830","nonce":9328},{"type":"v1","addr":"172.21.15.13:6831","nonce":9328}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.13:6828","nonce":9328},{"type":"v1","addr":"172.21.15.13:6829","nonce":9328}]},"public_addr":"172.21.15.13:6825/9328","cluster_addr":"172.21.15.13:6827/9328","heartbeat_back_addr":"172.21.15.13:6831/9328","heartbeat_front_addr":"172.21.15.13:6829/9328","state":["exists","up"]},{"osd":7,"uuid":"3163caee-ba1d-42b2-b777-2fcc023ca436","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.13:6804","nonce":9327},{"type":"v1","addr":"172.21.15.13:6806","nonce":9327}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.13:6810","nonce":9327},{"type":"v1","addr":"172.21.15.13:6811","nonce":9327}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.13:6814","nonce":9327},{"type":"v1","addr":"172.21.15.13:6815","nonce":9327}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.13:6812","nonce":9327},{"type":"v1","addr":"172.21.15.13:6813","nonce":9327}]},"public_addr":"172.21.15.13:6806/9327","cluster_addr":"172.21.15.13:6811/9327","heartbeat_back_addr":"172.21.15.13:6815/9327","heartbeat_front_addr":"172.21.15.13:6813/9327","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-08T12:03:11.815122+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-08T12:03:11.096175+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-08T12:03:11.159909+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-08T12:03:11.537107+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-08T12:03:10.846349+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-08T12:03:10.779121+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-08T12:03:11.096093+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292836696063,"old_weight":0,"last_purged_snaps_scrub":"2019-12-08T12:03:11.160034+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2019-12-08T12:03:28.770 INFO:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2019-12-08T12:03:29.258 INFO:teuthology.orchestra.run.smithi079.stdout:60129542150 2019-12-08T12:03:29.258 INFO:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2019-12-08T12:03:29.754 INFO:teuthology.orchestra.run.smithi079.stdout:60129542151 2019-12-08T12:03:29.754 INFO:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2019-12-08T12:03:30.359 INFO:teuthology.orchestra.run.smithi079.stdout:60129542150 2019-12-08T12:03:30.360 INFO:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2019-12-08T12:03:30.905 INFO:teuthology.orchestra.run.smithi079.stdout:60129542150 2019-12-08T12:03:30.905 INFO:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2019-12-08T12:03:31.409 INFO:teuthology.orchestra.run.smithi079.stdout:60129542150 2019-12-08T12:03:31.410 INFO:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2019-12-08T12:03:32.094 INFO:teuthology.orchestra.run.smithi079.stdout:60129542151 2019-12-08T12:03:32.095 INFO:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2019-12-08T12:03:32.735 INFO:teuthology.orchestra.run.smithi079.stdout:60129542151 2019-12-08T12:03:32.735 INFO:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2019-12-08T12:03:33.320 INFO:teuthology.orchestra.run.smithi079.stdout:60129542151 2019-12-08T12:03:33.320 INFO:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2019-12-08T12:03:34.288 INFO:teuthology.orchestra.run.smithi079.stdout:60129542151 2019-12-08T12:03:34.303 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542151 for osd.0 2019-12-08T12:03:34.303 INFO:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2019-12-08T12:03:34.998 INFO:teuthology.orchestra.run.smithi079.stdout:60129542151 2019-12-08T12:03:35.012 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.1 2019-12-08T12:03:35.012 INFO:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2019-12-08T12:03:35.794 INFO:teuthology.orchestra.run.smithi079.stdout:60129542151 2019-12-08T12:03:35.808 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542151 for osd.2 2019-12-08T12:03:35.809 INFO:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2019-12-08T12:03:36.623 INFO:teuthology.orchestra.run.smithi079.stdout:60129542150 2019-12-08T12:03:36.636 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.3 2019-12-08T12:03:36.637 INFO:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2019-12-08T12:03:37.508 INFO:teuthology.orchestra.run.smithi079.stdout:60129542151 2019-12-08T12:03:37.524 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542151 for osd.4 2019-12-08T12:03:37.524 INFO:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2019-12-08T12:03:38.326 INFO:teuthology.orchestra.run.smithi079.stdout:60129542152 2019-12-08T12:03:38.341 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542152 for osd.5 2019-12-08T12:03:38.342 INFO:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2019-12-08T12:03:39.367 INFO:teuthology.orchestra.run.smithi079.stdout:60129542152 2019-12-08T12:03:39.382 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542152 for osd.6 2019-12-08T12:03:39.382 INFO:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2019-12-08T12:03:40.201 INFO:teuthology.orchestra.run.smithi079.stdout:60129542152 2019-12-08T12:03:40.218 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542152 for osd.7 2019-12-08T12:03:40.218 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2019-12-08T12:03:40.219 INFO:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2019-12-08T12:03:40.926 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2019-12-08T12:03:40.927 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:03:40.940 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2019-12-08T12:03:40.636220+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":749595040,"kb_used":1699680,"kb_used_data":747895360,"kb_used_omap":294,"kb_used_meta":0,"kb_avail":747895360,"statfs":{"total":767585320960,"available":765844848640,"internally_reserved":0,"allocated":765844848640,"data_stored":765844848640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":302049,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-12-08T12:03:25.926693+0000","last_change":"2019-12-08T12:03:25.150271+0000","last_active":"2019-12-08T12:03:25.926693+0000","last_peered":"2019-12-08T12:03:25.926693+0000","last_clean":"2019-12-08T12:03:25.926693+0000","last_became_active":"2019-12-08T12:03:25.127454+0000","last_became_peered":"2019-12-08T12:03:25.127454+0000","last_unstale":"2019-12-08T12:03:25.926693+0000","last_undegraded":"2019-12-08T12:03:25.926693+0000","last_fullsized":"2019-12-08T12:03:25.926693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-08T12:03:22.307847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-08T12:03:22.307847+0000","last_clean_scrub_stamp":"2019-12-08T12:03:22.307847+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-12-08T12:03:25.802822+0000","last_change":"2019-12-08T12:03:25.254915+0000","last_active":"2019-12-08T12:03:25.802822+0000","last_peered":"2019-12-08T12:03:25.802822+0000","last_clean":"2019-12-08T12:03:25.802822+0000","last_became_active":"2019-12-08T12:03:25.184795+0000","last_became_peered":"2019-12-08T12:03:25.184795+0000","last_unstale":"2019-12-08T12:03:25.802822+0000","last_undegraded":"2019-12-08T12:03:25.802822+0000","last_fullsized":"2019-12-08T12:03:25.802822+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-08T12:03:22.307847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-08T12:03:22.307847+0000","last_clean_scrub_stamp":"2019-12-08T12:03:22.307847+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-12-08T12:03:25.394399+0000","last_change":"2019-12-08T12:03:25.226871+0000","last_active":"2019-12-08T12:03:25.394399+0000","last_peered":"2019-12-08T12:03:25.394399+0000","last_clean":"2019-12-08T12:03:25.394399+0000","last_became_active":"2019-12-08T12:03:25.185543+0000","last_became_peered":"2019-12-08T12:03:25.185543+0000","last_unstale":"2019-12-08T12:03:25.394399+0000","last_undegraded":"2019-12-08T12:03:25.394399+0000","last_fullsized":"2019-12-08T12:03:25.394399+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-08T12:03:22.307847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-08T12:03:22.307847+0000","last_clean_scrub_stamp":"2019-12-08T12:03:22.307847+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-12-08T12:03:25.691025+0000","last_change":"2019-12-08T12:03:24.539473+0000","last_active":"2019-12-08T12:03:25.691025+0000","last_peered":"2019-12-08T12:03:25.691025+0000","last_clean":"2019-12-08T12:03:25.691025+0000","last_became_active":"2019-12-08T12:03:24.512323+0000","last_became_peered":"2019-12-08T12:03:24.512323+0000","last_unstale":"2019-12-08T12:03:25.691025+0000","last_undegraded":"2019-12-08T12:03:25.691025+0000","last_fullsized":"2019-12-08T12:03:25.691025+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-08T12:03:22.307847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-08T12:03:22.307847+0000","last_clean_scrub_stamp":"2019-12-08T12:03:22.307847+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-12-08T12:03:25.913385+0000","last_change":"2019-12-08T12:03:24.971978+0000","last_active":"2019-12-08T12:03:25.913385+0000","last_peered":"2019-12-08T12:03:25.913385+0000","last_clean":"2019-12-08T12:03:25.913385+0000","last_became_active":"2019-12-08T12:03:24.919575+0000","last_became_peered":"2019-12-08T12:03:24.919575+0000","last_unstale":"2019-12-08T12:03:25.913385+0000","last_undegraded":"2019-12-08T12:03:25.913385+0000","last_fullsized":"2019-12-08T12:03:25.913385+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-08T12:03:22.307847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-08T12:03:22.307847+0000","last_clean_scrub_stamp":"2019-12-08T12:03:22.307847+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-12-08T12:03:25.808655+0000","last_change":"2019-12-08T12:03:25.248884+0000","last_active":"2019-12-08T12:03:25.808655+0000","last_peered":"2019-12-08T12:03:25.808655+0000","last_clean":"2019-12-08T12:03:25.808655+0000","last_became_active":"2019-12-08T12:03:25.216881+0000","last_became_peered":"2019-12-08T12:03:25.216881+0000","last_unstale":"2019-12-08T12:03:25.808655+0000","last_undegraded":"2019-12-08T12:03:25.808655+0000","last_fullsized":"2019-12-08T12:03:25.808655+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-08T12:03:22.307847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-08T12:03:22.307847+0000","last_clean_scrub_stamp":"2019-12-08T12:03:22.307847+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-12-08T12:03:25.614068+0000","last_change":"2019-12-08T12:03:24.507015+0000","last_active":"2019-12-08T12:03:25.614068+0000","last_peered":"2019-12-08T12:03:25.614068+0000","last_clean":"2019-12-08T12:03:25.614068+0000","last_became_active":"2019-12-08T12:03:24.479824+0000","last_became_peered":"2019-12-08T12:03:24.479824+0000","last_unstale":"2019-12-08T12:03:25.614068+0000","last_undegraded":"2019-12-08T12:03:25.614068+0000","last_fullsized":"2019-12-08T12:03:25.614068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-08T12:03:22.307847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-08T12:03:22.307847+0000","last_clean_scrub_stamp":"2019-12-08T12:03:22.307847+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-12-08T12:03:25.411273+0000","last_change":"2019-12-08T12:03:24.569828+0000","last_active":"2019-12-08T12:03:25.411273+0000","last_peered":"2019-12-08T12:03:25.411273+0000","last_clean":"2019-12-08T12:03:25.411273+0000","last_became_active":"2019-12-08T12:03:24.526877+0000","last_became_peered":"2019-12-08T12:03:24.526877+0000","last_unstale":"2019-12-08T12:03:25.411273+0000","last_undegraded":"2019-12-08T12:03:25.411273+0000","last_fullsized":"2019-12-08T12:03:25.411273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-08T12:03:22.307847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-08T12:03:22.307847+0000","last_clean_scrub_stamp":"2019-12-08T12:03:22.307847+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542153,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":212460,"kb_used_data":93486920,"kb_used_omap":32,"kb_used_meta":0,"kb_avail":93486920,"statfs":{"total":95948165120,"available":95730606080,"internally_reserved":0,"allocated":95730606080,"data_stored":95730606080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32935,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":27.259}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":38.160}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":12.792}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":35.094}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":39.728}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":18.632}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":23.960}]}]},{"osd":6,"up_from":14,"seq":60129542153,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":212460,"kb_used_data":93486920,"kb_used_omap":46,"kb_used_meta":0,"kb_avail":93486920,"statfs":{"total":95948165120,"available":95730606080,"internally_reserved":0,"allocated":95730606080,"data_stored":95730606080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47314,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":18.320}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":20.115}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":23.922}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":32.903}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":43.233}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":40.030}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":41.785}]}]},{"osd":4,"up_from":14,"seq":60129542152,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":212460,"kb_used_data":93486920,"kb_used_omap":36,"kb_used_meta":0,"kb_avail":93486920,"statfs":{"total":95948165120,"available":95730606080,"internally_reserved":0,"allocated":95730606080,"data_stored":95730606080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":37787,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":18.037}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":41.153}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":46.971}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":21.192}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":43.187}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":56.667}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":62.124}]}]},{"osd":3,"up_from":14,"seq":60129542152,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":212460,"kb_used_data":93486920,"kb_used_omap":36,"kb_used_meta":0,"kb_avail":93486920,"statfs":{"total":95948165120,"available":95730606080,"internally_reserved":0,"allocated":95730606080,"data_stored":95730606080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":37793,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":18.365}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":18.951}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":27.188}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":30.789}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":32.770}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":40.568}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":34.993}]}]},{"osd":2,"up_from":14,"seq":60129542152,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":212460,"kb_used_data":93486920,"kb_used_omap":32,"kb_used_meta":0,"kb_avail":93486920,"statfs":{"total":95948165120,"available":95730606080,"internally_reserved":0,"allocated":95730606080,"data_stored":95730606080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32935,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":29.147}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":16.437}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":18.239}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":31.973}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":23.376}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":34.298}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":36.636}]}]},{"osd":5,"up_from":14,"seq":60129542153,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":212460,"kb_used_data":93486920,"kb_used_omap":32,"kb_used_meta":0,"kb_avail":93486920,"statfs":{"total":95948165120,"available":95730606080,"internally_reserved":0,"allocated":95730606080,"data_stored":95730606080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32929,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":23.108}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":36.880}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":36.123}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":33.249}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":25.072}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":38.866}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":44.381}]}]},{"osd":0,"up_from":14,"seq":60129542153,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":212460,"kb_used_data":93486920,"kb_used_omap":36,"kb_used_meta":0,"kb_avail":93486920,"statfs":{"total":95948165120,"available":95730606080,"internally_reserved":0,"allocated":95730606080,"data_stored":95730606080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":37749,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":17.093}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":11.581}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":32.281}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":19.526}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":34.362}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":27.111}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":22.000}]}]},{"osd":1,"up_from":14,"seq":60129542153,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":212460,"kb_used_data":93486920,"kb_used_omap":41,"kb_used_meta":0,"kb_avail":93486920,"statfs":{"total":95948165120,"available":95730606080,"internally_reserved":0,"allocated":95730606080,"data_stored":95730606080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":42607,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":9.891}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":13.220}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":13.956}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":19.835}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":21.963}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":15.513}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":20.769}]}]}]}} 2019-12-08T12:03:40.942 INFO:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2019-12-08T12:03:41.829 INFO:teuthology.orchestra.run.smithi079.stderr:dumped all 2019-12-08T12:03:41.829 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:03:41.849 INFO:teuthology.orchestra.run.smithi079.stdout:{"pg_ready":true,"pg_map":{"version":35,"stamp":"2019-12-08T12:03:40.636220+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":16,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":749595040,"kb_used":1699680,"kb_used_data":747895360,"kb_used_omap":294,"kb_used_meta":0,"kb_avail":747895360,"statfs":{"total":767585320960,"available":765844848640,"internally_reserved":0,"allocated":765844848640,"data_stored":765844848640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":302049,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-12-08T12:03:25.926693+0000","last_change":"2019-12-08T12:03:25.150271+0000","last_active":"2019-12-08T12:03:25.926693+0000","last_peered":"2019-12-08T12:03:25.926693+0000","last_clean":"2019-12-08T12:03:25.926693+0000","last_became_active":"2019-12-08T12:03:25.127454+0000","last_became_peered":"2019-12-08T12:03:25.127454+0000","last_unstale":"2019-12-08T12:03:25.926693+0000","last_undegraded":"2019-12-08T12:03:25.926693+0000","last_fullsized":"2019-12-08T12:03:25.926693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-08T12:03:22.307847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-08T12:03:22.307847+0000","last_clean_scrub_stamp":"2019-12-08T12:03:22.307847+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-12-08T12:03:25.802822+0000","last_change":"2019-12-08T12:03:25.254915+0000","last_active":"2019-12-08T12:03:25.802822+0000","last_peered":"2019-12-08T12:03:25.802822+0000","last_clean":"2019-12-08T12:03:25.802822+0000","last_became_active":"2019-12-08T12:03:25.184795+0000","last_became_peered":"2019-12-08T12:03:25.184795+0000","last_unstale":"2019-12-08T12:03:25.802822+0000","last_undegraded":"2019-12-08T12:03:25.802822+0000","last_fullsized":"2019-12-08T12:03:25.802822+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-08T12:03:22.307847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-08T12:03:22.307847+0000","last_clean_scrub_stamp":"2019-12-08T12:03:22.307847+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-12-08T12:03:25.394399+0000","last_change":"2019-12-08T12:03:25.226871+0000","last_active":"2019-12-08T12:03:25.394399+0000","last_peered":"2019-12-08T12:03:25.394399+0000","last_clean":"2019-12-08T12:03:25.394399+0000","last_became_active":"2019-12-08T12:03:25.185543+0000","last_became_peered":"2019-12-08T12:03:25.185543+0000","last_unstale":"2019-12-08T12:03:25.394399+0000","last_undegraded":"2019-12-08T12:03:25.394399+0000","last_fullsized":"2019-12-08T12:03:25.394399+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-08T12:03:22.307847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-08T12:03:22.307847+0000","last_clean_scrub_stamp":"2019-12-08T12:03:22.307847+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-12-08T12:03:25.691025+0000","last_change":"2019-12-08T12:03:24.539473+0000","last_active":"2019-12-08T12:03:25.691025+0000","last_peered":"2019-12-08T12:03:25.691025+0000","last_clean":"2019-12-08T12:03:25.691025+0000","last_became_active":"2019-12-08T12:03:24.512323+0000","last_became_peered":"2019-12-08T12:03:24.512323+0000","last_unstale":"2019-12-08T12:03:25.691025+0000","last_undegraded":"2019-12-08T12:03:25.691025+0000","last_fullsized":"2019-12-08T12:03:25.691025+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-08T12:03:22.307847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-08T12:03:22.307847+0000","last_clean_scrub_stamp":"2019-12-08T12:03:22.307847+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-12-08T12:03:25.913385+0000","last_change":"2019-12-08T12:03:24.971978+0000","last_active":"2019-12-08T12:03:25.913385+0000","last_peered":"2019-12-08T12:03:25.913385+0000","last_clean":"2019-12-08T12:03:25.913385+0000","last_became_active":"2019-12-08T12:03:24.919575+0000","last_became_peered":"2019-12-08T12:03:24.919575+0000","last_unstale":"2019-12-08T12:03:25.913385+0000","last_undegraded":"2019-12-08T12:03:25.913385+0000","last_fullsized":"2019-12-08T12:03:25.913385+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-08T12:03:22.307847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-08T12:03:22.307847+0000","last_clean_scrub_stamp":"2019-12-08T12:03:22.307847+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-12-08T12:03:25.808655+0000","last_change":"2019-12-08T12:03:25.248884+0000","last_active":"2019-12-08T12:03:25.808655+0000","last_peered":"2019-12-08T12:03:25.808655+0000","last_clean":"2019-12-08T12:03:25.808655+0000","last_became_active":"2019-12-08T12:03:25.216881+0000","last_became_peered":"2019-12-08T12:03:25.216881+0000","last_unstale":"2019-12-08T12:03:25.808655+0000","last_undegraded":"2019-12-08T12:03:25.808655+0000","last_fullsized":"2019-12-08T12:03:25.808655+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-08T12:03:22.307847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-08T12:03:22.307847+0000","last_clean_scrub_stamp":"2019-12-08T12:03:22.307847+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-12-08T12:03:25.614068+0000","last_change":"2019-12-08T12:03:24.507015+0000","last_active":"2019-12-08T12:03:25.614068+0000","last_peered":"2019-12-08T12:03:25.614068+0000","last_clean":"2019-12-08T12:03:25.614068+0000","last_became_active":"2019-12-08T12:03:24.479824+0000","last_became_peered":"2019-12-08T12:03:24.479824+0000","last_unstale":"2019-12-08T12:03:25.614068+0000","last_undegraded":"2019-12-08T12:03:25.614068+0000","last_fullsized":"2019-12-08T12:03:25.614068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-08T12:03:22.307847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-08T12:03:22.307847+0000","last_clean_scrub_stamp":"2019-12-08T12:03:22.307847+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"10","reported_epoch":"19","state":"active+clean","last_fresh":"2019-12-08T12:03:25.411273+0000","last_change":"2019-12-08T12:03:24.569828+0000","last_active":"2019-12-08T12:03:25.411273+0000","last_peered":"2019-12-08T12:03:25.411273+0000","last_clean":"2019-12-08T12:03:25.411273+0000","last_became_active":"2019-12-08T12:03:24.526877+0000","last_became_peered":"2019-12-08T12:03:24.526877+0000","last_unstale":"2019-12-08T12:03:25.411273+0000","last_undegraded":"2019-12-08T12:03:25.411273+0000","last_fullsized":"2019-12-08T12:03:25.411273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2019-12-08T12:03:22.307847+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2019-12-08T12:03:22.307847+0000","last_clean_scrub_stamp":"2019-12-08T12:03:22.307847+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542153,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":212460,"kb_used_data":93486920,"kb_used_omap":32,"kb_used_meta":0,"kb_avail":93486920,"statfs":{"total":95948165120,"available":95730606080,"internally_reserved":0,"allocated":95730606080,"data_stored":95730606080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32935,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":27.259}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":38.160}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":12.792}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":35.094}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":39.728}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":18.632}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":23.960}]}]},{"osd":6,"up_from":14,"seq":60129542153,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":212460,"kb_used_data":93486920,"kb_used_omap":46,"kb_used_meta":0,"kb_avail":93486920,"statfs":{"total":95948165120,"available":95730606080,"internally_reserved":0,"allocated":95730606080,"data_stored":95730606080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":47314,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":18.320}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":20.115}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":23.922}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":32.903}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":43.233}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":40.030}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":41.785}]}]},{"osd":4,"up_from":14,"seq":60129542152,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":212460,"kb_used_data":93486920,"kb_used_omap":36,"kb_used_meta":0,"kb_avail":93486920,"statfs":{"total":95948165120,"available":95730606080,"internally_reserved":0,"allocated":95730606080,"data_stored":95730606080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":37787,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":18.037}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":41.153}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":46.971}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":21.192}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":43.187}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":56.667}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":62.124}]}]},{"osd":3,"up_from":14,"seq":60129542152,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":212460,"kb_used_data":93486920,"kb_used_omap":36,"kb_used_meta":0,"kb_avail":93486920,"statfs":{"total":95948165120,"available":95730606080,"internally_reserved":0,"allocated":95730606080,"data_stored":95730606080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":37793,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":18.365}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":18.951}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":27.188}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":30.789}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":32.770}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":40.568}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":34.993}]}]},{"osd":2,"up_from":14,"seq":60129542152,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":212460,"kb_used_data":93486920,"kb_used_omap":32,"kb_used_meta":0,"kb_avail":93486920,"statfs":{"total":95948165120,"available":95730606080,"internally_reserved":0,"allocated":95730606080,"data_stored":95730606080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32935,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":29.147}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":16.437}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":18.239}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":31.973}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":23.376}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":34.298}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":36.636}]}]},{"osd":5,"up_from":14,"seq":60129542153,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":212460,"kb_used_data":93486920,"kb_used_omap":32,"kb_used_meta":0,"kb_avail":93486920,"statfs":{"total":95948165120,"available":95730606080,"internally_reserved":0,"allocated":95730606080,"data_stored":95730606080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":32929,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":23.108}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":36.880}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":36.123}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":33.249}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":25.072}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":38.866}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":44.381}]}]},{"osd":0,"up_from":14,"seq":60129542153,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":212460,"kb_used_data":93486920,"kb_used_omap":36,"kb_used_meta":0,"kb_avail":93486920,"statfs":{"total":95948165120,"available":95730606080,"internally_reserved":0,"allocated":95730606080,"data_stored":95730606080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":37749,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":17.093}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":11.581}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":32.281}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":19.526}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":34.362}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":27.111}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":22.000}]}]},{"osd":1,"up_from":14,"seq":60129542153,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":212460,"kb_used_data":93486920,"kb_used_omap":41,"kb_used_meta":0,"kb_avail":93486920,"statfs":{"total":95948165120,"available":95730606080,"internally_reserved":0,"allocated":95730606080,"data_stored":95730606080,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":42607,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":9.891}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":13.220}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":13.956}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":19.835}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":21.963}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":15.513}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0.000,"5min":0.000,"15min":0.000},"min":{"1min":0.000,"5min":0.000,"15min":0.000},"max":{"1min":0.000,"5min":0.000,"15min":0.000},"last":20.769}]}]}]}} 2019-12-08T12:03:41.852 INFO:tasks.ceph.ceph_manager.ceph:clean! 2019-12-08T12:03:41.852 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2019-12-08T12:03:41.852 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2019-12-08T12:03:41.852 INFO:teuthology.orchestra.run.smithi079:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2019-12-08T12:03:42.767 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:03:42.789 INFO:teuthology.orchestra.run.smithi079.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2019-12-08T12:03:42.789 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2019-12-08T12:03:42.790 INFO:teuthology.run_tasks:Running task openssl_keys... 2019-12-08T12:03:42.835 INFO:teuthology.run_tasks:Running task rgw... 2019-12-08T12:03:42.852 DEBUG:tasks.rgw:config is {'client.0': {'valgrind': ['--tool=memcheck', '--max-threads=1024']}} 2019-12-08T12:03:42.852 DEBUG:tasks.rgw:client list is ['client.0'] 2019-12-08T12:03:42.852 INFO:tasks.rgw:Creating data pools 2019-12-08T12:03:42.852 DEBUG:tasks.rgw:Obtaining remote for client client.0 2019-12-08T12:03:42.853 INFO:teuthology.orchestra.run.smithi079:> sudo ceph osd erasure-code-profile set client.0 crush-failure-domain=osd k=3 m=1 name=testprofile --cluster ceph 2019-12-08T12:03:44.327 INFO:teuthology.orchestra.run.smithi079:> sudo ceph osd pool create default.rgw.buckets.data 64 64 erasure client.0 --cluster ceph 2019-12-08T12:03:46.777 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'default.rgw.buckets.data' created 2019-12-08T12:03:46.795 INFO:teuthology.orchestra.run.smithi079:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2019-12-08T12:03:48.153 INFO:teuthology.orchestra.run.smithi079.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2019-12-08T12:03:48.169 INFO:teuthology.orchestra.run.smithi079:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2019-12-08T12:03:49.360 INFO:teuthology.orchestra.run.smithi079.stderr:pool 'default.rgw.buckets.index' created 2019-12-08T12:03:49.375 INFO:teuthology.orchestra.run.smithi079:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2019-12-08T12:03:50.388 INFO:teuthology.orchestra.run.smithi079.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2019-12-08T12:03:50.402 DEBUG:tasks.rgw:Pools created 2019-12-08T12:03:50.402 INFO:tasks.rgw:Configuring compression type = random 2019-12-08T12:03:50.403 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2019-12-08T12:03:50.403 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2019-12-08T12:03:50.403 INFO:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2019-12-08T12:03:50.596 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:03:50.578+0000 7f89b765eec0 20 rados->read ofs=0 len=0 2019-12-08T12:03:52.968 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:03:52.943+0000 7f89b765eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:03:52.968 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:03:52.943+0000 7f89b765eec0 20 rados->read ofs=0 len=0 2019-12-08T12:03:52.972 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:03:52.954+0000 7f89b765eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:03:52.972 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:03:52.954+0000 7f89b765eec0 20 rados->read ofs=0 len=0 2019-12-08T12:03:52.984 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:03:52.967+0000 7f89b765eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:03:52.984 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:03:52.967+0000 7f89b765eec0 20 rados->read ofs=0 len=0 2019-12-08T12:03:53.106 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:03:53.089+0000 7f89b765eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:03:55.100 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:03:55.083+0000 7f89b765eec0 20 rados->read ofs=0 len=0 2019-12-08T12:03:55.114 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:03:55.097+0000 7f89b765eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:03:55.115 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:03:55.097+0000 7f89b765eec0 20 rados->read ofs=0 len=0 2019-12-08T12:03:55.124 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:03:55.106+0000 7f89b765eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:03:55.124 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:03:55.106+0000 7f89b765eec0 20 rados->read ofs=0 len=0 2019-12-08T12:03:55.136 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:03:55.119+0000 7f89b765eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:03:55.136 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:03:55.119+0000 7f89b765eec0 10 cannot find current period zonegroup using local zonegroup 2019-12-08T12:03:55.136 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:03:55.119+0000 7f89b765eec0 20 rados->read ofs=0 len=0 2019-12-08T12:03:55.147 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:03:55.130+0000 7f89b765eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:03:55.147 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:03:55.130+0000 7f89b765eec0 20 rados->read ofs=0 len=0 2019-12-08T12:03:55.158 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:03:55.140+0000 7f89b765eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:03:55.158 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:03:55.140+0000 7f89b765eec0 10 Creating default zonegroup 2019-12-08T12:03:55.158 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:03:55.140+0000 7f89b765eec0 20 get_system_obj_state: rctx=0x7fff3b496a00 obj=:.pools.avail state=0x5608cbdfb380 s->prefetch_data=0 2019-12-08T12:03:55.163 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:03:55.145+0000 7f89b765eec0 10 couldn't find old data placement pools config, setting up new ones for the zone 2019-12-08T12:03:55.380 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:03:55.363+0000 7f89b765eec0 10 WARNING: store->list_zones() returned r=-2 2019-12-08T12:03:55.381 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:03:55.363+0000 7f89b765eec0 20 rados->read ofs=0 len=0 2019-12-08T12:03:55.388 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:03:55.371+0000 7f89b765eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:03:56.163 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:03:56.145+0000 7f89b765eec0 20 rados->read ofs=0 len=0 2019-12-08T12:03:56.175 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:03:56.157+0000 7f89b765eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:03:56.175 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:03:56.157+0000 7f89b765eec0 10 could not read realm id: (2) No such file or directory 2019-12-08T12:03:56.175 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:03:56.157+0000 7f89b765eec0 10 WARNING: failed to set zone as default, r=-22 2019-12-08T12:03:56.175 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:03:56.157+0000 7f89b765eec0 20 rados->read ofs=0 len=0 2019-12-08T12:03:56.184 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:03:56.166+0000 7f89b765eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:03:56.373 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:03:56.355+0000 7f89a4888700 0 -- 172.21.15.79:0/1562493475 >> [v2:172.21.15.13:6804/9327,v1:172.21.15.13:6806/9327] conn(0x5608cbdf41e0 msgr2=0x5608cbdf6660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-08T12:03:56.373 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:03:56.355+0000 7f89b765eec0 20 rados->read ofs=0 len=0 2019-12-08T12:03:56.402 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:03:56.384+0000 7f89b765eec0 20 rados_obj.operate() r=0 bl.length=805 2019-12-08T12:03:56.402 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:03:56.384+0000 7f89b765eec0 20 rados->read ofs=0 len=0 2019-12-08T12:03:56.412 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:03:56.394+0000 7f89b765eec0 20 rados_obj.operate() r=0 bl.length=348 2019-12-08T12:03:56.412 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:03:56.395+0000 7f89b765eec0 20 zonegroup default 2019-12-08T12:03:56.413 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:03:56.395+0000 7f89b765eec0 20 rados->read ofs=0 len=0 2019-12-08T12:03:56.419 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:03:56.402+0000 7f89b765eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:03:56.420 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:03:56.402+0000 7f89b765eec0 10 Cannot find current period zone using local zone 2019-12-08T12:03:56.420 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:03:56.402+0000 7f89b765eec0 10 Using default name default 2019-12-08T12:03:56.420 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:03:56.402+0000 7f89b765eec0 20 rados->read ofs=0 len=0 2019-12-08T12:03:56.473 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:03:56.455+0000 7f89b765eec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:03:56.473 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:03:56.456+0000 7f89b765eec0 20 rados->read ofs=0 len=0 2019-12-08T12:03:56.491 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:03:56.473+0000 7f89b765eec0 20 rados_obj.operate() r=0 bl.length=805 2019-12-08T12:03:56.491 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:03:56.473+0000 7f89b765eec0 20 zone default found 2019-12-08T12:03:56.491 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:03:56.473+0000 7f89b765eec0 20 started sync module instance, tier type = 2019-12-08T12:03:56.491 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:03:56.473+0000 7f89b765eec0 20 started zone id=f8ab349b-4577-410d-b524-4ecaf50bb1bd (name=default) with tier type = 2019-12-08T12:04:00.554 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:00.536+0000 7f89a5089700 0 -- 172.21.15.79:0/1562493475 >> [v2:172.21.15.79:6818/10450,v1:172.21.15.79:6819/10450] conn(0x7f89900026d0 msgr2=0x7f8990009310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-12-08T12:04:01.359 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:01.341+0000 7f89b765eec0 20 add_watcher() i=0 2019-12-08T12:04:01.359 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:01.341+0000 7f89b765eec0 20 add_watcher() i=1 2019-12-08T12:04:01.360 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:01.341+0000 7f89b765eec0 20 add_watcher() i=2 2019-12-08T12:04:01.360 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:01.341+0000 7f89b765eec0 20 add_watcher() i=3 2019-12-08T12:04:01.360 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:01.341+0000 7f89b765eec0 20 add_watcher() i=4 2019-12-08T12:04:01.360 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:01.341+0000 7f89b765eec0 20 add_watcher() i=5 2019-12-08T12:04:01.394 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:01.377+0000 7f89b765eec0 20 add_watcher() i=6 2019-12-08T12:04:01.425 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:01.407+0000 7f89b765eec0 20 add_watcher() i=7 2019-12-08T12:04:01.425 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:01.407+0000 7f89b765eec0 2 all 8 watchers are set, enabling cache 2019-12-08T12:04:01.425 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:01.408+0000 7f8974fe1700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-08T12:04:05.599 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:05.582+0000 7f89b765eec0 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2019-12-08T12:04:10.190 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:10.171+0000 7f89b765eec0 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.log 2019-12-08T12:04:14.389 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:14.371+0000 7f88deffd700 20 reqs_thread_entry: start 2019-12-08T12:04:14.389 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:14.371+0000 7f88dcff9700 20 reqs_thread_entry: start 2019-12-08T12:04:14.389 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:14.371+0000 7f89b765eec0 20 init_complete bucket index max shards: 0 2019-12-08T12:04:14.390 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:14.372+0000 7f88caffd700 20 reqs_thread_entry: start 2019-12-08T12:04:14.691 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:14.673+0000 7f89b765eec0 20 remove_watcher() i=0 2019-12-08T12:04:14.691 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:14.673+0000 7f89b765eec0 2 removed watcher, disabling cache 2019-12-08T12:04:14.772 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:14.753+0000 7f89b765eec0 20 remove_watcher() i=1 2019-12-08T12:04:14.825 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:14.807+0000 7f89b765eec0 20 remove_watcher() i=2 2019-12-08T12:04:14.864 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:14.846+0000 7f89b765eec0 20 remove_watcher() i=3 2019-12-08T12:04:14.896 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:14.878+0000 7f89b765eec0 20 remove_watcher() i=4 2019-12-08T12:04:14.930 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:14.912+0000 7f89b765eec0 20 remove_watcher() i=5 2019-12-08T12:04:15.004 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:14.986+0000 7f89b765eec0 20 remove_watcher() i=6 2019-12-08T12:04:15.052 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:15.034+0000 7f89b765eec0 20 remove_watcher() i=7 2019-12-08T12:04:15.061 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2019-12-08T12:04:15.061 DEBUG:tasks.util.rgw: json result: [] 2019-12-08T12:04:15.061 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2019-12-08T12:04:15.062 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2019-12-08T12:04:15.062 INFO:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --compression random 2019-12-08T12:04:15.264 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:15.246+0000 7fa9bb7fe700 20 reqs_thread_entry: start 2019-12-08T12:04:15.264 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:15.246+0000 7faa86509ec0 20 rados->read ofs=0 len=0 2019-12-08T12:04:15.291 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:15.273+0000 7faa86509ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:04:15.291 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:15.273+0000 7faa86509ec0 20 rados->read ofs=0 len=0 2019-12-08T12:04:15.318 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:15.300+0000 7faa86509ec0 20 rados_obj.operate() r=0 bl.length=805 2019-12-08T12:04:15.319 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:15.300+0000 7faa86509ec0 20 rados->read ofs=0 len=0 2019-12-08T12:04:15.334 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:15.316+0000 7faa86509ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:04:15.335 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:15.316+0000 7faa86509ec0 20 rados->read ofs=0 len=0 2019-12-08T12:04:15.349 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:15.331+0000 7faa86509ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:04:15.349 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:15.331+0000 7faa86509ec0 20 rados->read ofs=0 len=0 2019-12-08T12:04:15.365 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:15.348+0000 7faa86509ec0 20 rados_obj.operate() r=0 bl.length=348 2019-12-08T12:04:15.498 INFO:teuthology.orchestra.run.smithi079.stdout:{"id":"f8ab349b-4577-410d-b524-4ecaf50bb1bd","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0}}],"realm_id":""} 2019-12-08T12:04:15.499 DEBUG:tasks.util.rgw: json result: {u'control_pool': u'default.rgw.control', u'otp_pool': u'default.rgw.otp', u'usage_log_pool': u'default.rgw.log:usage', u'name': u'default', u'user_uid_pool': u'default.rgw.meta:users.uid', u'gc_pool': u'default.rgw.log:gc', u'intent_log_pool': u'default.rgw.log:intent', u'roles_pool': u'default.rgw.meta:roles', u'lc_pool': u'default.rgw.log:lc', u'user_keys_pool': u'default.rgw.meta:users.keys', u'domain_root': u'default.rgw.meta:root', u'system_key': {u'access_key': u'', u'secret_key': u''}, u'reshard_pool': u'default.rgw.log:reshard', u'log_pool': u'default.rgw.log', u'user_email_pool': u'default.rgw.meta:users.email', u'realm_id': u'', u'placement_pools': [{u'val': {u'storage_classes': {u'STANDARD': {u'data_pool': u'default.rgw.buckets.data', u'compression_type': u'random'}}, u'data_extra_pool': u'default.rgw.buckets.non-ec', u'index_type': 0, u'index_pool': u'default.rgw.buckets.index'}, u'key': u'default-placement'}], u'id': u'f8ab349b-4577-410d-b524-4ecaf50bb1bd', u'user_swift_pool': u'default.rgw.meta:users.swift'} 2019-12-08T12:04:15.499 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2019-12-08T12:04:15.499 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2019-12-08T12:04:15.499 INFO:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2019-12-08T12:04:15.719 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:15.701+0000 7f36de788ec0 20 rados->read ofs=0 len=0 2019-12-08T12:04:15.758 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:15.740+0000 7f36de788ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:04:15.758 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:15.740+0000 7f36de788ec0 20 rados->read ofs=0 len=0 2019-12-08T12:04:15.771 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:15.753+0000 7f36de788ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:04:15.771 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:15.753+0000 7f36de788ec0 20 rados->read ofs=0 len=0 2019-12-08T12:04:15.782 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:15.764+0000 7f36de788ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:04:15.782 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:15.764+0000 7f36de788ec0 20 rados->read ofs=0 len=0 2019-12-08T12:04:15.803 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:15.785+0000 7f36de788ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:04:16.127 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:16.109+0000 7f36de788ec0 20 RGWRados::pool_iterate: got zonegroup_info.fee0148b-7ae2-4cf0-a79e-86045a29cb7c 2019-12-08T12:04:16.128 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:16.109+0000 7f36de788ec0 20 RGWRados::pool_iterate: got zone_info.f8ab349b-4577-410d-b524-4ecaf50bb1bd 2019-12-08T12:04:16.128 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:16.109+0000 7f36de788ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-08T12:04:16.128 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:16.109+0000 7f36de788ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-08T12:04:16.128 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:16.109+0000 7f36de788ec0 20 rados->read ofs=0 len=0 2019-12-08T12:04:16.146 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:16.128+0000 7f36de788ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:04:16.147 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:16.128+0000 7f36de788ec0 20 rados->read ofs=0 len=0 2019-12-08T12:04:16.165 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:16.147+0000 7f36de788ec0 20 rados_obj.operate() r=0 bl.length=821 2019-12-08T12:04:16.165 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:16.147+0000 7f36de788ec0 20 rados->read ofs=0 len=0 2019-12-08T12:04:16.180 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:16.162+0000 7f36de788ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:04:16.181 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:16.162+0000 7f36de788ec0 20 rados->read ofs=0 len=0 2019-12-08T12:04:16.196 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:16.177+0000 7f36de788ec0 20 rados_obj.operate() r=0 bl.length=348 2019-12-08T12:04:16.196 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:16.177+0000 7f36de788ec0 20 rados->read ofs=0 len=0 2019-12-08T12:04:16.205 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:16.186+0000 7f36de788ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:04:16.205 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:16.186+0000 7f36de788ec0 10 cannot find current period zonegroup using local zonegroup 2019-12-08T12:04:16.205 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:16.186+0000 7f36de788ec0 20 rados->read ofs=0 len=0 2019-12-08T12:04:16.213 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:16.195+0000 7f36de788ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:04:16.214 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:16.195+0000 7f36de788ec0 20 rados->read ofs=0 len=0 2019-12-08T12:04:16.225 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:16.207+0000 7f36de788ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:04:16.225 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:16.207+0000 7f36de788ec0 20 rados->read ofs=0 len=0 2019-12-08T12:04:16.237 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:16.219+0000 7f36de788ec0 20 rados_obj.operate() r=0 bl.length=348 2019-12-08T12:04:16.237 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:16.219+0000 7f36de788ec0 20 zonegroup default 2019-12-08T12:04:16.238 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:16.219+0000 7f36de788ec0 20 rados->read ofs=0 len=0 2019-12-08T12:04:16.245 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:16.227+0000 7f36de788ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:04:16.245 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:16.227+0000 7f36de788ec0 10 Cannot find current period zone using local zone 2019-12-08T12:04:16.245 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:16.227+0000 7f36de788ec0 20 rados->read ofs=0 len=0 2019-12-08T12:04:16.251 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:16.234+0000 7f36de788ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:04:16.252 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:16.234+0000 7f36de788ec0 20 rados->read ofs=0 len=0 2019-12-08T12:04:16.263 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:16.245+0000 7f36de788ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:04:16.263 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:16.245+0000 7f36de788ec0 20 rados->read ofs=0 len=0 2019-12-08T12:04:16.276 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:16.257+0000 7f36de788ec0 20 rados_obj.operate() r=0 bl.length=821 2019-12-08T12:04:16.276 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:16.257+0000 7f36de788ec0 20 zone default found 2019-12-08T12:04:16.276 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:16.257+0000 7f36de788ec0 20 started sync module instance, tier type = 2019-12-08T12:04:16.276 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:16.257+0000 7f36de788ec0 20 started zone id=f8ab349b-4577-410d-b524-4ecaf50bb1bd (name=default) with tier type = 2019-12-08T12:04:16.738 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:16.720+0000 7f36de788ec0 20 add_watcher() i=0 2019-12-08T12:04:16.739 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:16.720+0000 7f36de788ec0 20 add_watcher() i=1 2019-12-08T12:04:16.739 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:16.720+0000 7f36de788ec0 20 add_watcher() i=2 2019-12-08T12:04:16.739 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:16.720+0000 7f36de788ec0 20 add_watcher() i=3 2019-12-08T12:04:16.739 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:16.720+0000 7f36de788ec0 20 add_watcher() i=4 2019-12-08T12:04:16.739 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:16.720+0000 7f36de788ec0 20 add_watcher() i=5 2019-12-08T12:04:16.739 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:16.720+0000 7f36de788ec0 20 add_watcher() i=6 2019-12-08T12:04:16.773 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:16.755+0000 7f36de788ec0 20 add_watcher() i=7 2019-12-08T12:04:16.773 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:16.755+0000 7f36de788ec0 2 all 8 watchers are set, enabling cache 2019-12-08T12:04:16.773 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:16.755+0000 7f361ffff700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-08T12:04:16.793 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:16.775+0000 7f36cb9b2700 0 -- 172.21.15.79:0/3440136964 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559bf578fd40 msgr2=0x559bf5792160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-08T12:04:16.823 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:16.805+0000 7f36cc1b3700 0 -- 172.21.15.79:0/1121437878 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x559bf57927b0 msgr2=0x559bf5792bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-12-08T12:04:19.709 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:19.691+0000 7f360a7fc700 20 reqs_thread_entry: start 2019-12-08T12:04:19.709 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:19.691+0000 7f3603fff700 20 reqs_thread_entry: start 2019-12-08T12:04:19.709 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:19.691+0000 7f36de788ec0 20 init_complete bucket index max shards: 0 2019-12-08T12:04:19.710 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:19.691+0000 7f36027fc700 20 reqs_thread_entry: start 2019-12-08T12:04:19.906 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:19.888+0000 7f36de788ec0 20 remove_watcher() i=0 2019-12-08T12:04:19.906 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:19.888+0000 7f36de788ec0 2 removed watcher, disabling cache 2019-12-08T12:04:19.980 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:19.962+0000 7f36de788ec0 20 remove_watcher() i=1 2019-12-08T12:04:20.045 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:20.027+0000 7f36de788ec0 20 remove_watcher() i=2 2019-12-08T12:04:20.143 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:20.125+0000 7f36de788ec0 20 remove_watcher() i=3 2019-12-08T12:04:20.232 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:20.213+0000 7f36de788ec0 20 remove_watcher() i=4 2019-12-08T12:04:20.347 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:20.329+0000 7f36de788ec0 20 remove_watcher() i=5 2019-12-08T12:04:20.396 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:20.377+0000 7f36de788ec0 20 remove_watcher() i=6 2019-12-08T12:04:20.439 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:20.421+0000 7f36de788ec0 20 remove_watcher() i=7 2019-12-08T12:04:20.446 INFO:teuthology.orchestra.run.smithi079.stdout:[] 2019-12-08T12:04:20.446 DEBUG:tasks.util.rgw: json result: [] 2019-12-08T12:04:20.446 INFO:tasks.rgw:Configuring storage class type = LUKEWARM 2019-12-08T12:04:20.447 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2019-12-08T12:04:20.447 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2019-12-08T12:04:20.447 INFO:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM 2019-12-08T12:04:20.598 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:20.580+0000 7f066effd700 20 reqs_thread_entry: start 2019-12-08T12:04:20.599 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:20.580+0000 7f0739a26ec0 20 rados->read ofs=0 len=0 2019-12-08T12:04:20.609 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:20.591+0000 7f0739a26ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:04:20.609 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:20.591+0000 7f0739a26ec0 20 rados->read ofs=0 len=0 2019-12-08T12:04:20.624 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:20.606+0000 7f0739a26ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:04:20.624 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:20.606+0000 7f0739a26ec0 20 rados->read ofs=0 len=0 2019-12-08T12:04:20.639 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:20.620+0000 7f0739a26ec0 20 rados_obj.operate() r=0 bl.length=348 2019-12-08T12:04:20.639 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:20.620+0000 7f0739a26ec0 20 rados->read ofs=0 len=0 2019-12-08T12:04:20.651 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:20.633+0000 7f0739a26ec0 20 rados_obj.operate() r=0 bl.length=821 2019-12-08T12:04:20.689 INFO:teuthology.orchestra.run.smithi079.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["LUKEWARM","STANDARD"]}}] 2019-12-08T12:04:20.689 DEBUG:tasks.util.rgw: json result: [{u'val': {u'storage_classes': [u'LUKEWARM', u'STANDARD'], u'name': u'default-placement', u'tags': []}, u'key': u'default-placement'}] 2019-12-08T12:04:20.691 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2019-12-08T12:04:20.691 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2019-12-08T12:04:20.692 INFO:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM --data-pool default.rgw.buckets.data.lukewarm 2019-12-08T12:04:20.858 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:20.840+0000 7fe5a4ff9700 20 reqs_thread_entry: start 2019-12-08T12:04:20.859 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:20.840+0000 7fe667d65ec0 20 rados->read ofs=0 len=0 2019-12-08T12:04:20.884 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:20.865+0000 7fe667d65ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:04:20.884 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:20.866+0000 7fe667d65ec0 20 rados->read ofs=0 len=0 2019-12-08T12:04:20.918 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:20.900+0000 7fe667d65ec0 20 rados_obj.operate() r=0 bl.length=821 2019-12-08T12:04:20.918 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:20.900+0000 7fe667d65ec0 20 rados->read ofs=0 len=0 2019-12-08T12:04:20.942 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:20.924+0000 7fe667d65ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:04:20.942 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:20.924+0000 7fe667d65ec0 20 rados->read ofs=0 len=0 2019-12-08T12:04:20.956 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:20.939+0000 7fe667d65ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:04:20.957 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:20.939+0000 7fe667d65ec0 20 rados->read ofs=0 len=0 2019-12-08T12:04:20.965 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:20.946+0000 7fe667d65ec0 20 rados_obj.operate() r=0 bl.length=372 2019-12-08T12:04:21.030 INFO:teuthology.orchestra.run.smithi079.stdout:{"id":"f8ab349b-4577-410d-b524-4ecaf50bb1bd","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0}}],"realm_id":""} 2019-12-08T12:04:21.030 DEBUG:tasks.util.rgw: json result: {u'control_pool': u'default.rgw.control', u'otp_pool': u'default.rgw.otp', u'usage_log_pool': u'default.rgw.log:usage', u'name': u'default', u'user_uid_pool': u'default.rgw.meta:users.uid', u'gc_pool': u'default.rgw.log:gc', u'intent_log_pool': u'default.rgw.log:intent', u'roles_pool': u'default.rgw.meta:roles', u'lc_pool': u'default.rgw.log:lc', u'user_keys_pool': u'default.rgw.meta:users.keys', u'domain_root': u'default.rgw.meta:root', u'system_key': {u'access_key': u'', u'secret_key': u''}, u'reshard_pool': u'default.rgw.log:reshard', u'log_pool': u'default.rgw.log', u'user_email_pool': u'default.rgw.meta:users.email', u'realm_id': u'', u'placement_pools': [{u'val': {u'storage_classes': {u'LUKEWARM': {u'data_pool': u'default.rgw.buckets.data.lukewarm'}, u'STANDARD': {u'data_pool': u'default.rgw.buckets.data', u'compression_type': u'random'}}, u'data_extra_pool': u'default.rgw.buckets.non-ec', u'index_type': 0, u'index_pool': u'default.rgw.buckets.index'}, u'key': u'default-placement'}], u'id': u'f8ab349b-4577-410d-b524-4ecaf50bb1bd', u'user_swift_pool': u'default.rgw.meta:users.swift'} 2019-12-08T12:04:21.030 INFO:tasks.rgw:Configuring storage class type = FROZEN 2019-12-08T12:04:21.031 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2019-12-08T12:04:21.031 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2019-12-08T12:04:21.031 INFO:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN 2019-12-08T12:04:21.317 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:21.299+0000 7f83427fc700 20 reqs_thread_entry: start 2019-12-08T12:04:21.318 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:21.299+0000 7f840d41eec0 20 rados->read ofs=0 len=0 2019-12-08T12:04:21.337 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:21.319+0000 7f840d41eec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:04:21.338 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:21.319+0000 7f840d41eec0 20 rados->read ofs=0 len=0 2019-12-08T12:04:21.363 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:21.346+0000 7f840d41eec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:04:21.364 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:21.346+0000 7f840d41eec0 20 rados->read ofs=0 len=0 2019-12-08T12:04:21.391 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:21.374+0000 7f840d41eec0 20 rados_obj.operate() r=0 bl.length=372 2019-12-08T12:04:21.391 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:21.374+0000 7f840d41eec0 20 rados->read ofs=0 len=0 2019-12-08T12:04:21.413 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:21.394+0000 7f840d41eec0 20 rados_obj.operate() r=0 bl.length=888 2019-12-08T12:04:21.489 INFO:teuthology.orchestra.run.smithi079.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["FROZEN","LUKEWARM","STANDARD"]}}] 2019-12-08T12:04:21.490 DEBUG:tasks.util.rgw: json result: [{u'val': {u'storage_classes': [u'FROZEN', u'LUKEWARM', u'STANDARD'], u'name': u'default-placement', u'tags': []}, u'key': u'default-placement'}] 2019-12-08T12:04:21.490 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2019-12-08T12:04:21.490 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2019-12-08T12:04:21.490 INFO:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN --data-pool default.rgw.buckets.data.frozen 2019-12-08T12:04:21.798 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:21.779+0000 7fd39effd700 20 reqs_thread_entry: start 2019-12-08T12:04:21.798 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:21.779+0000 7fd469843ec0 20 rados->read ofs=0 len=0 2019-12-08T12:04:21.823 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:21.803+0000 7fd469843ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:04:21.823 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:21.803+0000 7fd469843ec0 20 rados->read ofs=0 len=0 2019-12-08T12:04:21.842 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:21.824+0000 7fd469843ec0 20 rados_obj.operate() r=0 bl.length=888 2019-12-08T12:04:21.842 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:21.824+0000 7fd469843ec0 20 rados->read ofs=0 len=0 2019-12-08T12:04:21.860 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:21.842+0000 7fd469843ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:04:21.860 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:21.842+0000 7fd469843ec0 20 rados->read ofs=0 len=0 2019-12-08T12:04:21.878 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:21.855+0000 7fd469843ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:04:21.878 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:21.855+0000 7fd469843ec0 20 rados->read ofs=0 len=0 2019-12-08T12:04:21.886 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:04:21.868+0000 7fd469843ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-08T12:04:21.950 INFO:teuthology.orchestra.run.smithi079.stdout:{"id":"f8ab349b-4577-410d-b524-4ecaf50bb1bd","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"FROZEN":{"data_pool":"default.rgw.buckets.data.frozen"},"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0}}],"realm_id":""} 2019-12-08T12:04:21.950 DEBUG:tasks.util.rgw: json result: {u'control_pool': u'default.rgw.control', u'otp_pool': u'default.rgw.otp', u'usage_log_pool': u'default.rgw.log:usage', u'name': u'default', u'user_uid_pool': u'default.rgw.meta:users.uid', u'gc_pool': u'default.rgw.log:gc', u'intent_log_pool': u'default.rgw.log:intent', u'roles_pool': u'default.rgw.meta:roles', u'lc_pool': u'default.rgw.log:lc', u'user_keys_pool': u'default.rgw.meta:users.keys', u'domain_root': u'default.rgw.meta:root', u'system_key': {u'access_key': u'', u'secret_key': u''}, u'reshard_pool': u'default.rgw.log:reshard', u'log_pool': u'default.rgw.log', u'user_email_pool': u'default.rgw.meta:users.email', u'realm_id': u'', u'placement_pools': [{u'val': {u'storage_classes': {u'FROZEN': {u'data_pool': u'default.rgw.buckets.data.frozen'}, u'LUKEWARM': {u'data_pool': u'default.rgw.buckets.data.lukewarm'}, u'STANDARD': {u'data_pool': u'default.rgw.buckets.data', u'compression_type': u'random'}}, u'data_extra_pool': u'default.rgw.buckets.non-ec', u'index_type': 0, u'index_pool': u'default.rgw.buckets.index'}, u'key': u'default-placement'}], u'id': u'f8ab349b-4577-410d-b524-4ecaf50bb1bd', u'user_swift_pool': u'default.rgw.meta:users.swift'} 2019-12-08T12:04:21.951 INFO:tasks.rgw:Starting rgw... 2019-12-08T12:04:21.951 INFO:tasks.rgw:rgw client.0 config is {'valgrind': ['--tool=memcheck', '--max-threads=1024']} 2019-12-08T12:04:21.951 INFO:tasks.rgw:Using civetweb as radosgw frontend 2019-12-08T12:04:21.951 DEBUG:teuthology.misc:running ceph.client.0 under valgrind with args ['cd', '/home/ubuntu/cephtest', Raw('&&'), 'sudo', 'adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'daemon-helper', 'term', 'valgrind', '--trace-children=no', '--child-silent-after-fork=yes', '--num-callers=50', '--suppressions=/home/ubuntu/cephtest/valgrind.supp', '--xml=yes', '--xml-file=/var/log/ceph/valgrind/ceph.client.0.log', '--time-stamp=yes', '--tool=memcheck', '--max-threads=1024'] 2019-12-08T12:04:21.952 INFO:tasks.rgw.client.0:Restarting daemon 2019-12-08T12:04:21.952 INFO:teuthology.orchestra.run.smithi079:> cd /home/ubuntu/cephtest && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term valgrind --trace-children=no --child-silent-after-fork=yes --num-callers=50 --suppressions=/home/ubuntu/cephtest/valgrind.supp --xml=yes --xml-file=/var/log/ceph/valgrind/ceph.client.0.log --time-stamp=yes --tool=memcheck --max-threads=1024 radosgw --rgw-frontends 'civetweb port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2019-12-08T12:04:21.972 INFO:tasks.rgw.client.0:Started 2019-12-08T12:04:21.973 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi079.front.sepia.ceph.com:80/ 2019-12-08T12:04:21.973 INFO:teuthology.orchestra.run.smithi079:> curl http://smithi079.front.sepia.ceph.com:80/ 2019-12-08T12:04:22.068 INFO:teuthology.orchestra.run.smithi079.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2019-12-08T12:04:22.068 INFO:teuthology.orchestra.run.smithi079.stderr: Dload Upload Total Spent Left Speed 2019-12-08T12:04:22.073 INFO:teuthology.orchestra.run.smithi079.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0curl: (7) Failed connect to smithi079.front.sepia.ceph.com:80; Connection refused 2019-12-08T12:04:22.073 DEBUG:teuthology.orchestra.run:got remote process result: 7 2019-12-08T12:04:23.074 INFO:teuthology.orchestra.run.smithi079:> curl http://smithi079.front.sepia.ceph.com:80/ 2019-12-08T12:04:23.173 INFO:teuthology.orchestra.run.smithi079.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2019-12-08T12:04:23.173 INFO:teuthology.orchestra.run.smithi079.stderr: Dload Upload Total Spent Left Speed 2019-12-08T12:04:23.177 INFO:teuthology.orchestra.run.smithi079.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0curl: (7) Failed connect to smithi079.front.sepia.ceph.com:80; Connection refused 2019-12-08T12:04:23.178 DEBUG:teuthology.orchestra.run:got remote process result: 7 2019-12-08T12:04:25.179 INFO:teuthology.orchestra.run.smithi079:> curl http://smithi079.front.sepia.ceph.com:80/ 2019-12-08T12:04:25.257 INFO:teuthology.orchestra.run.smithi079.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2019-12-08T12:04:25.257 INFO:teuthology.orchestra.run.smithi079.stderr: Dload Upload Total Spent Left Speed 2019-12-08T12:04:25.260 INFO:teuthology.orchestra.run.smithi079.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0curl: (7) Failed connect to smithi079.front.sepia.ceph.com:80; Connection refused 2019-12-08T12:04:25.260 DEBUG:teuthology.orchestra.run:got remote process result: 7 2019-12-08T12:04:29.267 INFO:teuthology.orchestra.run.smithi079:> curl http://smithi079.front.sepia.ceph.com:80/ 2019-12-08T12:04:29.354 INFO:teuthology.orchestra.run.smithi079.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2019-12-08T12:04:29.354 INFO:teuthology.orchestra.run.smithi079.stderr: Dload Upload Total Spent Left Speed 2019-12-08T12:04:29.357 INFO:teuthology.orchestra.run.smithi079.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0curl: (7) Failed connect to smithi079.front.sepia.ceph.com:80; Connection refused 2019-12-08T12:04:29.358 DEBUG:teuthology.orchestra.run:got remote process result: 7 2019-12-08T12:04:37.359 INFO:teuthology.orchestra.run.smithi079:> curl http://smithi079.front.sepia.ceph.com:80/ 2019-12-08T12:04:37.436 INFO:teuthology.orchestra.run.smithi079.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2019-12-08T12:04:37.436 INFO:teuthology.orchestra.run.smithi079.stderr: Dload Upload Total Spent Left Speed 2019-12-08T12:04:38.112 INFO:teuthology.orchestra.run.smithi079.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 214 0 214 0 0 316 0 --:--:-- --:--:-- --:--:-- 316 100 214 0 214 0 0 316 0 --:--:-- --:--:-- --:--:-- 316 2019-12-08T12:04:38.113 INFO:teuthology.orchestra.run.smithi079.stdout:anonymous 2019-12-08T12:04:38.114 INFO:teuthology.run_tasks:Running task workunit... 2019-12-08T12:04:38.136 INFO:tasks.workunit:Pulling workunits from ref 1351c819e1a9518cde4c8b12d645782009028360 2019-12-08T12:04:38.136 INFO:tasks.workunit:Making a separate scratch dir for every client... 2019-12-08T12:04:38.137 INFO:teuthology.orchestra.run.smithi079:> stat -- /home/ubuntu/cephtest/mnt.0 2019-12-08T12:04:38.197 INFO:teuthology.orchestra.run.smithi079.stderr:stat: cannot stat ‘/home/ubuntu/cephtest/mnt.0’: No such file or directory 2019-12-08T12:04:38.197 DEBUG:teuthology.orchestra.run:got remote process result: 1 2019-12-08T12:04:38.197 INFO:teuthology.orchestra.run.smithi079:> mkdir -- /home/ubuntu/cephtest/mnt.0 2019-12-08T12:04:38.251 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2019-12-08T12:04:38.251 INFO:teuthology.orchestra.run.smithi079:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2019-12-08T12:04:38.337 INFO:tasks.workunit:timeout=3h 2019-12-08T12:04:38.337 INFO:tasks.workunit:cleanup=True 2019-12-08T12:04:38.338 INFO:teuthology.orchestra.run.smithi079:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 1351c819e1a9518cde4c8b12d645782009028360 2019-12-08T12:04:38.637 INFO:tasks.workunit.client.0.smithi079.stdout:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2019-12-08T12:05:43.184 INFO:tasks.workunit.client.0.smithi079.stderr:Note: checking out '1351c819e1a9518cde4c8b12d645782009028360'. 2019-12-08T12:05:43.185 INFO:tasks.workunit.client.0.smithi079.stderr: 2019-12-08T12:05:43.185 INFO:tasks.workunit.client.0.smithi079.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2019-12-08T12:05:43.185 INFO:tasks.workunit.client.0.smithi079.stderr:changes and commit them, and you can discard any commits you make in this 2019-12-08T12:05:43.185 INFO:tasks.workunit.client.0.smithi079.stderr:state without impacting any branches by performing another checkout. 2019-12-08T12:05:43.186 INFO:tasks.workunit.client.0.smithi079.stderr: 2019-12-08T12:05:43.186 INFO:tasks.workunit.client.0.smithi079.stderr:If you want to create a new branch to retain commits you create, you may 2019-12-08T12:05:43.186 INFO:tasks.workunit.client.0.smithi079.stderr:do so (now or later) by using -b with the checkout command again. Example: 2019-12-08T12:05:43.186 INFO:tasks.workunit.client.0.smithi079.stderr: 2019-12-08T12:05:43.186 INFO:tasks.workunit.client.0.smithi079.stderr: git checkout -b new_branch_name 2019-12-08T12:05:43.187 INFO:tasks.workunit.client.0.smithi079.stderr: 2019-12-08T12:05:43.187 INFO:tasks.workunit.client.0.smithi079.stderr:HEAD is now at 1351c81... rgw: Fix dynamic resharding not working for empty zonegroup in period 2019-12-08T12:05:43.188 INFO:teuthology.orchestra.run.smithi079:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2019-12-08T12:05:43.235 INFO:tasks.workunit.client.0.smithi079.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2019-12-08T12:05:43.238 INFO:tasks.workunit.client.0.smithi079.stdout:make[1]: Entering directory `/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2019-12-08T12:05:43.238 INFO:tasks.workunit.client.0.smithi079.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2019-12-08T12:05:43.680 INFO:tasks.workunit.client.0.smithi079.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2019-12-08T12:05:43.767 INFO:tasks.workunit.client.0.smithi079.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2019-12-08T12:05:43.808 INFO:tasks.workunit.client.0.smithi079.stdout:make[1]: Leaving directory `/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2019-12-08T12:05:43.810 INFO:tasks.workunit.client.0.smithi079.stdout:make[1]: Entering directory `/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2019-12-08T12:05:43.810 INFO:tasks.workunit.client.0.smithi079.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2019-12-08T12:05:43.857 INFO:tasks.workunit.client.0.smithi079.stdout:make[1]: Leaving directory `/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2019-12-08T12:05:43.922 DEBUG:teuthology.orchestra.remote:smithi079:/home/ubuntu/cephtest/workunits.list.client.0 is 4KB 2019-12-08T12:05:43.969 INFO:tasks.workunit:Running workunits matching cls/test_cls_lock.sh on client.0... 2019-12-08T12:05:43.969 INFO:tasks.workunit:Running workunit cls/test_cls_lock.sh... 2019-12-08T12:05:43.970 INFO:teuthology.orchestra.run.smithi079:workunit test cls/test_cls_lock.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1351c819e1a9518cde4c8b12d645782009028360 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_lock.sh 2019-12-08T12:05:44.022 INFO:tasks.workunit.client.0.smithi079.stdout:Running main() from gmock_main.cc 2019-12-08T12:05:44.023 INFO:tasks.workunit.client.0.smithi079.stdout:[==========] Running 11 tests from 1 test suite. 2019-12-08T12:05:44.023 INFO:tasks.workunit.client.0.smithi079.stdout:[----------] Global test environment set-up. 2019-12-08T12:05:44.023 INFO:tasks.workunit.client.0.smithi079.stdout:[----------] 11 tests from ClsLock 2019-12-08T12:05:44.023 INFO:tasks.workunit.client.0.smithi079.stdout:[ RUN ] ClsLock.TestMultiLocking 2019-12-08T12:05:46.494 INFO:tasks.workunit.client.0.smithi079.stdout:lock: mylock 2019-12-08T12:05:46.494 INFO:tasks.workunit.client.0.smithi079.stdout: lock_type: exclusive 2019-12-08T12:05:46.494 INFO:tasks.workunit.client.0.smithi079.stdout: tag: 2019-12-08T12:05:46.494 INFO:tasks.workunit.client.0.smithi079.stdout: lockers: 2019-12-08T12:05:46.495 INFO:tasks.workunit.client.0.smithi079.stdout: client.4334 expiration=2019-12-08T12:07:46.228939+0000 addr=v1:172.21.15.79:0/3761562599 cookie= 2019-12-08T12:05:46.684 INFO:tasks.workunit.client.0.smithi079.stdout:lock: mylock 2019-12-08T12:05:46.684 INFO:tasks.workunit.client.0.smithi079.stdout: lock_type: shared 2019-12-08T12:05:46.685 INFO:tasks.workunit.client.0.smithi079.stdout: tag: 2019-12-08T12:05:46.685 INFO:tasks.workunit.client.0.smithi079.stdout: lockers: 2019-12-08T12:05:46.685 INFO:tasks.workunit.client.0.smithi079.stdout: client.4334 expiration=2019-12-08T12:07:46.625310+0000 addr=v1:172.21.15.79:0/3761562599 cookie= 2019-12-08T12:05:46.685 INFO:tasks.workunit.client.0.smithi079.stdout: client.4470 expiration=0.000000 addr=v1:172.21.15.79:0/1268445040 cookie= 2019-12-08T12:05:46.733 INFO:tasks.workunit.client.0.smithi079.stdout:lock: mylock 2019-12-08T12:05:46.733 INFO:tasks.workunit.client.0.smithi079.stdout: lock_type: shared 2019-12-08T12:05:46.733 INFO:tasks.workunit.client.0.smithi079.stdout: tag: 2019-12-08T12:05:46.733 INFO:tasks.workunit.client.0.smithi079.stdout: lockers: 2019-12-08T12:05:46.733 INFO:tasks.workunit.client.0.smithi079.stdout: client.4470 expiration=0.000000 addr=v1:172.21.15.79:0/1268445040 cookie= 2019-12-08T12:05:47.897 INFO:tasks.workunit.client.0.smithi079.stdout:[ OK ] ClsLock.TestMultiLocking (3875 ms) 2019-12-08T12:05:47.898 INFO:tasks.workunit.client.0.smithi079.stdout:[ RUN ] ClsLock.TestMeta 2019-12-08T12:05:50.819 INFO:tasks.workunit.client.0.smithi079.stdout:lock: mylock 2019-12-08T12:05:50.819 INFO:tasks.workunit.client.0.smithi079.stdout: lock_type: shared 2019-12-08T12:05:50.819 INFO:tasks.workunit.client.0.smithi079.stdout: tag: 2019-12-08T12:05:50.820 INFO:tasks.workunit.client.0.smithi079.stdout: lockers: 2019-12-08T12:05:50.820 INFO:tasks.workunit.client.0.smithi079.stdout: client.4343 expiration=0.000000 addr=v1:172.21.15.79:0/4183361942 cookie= 2019-12-08T12:05:50.913 INFO:tasks.workunit.client.0.smithi079.stdout:lock: mylock 2019-12-08T12:05:50.913 INFO:tasks.workunit.client.0.smithi079.stdout: lock_type: exclusive 2019-12-08T12:05:50.914 INFO:tasks.workunit.client.0.smithi079.stdout: tag: new_tag 2019-12-08T12:05:50.914 INFO:tasks.workunit.client.0.smithi079.stdout: lockers: 2019-12-08T12:05:50.914 INFO:tasks.workunit.client.0.smithi079.stdout: client.4576 expiration=0.000000 addr=v1:172.21.15.79:0/1177465123 cookie= 2019-12-08T12:05:51.144 INFO:tasks.workunit.client.0.smithi079.stdout:[ OK ] ClsLock.TestMeta (3246 ms) 2019-12-08T12:05:51.144 INFO:tasks.workunit.client.0.smithi079.stdout:[ RUN ] ClsLock.TestCookie 2019-12-08T12:05:54.253 INFO:tasks.workunit.client.0.smithi079.stdout:lock: mylock 2019-12-08T12:05:54.254 INFO:tasks.workunit.client.0.smithi079.stdout: lock_type: exclusive 2019-12-08T12:05:54.254 INFO:tasks.workunit.client.0.smithi079.stdout: tag: 2019-12-08T12:05:54.254 INFO:tasks.workunit.client.0.smithi079.stdout: lockers: 2019-12-08T12:05:54.321 INFO:tasks.workunit.client.0.smithi079.stdout:lock: mylock 2019-12-08T12:05:54.322 INFO:tasks.workunit.client.0.smithi079.stdout: lock_type: shared 2019-12-08T12:05:54.322 INFO:tasks.workunit.client.0.smithi079.stdout: tag: 2019-12-08T12:05:54.322 INFO:tasks.workunit.client.0.smithi079.stdout: lockers: 2019-12-08T12:05:54.322 INFO:tasks.workunit.client.0.smithi079.stdout: client.4349 expiration=0.000000 addr=v1:172.21.15.79:0/662948947 cookie= 2019-12-08T12:05:54.322 INFO:tasks.workunit.client.0.smithi079.stdout: client.4349 expiration=0.000000 addr=v1:172.21.15.79:0/662948947 cookie=new cookie 2019-12-08T12:05:54.754 INFO:tasks.workunit.client.0.smithi079.stdout:[ OK ] ClsLock.TestCookie (3610 ms) 2019-12-08T12:05:54.754 INFO:tasks.workunit.client.0.smithi079.stdout:[ RUN ] ClsLock.TestMultipleLocks 2019-12-08T12:05:58.273 INFO:tasks.workunit.client.0.smithi079.stdout:[ OK ] ClsLock.TestMultipleLocks (3519 ms) 2019-12-08T12:05:58.273 INFO:tasks.workunit.client.0.smithi079.stdout:[ RUN ] ClsLock.TestLockDuration 2019-12-08T12:06:06.356 INFO:tasks.workunit.client.0.smithi079.stdout:[ OK ] ClsLock.TestLockDuration (8083 ms) 2019-12-08T12:06:06.356 INFO:tasks.workunit.client.0.smithi079.stdout:[ RUN ] ClsLock.TestAssertLocked 2019-12-08T12:06:09.671 INFO:tasks.workunit.client.0.smithi079.stdout:[ OK ] ClsLock.TestAssertLocked (3315 ms) 2019-12-08T12:06:09.671 INFO:tasks.workunit.client.0.smithi079.stdout:[ RUN ] ClsLock.TestSetCookie 2019-12-08T12:06:13.352 INFO:tasks.workunit.client.0.smithi079.stdout:[ OK ] ClsLock.TestSetCookie (3680 ms) 2019-12-08T12:06:13.352 INFO:tasks.workunit.client.0.smithi079.stdout:[ RUN ] ClsLock.TestRenew 2019-12-08T12:06:35.135 INFO:tasks.workunit.client.0.smithi079.stdout:[ OK ] ClsLock.TestRenew (21780 ms) 2019-12-08T12:06:35.135 INFO:tasks.workunit.client.0.smithi079.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralBasic 2019-12-08T12:06:42.774 INFO:tasks.workunit.client.0.smithi079.stdout:[ OK ] ClsLock.TestExclusiveEphemeralBasic (7641 ms) 2019-12-08T12:06:42.774 INFO:tasks.workunit.client.0.smithi079.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealEphemeral 2019-12-08T12:06:51.967 INFO:tasks.workunit.client.0.smithi079.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealEphemeral (9193 ms) 2019-12-08T12:06:51.968 INFO:tasks.workunit.client.0.smithi079.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealExclusive 2019-12-08T12:07:00.288 INFO:tasks.workunit.client.0.smithi079.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealExclusive (8320 ms) 2019-12-08T12:07:00.288 INFO:tasks.workunit.client.0.smithi079.stdout:[----------] 11 tests from ClsLock (76262 ms total) 2019-12-08T12:07:00.289 INFO:tasks.workunit.client.0.smithi079.stdout: 2019-12-08T12:07:00.289 INFO:tasks.workunit.client.0.smithi079.stdout:[----------] Global test environment tear-down 2019-12-08T12:07:00.289 INFO:tasks.workunit.client.0.smithi079.stdout:[==========] 11 tests from 1 test suite ran. (76262 ms total) 2019-12-08T12:07:00.289 INFO:tasks.workunit.client.0.smithi079.stdout:[ PASSED ] 11 tests. 2019-12-08T12:07:00.290 INFO:teuthology.orchestra.run:Running command with timeout 3600 2019-12-08T12:07:00.291 INFO:teuthology.orchestra.run.smithi079:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2019-12-08T12:07:00.408 INFO:tasks.workunit:Running workunits matching cls/test_cls_log.sh on client.0... 2019-12-08T12:07:00.408 INFO:tasks.workunit:Running workunit cls/test_cls_log.sh... 2019-12-08T12:07:00.409 INFO:teuthology.orchestra.run.smithi079:workunit test cls/test_cls_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1351c819e1a9518cde4c8b12d645782009028360 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_log.sh 2019-12-08T12:07:00.473 INFO:tasks.workunit.client.0.smithi079.stdout:Running main() from gmock_main.cc 2019-12-08T12:07:00.473 INFO:tasks.workunit.client.0.smithi079.stdout:[==========] Running 4 tests from 1 test suite. 2019-12-08T12:07:00.473 INFO:tasks.workunit.client.0.smithi079.stdout:[----------] Global test environment set-up. 2019-12-08T12:07:00.474 INFO:tasks.workunit.client.0.smithi079.stdout:[----------] 4 tests from cls_log 2019-12-08T12:07:00.474 INFO:tasks.workunit.client.0.smithi079.stdout:[ RUN ] cls_log.test_log_add_same_time 2019-12-08T12:07:03.666 INFO:tasks.workunit.client.0.smithi079.stdout:[ OK ] cls_log.test_log_add_same_time (3196 ms) 2019-12-08T12:07:03.666 INFO:tasks.workunit.client.0.smithi079.stdout:[ RUN ] cls_log.test_log_add_different_time 2019-12-08T12:07:07.418 INFO:tasks.workunit.client.0.smithi079.stdout:[ OK ] cls_log.test_log_add_different_time (3753 ms) 2019-12-08T12:07:07.418 INFO:tasks.workunit.client.0.smithi079.stdout:[ RUN ] cls_log.trim_by_time 2019-12-08T12:07:12.978 INFO:tasks.workunit.client.0.smithi079.stdout:[ OK ] cls_log.trim_by_time (5560 ms) 2019-12-08T12:07:12.979 INFO:tasks.workunit.client.0.smithi079.stdout:[ RUN ] cls_log.trim_by_marker 2019-12-08T12:07:17.880 INFO:tasks.workunit.client.0.smithi079.stdout:[ OK ] cls_log.trim_by_marker (4898 ms) 2019-12-08T12:07:17.880 INFO:tasks.workunit.client.0.smithi079.stdout:[----------] 4 tests from cls_log (17407 ms total) 2019-12-08T12:07:17.880 INFO:tasks.workunit.client.0.smithi079.stdout: 2019-12-08T12:07:17.880 INFO:tasks.workunit.client.0.smithi079.stdout:[----------] Global test environment tear-down 2019-12-08T12:07:17.881 INFO:tasks.workunit.client.0.smithi079.stdout:[==========] 4 tests from 1 test suite ran. (17407 ms total) 2019-12-08T12:07:17.881 INFO:tasks.workunit.client.0.smithi079.stdout:[ PASSED ] 4 tests. 2019-12-08T12:07:17.882 INFO:teuthology.orchestra.run:Running command with timeout 3600 2019-12-08T12:07:17.882 INFO:teuthology.orchestra.run.smithi079:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2019-12-08T12:07:18.004 INFO:tasks.workunit:Running workunits matching cls/test_cls_refcount.sh on client.0... 2019-12-08T12:07:18.005 INFO:tasks.workunit:Running workunit cls/test_cls_refcount.sh... 2019-12-08T12:07:18.005 INFO:teuthology.orchestra.run.smithi079:workunit test cls/test_cls_refcount.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1351c819e1a9518cde4c8b12d645782009028360 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_refcount.sh 2019-12-08T12:07:18.071 INFO:tasks.workunit.client.0.smithi079.stdout:Running main() from gmock_main.cc 2019-12-08T12:07:18.071 INFO:tasks.workunit.client.0.smithi079.stdout:[==========] Running 5 tests from 1 test suite. 2019-12-08T12:07:18.071 INFO:tasks.workunit.client.0.smithi079.stdout:[----------] Global test environment set-up. 2019-12-08T12:07:18.071 INFO:tasks.workunit.client.0.smithi079.stdout:[----------] 5 tests from cls_rgw 2019-12-08T12:07:18.072 INFO:tasks.workunit.client.0.smithi079.stdout:[ RUN ] cls_rgw.test_implicit 2019-12-08T12:07:21.396 INFO:tasks.workunit.client.0.smithi079.stdout:[ OK ] cls_rgw.test_implicit (3325 ms) 2019-12-08T12:07:21.396 INFO:tasks.workunit.client.0.smithi079.stdout:[ RUN ] cls_rgw.test_implicit_idempotent 2019-12-08T12:07:25.190 INFO:tasks.workunit.client.0.smithi079.stdout:[ OK ] cls_rgw.test_implicit_idempotent (3793 ms) 2019-12-08T12:07:25.190 INFO:tasks.workunit.client.0.smithi079.stdout:[ RUN ] cls_rgw.test_put_snap 2019-12-08T12:07:34.281 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T12:07:34.237+0000 3aa81700 -1 osd.5 pg_epoch: 104 pg[25.6( v 103'4 (0'0,103'4] local-lis/les=100/101 n=2 ec=100/100 lis/c=100/100 les/c/f=101/101/0 sis=100) [5,1] r=0 lpr=100 crt=102'3 lcod 102'3 mlcod 102'3 active+clean+snaptrim trimq=[1~1]] removing snap head 2019-12-08T12:07:35.743 INFO:tasks.workunit.client.0.smithi079.stdout:[ OK ] cls_rgw.test_put_snap (10551 ms) 2019-12-08T12:07:35.744 INFO:tasks.workunit.client.0.smithi079.stdout:[ RUN ] cls_rgw.test_explicit 2019-12-08T12:07:39.192 INFO:tasks.workunit.client.0.smithi079.stdout:[ OK ] cls_rgw.test_explicit (3448 ms) 2019-12-08T12:07:39.192 INFO:tasks.workunit.client.0.smithi079.stdout:[ RUN ] cls_rgw.set 2019-12-08T12:07:42.529 INFO:tasks.workunit.client.0.smithi079.stdout:[ OK ] cls_rgw.set (3339 ms) 2019-12-08T12:07:42.529 INFO:tasks.workunit.client.0.smithi079.stdout:[----------] 5 tests from cls_rgw (24457 ms total) 2019-12-08T12:07:42.529 INFO:tasks.workunit.client.0.smithi079.stdout: 2019-12-08T12:07:42.529 INFO:tasks.workunit.client.0.smithi079.stdout:[----------] Global test environment tear-down 2019-12-08T12:07:42.530 INFO:tasks.workunit.client.0.smithi079.stdout:[==========] 5 tests from 1 test suite ran. (24458 ms total) 2019-12-08T12:07:42.530 INFO:tasks.workunit.client.0.smithi079.stdout:[ PASSED ] 5 tests. 2019-12-08T12:07:42.534 INFO:teuthology.orchestra.run:Running command with timeout 3600 2019-12-08T12:07:42.535 INFO:teuthology.orchestra.run.smithi079:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2019-12-08T12:07:42.607 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw.sh on client.0... 2019-12-08T12:07:42.607 INFO:tasks.workunit:Running workunit cls/test_cls_rgw.sh... 2019-12-08T12:07:42.608 INFO:teuthology.orchestra.run.smithi079:workunit test cls/test_cls_rgw.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1351c819e1a9518cde4c8b12d645782009028360 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh 2019-12-08T12:07:42.669 INFO:tasks.workunit.client.0.smithi079.stdout:Running main() from gmock_main.cc 2019-12-08T12:07:42.670 INFO:tasks.workunit.client.0.smithi079.stdout:[==========] Running 13 tests from 1 test suite. 2019-12-08T12:07:42.670 INFO:tasks.workunit.client.0.smithi079.stdout:[----------] Global test environment set-up. 2019-12-08T12:07:42.670 INFO:tasks.workunit.client.0.smithi079.stdout:[----------] 13 tests from cls_rgw 2019-12-08T12:07:44.900 INFO:tasks.workunit.client.0.smithi079.stdout:[ RUN ] cls_rgw.index_basic 2019-12-08T12:07:46.644 INFO:tasks.workunit.client.0.smithi079.stdout:[ OK ] cls_rgw.index_basic (1745 ms) 2019-12-08T12:07:46.645 INFO:tasks.workunit.client.0.smithi079.stdout:[ RUN ] cls_rgw.index_multiple_obj_writers 2019-12-08T12:07:48.038 INFO:tasks.workunit.client.0.smithi079.stdout:[ OK ] cls_rgw.index_multiple_obj_writers (1392 ms) 2019-12-08T12:07:48.038 INFO:tasks.workunit.client.0.smithi079.stdout:[ RUN ] cls_rgw.index_remove_object 2019-12-08T12:07:50.140 INFO:tasks.workunit.client.0.smithi079.stdout:[ OK ] cls_rgw.index_remove_object (2102 ms) 2019-12-08T12:07:50.140 INFO:tasks.workunit.client.0.smithi079.stdout:[ RUN ] cls_rgw.index_suggest 2019-12-08T12:08:16.646 INFO:tasks.workunit.client.0.smithi079.stdout:[ OK ] cls_rgw.index_suggest (26505 ms) 2019-12-08T12:08:16.646 INFO:tasks.workunit.client.0.smithi079.stdout:[ RUN ] cls_rgw.index_list 2019-12-08T12:08:17.751 INFO:tasks.workunit.client.0.smithi079.stdout:[ OK ] cls_rgw.index_list (1106 ms) 2019-12-08T12:08:17.752 INFO:tasks.workunit.client.0.smithi079.stdout:[ RUN ] cls_rgw.bi_list 2019-12-08T12:08:20.391 INFO:tasks.workunit.client.0.smithi079.stdout:[ OK ] cls_rgw.bi_list (2640 ms) 2019-12-08T12:08:20.391 INFO:tasks.workunit.client.0.smithi079.stdout:[ RUN ] cls_rgw.gc_set 2019-12-08T12:08:21.038 INFO:tasks.workunit.client.0.smithi079.stdout:[ OK ] cls_rgw.gc_set (646 ms) 2019-12-08T12:08:21.038 INFO:tasks.workunit.client.0.smithi079.stdout:[ RUN ] cls_rgw.gc_list 2019-12-08T12:08:21.597 INFO:tasks.workunit.client.0.smithi079.stdout:[ OK ] cls_rgw.gc_list (557 ms) 2019-12-08T12:08:21.598 INFO:tasks.workunit.client.0.smithi079.stdout:[ RUN ] cls_rgw.gc_defer 2019-12-08T12:08:30.102 INFO:tasks.workunit.client.0.smithi079.stdout:[ OK ] cls_rgw.gc_defer (8507 ms) 2019-12-08T12:08:30.102 INFO:tasks.workunit.client.0.smithi079.stdout:[ RUN ] cls_rgw.usage_basic 2019-12-08T12:08:38.339 INFO:tasks.workunit.client.0.smithi079.stdout:[ OK ] cls_rgw.usage_basic (8236 ms) 2019-12-08T12:08:38.339 INFO:tasks.workunit.client.0.smithi079.stdout:[ RUN ] cls_rgw.usage_clear_no_obj 2019-12-08T12:08:38.368 INFO:tasks.workunit.client.0.smithi079.stdout:[ OK ] cls_rgw.usage_clear_no_obj (30 ms) 2019-12-08T12:08:38.368 INFO:tasks.workunit.client.0.smithi079.stdout:[ RUN ] cls_rgw.usage_clear 2019-12-08T12:08:45.460 INFO:tasks.workunit.client.0.smithi079.stdout:[ OK ] cls_rgw.usage_clear (7088 ms) 2019-12-08T12:08:45.460 INFO:tasks.workunit.client.0.smithi079.stdout:[ RUN ] cls_rgw.bi_log_trim 2019-12-08T12:08:47.700 INFO:tasks.workunit.client.0.smithi079.stdout:[ OK ] cls_rgw.bi_log_trim (2241 ms) 2019-12-08T12:08:48.300 INFO:tasks.workunit.client.0.smithi079.stdout:[----------] 13 tests from cls_rgw (62795 ms total) 2019-12-08T12:08:48.300 INFO:tasks.workunit.client.0.smithi079.stdout: 2019-12-08T12:08:48.301 INFO:tasks.workunit.client.0.smithi079.stdout:[----------] Global test environment tear-down 2019-12-08T12:08:48.301 INFO:tasks.workunit.client.0.smithi079.stdout:[==========] 13 tests from 1 test suite ran. (65627 ms total) 2019-12-08T12:08:48.301 INFO:tasks.workunit.client.0.smithi079.stdout:[ PASSED ] 13 tests. 2019-12-08T12:08:48.302 INFO:teuthology.orchestra.run:Running command with timeout 3600 2019-12-08T12:08:48.302 INFO:teuthology.orchestra.run.smithi079:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2019-12-08T12:08:48.370 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_gc_log.sh on client.0... 2019-12-08T12:08:48.370 INFO:tasks.workunit:Running workunit rgw/test_rgw_gc_log.sh... 2019-12-08T12:08:48.370 INFO:teuthology.orchestra.run.smithi079:workunit test rgw/test_rgw_gc_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=1351c819e1a9518cde4c8b12d645782009028360 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_gc_log.sh 2019-12-08T12:08:48.440 INFO:tasks.workunit.client.0.smithi079.stdout:[==========] Running 6 tests from 1 test suite. 2019-12-08T12:08:48.441 INFO:tasks.workunit.client.0.smithi079.stdout:[----------] Global test environment set-up. 2019-12-08T12:08:50.328 INFO:tasks.workunit.client.0.smithi079.stdout:[----------] 6 tests from rgw_gc_log 2019-12-08T12:08:50.328 INFO:tasks.workunit.client.0.smithi079.stdout:[ RUN ] rgw_gc_log.init_existing_queue 2019-12-08T12:08:50.922 INFO:tasks.workunit.client.0.smithi079.stdout:[ OK ] rgw_gc_log.init_existing_queue (593 ms) 2019-12-08T12:08:50.922 INFO:tasks.workunit.client.0.smithi079.stdout:[ RUN ] rgw_gc_log.init_existing_omap 2019-12-08T12:08:51.215 INFO:tasks.workunit.client.0.smithi079.stdout:[ OK ] rgw_gc_log.init_existing_omap (294 ms) 2019-12-08T12:08:51.215 INFO:tasks.workunit.client.0.smithi079.stdout:[ RUN ] rgw_gc_log.enqueue1_after_init 2019-12-08T12:08:51.350 INFO:tasks.workunit.client.0.smithi079.stdout:[ OK ] rgw_gc_log.enqueue1_after_init (135 ms) 2019-12-08T12:08:51.351 INFO:tasks.workunit.client.0.smithi079.stdout:[ RUN ] rgw_gc_log.enqueue2_before_init 2019-12-08T12:08:51.697 INFO:tasks.workunit.client.0.smithi079.stdout:[ OK ] rgw_gc_log.enqueue2_before_init (346 ms) 2019-12-08T12:08:51.697 INFO:tasks.workunit.client.0.smithi079.stdout:[ RUN ] rgw_gc_log.defer1_after_init 2019-12-08T12:08:52.287 INFO:tasks.workunit.client.0.smithi079.stdout:[ OK ] rgw_gc_log.defer1_after_init (591 ms) 2019-12-08T12:08:52.287 INFO:tasks.workunit.client.0.smithi079.stdout:[ RUN ] rgw_gc_log.defer2_before_init 2019-12-08T12:08:52.365 INFO:tasks.workunit.client.0.smithi079.stdout:[ OK ] rgw_gc_log.defer2_before_init (77 ms) 2019-12-08T12:08:52.365 INFO:tasks.workunit.client.0.smithi079.stdout:[----------] 6 tests from rgw_gc_log (2036 ms total) 2019-12-08T12:08:52.366 INFO:tasks.workunit.client.0.smithi079.stdout: 2019-12-08T12:08:52.366 INFO:tasks.workunit.client.0.smithi079.stdout:[----------] Global test environment tear-down 2019-12-08T12:08:52.675 INFO:tasks.workunit.client.0.smithi079.stdout:[==========] 6 tests from 1 test suite ran. (4235 ms total) 2019-12-08T12:08:52.675 INFO:tasks.workunit.client.0.smithi079.stdout:[ PASSED ] 6 tests. 2019-12-08T12:08:52.678 INFO:teuthology.orchestra.run:Running command with timeout 3600 2019-12-08T12:08:52.679 INFO:teuthology.orchestra.run.smithi079:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2019-12-08T12:08:52.797 INFO:tasks.workunit:Stopping ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'rgw/test_rgw_gc_log.sh'] on client.0... 2019-12-08T12:08:52.797 INFO:teuthology.orchestra.run.smithi079:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2019-12-08T12:08:53.049 DEBUG:teuthology.parallel:result is None 2019-12-08T12:08:53.049 INFO:teuthology.orchestra.run.smithi079:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2019-12-08T12:08:53.117 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2019-12-08T12:08:53.117 INFO:teuthology.orchestra.run.smithi079:> rmdir -- /home/ubuntu/cephtest/mnt.0 2019-12-08T12:08:53.163 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2019-12-08T12:08:53.164 INFO:teuthology.run_tasks:Running task ragweed... 2019-12-08T12:08:53.180 DEBUG:tasks.ragweed:ragweed config is {'client.0': {'rgw_server': 'client.0', 'stages': 'prepare,check', 'default-branch': 'ceph-master'}} 2019-12-08T12:08:53.180 INFO:tasks.ragweed:Downloading ragweed... 2019-12-08T12:08:53.180 INFO:tasks.ragweed:Using branch 'wip-ofriedma-dynamic-disable' for ragweed 2019-12-08T12:08:53.181 INFO:teuthology.orchestra.run.smithi079:> git clone -b wip-ofriedma-dynamic-disable git://git.ceph.com/git/ragweed.git /home/ubuntu/cephtest/ragweed 2019-12-08T12:08:53.240 INFO:teuthology.orchestra.run.smithi079.stderr:fatal: Remote branch wip-ofriedma-dynamic-disable not found in upstream origin 2019-12-08T12:08:53.240 INFO:teuthology.orchestra.run.smithi079.stdout:Cloning into '/home/ubuntu/cephtest/ragweed'... 2019-12-08T12:08:53.241 DEBUG:teuthology.orchestra.run:got remote process result: 128 2019-12-08T12:08:53.241 INFO:teuthology.orchestra.run.smithi079:> git clone -b ceph-master git://git.ceph.com/git/ragweed.git /home/ubuntu/cephtest/ragweed 2019-12-08T12:08:53.334 INFO:teuthology.orchestra.run.smithi079.stdout:Cloning into '/home/ubuntu/cephtest/ragweed'... 2019-12-08T12:08:53.408 INFO:tasks.ragweed:Creating rgw users... 2019-12-08T12:08:53.408 DEBUG:tasks.ragweed:Creating user sysuser.client.0 on client.0 2019-12-08T12:08:53.409 INFO:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid sysuser.client.0 --display-name 'Mr. sysuser.client.0' --access-key ESGEUHOKGRNMAKPDFIOK --secret dq6ClRsN04/SREIu7QUOpgTU45XlFD8xciY6terPei14ouYbl6QYGA== --email sysuser.client.0+test@test.test --system true 2019-12-08T12:08:53.537 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:53.505+0000 7f4ec1f0fec0 20 rados->read ofs=0 len=0 2019-12-08T12:08:53.568 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:53.537+0000 7f4ec1f0fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:08:53.568 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:53.537+0000 7f4ec1f0fec0 20 rados->read ofs=0 len=0 2019-12-08T12:08:53.574 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:53.543+0000 7f4ec1f0fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:08:53.574 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:53.543+0000 7f4ec1f0fec0 20 rados->read ofs=0 len=0 2019-12-08T12:08:53.580 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:53.549+0000 7f4ec1f0fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:08:53.581 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:53.549+0000 7f4ec1f0fec0 20 rados->read ofs=0 len=0 2019-12-08T12:08:53.595 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:53.564+0000 7f4ec1f0fec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:08:54.129 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:54.097+0000 7f4ec1f0fec0 20 RGWRados::pool_iterate: got zonegroup_info.fee0148b-7ae2-4cf0-a79e-86045a29cb7c 2019-12-08T12:08:54.130 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:54.097+0000 7f4ec1f0fec0 20 RGWRados::pool_iterate: got zone_info.f8ab349b-4577-410d-b524-4ecaf50bb1bd 2019-12-08T12:08:54.130 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:54.097+0000 7f4ec1f0fec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-08T12:08:54.130 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:54.097+0000 7f4ec1f0fec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-08T12:08:54.130 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:54.097+0000 7f4ec1f0fec0 20 rados->read ofs=0 len=0 2019-12-08T12:08:54.150 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:54.118+0000 7f4ec1f0fec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:08:54.150 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:54.118+0000 7f4ec1f0fec0 20 rados->read ofs=0 len=0 2019-12-08T12:08:54.168 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:54.136+0000 7f4ec1f0fec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-08T12:08:54.168 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:54.136+0000 7f4ec1f0fec0 20 rados->read ofs=0 len=0 2019-12-08T12:08:54.186 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:54.155+0000 7f4ec1f0fec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:08:54.187 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:54.155+0000 7f4ec1f0fec0 20 rados->read ofs=0 len=0 2019-12-08T12:08:54.201 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:54.170+0000 7f4ec1f0fec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-08T12:08:54.202 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:54.170+0000 7f4ec1f0fec0 20 rados->read ofs=0 len=0 2019-12-08T12:08:54.210 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:54.179+0000 7f4ec1f0fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:08:54.211 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:54.179+0000 7f4ec1f0fec0 10 cannot find current period zonegroup using local zonegroup 2019-12-08T12:08:54.211 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:54.179+0000 7f4ec1f0fec0 20 rados->read ofs=0 len=0 2019-12-08T12:08:54.220 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:54.188+0000 7f4ec1f0fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:08:54.220 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:54.188+0000 7f4ec1f0fec0 20 rados->read ofs=0 len=0 2019-12-08T12:08:54.236 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:54.204+0000 7f4ec1f0fec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:08:54.236 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:54.204+0000 7f4ec1f0fec0 20 rados->read ofs=0 len=0 2019-12-08T12:08:54.252 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:54.221+0000 7f4ec1f0fec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-08T12:08:54.253 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:54.221+0000 7f4ec1f0fec0 20 zonegroup default 2019-12-08T12:08:54.253 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:54.221+0000 7f4ec1f0fec0 20 rados->read ofs=0 len=0 2019-12-08T12:08:54.262 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:54.231+0000 7f4ec1f0fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:08:54.263 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:54.231+0000 7f4ec1f0fec0 10 Cannot find current period zone using local zone 2019-12-08T12:08:54.263 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:54.231+0000 7f4ec1f0fec0 20 rados->read ofs=0 len=0 2019-12-08T12:08:54.269 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:54.238+0000 7f4ec1f0fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:08:54.269 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:54.238+0000 7f4ec1f0fec0 20 rados->read ofs=0 len=0 2019-12-08T12:08:54.284 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:54.253+0000 7f4ec1f0fec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:08:54.284 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:54.253+0000 7f4ec1f0fec0 20 rados->read ofs=0 len=0 2019-12-08T12:08:54.304 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:54.264+0000 7f4ec1f0fec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-08T12:08:54.305 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:54.264+0000 7f4ec1f0fec0 20 zone default found 2019-12-08T12:08:54.305 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:54.264+0000 7f4ec1f0fec0 20 started sync module instance, tier type = 2019-12-08T12:08:54.305 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:54.264+0000 7f4ec1f0fec0 20 started zone id=f8ab349b-4577-410d-b524-4ecaf50bb1bd (name=default) with tier type = 2019-12-08T12:08:54.758 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:54.726+0000 7f4ec1f0fec0 20 add_watcher() i=0 2019-12-08T12:08:54.758 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:54.726+0000 7f4ec1f0fec0 20 add_watcher() i=1 2019-12-08T12:08:54.758 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:54.726+0000 7f4ec1f0fec0 20 add_watcher() i=2 2019-12-08T12:08:54.758 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:54.726+0000 7f4ec1f0fec0 20 add_watcher() i=3 2019-12-08T12:08:54.758 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:54.726+0000 7f4ec1f0fec0 20 add_watcher() i=4 2019-12-08T12:08:54.759 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:54.726+0000 7f4ec1f0fec0 20 add_watcher() i=5 2019-12-08T12:08:54.759 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:54.726+0000 7f4ec1f0fec0 20 add_watcher() i=6 2019-12-08T12:08:54.786 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:54.754+0000 7f4ec1f0fec0 20 add_watcher() i=7 2019-12-08T12:08:54.786 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:54.754+0000 7f4ec1f0fec0 2 all 8 watchers are set, enabling cache 2019-12-08T12:08:54.786 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:54.755+0000 7f4e7ffdf700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-08T12:08:54.788 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:54.757+0000 7f4eaf139700 0 -- 172.21.15.79:0/1642154825 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55f7428ded80 msgr2=0x55f7428e11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-12-08T12:08:54.835 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:54.804+0000 7f4ea6938700 0 -- 172.21.15.79:0/272822257 >> [v2:172.21.15.13:6800/9325,v1:172.21.15.13:6801/9325] conn(0x55f7428f3ee0 msgr2=0x55f7428f6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-08T12:08:56.611 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:56.579+0000 7f4dee7fc700 20 reqs_thread_entry: start 2019-12-08T12:08:56.611 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:56.580+0000 7f4de7fff700 20 reqs_thread_entry: start 2019-12-08T12:08:56.612 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:56.580+0000 7f4ec1f0fec0 20 init_complete bucket index max shards: 0 2019-12-08T12:08:56.612 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:56.581+0000 7f4de67fc700 20 reqs_thread_entry: start 2019-12-08T12:08:56.612 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:56.581+0000 7f4ec1f0fec0 20 get_system_obj_state: rctx=0x7fffb991d498 obj=default.rgw.meta:users.uid:sysuser.client.0 state=0x55f74295d700 s->prefetch_data=0 2019-12-08T12:08:56.613 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:56.581+0000 7f4ec1f0fec0 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2019-12-08T12:08:56.635 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:56.603+0000 7f4ec1f0fec0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x0 2019-12-08T12:08:56.635 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:56.603+0000 7f4ec1f0fec0 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2019-12-08T12:08:56.635 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:56.603+0000 7f4ec1f0fec0 20 get_system_obj_state: rctx=0x7fffb991d4a8 obj=default.rgw.meta:users.email:sysuser.client.0+test@test.test state=0x55f74295f490 s->prefetch_data=0 2019-12-08T12:08:56.636 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:56.603+0000 7f4ec1f0fec0 10 cache get: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test : miss 2019-12-08T12:08:56.649 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:56.617+0000 7f4ec1f0fec0 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x0 2019-12-08T12:08:56.649 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:56.617+0000 7f4ec1f0fec0 10 adding default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2019-12-08T12:08:56.649 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:56.617+0000 7f4ec1f0fec0 20 get_system_obj_state: rctx=0x7fffb991d4a8 obj=default.rgw.meta:users.keys:ESGEUHOKGRNMAKPDFIOK state=0x55f74295f490 s->prefetch_data=0 2019-12-08T12:08:56.649 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:56.617+0000 7f4ec1f0fec0 10 cache get: name=default.rgw.meta+users.keys+ESGEUHOKGRNMAKPDFIOK : miss 2019-12-08T12:08:56.657 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:56.625+0000 7f4ec1f0fec0 10 cache put: name=default.rgw.meta+users.keys+ESGEUHOKGRNMAKPDFIOK info.flags=0x0 2019-12-08T12:08:56.657 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:56.625+0000 7f4ec1f0fec0 10 adding default.rgw.meta+users.keys+ESGEUHOKGRNMAKPDFIOK to cache LRU end 2019-12-08T12:08:56.657 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:56.625+0000 7f4ec1f0fec0 20 get_system_obj_state: rctx=0x7fffb991d0b8 obj=default.rgw.meta:users.keys:ESGEUHOKGRNMAKPDFIOK state=0x55f74295f490 s->prefetch_data=0 2019-12-08T12:08:56.657 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:56.625+0000 7f4ec1f0fec0 10 cache get: name=default.rgw.meta+users.keys+ESGEUHOKGRNMAKPDFIOK : type miss (requested=0x6, cached=0x0) 2019-12-08T12:08:56.666 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:56.635+0000 7f4ec1f0fec0 10 cache put: name=default.rgw.meta+users.keys+ESGEUHOKGRNMAKPDFIOK info.flags=0x0 2019-12-08T12:08:56.666 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:56.635+0000 7f4ec1f0fec0 10 moving default.rgw.meta+users.keys+ESGEUHOKGRNMAKPDFIOK to cache LRU end 2019-12-08T12:08:56.667 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:56.635+0000 7f4ec1f0fec0 20 get_system_obj_state: rctx=0x7fffb991d238 obj=default.rgw.meta:users.keys:ESGEUHOKGRNMAKPDFIOK state=0x55f74295f490 s->prefetch_data=0 2019-12-08T12:08:56.667 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:56.635+0000 7f4ec1f0fec0 10 cache get: name=default.rgw.meta+users.keys+ESGEUHOKGRNMAKPDFIOK : type miss (requested=0x6, cached=0x0) 2019-12-08T12:08:56.679 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:56.645+0000 7f4ec1f0fec0 10 cache put: name=default.rgw.meta+users.keys+ESGEUHOKGRNMAKPDFIOK info.flags=0x0 2019-12-08T12:08:56.680 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:56.645+0000 7f4ec1f0fec0 10 moving default.rgw.meta+users.keys+ESGEUHOKGRNMAKPDFIOK to cache LRU end 2019-12-08T12:08:56.727 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:56.696+0000 7f4ec1f0fec0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2019-12-08T12:08:56.728 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:56.696+0000 7f4ec1f0fec0 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2019-12-08T12:08:56.728 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:56.696+0000 7f4ec1f0fec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=637 2019-12-08T12:08:56.789 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:56.756+0000 7f4ea4934700 10 RGWWatcher::handle_notify() notify_id 532575944704 cookie 94520461805360 notifier 4427 bl.length()=637 2019-12-08T12:08:56.789 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:56.757+0000 7f4ea4934700 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2019-12-08T12:08:56.790 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:56.757+0000 7f4ea4934700 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2019-12-08T12:08:57.321 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:57.288+0000 7f4ec1f0fec0 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2019-12-08T12:08:57.321 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:57.288+0000 7f4ec1f0fec0 10 moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2019-12-08T12:08:57.321 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:57.288+0000 7f4ec1f0fec0 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=202 2019-12-08T12:08:57.341 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:57.308+0000 7f4ea4934700 10 RGWWatcher::handle_notify() notify_id 532575944705 cookie 94520461807152 notifier 4427 bl.length()=202 2019-12-08T12:08:57.341 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:57.308+0000 7f4ea4934700 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2019-12-08T12:08:57.341 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:57.308+0000 7f4ea4934700 10 moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2019-12-08T12:08:58.412 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:58.380+0000 7f4ec1f0fec0 10 cache put: name=default.rgw.meta+users.keys+ESGEUHOKGRNMAKPDFIOK info.flags=0x7 2019-12-08T12:08:58.412 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:58.380+0000 7f4ec1f0fec0 10 moving default.rgw.meta+users.keys+ESGEUHOKGRNMAKPDFIOK to cache LRU end 2019-12-08T12:08:58.413 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:58.380+0000 7f4ec1f0fec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=190 2019-12-08T12:08:58.469 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:58.437+0000 7f4ea4934700 10 RGWWatcher::handle_notify() notify_id 532575944704 cookie 94520461812896 notifier 4427 bl.length()=190 2019-12-08T12:08:58.469 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:58.437+0000 7f4ea4934700 10 cache put: name=default.rgw.meta+users.keys+ESGEUHOKGRNMAKPDFIOK info.flags=0x7 2019-12-08T12:08:58.469 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:58.437+0000 7f4ea4934700 10 moving default.rgw.meta+users.keys+ESGEUHOKGRNMAKPDFIOK to cache LRU end 2019-12-08T12:08:58.631 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2019-12-08T12:08:58.631 INFO:teuthology.orchestra.run.smithi079.stdout: "user_id": "sysuser.client.0", 2019-12-08T12:08:58.631 INFO:teuthology.orchestra.run.smithi079.stdout: "display_name": "Mr. sysuser.client.0", 2019-12-08T12:08:58.632 INFO:teuthology.orchestra.run.smithi079.stdout: "email": "sysuser.client.0+test@test.test", 2019-12-08T12:08:58.632 INFO:teuthology.orchestra.run.smithi079.stdout: "suspended": 0, 2019-12-08T12:08:58.632 INFO:teuthology.orchestra.run.smithi079.stdout: "max_buckets": 1000, 2019-12-08T12:08:58.632 INFO:teuthology.orchestra.run.smithi079.stdout: "subusers": [], 2019-12-08T12:08:58.633 INFO:teuthology.orchestra.run.smithi079.stdout: "keys": [ 2019-12-08T12:08:58.633 INFO:teuthology.orchestra.run.smithi079.stdout: { 2019-12-08T12:08:58.633 INFO:teuthology.orchestra.run.smithi079.stdout: "user": "sysuser.client.0", 2019-12-08T12:08:58.633 INFO:teuthology.orchestra.run.smithi079.stdout: "access_key": "ESGEUHOKGRNMAKPDFIOK", 2019-12-08T12:08:58.634 INFO:teuthology.orchestra.run.smithi079.stdout: "secret_key": "dq6ClRsN04/SREIu7QUOpgTU45XlFD8xciY6terPei14ouYbl6QYGA==" 2019-12-08T12:08:58.634 INFO:teuthology.orchestra.run.smithi079.stdout: } 2019-12-08T12:08:58.634 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2019-12-08T12:08:58.634 INFO:teuthology.orchestra.run.smithi079.stdout: "swift_keys": [], 2019-12-08T12:08:58.634 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": [], 2019-12-08T12:08:58.635 INFO:teuthology.orchestra.run.smithi079.stdout: "op_mask": "read, write, delete", 2019-12-08T12:08:58.635 INFO:teuthology.orchestra.run.smithi079.stdout: "system": "true", 2019-12-08T12:08:58.635 INFO:teuthology.orchestra.run.smithi079.stdout: "default_placement": "", 2019-12-08T12:08:58.635 INFO:teuthology.orchestra.run.smithi079.stdout: "default_storage_class": "", 2019-12-08T12:08:58.635 INFO:teuthology.orchestra.run.smithi079.stdout: "placement_tags": [], 2019-12-08T12:08:58.636 INFO:teuthology.orchestra.run.smithi079.stdout: "bucket_quota": { 2019-12-08T12:08:58.636 INFO:teuthology.orchestra.run.smithi079.stdout: "enabled": false, 2019-12-08T12:08:58.636 INFO:teuthology.orchestra.run.smithi079.stdout: "check_on_raw": false, 2019-12-08T12:08:58.636 INFO:teuthology.orchestra.run.smithi079.stdout: "max_size": -1, 2019-12-08T12:08:58.637 INFO:teuthology.orchestra.run.smithi079.stdout: "max_size_kb": 0, 2019-12-08T12:08:58.637 INFO:teuthology.orchestra.run.smithi079.stdout: "max_objects": -1 2019-12-08T12:08:58.637 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2019-12-08T12:08:58.637 INFO:teuthology.orchestra.run.smithi079.stdout: "user_quota": { 2019-12-08T12:08:58.637 INFO:teuthology.orchestra.run.smithi079.stdout: "enabled": false, 2019-12-08T12:08:58.638 INFO:teuthology.orchestra.run.smithi079.stdout: "check_on_raw": false, 2019-12-08T12:08:58.638 INFO:teuthology.orchestra.run.smithi079.stdout: "max_size": -1, 2019-12-08T12:08:58.638 INFO:teuthology.orchestra.run.smithi079.stdout: "max_size_kb": 0, 2019-12-08T12:08:58.638 INFO:teuthology.orchestra.run.smithi079.stdout: "max_objects": -1 2019-12-08T12:08:58.638 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2019-12-08T12:08:58.639 INFO:teuthology.orchestra.run.smithi079.stdout: "temp_url_keys": [], 2019-12-08T12:08:58.639 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "rgw", 2019-12-08T12:08:58.639 INFO:teuthology.orchestra.run.smithi079.stdout: "mfa_ids": [] 2019-12-08T12:08:58.639 INFO:teuthology.orchestra.run.smithi079.stdout:} 2019-12-08T12:08:58.639 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:08:58.684 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:58.652+0000 7f4ec1f0fec0 20 remove_watcher() i=0 2019-12-08T12:08:58.684 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:58.652+0000 7f4ec1f0fec0 2 removed watcher, disabling cache 2019-12-08T12:08:58.759 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:58.727+0000 7f4ec1f0fec0 20 remove_watcher() i=1 2019-12-08T12:08:58.832 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:58.801+0000 7f4ec1f0fec0 20 remove_watcher() i=2 2019-12-08T12:08:58.886 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:58.854+0000 7f4ec1f0fec0 20 remove_watcher() i=3 2019-12-08T12:08:58.935 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:58.903+0000 7f4ec1f0fec0 20 remove_watcher() i=4 2019-12-08T12:08:58.974 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:58.943+0000 7f4ec1f0fec0 20 remove_watcher() i=5 2019-12-08T12:08:59.005 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:58.973+0000 7f4ec1f0fec0 20 remove_watcher() i=6 2019-12-08T12:08:59.067 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:59.036+0000 7f4ec1f0fec0 20 remove_watcher() i=7 2019-12-08T12:08:59.077 DEBUG:tasks.ragweed:Creating user ragweed.client.0 on client.0 2019-12-08T12:08:59.078 INFO:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid ragweed.client.0 --display-name 'Mr. ragweed.client.0' --access-key PEAIWRQJBYHGHZDWIHUK --secret bPh103iK+8zgnuxuFlj2JLdjtsjSe8WyJV2qCH3aJ2/Tewbt3wmZFg== --email ragweed.client.0+test@test.test --system false 2019-12-08T12:08:59.213 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:59.181+0000 7fb4bd2cbec0 20 rados->read ofs=0 len=0 2019-12-08T12:08:59.243 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:59.211+0000 7fb4bd2cbec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:08:59.244 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:59.211+0000 7fb4bd2cbec0 20 rados->read ofs=0 len=0 2019-12-08T12:08:59.255 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:59.223+0000 7fb4bd2cbec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:08:59.255 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:59.223+0000 7fb4bd2cbec0 20 rados->read ofs=0 len=0 2019-12-08T12:08:59.264 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:59.232+0000 7fb4bd2cbec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:08:59.264 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:59.232+0000 7fb4bd2cbec0 20 rados->read ofs=0 len=0 2019-12-08T12:08:59.287 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:59.255+0000 7fb4bd2cbec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:08:59.518 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:59.486+0000 7fb4bd2cbec0 20 RGWRados::pool_iterate: got zonegroup_info.fee0148b-7ae2-4cf0-a79e-86045a29cb7c 2019-12-08T12:08:59.518 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:59.486+0000 7fb4bd2cbec0 20 RGWRados::pool_iterate: got zone_info.f8ab349b-4577-410d-b524-4ecaf50bb1bd 2019-12-08T12:08:59.518 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:59.486+0000 7fb4bd2cbec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-08T12:08:59.518 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:59.486+0000 7fb4bd2cbec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-08T12:08:59.519 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:59.486+0000 7fb4bd2cbec0 20 rados->read ofs=0 len=0 2019-12-08T12:08:59.536 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:59.505+0000 7fb4bd2cbec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:08:59.537 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:59.505+0000 7fb4bd2cbec0 20 rados->read ofs=0 len=0 2019-12-08T12:08:59.555 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:59.523+0000 7fb4bd2cbec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-08T12:08:59.555 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:59.523+0000 7fb4bd2cbec0 20 rados->read ofs=0 len=0 2019-12-08T12:08:59.567 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:59.535+0000 7fb4bd2cbec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:08:59.567 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:59.535+0000 7fb4bd2cbec0 20 rados->read ofs=0 len=0 2019-12-08T12:08:59.589 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:59.557+0000 7fb4bd2cbec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-08T12:08:59.589 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:59.557+0000 7fb4bd2cbec0 20 rados->read ofs=0 len=0 2019-12-08T12:08:59.598 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:59.566+0000 7fb4bd2cbec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:08:59.598 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:59.566+0000 7fb4bd2cbec0 10 cannot find current period zonegroup using local zonegroup 2019-12-08T12:08:59.598 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:59.566+0000 7fb4bd2cbec0 20 rados->read ofs=0 len=0 2019-12-08T12:08:59.611 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:59.579+0000 7fb4bd2cbec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:08:59.611 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:59.579+0000 7fb4bd2cbec0 20 rados->read ofs=0 len=0 2019-12-08T12:08:59.622 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:59.591+0000 7fb4bd2cbec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:08:59.623 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:59.591+0000 7fb4bd2cbec0 20 rados->read ofs=0 len=0 2019-12-08T12:08:59.643 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:59.608+0000 7fb4bd2cbec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-08T12:08:59.644 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:59.608+0000 7fb4bd2cbec0 20 zonegroup default 2019-12-08T12:08:59.644 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:59.608+0000 7fb4bd2cbec0 20 rados->read ofs=0 len=0 2019-12-08T12:08:59.649 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:59.617+0000 7fb4bd2cbec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:08:59.649 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:59.617+0000 7fb4bd2cbec0 10 Cannot find current period zone using local zone 2019-12-08T12:08:59.649 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:59.617+0000 7fb4bd2cbec0 20 rados->read ofs=0 len=0 2019-12-08T12:08:59.660 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:59.628+0000 7fb4bd2cbec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:08:59.660 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:59.628+0000 7fb4bd2cbec0 20 rados->read ofs=0 len=0 2019-12-08T12:08:59.674 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:59.642+0000 7fb4bd2cbec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:08:59.674 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:59.642+0000 7fb4bd2cbec0 20 rados->read ofs=0 len=0 2019-12-08T12:08:59.688 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:59.654+0000 7fb4bd2cbec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-08T12:08:59.689 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:59.654+0000 7fb4bd2cbec0 20 zone default found 2019-12-08T12:08:59.689 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:59.654+0000 7fb4bd2cbec0 20 started sync module instance, tier type = 2019-12-08T12:08:59.689 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:08:59.654+0000 7fb4bd2cbec0 20 started zone id=f8ab349b-4577-410d-b524-4ecaf50bb1bd (name=default) with tier type = 2019-12-08T12:09:00.084 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:09:00.052+0000 7fb4bd2cbec0 20 add_watcher() i=0 2019-12-08T12:09:00.084 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:09:00.052+0000 7fb4bd2cbec0 20 add_watcher() i=1 2019-12-08T12:09:00.084 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:09:00.052+0000 7fb4bd2cbec0 20 add_watcher() i=2 2019-12-08T12:09:00.084 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:09:00.052+0000 7fb4bd2cbec0 20 add_watcher() i=3 2019-12-08T12:09:00.084 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:09:00.052+0000 7fb4bd2cbec0 20 add_watcher() i=4 2019-12-08T12:09:00.084 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:09:00.052+0000 7fb4bd2cbec0 20 add_watcher() i=5 2019-12-08T12:09:00.085 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:09:00.052+0000 7fb4bd2cbec0 20 add_watcher() i=6 2019-12-08T12:09:00.120 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:09:00.088+0000 7fb4bd2cbec0 20 add_watcher() i=7 2019-12-08T12:09:00.120 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:09:00.088+0000 7fb4bd2cbec0 2 all 8 watchers are set, enabling cache 2019-12-08T12:09:00.120 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:09:00.088+0000 7fb47afdd700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-08T12:09:00.127 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:09:00.095+0000 7fb4a9cf4700 0 -- 172.21.15.79:0/3758433761 >> v2:172.21.15.79:3300/0 conn(0x5577134dde90 msgr2=0x5577134e03a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-12-08T12:09:00.158 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:09:00.126+0000 7fb4aa4f5700 0 -- 172.21.15.79:0/2835372646 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x5577134dd2f0 msgr2=0x5577134e3c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-08T12:09:01.655 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:09:01.623+0000 7fb3e97fa700 20 reqs_thread_entry: start 2019-12-08T12:09:01.656 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:09:01.623+0000 7fb3e2ffd700 20 reqs_thread_entry: start 2019-12-08T12:09:01.656 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:09:01.624+0000 7fb4bd2cbec0 20 init_complete bucket index max shards: 0 2019-12-08T12:09:01.656 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:09:01.624+0000 7fb3e17fa700 20 reqs_thread_entry: start 2019-12-08T12:09:01.656 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:09:01.624+0000 7fb4bd2cbec0 20 get_system_obj_state: rctx=0x7ffe55cb2558 obj=default.rgw.meta:users.uid:ragweed.client.0 state=0x557713556f50 s->prefetch_data=0 2019-12-08T12:09:01.657 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:09:01.624+0000 7fb4bd2cbec0 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2019-12-08T12:09:01.667 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:09:01.635+0000 7fb4bd2cbec0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x0 2019-12-08T12:09:01.667 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:09:01.635+0000 7fb4bd2cbec0 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2019-12-08T12:09:01.667 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:09:01.635+0000 7fb4bd2cbec0 20 get_system_obj_state: rctx=0x7ffe55cb2568 obj=default.rgw.meta:users.email:ragweed.client.0+test@test.test state=0x557713558ce0 s->prefetch_data=0 2019-12-08T12:09:01.668 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:09:01.635+0000 7fb4bd2cbec0 10 cache get: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test : miss 2019-12-08T12:09:01.678 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:09:01.646+0000 7fb4bd2cbec0 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x0 2019-12-08T12:09:01.679 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:09:01.646+0000 7fb4bd2cbec0 10 adding default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2019-12-08T12:09:01.679 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:09:01.646+0000 7fb4bd2cbec0 20 get_system_obj_state: rctx=0x7ffe55cb2568 obj=default.rgw.meta:users.keys:PEAIWRQJBYHGHZDWIHUK state=0x557713558ce0 s->prefetch_data=0 2019-12-08T12:09:01.679 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:09:01.646+0000 7fb4bd2cbec0 10 cache get: name=default.rgw.meta+users.keys+PEAIWRQJBYHGHZDWIHUK : miss 2019-12-08T12:09:01.688 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:09:01.656+0000 7fb4bd2cbec0 10 cache put: name=default.rgw.meta+users.keys+PEAIWRQJBYHGHZDWIHUK info.flags=0x0 2019-12-08T12:09:01.688 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:09:01.656+0000 7fb4bd2cbec0 10 adding default.rgw.meta+users.keys+PEAIWRQJBYHGHZDWIHUK to cache LRU end 2019-12-08T12:09:01.688 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:09:01.656+0000 7fb4bd2cbec0 20 get_system_obj_state: rctx=0x7ffe55cb2178 obj=default.rgw.meta:users.keys:PEAIWRQJBYHGHZDWIHUK state=0x557713558ce0 s->prefetch_data=0 2019-12-08T12:09:01.688 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:09:01.656+0000 7fb4bd2cbec0 10 cache get: name=default.rgw.meta+users.keys+PEAIWRQJBYHGHZDWIHUK : type miss (requested=0x6, cached=0x0) 2019-12-08T12:09:01.696 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:09:01.664+0000 7fb4bd2cbec0 10 cache put: name=default.rgw.meta+users.keys+PEAIWRQJBYHGHZDWIHUK info.flags=0x0 2019-12-08T12:09:01.696 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:09:01.664+0000 7fb4bd2cbec0 10 moving default.rgw.meta+users.keys+PEAIWRQJBYHGHZDWIHUK to cache LRU end 2019-12-08T12:09:01.696 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:09:01.664+0000 7fb4bd2cbec0 20 get_system_obj_state: rctx=0x7ffe55cb22f8 obj=default.rgw.meta:users.keys:PEAIWRQJBYHGHZDWIHUK state=0x557713558ce0 s->prefetch_data=0 2019-12-08T12:09:01.696 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:09:01.664+0000 7fb4bd2cbec0 10 cache get: name=default.rgw.meta+users.keys+PEAIWRQJBYHGHZDWIHUK : type miss (requested=0x6, cached=0x0) 2019-12-08T12:09:01.704 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:09:01.672+0000 7fb4bd2cbec0 10 cache put: name=default.rgw.meta+users.keys+PEAIWRQJBYHGHZDWIHUK info.flags=0x0 2019-12-08T12:09:01.704 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:09:01.672+0000 7fb4bd2cbec0 10 moving default.rgw.meta+users.keys+PEAIWRQJBYHGHZDWIHUK to cache LRU end 2019-12-08T12:09:01.762 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:09:01.730+0000 7fb4bd2cbec0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2019-12-08T12:09:01.762 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:09:01.730+0000 7fb4bd2cbec0 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2019-12-08T12:09:01.762 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:09:01.730+0000 7fb4bd2cbec0 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=637 2019-12-08T12:09:01.776 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:09:01.744+0000 7fb48b7fe700 10 RGWWatcher::handle_notify() notify_id 532575944706 cookie 93969913253296 notifier 4436 bl.length()=637 2019-12-08T12:09:01.776 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:09:01.744+0000 7fb48b7fe700 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2019-12-08T12:09:01.776 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:09:01.744+0000 7fb48b7fe700 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2019-12-08T12:09:02.224 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:09:02.192+0000 7fb4bd2cbec0 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2019-12-08T12:09:02.224 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:09:02.192+0000 7fb4bd2cbec0 10 moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2019-12-08T12:09:02.224 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:09:02.192+0000 7fb4bd2cbec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=202 2019-12-08T12:09:02.241 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:09:02.209+0000 7fb48b7fe700 10 RGWWatcher::handle_notify() notify_id 532575944707 cookie 93969913248128 notifier 4436 bl.length()=202 2019-12-08T12:09:02.241 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:09:02.209+0000 7fb48b7fe700 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2019-12-08T12:09:02.241 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:09:02.209+0000 7fb48b7fe700 10 moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2019-12-08T12:09:02.805 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:09:02.773+0000 7fb4bd2cbec0 10 cache put: name=default.rgw.meta+users.keys+PEAIWRQJBYHGHZDWIHUK info.flags=0x7 2019-12-08T12:09:02.805 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:09:02.773+0000 7fb4bd2cbec0 10 moving default.rgw.meta+users.keys+PEAIWRQJBYHGHZDWIHUK to cache LRU end 2019-12-08T12:09:02.805 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:09:02.773+0000 7fb4bd2cbec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=190 2019-12-08T12:09:02.822 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:09:02.790+0000 7fb48b7fe700 10 RGWWatcher::handle_notify() notify_id 532575944705 cookie 93969913255376 notifier 4436 bl.length()=190 2019-12-08T12:09:02.822 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:09:02.790+0000 7fb48b7fe700 10 cache put: name=default.rgw.meta+users.keys+PEAIWRQJBYHGHZDWIHUK info.flags=0x7 2019-12-08T12:09:02.823 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:09:02.790+0000 7fb48b7fe700 10 moving default.rgw.meta+users.keys+PEAIWRQJBYHGHZDWIHUK to cache LRU end 2019-12-08T12:09:03.034 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2019-12-08T12:09:03.034 INFO:teuthology.orchestra.run.smithi079.stdout: "user_id": "ragweed.client.0", 2019-12-08T12:09:03.034 INFO:teuthology.orchestra.run.smithi079.stdout: "display_name": "Mr. ragweed.client.0", 2019-12-08T12:09:03.034 INFO:teuthology.orchestra.run.smithi079.stdout: "email": "ragweed.client.0+test@test.test", 2019-12-08T12:09:03.035 INFO:teuthology.orchestra.run.smithi079.stdout: "suspended": 0, 2019-12-08T12:09:03.035 INFO:teuthology.orchestra.run.smithi079.stdout: "max_buckets": 1000, 2019-12-08T12:09:03.035 INFO:teuthology.orchestra.run.smithi079.stdout: "subusers": [], 2019-12-08T12:09:03.035 INFO:teuthology.orchestra.run.smithi079.stdout: "keys": [ 2019-12-08T12:09:03.035 INFO:teuthology.orchestra.run.smithi079.stdout: { 2019-12-08T12:09:03.035 INFO:teuthology.orchestra.run.smithi079.stdout: "user": "ragweed.client.0", 2019-12-08T12:09:03.035 INFO:teuthology.orchestra.run.smithi079.stdout: "access_key": "PEAIWRQJBYHGHZDWIHUK", 2019-12-08T12:09:03.036 INFO:teuthology.orchestra.run.smithi079.stdout: "secret_key": "bPh103iK+8zgnuxuFlj2JLdjtsjSe8WyJV2qCH3aJ2/Tewbt3wmZFg==" 2019-12-08T12:09:03.036 INFO:teuthology.orchestra.run.smithi079.stdout: } 2019-12-08T12:09:03.036 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2019-12-08T12:09:03.036 INFO:teuthology.orchestra.run.smithi079.stdout: "swift_keys": [], 2019-12-08T12:09:03.036 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": [], 2019-12-08T12:09:03.036 INFO:teuthology.orchestra.run.smithi079.stdout: "op_mask": "read, write, delete", 2019-12-08T12:09:03.036 INFO:teuthology.orchestra.run.smithi079.stdout: "system": "true", 2019-12-08T12:09:03.037 INFO:teuthology.orchestra.run.smithi079.stdout: "default_placement": "", 2019-12-08T12:09:03.037 INFO:teuthology.orchestra.run.smithi079.stdout: "default_storage_class": "", 2019-12-08T12:09:03.037 INFO:teuthology.orchestra.run.smithi079.stdout: "placement_tags": [], 2019-12-08T12:09:03.037 INFO:teuthology.orchestra.run.smithi079.stdout: "bucket_quota": { 2019-12-08T12:09:03.037 INFO:teuthology.orchestra.run.smithi079.stdout: "enabled": false, 2019-12-08T12:09:03.037 INFO:teuthology.orchestra.run.smithi079.stdout: "check_on_raw": false, 2019-12-08T12:09:03.037 INFO:teuthology.orchestra.run.smithi079.stdout: "max_size": -1, 2019-12-08T12:09:03.038 INFO:teuthology.orchestra.run.smithi079.stdout: "max_size_kb": 0, 2019-12-08T12:09:03.038 INFO:teuthology.orchestra.run.smithi079.stdout: "max_objects": -1 2019-12-08T12:09:03.038 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2019-12-08T12:09:03.039 INFO:teuthology.orchestra.run.smithi079.stdout: "user_quota": { 2019-12-08T12:09:03.039 INFO:teuthology.orchestra.run.smithi079.stdout: "enabled": false, 2019-12-08T12:09:03.039 INFO:teuthology.orchestra.run.smithi079.stdout: "check_on_raw": false, 2019-12-08T12:09:03.039 INFO:teuthology.orchestra.run.smithi079.stdout: "max_size": -1, 2019-12-08T12:09:03.039 INFO:teuthology.orchestra.run.smithi079.stdout: "max_size_kb": 0, 2019-12-08T12:09:03.040 INFO:teuthology.orchestra.run.smithi079.stdout: "max_objects": -1 2019-12-08T12:09:03.040 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2019-12-08T12:09:03.040 INFO:teuthology.orchestra.run.smithi079.stdout: "temp_url_keys": [], 2019-12-08T12:09:03.040 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "rgw", 2019-12-08T12:09:03.041 INFO:teuthology.orchestra.run.smithi079.stdout: "mfa_ids": [] 2019-12-08T12:09:03.041 INFO:teuthology.orchestra.run.smithi079.stdout:} 2019-12-08T12:09:03.041 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:09:03.081 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:09:03.046+0000 7fb4bd2cbec0 20 remove_watcher() i=0 2019-12-08T12:09:03.081 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:09:03.046+0000 7fb4bd2cbec0 2 removed watcher, disabling cache 2019-12-08T12:09:03.210 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:09:03.178+0000 7fb4bd2cbec0 20 remove_watcher() i=1 2019-12-08T12:09:03.253 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:09:03.221+0000 7fb4bd2cbec0 20 remove_watcher() i=2 2019-12-08T12:09:03.294 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:09:03.262+0000 7fb4bd2cbec0 20 remove_watcher() i=3 2019-12-08T12:09:03.327 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:09:03.295+0000 7fb4bd2cbec0 20 remove_watcher() i=4 2019-12-08T12:09:03.364 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:09:03.332+0000 7fb4bd2cbec0 20 remove_watcher() i=5 2019-12-08T12:09:03.425 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:09:03.393+0000 7fb4bd2cbec0 20 remove_watcher() i=6 2019-12-08T12:09:03.471 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:09:03.438+0000 7fb4bd2cbec0 20 remove_watcher() i=7 2019-12-08T12:09:03.479 INFO:tasks.ragweed:Configuring ragweed... 2019-12-08T12:09:03.479 INFO:teuthology.orchestra.run.smithi079:> cd /home/ubuntu/cephtest/ragweed && ./bootstrap 2019-12-08T12:09:10.037 INFO:teuthology.orchestra.run.smithi079.stderr:./bootstrap: missing required RPM packages. Installing via sudo. 2019-12-08T12:09:10.193 INFO:teuthology.orchestra.run.smithi079.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-08T12:09:10.234 INFO:teuthology.orchestra.run.smithi079.stdout:Loading mirror speeds from cached hostfile 2019-12-08T12:09:10.234 INFO:teuthology.orchestra.run.smithi079.stdout: * base: mirrors.umflint.edu 2019-12-08T12:09:10.235 INFO:teuthology.orchestra.run.smithi079.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-08T12:09:10.235 INFO:teuthology.orchestra.run.smithi079.stdout: * extras: mirror.facebook.net 2019-12-08T12:09:10.235 INFO:teuthology.orchestra.run.smithi079.stdout: * updates: mirror.math.princeton.edu 2019-12-08T12:09:10.908 INFO:teuthology.orchestra.run.smithi079.stdout:7 packages excluded due to repository priority protections 2019-12-08T12:09:11.251 INFO:teuthology.orchestra.run.smithi079.stdout:Package python2-pip-8.1.2-10.el7.noarch already installed and latest version 2019-12-08T12:09:12.323 INFO:teuthology.orchestra.run.smithi079.stdout:Resolving Dependencies 2019-12-08T12:09:12.323 INFO:teuthology.orchestra.run.smithi079.stdout:--> Running transaction check 2019-12-08T12:09:12.323 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package libevent-devel.x86_64 0:2.0.21-4.el7 will be installed 2019-12-08T12:09:12.325 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package libxml2-devel.x86_64 0:2.9.1-6.el7_2.3 will be installed 2019-12-08T12:09:12.327 INFO:teuthology.orchestra.run.smithi079.stdout:--> Processing Dependency: xz-devel for package: libxml2-devel-2.9.1-6.el7_2.3.x86_64 2019-12-08T12:09:12.361 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package libxslt-devel.x86_64 0:1.1.28-5.el7 will be installed 2019-12-08T12:09:12.362 INFO:teuthology.orchestra.run.smithi079.stdout:--> Processing Dependency: libgcrypt-devel for package: libxslt-devel-1.1.28-5.el7.x86_64 2019-12-08T12:09:12.365 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package zlib-devel.x86_64 0:1.2.7-18.el7 will be installed 2019-12-08T12:09:12.365 INFO:teuthology.orchestra.run.smithi079.stdout:--> Running transaction check 2019-12-08T12:09:12.365 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package libgcrypt-devel.x86_64 0:1.5.3-14.el7 will be installed 2019-12-08T12:09:12.367 INFO:teuthology.orchestra.run.smithi079.stdout:--> Processing Dependency: libgpg-error-devel for package: libgcrypt-devel-1.5.3-14.el7.x86_64 2019-12-08T12:09:12.370 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package xz-devel.x86_64 0:5.2.2-1.el7 will be installed 2019-12-08T12:09:12.370 INFO:teuthology.orchestra.run.smithi079.stdout:--> Running transaction check 2019-12-08T12:09:12.371 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package libgpg-error-devel.x86_64 0:1.12-3.el7 will be installed 2019-12-08T12:09:12.763 INFO:teuthology.orchestra.run.smithi079.stdout:--> Finished Dependency Resolution 2019-12-08T12:09:12.956 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:09:12.956 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies Resolved 2019-12-08T12:09:12.957 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:09:12.958 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2019-12-08T12:09:12.958 INFO:teuthology.orchestra.run.smithi079.stdout: Package Arch Version Repository Size 2019-12-08T12:09:12.958 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2019-12-08T12:09:12.958 INFO:teuthology.orchestra.run.smithi079.stdout:Installing: 2019-12-08T12:09:12.959 INFO:teuthology.orchestra.run.smithi079.stdout: libevent-devel x86_64 2.0.21-4.el7 base 85 k 2019-12-08T12:09:12.959 INFO:teuthology.orchestra.run.smithi079.stdout: libxml2-devel x86_64 2.9.1-6.el7_2.3 base 1.0 M 2019-12-08T12:09:12.959 INFO:teuthology.orchestra.run.smithi079.stdout: libxslt-devel x86_64 1.1.28-5.el7 base 309 k 2019-12-08T12:09:12.959 INFO:teuthology.orchestra.run.smithi079.stdout: zlib-devel x86_64 1.2.7-18.el7 base 50 k 2019-12-08T12:09:12.959 INFO:teuthology.orchestra.run.smithi079.stdout:Installing for dependencies: 2019-12-08T12:09:12.960 INFO:teuthology.orchestra.run.smithi079.stdout: libgcrypt-devel x86_64 1.5.3-14.el7 base 129 k 2019-12-08T12:09:12.960 INFO:teuthology.orchestra.run.smithi079.stdout: libgpg-error-devel x86_64 1.12-3.el7 base 16 k 2019-12-08T12:09:12.960 INFO:teuthology.orchestra.run.smithi079.stdout: xz-devel x86_64 5.2.2-1.el7 base 46 k 2019-12-08T12:09:12.960 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:09:12.961 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction Summary 2019-12-08T12:09:12.961 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2019-12-08T12:09:12.961 INFO:teuthology.orchestra.run.smithi079.stdout:Install 4 Packages (+3 Dependent packages) 2019-12-08T12:09:12.961 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:09:12.962 INFO:teuthology.orchestra.run.smithi079.stdout:Total download size: 1.7 M 2019-12-08T12:09:12.962 INFO:teuthology.orchestra.run.smithi079.stdout:Installed size: 12 M 2019-12-08T12:09:12.962 INFO:teuthology.orchestra.run.smithi079.stdout:Downloading packages: 2019-12-08T12:09:13.272 INFO:teuthology.orchestra.run.smithi079.stdout:-------------------------------------------------------------------------------- 2019-12-08T12:09:13.273 INFO:teuthology.orchestra.run.smithi079.stdout:Total 5.3 MB/s | 1.7 MB 00:00 2019-12-08T12:09:13.286 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction check 2019-12-08T12:09:13.300 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction test 2019-12-08T12:09:13.365 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction test succeeded 2019-12-08T12:09:13.365 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction 2019-12-08T12:09:14.087 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libgpg-error-devel-1.12-3.el7.x86_64 1/7 2019-12-08T12:09:14.400 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libgcrypt-devel-1.5.3-14.el7.x86_64 2/7 2019-12-08T12:09:14.673 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : zlib-devel-1.2.7-18.el7.x86_64 3/7 2019-12-08T12:09:15.341 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : xz-devel-5.2.2-1.el7.x86_64 4/7 2019-12-08T12:09:15.874 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libxml2-devel-2.9.1-6.el7_2.3.x86_64 5/7 2019-12-08T12:09:16.261 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libxslt-devel-1.1.28-5.el7.x86_64 6/7 2019-12-08T12:09:16.574 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libevent-devel-2.0.21-4.el7.x86_64 7/7 2019-12-08T12:09:16.682 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : xz-devel-5.2.2-1.el7.x86_64 1/7 2019-12-08T12:09:16.775 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libxml2-devel-2.9.1-6.el7_2.3.x86_64 2/7 2019-12-08T12:09:16.892 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : zlib-devel-1.2.7-18.el7.x86_64 3/7 2019-12-08T12:09:17.034 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libxslt-devel-1.1.28-5.el7.x86_64 4/7 2019-12-08T12:09:17.160 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libgpg-error-devel-1.12-3.el7.x86_64 5/7 2019-12-08T12:09:17.269 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libevent-devel-2.0.21-4.el7.x86_64 6/7 2019-12-08T12:09:17.793 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libgcrypt-devel-1.5.3-14.el7.x86_64 7/7 2019-12-08T12:09:17.793 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:09:17.794 INFO:teuthology.orchestra.run.smithi079.stdout:Installed: 2019-12-08T12:09:17.794 INFO:teuthology.orchestra.run.smithi079.stdout: libevent-devel.x86_64 0:2.0.21-4.el7 libxml2-devel.x86_64 0:2.9.1-6.el7_2.3 2019-12-08T12:09:17.794 INFO:teuthology.orchestra.run.smithi079.stdout: libxslt-devel.x86_64 0:1.1.28-5.el7 zlib-devel.x86_64 0:1.2.7-18.el7 2019-12-08T12:09:17.794 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:09:17.794 INFO:teuthology.orchestra.run.smithi079.stdout:Dependency Installed: 2019-12-08T12:09:17.794 INFO:teuthology.orchestra.run.smithi079.stdout: libgcrypt-devel.x86_64 0:1.5.3-14.el7 libgpg-error-devel.x86_64 0:1.12-3.el7 2019-12-08T12:09:17.794 INFO:teuthology.orchestra.run.smithi079.stdout: xz-devel.x86_64 0:5.2.2-1.el7 2019-12-08T12:09:17.795 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:09:17.795 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2019-12-08T12:09:18.063 INFO:teuthology.orchestra.run.smithi079.stdout:New python executable in /home/ubuntu/cephtest/ragweed/virtualenv/bin/python 2019-12-08T12:09:19.504 INFO:teuthology.orchestra.run.smithi079.stdout:Installing setuptools, pip, wheel...done. 2019-12-08T12:09:20.072 INFO:teuthology.orchestra.run.smithi079.stdout:Collecting pip 2019-12-08T12:09:20.187 INFO:teuthology.orchestra.run.smithi079.stdout: Downloading https://files.pythonhosted.org/packages/00/b6/9cfa56b4081ad13874b0c6f96af8ce16cfbc1cb06bedf8e9164ce5551ec1/pip-19.3.1-py2.py3-none-any.whl (1.4MB) 2019-12-08T12:09:20.437 INFO:teuthology.orchestra.run.smithi079.stdout:Installing collected packages: pip 2019-12-08T12:09:20.438 INFO:teuthology.orchestra.run.smithi079.stdout: Found existing installation: pip 9.0.1 2019-12-08T12:09:20.500 INFO:teuthology.orchestra.run.smithi079.stdout: Uninstalling pip-9.0.1: 2019-12-08T12:09:20.543 INFO:teuthology.orchestra.run.smithi079.stdout: Successfully uninstalled pip-9.0.1 2019-12-08T12:09:21.150 INFO:teuthology.orchestra.run.smithi079.stdout:Successfully installed pip-19.3.1 2019-12-08T12:09:22.006 INFO:teuthology.orchestra.run.smithi079.stderr:DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support 2019-12-08T12:09:22.083 INFO:teuthology.orchestra.run.smithi079.stdout:Requirement already satisfied: six in /usr/lib/python2.7/site-packages (1.9.0) 2019-12-08T12:09:22.945 INFO:teuthology.orchestra.run.smithi079.stderr:DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support 2019-12-08T12:09:23.185 INFO:teuthology.orchestra.run.smithi079.stdout:Collecting nose 2019-12-08T12:09:23.233 INFO:teuthology.orchestra.run.smithi079.stdout: Downloading https://files.pythonhosted.org/packages/99/4f/13fb671119e65c4dce97c60e67d3fd9e6f7f809f2b307e2611f4701205cb/nose-1.3.7-py2-none-any.whl (154kB) 2019-12-08T12:09:23.333 INFO:teuthology.orchestra.run.smithi079.stdout:Installing collected packages: nose 2019-12-08T12:09:23.405 INFO:teuthology.orchestra.run.smithi079.stdout:Successfully installed nose-1.3.7 2019-12-08T12:09:23.997 INFO:teuthology.orchestra.run.smithi079.stderr:DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support 2019-12-08T12:09:24.544 INFO:teuthology.orchestra.run.smithi079.stdout:Collecting setuptools==32.3.1 2019-12-08T12:09:24.586 INFO:teuthology.orchestra.run.smithi079.stdout: Downloading https://files.pythonhosted.org/packages/69/19/b1dff551058ce79d88b1e3688f1c735590d7ddf44d10681512133b35019f/setuptools-32.3.1-py2.py3-none-any.whl (479kB) 2019-12-08T12:09:24.737 INFO:teuthology.orchestra.run.smithi079.stderr:ERROR: kubernetes 10.0.1 has requirement ipaddress>=1.0.17, but you'll have ipaddress 1.0.16 which is incompatible. 2019-12-08T12:09:25.028 INFO:teuthology.orchestra.run.smithi079.stdout:Installing collected packages: setuptools 2019-12-08T12:09:25.028 INFO:teuthology.orchestra.run.smithi079.stdout: Found existing installation: setuptools 28.8.0 2019-12-08T12:09:25.029 INFO:teuthology.orchestra.run.smithi079.stdout: Uninstalling setuptools-28.8.0: 2019-12-08T12:09:25.029 INFO:teuthology.orchestra.run.smithi079.stdout: Successfully uninstalled setuptools-28.8.0 2019-12-08T12:09:25.029 INFO:teuthology.orchestra.run.smithi079.stdout:Successfully installed setuptools-32.3.1 2019-12-08T12:09:25.444 INFO:teuthology.orchestra.run.smithi079.stderr:DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support 2019-12-08T12:09:25.862 INFO:teuthology.orchestra.run.smithi079.stdout:Collecting PyYAML 2019-12-08T12:09:25.908 INFO:teuthology.orchestra.run.smithi079.stdout: Downloading https://files.pythonhosted.org/packages/8d/c9/e5be955a117a1ac548cdd31e37e8fd7b02ce987f9655f5c7563c656d5dcb/PyYAML-5.2.tar.gz (265kB) 2019-12-08T12:09:26.514 INFO:teuthology.orchestra.run.smithi079.stdout:Requirement already up-to-date: nose>=1.0.0 in ./virtualenv/lib/python2.7/site-packages (from -r requirements.txt (line 2)) (1.3.7) 2019-12-08T12:09:26.688 INFO:teuthology.orchestra.run.smithi079.stdout:Collecting boto!=2.46.0,>=2.6.0 2019-12-08T12:09:26.698 INFO:teuthology.orchestra.run.smithi079.stdout: Downloading https://files.pythonhosted.org/packages/23/10/c0b78c27298029e4454a472a1919bde20cb182dab1662cec7f2ca1dcc523/boto-2.49.0-py2.py3-none-any.whl (1.4MB) 2019-12-08T12:09:26.996 INFO:teuthology.orchestra.run.smithi079.stdout:Collecting bunch>=1.0.0 2019-12-08T12:09:27.008 INFO:teuthology.orchestra.run.smithi079.stdout: Downloading https://files.pythonhosted.org/packages/ef/bf/a4cf1779a4ffb4f610903fa08e15d1f4a8a2f4e3353a02afbe097c5bf4a8/bunch-1.0.1.tar.gz 2019-12-08T12:09:27.867 INFO:teuthology.orchestra.run.smithi079.stdout:Collecting gevent>=1.0 2019-12-08T12:09:27.883 INFO:teuthology.orchestra.run.smithi079.stdout: Downloading https://files.pythonhosted.org/packages/e6/e9/3a693414f706e12abe60554cd73c5ae8f848b182ae58018f93d86c9eb418/gevent-1.4.0-cp27-cp27mu-manylinux1_x86_64.whl (5.0MB) 2019-12-08T12:09:28.363 INFO:teuthology.orchestra.run.smithi079.stdout:Collecting httplib2 2019-12-08T12:09:28.374 INFO:teuthology.orchestra.run.smithi079.stdout: Downloading https://files.pythonhosted.org/packages/ce/2e/87461bfbb7e561203b759b3f7f639e2144226604372830d00a8279960ae1/httplib2-0.14.0.tar.gz (219kB) 2019-12-08T12:09:29.597 INFO:teuthology.orchestra.run.smithi079.stdout:Collecting lxml 2019-12-08T12:09:29.616 INFO:teuthology.orchestra.run.smithi079.stdout: Downloading https://files.pythonhosted.org/packages/25/73/730ad7249847f741c7e622f52b971daa5540f6fb87589bc92c717f5aafba/lxml-4.4.2-cp27-cp27mu-manylinux1_x86_64.whl (5.7MB) 2019-12-08T12:09:30.218 INFO:teuthology.orchestra.run.smithi079.stdout:Collecting greenlet>=0.4.14; platform_python_implementation == "CPython" 2019-12-08T12:09:30.231 INFO:teuthology.orchestra.run.smithi079.stdout: Downloading https://files.pythonhosted.org/packages/8b/6e/f2d25875713ad0885c8d3c69269697406652e6f64e1a6bd8264f7a609327/greenlet-0.4.15-cp27-cp27mu-manylinux1_x86_64.whl 2019-12-08T12:09:30.316 INFO:teuthology.orchestra.run.smithi079.stdout:Building wheels for collected packages: PyYAML, bunch, httplib2 2019-12-08T12:09:30.317 INFO:teuthology.orchestra.run.smithi079.stdout: Building wheel for PyYAML (setup.py): started 2019-12-08T12:09:31.144 INFO:teuthology.orchestra.run.smithi079.stdout: Building wheel for PyYAML (setup.py): finished with status 'done' 2019-12-08T12:09:31.145 INFO:teuthology.orchestra.run.smithi079.stdout: Created wheel for PyYAML: filename=PyYAML-5.2-cp27-cp27mu-linux_x86_64.whl size=46299 sha256=3991fc236e51625851e2a59d5fd4dc46bfd792c7e91929124274236db167bf64 2019-12-08T12:09:31.145 INFO:teuthology.orchestra.run.smithi079.stdout: Stored in directory: /home/ubuntu/.cache/pip/wheels/54/b7/c7/2ada654ee54483c9329871665aaf4a6056c3ce36f29cf66e67 2019-12-08T12:09:31.170 INFO:teuthology.orchestra.run.smithi079.stdout: Building wheel for bunch (setup.py): started 2019-12-08T12:09:31.491 INFO:teuthology.orchestra.run.smithi079.stdout: Building wheel for bunch (setup.py): finished with status 'done' 2019-12-08T12:09:31.492 INFO:teuthology.orchestra.run.smithi079.stdout: Created wheel for bunch: filename=bunch-1.0.1-cp27-none-any.whl size=8347 sha256=7f49e455d9e7e3ddc978eefcb3f37d75d3b068872d9b2664adc3913d7b185bb8 2019-12-08T12:09:31.492 INFO:teuthology.orchestra.run.smithi079.stdout: Stored in directory: /home/ubuntu/.cache/pip/wheels/56/0f/19/fbbf81e5764e6d8b74501c4357a88c14c94466ec777c03734c 2019-12-08T12:09:31.497 INFO:teuthology.orchestra.run.smithi079.stdout: Building wheel for httplib2 (setup.py): started 2019-12-08T12:09:31.839 INFO:teuthology.orchestra.run.smithi079.stdout: Building wheel for httplib2 (setup.py): finished with status 'done' 2019-12-08T12:09:31.839 INFO:teuthology.orchestra.run.smithi079.stdout: Created wheel for httplib2: filename=httplib2-0.14.0-cp27-none-any.whl size=96742 sha256=634df86237798eae7c429462c60508c002808331316d5781a510d938e699ddc2 2019-12-08T12:09:31.840 INFO:teuthology.orchestra.run.smithi079.stdout: Stored in directory: /home/ubuntu/.cache/pip/wheels/51/ab/65/f318b4271019823cf7d7c178ac76a8ea4d6e6271fe9f5ba488 2019-12-08T12:09:31.848 INFO:teuthology.orchestra.run.smithi079.stdout:Successfully built PyYAML bunch httplib2 2019-12-08T12:09:31.971 INFO:teuthology.orchestra.run.smithi079.stderr:ERROR: kubernetes 10.0.1 has requirement ipaddress>=1.0.17, but you'll have ipaddress 1.0.16 which is incompatible. 2019-12-08T12:09:31.971 INFO:teuthology.orchestra.run.smithi079.stdout:Installing collected packages: PyYAML, boto, bunch, greenlet, gevent, httplib2, lxml 2019-12-08T12:09:31.971 INFO:teuthology.orchestra.run.smithi079.stdout: Found existing installation: PyYAML 3.10 2019-12-08T12:09:31.972 INFO:teuthology.orchestra.run.smithi079.stdout: Not uninstalling pyyaml at /usr/lib64/python2.7/site-packages, outside environment /home/ubuntu/cephtest/ragweed/virtualenv 2019-12-08T12:09:31.972 INFO:teuthology.orchestra.run.smithi079.stdout: Can't uninstall 'PyYAML'. No files were found to uninstall. 2019-12-08T12:09:33.018 INFO:teuthology.orchestra.run.smithi079.stdout: Found existing installation: lxml 3.2.1 2019-12-08T12:09:33.019 INFO:teuthology.orchestra.run.smithi079.stdout: Not uninstalling lxml at /usr/lib64/python2.7/site-packages, outside environment /home/ubuntu/cephtest/ragweed/virtualenv 2019-12-08T12:09:33.019 INFO:teuthology.orchestra.run.smithi079.stdout: Can't uninstall 'lxml'. No files were found to uninstall. 2019-12-08T12:09:33.133 INFO:teuthology.orchestra.run.smithi079.stdout:Successfully installed PyYAML-5.2 boto-2.49.0 bunch-1.0.1 gevent-1.4.0 greenlet-0.4.15 httplib2-0.14.0 lxml-4.4.2 2019-12-08T12:09:33.551 INFO:teuthology.orchestra.run.smithi079.stdout:running develop 2019-12-08T12:09:33.618 INFO:teuthology.orchestra.run.smithi079.stdout:running egg_info 2019-12-08T12:09:33.618 INFO:teuthology.orchestra.run.smithi079.stdout:creating ragweed.egg-info 2019-12-08T12:09:33.618 INFO:teuthology.orchestra.run.smithi079.stdout:writing requirements to ragweed.egg-info/requires.txt 2019-12-08T12:09:33.618 INFO:teuthology.orchestra.run.smithi079.stdout:writing ragweed.egg-info/PKG-INFO 2019-12-08T12:09:33.618 INFO:teuthology.orchestra.run.smithi079.stdout:writing top-level names to ragweed.egg-info/top_level.txt 2019-12-08T12:09:33.618 INFO:teuthology.orchestra.run.smithi079.stdout:writing dependency_links to ragweed.egg-info/dependency_links.txt 2019-12-08T12:09:33.619 INFO:teuthology.orchestra.run.smithi079.stdout:writing manifest file 'ragweed.egg-info/SOURCES.txt' 2019-12-08T12:09:33.619 INFO:teuthology.orchestra.run.smithi079.stdout:reading manifest file 'ragweed.egg-info/SOURCES.txt' 2019-12-08T12:09:33.619 INFO:teuthology.orchestra.run.smithi079.stdout:writing manifest file 'ragweed.egg-info/SOURCES.txt' 2019-12-08T12:09:33.621 INFO:teuthology.orchestra.run.smithi079.stdout:running build_ext 2019-12-08T12:09:33.621 INFO:teuthology.orchestra.run.smithi079.stdout:Creating /home/ubuntu/cephtest/ragweed/virtualenv/lib/python2.7/site-packages/ragweed.egg-link (link to .) 2019-12-08T12:09:33.621 INFO:teuthology.orchestra.run.smithi079.stdout:Adding ragweed 0.0.1 to easy-install.pth file 2019-12-08T12:09:33.621 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:09:33.622 INFO:teuthology.orchestra.run.smithi079.stdout:Installed /home/ubuntu/cephtest/ragweed 2019-12-08T12:09:33.622 INFO:teuthology.orchestra.run.smithi079.stdout:Processing dependencies for ragweed==0.0.1 2019-12-08T12:09:33.635 INFO:teuthology.orchestra.run.smithi079.stdout:Searching for isodate>=0.4.4 2019-12-08T12:09:33.635 INFO:teuthology.orchestra.run.smithi079.stdout:Reading https://pypi.python.org/simple/isodate/ 2019-12-08T12:09:33.739 INFO:teuthology.orchestra.run.smithi079.stdout:Downloading https://files.pythonhosted.org/packages/b1/80/fb8c13a4cd38eb5021dc3741a9e588e4d1de88d895c1910c6fc8a08b7a70/isodate-0.6.0.tar.gz#sha256=2e364a3d5759479cdb2d37cce6b9376ea504db2ff90252a2e5b7cc89cc9ff2d8 2019-12-08T12:09:33.796 INFO:teuthology.orchestra.run.smithi079.stdout:Best match: isodate 0.6.0 2019-12-08T12:09:33.797 INFO:teuthology.orchestra.run.smithi079.stdout:Processing isodate-0.6.0.tar.gz 2019-12-08T12:09:33.806 INFO:teuthology.orchestra.run.smithi079.stdout:Writing /tmp/easy_install-3tZHiZ/isodate-0.6.0/setup.cfg 2019-12-08T12:09:33.807 INFO:teuthology.orchestra.run.smithi079.stdout:Running isodate-0.6.0/setup.py -q bdist_egg --dist-dir /tmp/easy_install-3tZHiZ/isodate-0.6.0/egg-dist-tmp-3pPYyL 2019-12-08T12:09:34.102 INFO:teuthology.orchestra.run.smithi079.stderr:zip_safe flag not set; analyzing archive contents... 2019-12-08T12:09:34.121 INFO:teuthology.orchestra.run.smithi079.stdout:Moving isodate-0.6.0-py2.7.egg to /home/ubuntu/cephtest/ragweed/virtualenv/lib/python2.7/site-packages 2019-12-08T12:09:34.122 INFO:teuthology.orchestra.run.smithi079.stdout:Adding isodate 0.6.0 to easy-install.pth file 2019-12-08T12:09:34.124 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:09:34.124 INFO:teuthology.orchestra.run.smithi079.stdout:Installed /home/ubuntu/cephtest/ragweed/virtualenv/lib/python2.7/site-packages/isodate-0.6.0-py2.7.egg 2019-12-08T12:09:34.155 INFO:teuthology.orchestra.run.smithi079.stdout:Searching for gevent==1.4.0 2019-12-08T12:09:34.155 INFO:teuthology.orchestra.run.smithi079.stdout:Best match: gevent 1.4.0 2019-12-08T12:09:34.156 INFO:teuthology.orchestra.run.smithi079.stdout:Adding gevent 1.4.0 to easy-install.pth file 2019-12-08T12:09:34.158 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:09:34.158 INFO:teuthology.orchestra.run.smithi079.stdout:Using /home/ubuntu/cephtest/ragweed/virtualenv/lib/python2.7/site-packages 2019-12-08T12:09:34.158 INFO:teuthology.orchestra.run.smithi079.stdout:Searching for bunch==1.0.1 2019-12-08T12:09:34.158 INFO:teuthology.orchestra.run.smithi079.stdout:Best match: bunch 1.0.1 2019-12-08T12:09:34.160 INFO:teuthology.orchestra.run.smithi079.stdout:Adding bunch 1.0.1 to easy-install.pth file 2019-12-08T12:09:34.160 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:09:34.160 INFO:teuthology.orchestra.run.smithi079.stdout:Using /home/ubuntu/cephtest/ragweed/virtualenv/lib/python2.7/site-packages 2019-12-08T12:09:34.160 INFO:teuthology.orchestra.run.smithi079.stdout:Searching for PyYAML==5.2 2019-12-08T12:09:34.161 INFO:teuthology.orchestra.run.smithi079.stdout:Best match: PyYAML 5.2 2019-12-08T12:09:34.161 INFO:teuthology.orchestra.run.smithi079.stdout:Adding PyYAML 5.2 to easy-install.pth file 2019-12-08T12:09:34.161 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:09:34.161 INFO:teuthology.orchestra.run.smithi079.stdout:Using /home/ubuntu/cephtest/ragweed/virtualenv/lib/python2.7/site-packages 2019-12-08T12:09:34.163 INFO:teuthology.orchestra.run.smithi079.stdout:Searching for boto==2.49.0 2019-12-08T12:09:34.163 INFO:teuthology.orchestra.run.smithi079.stdout:Best match: boto 2.49.0 2019-12-08T12:09:34.164 INFO:teuthology.orchestra.run.smithi079.stdout:Adding boto 2.49.0 to easy-install.pth file 2019-12-08T12:09:34.164 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:09:34.164 INFO:teuthology.orchestra.run.smithi079.stdout:Using /home/ubuntu/cephtest/ragweed/virtualenv/lib/python2.7/site-packages 2019-12-08T12:09:34.164 INFO:teuthology.orchestra.run.smithi079.stdout:Searching for six==1.9.0 2019-12-08T12:09:34.165 INFO:teuthology.orchestra.run.smithi079.stdout:Best match: six 1.9.0 2019-12-08T12:09:34.165 INFO:teuthology.orchestra.run.smithi079.stdout:Adding six 1.9.0 to easy-install.pth file 2019-12-08T12:09:34.165 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:09:34.165 INFO:teuthology.orchestra.run.smithi079.stdout:Using /usr/lib/python2.7/site-packages 2019-12-08T12:09:34.172 INFO:teuthology.orchestra.run.smithi079.stdout:Searching for greenlet==0.4.15 2019-12-08T12:09:34.172 INFO:teuthology.orchestra.run.smithi079.stdout:Best match: greenlet 0.4.15 2019-12-08T12:09:34.173 INFO:teuthology.orchestra.run.smithi079.stdout:Adding greenlet 0.4.15 to easy-install.pth file 2019-12-08T12:09:34.173 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:09:34.173 INFO:teuthology.orchestra.run.smithi079.stdout:Using /home/ubuntu/cephtest/ragweed/virtualenv/lib/python2.7/site-packages 2019-12-08T12:09:34.173 INFO:teuthology.orchestra.run.smithi079.stdout:Finished processing dependencies for ragweed==0.0.1 2019-12-08T12:09:34.193 INFO:teuthology.orchestra.run.smithi079:> cat > /home/ubuntu/cephtest/archive/ragweed.client.0.conf 2019-12-08T12:09:34.259 INFO:tasks.ragweed:Configuring boto... 2019-12-08T12:09:34.259 INFO:teuthology.orchestra.run.smithi079:> cat > /home/ubuntu/cephtest/boto.cfg 2019-12-08T12:09:34.358 INFO:teuthology.orchestra.run.smithi079:ragweed tests against rgw> RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg /home/ubuntu/cephtest/ragweed/virtualenv/bin/nosetests -w /home/ubuntu/cephtest/ragweed -v -a '!fails_on_rgw' 2019-12-08T12:10:10.485 INFO:teuthology.orchestra.run.smithi079.stderr:ragweed.tests.tests.r_test_multipart_defer_complete.test ... ok 2019-12-08T12:10:34.081 INFO:teuthology.orchestra.run.smithi079.stderr:ragweed.tests.tests.r_test_multipart_defer_update_complete.test ... ok 2019-12-08T12:10:58.625 INFO:teuthology.orchestra.run.smithi079.stderr:ragweed.tests.tests.r_test_multipart_index_versioning.test ... ok 2019-12-08T12:11:20.586 INFO:teuthology.orchestra.run.smithi079.stderr:ragweed.tests.tests.r_test_multipart_simple.test ... ok 2019-12-08T12:11:42.963 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:00:09:07.672 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T12:11:43.014 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:00:09:07.705 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T12:11:43.028 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:00:09:07.739 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T12:11:43.036 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:00:09:07.728 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T12:11:43.091 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:00:09:07.782 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T12:11:43.099 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:00:09:07.791 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T12:11:43.670 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:00:09:08.361 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T12:11:43.762 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:00:09:08.472 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T12:11:43.873 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:00:09:08.564 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T12:11:48.426 INFO:teuthology.orchestra.run.smithi079.stderr:ragweed.tests.tests.r_test_obj_storage_class.test ... ok 2019-12-08T12:12:53.122 INFO:teuthology.orchestra.run.smithi079.stderr:ragweed.tests.tests.r_test_obj_storage_class_copy.test ... ok 2019-12-08T12:13:50.441 INFO:teuthology.orchestra.run.smithi079.stderr:ragweed.tests.tests.r_test_obj_storage_class_multipart.test ... ok 2019-12-08T12:13:53.300 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:00:11:18.011 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T12:13:53.315 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:00:11:18.027 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T12:13:53.320 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:00:11:18.003 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T12:13:53.324 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:00:11:18.007 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T12:13:53.332 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:00:11:18.015 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T12:13:53.336 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:00:11:18.018 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T12:13:53.426 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:00:11:18.108 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T12:13:53.433 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:00:11:18.145 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T12:13:53.459 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:00:11:18.142 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T12:15:54.064 INFO:teuthology.orchestra.run.smithi079.stderr:ragweed.tests.tests.r_test_obj_storage_class_multipart_copy.test ... ok 2019-12-08T12:16:31.661 INFO:teuthology.orchestra.run.smithi079.stderr:ragweed.tests.tests.r_test_small_obj_data.test ... ok 2019-12-08T12:16:31.662 INFO:teuthology.orchestra.run.smithi079.stderr: 2019-12-08T12:16:31.662 INFO:teuthology.orchestra.run.smithi079.stderr:---------------------------------------------------------------------- 2019-12-08T12:16:31.662 INFO:teuthology.orchestra.run.smithi079.stderr:Ran 9 tests in 416.828s 2019-12-08T12:16:31.662 INFO:teuthology.orchestra.run.smithi079.stderr: 2019-12-08T12:16:31.663 INFO:teuthology.orchestra.run.smithi079.stderr:OK 2019-12-08T12:16:31.689 INFO:tasks.ragweed:Cleaning up boto... 2019-12-08T12:16:31.689 INFO:teuthology.orchestra.run.smithi079:> rm /home/ubuntu/cephtest/boto.cfg 2019-12-08T12:16:31.754 INFO:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid sysuser.client.0 --purge-data 2019-12-08T12:16:31.879 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:31.816+0000 7fcdffbeaec0 20 rados->read ofs=0 len=0 2019-12-08T12:16:31.912 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:31.850+0000 7fcdffbeaec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:16:31.912 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:31.850+0000 7fcdffbeaec0 20 rados->read ofs=0 len=0 2019-12-08T12:16:31.925 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:31.862+0000 7fcdffbeaec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:16:31.925 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:31.862+0000 7fcdffbeaec0 20 rados->read ofs=0 len=0 2019-12-08T12:16:31.936 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:31.874+0000 7fcdffbeaec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:16:31.936 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:31.874+0000 7fcdffbeaec0 20 rados->read ofs=0 len=0 2019-12-08T12:16:31.962 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:31.899+0000 7fcdffbeaec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:16:32.195 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:32.132+0000 7fcdffbeaec0 20 RGWRados::pool_iterate: got zonegroup_info.fee0148b-7ae2-4cf0-a79e-86045a29cb7c 2019-12-08T12:16:32.195 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:32.132+0000 7fcdffbeaec0 20 RGWRados::pool_iterate: got zone_info.f8ab349b-4577-410d-b524-4ecaf50bb1bd 2019-12-08T12:16:32.195 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:32.132+0000 7fcdffbeaec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-08T12:16:32.196 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:32.132+0000 7fcdffbeaec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-08T12:16:32.196 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:32.132+0000 7fcdffbeaec0 20 rados->read ofs=0 len=0 2019-12-08T12:16:32.211 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:32.148+0000 7fcdffbeaec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:16:32.211 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:32.148+0000 7fcdffbeaec0 20 rados->read ofs=0 len=0 2019-12-08T12:16:32.231 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:32.168+0000 7fcdffbeaec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-08T12:16:32.231 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:32.169+0000 7fcdffbeaec0 20 rados->read ofs=0 len=0 2019-12-08T12:16:32.251 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:32.189+0000 7fcdffbeaec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:16:32.251 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:32.189+0000 7fcdffbeaec0 20 rados->read ofs=0 len=0 2019-12-08T12:16:32.270 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:32.208+0000 7fcdffbeaec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-08T12:16:32.270 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:32.208+0000 7fcdffbeaec0 20 rados->read ofs=0 len=0 2019-12-08T12:16:32.282 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:32.219+0000 7fcdffbeaec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:16:32.282 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:32.219+0000 7fcdffbeaec0 10 cannot find current period zonegroup using local zonegroup 2019-12-08T12:16:32.282 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:32.219+0000 7fcdffbeaec0 20 rados->read ofs=0 len=0 2019-12-08T12:16:32.293 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:32.231+0000 7fcdffbeaec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:16:32.294 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:32.231+0000 7fcdffbeaec0 20 rados->read ofs=0 len=0 2019-12-08T12:16:32.313 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:32.250+0000 7fcdffbeaec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:16:32.313 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:32.250+0000 7fcdffbeaec0 20 rados->read ofs=0 len=0 2019-12-08T12:16:32.330 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:32.268+0000 7fcdffbeaec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-08T12:16:32.330 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:32.268+0000 7fcdffbeaec0 20 zonegroup default 2019-12-08T12:16:32.331 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:32.268+0000 7fcdffbeaec0 20 rados->read ofs=0 len=0 2019-12-08T12:16:32.341 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:32.278+0000 7fcdffbeaec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:16:32.341 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:32.278+0000 7fcdffbeaec0 10 Cannot find current period zone using local zone 2019-12-08T12:16:32.341 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:32.278+0000 7fcdffbeaec0 20 rados->read ofs=0 len=0 2019-12-08T12:16:32.349 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:32.286+0000 7fcdffbeaec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:16:32.349 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:32.286+0000 7fcdffbeaec0 20 rados->read ofs=0 len=0 2019-12-08T12:16:32.362 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:32.299+0000 7fcdffbeaec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:16:32.362 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:32.299+0000 7fcdffbeaec0 20 rados->read ofs=0 len=0 2019-12-08T12:16:32.380 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:32.317+0000 7fcdffbeaec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-08T12:16:32.380 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:32.317+0000 7fcdffbeaec0 20 zone default found 2019-12-08T12:16:32.380 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:32.317+0000 7fcdffbeaec0 20 started sync module instance, tier type = 2019-12-08T12:16:32.381 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:32.317+0000 7fcdffbeaec0 20 started zone id=f8ab349b-4577-410d-b524-4ecaf50bb1bd (name=default) with tier type = 2019-12-08T12:16:32.770 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:32.708+0000 7fcdffbeaec0 20 add_watcher() i=0 2019-12-08T12:16:32.771 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:32.708+0000 7fcdffbeaec0 20 add_watcher() i=1 2019-12-08T12:16:32.771 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:32.708+0000 7fcdffbeaec0 20 add_watcher() i=2 2019-12-08T12:16:32.771 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:32.708+0000 7fcdffbeaec0 20 add_watcher() i=3 2019-12-08T12:16:32.771 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:32.708+0000 7fcdffbeaec0 20 add_watcher() i=4 2019-12-08T12:16:32.771 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:32.708+0000 7fcdffbeaec0 20 add_watcher() i=5 2019-12-08T12:16:32.775 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:32.713+0000 7fcdffbeaec0 20 add_watcher() i=6 2019-12-08T12:16:32.800 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:32.738+0000 7fcdffbeaec0 20 add_watcher() i=7 2019-12-08T12:16:32.801 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:32.738+0000 7fcdffbeaec0 2 all 8 watchers are set, enabling cache 2019-12-08T12:16:32.801 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:32.738+0000 7fcd3ffff700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-08T12:16:32.807 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:32.745+0000 7fcded615700 0 -- 172.21.15.79:0/3740882777 >> v2:172.21.15.79:3300/0 conn(0x559f5dcc1940 msgr2=0x559f5dcc1d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-12-08T12:16:32.836 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:32.774+0000 7fcde7fff700 0 -- 172.21.15.79:0/4169708385 >> [v2:172.21.15.13:3300/0,v1:172.21.15.13:6789/0] conn(0x7fcd2c002260 msgr2=0x7fcd2c002670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-08T12:16:34.378 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:34.311+0000 7fcd2a7fc700 20 reqs_thread_entry: start 2019-12-08T12:16:34.378 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:34.312+0000 7fcd23fff700 20 reqs_thread_entry: start 2019-12-08T12:16:34.378 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:34.312+0000 7fcdffbeaec0 20 init_complete bucket index max shards: 0 2019-12-08T12:16:34.378 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:34.313+0000 7fcd227fc700 20 reqs_thread_entry: start 2019-12-08T12:16:34.379 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:34.313+0000 7fcdffbeaec0 20 get_system_obj_state: rctx=0x7ffc45d77208 obj=default.rgw.meta:users.uid:sysuser.client.0 state=0x559f5dd3a350 s->prefetch_data=0 2019-12-08T12:16:34.379 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:34.313+0000 7fcdffbeaec0 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2019-12-08T12:16:34.400 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:34.337+0000 7fcdffbeaec0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x16 2019-12-08T12:16:34.400 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:34.337+0000 7fcdffbeaec0 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2019-12-08T12:16:34.400 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:34.337+0000 7fcdffbeaec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-08T12:16:34.401 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:34.337+0000 7fcdffbeaec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-08T12:16:34.401 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:34.337+0000 7fcdffbeaec0 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : type miss (requested=0x11, cached=0x16) 2019-12-08T12:16:34.401 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:34.337+0000 7fcdffbeaec0 20 rados->read ofs=0 len=0 2019-12-08T12:16:34.428 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:34.365+0000 7fcdffbeaec0 20 rados_obj.operate() r=0 bl.length=448 2019-12-08T12:16:34.428 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:34.365+0000 7fcdffbeaec0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x11 2019-12-08T12:16:34.428 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:34.365+0000 7fcdffbeaec0 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2019-12-08T12:16:34.442 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:34.379+0000 7fcdffbeaec0 10 removing key index: ESGEUHOKGRNMAKPDFIOK 2019-12-08T12:16:34.442 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:34.379+0000 7fcdffbeaec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=170 2019-12-08T12:16:34.469 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:34.405+0000 7fcdddffb700 10 RGWWatcher::handle_notify() notify_id 571230650370 cookie 94142961763664 notifier 4741 bl.length()=170 2019-12-08T12:16:35.250 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:35.187+0000 7fcdffbeaec0 10 removing email index: sysuser.client.0+test@test.test 2019-12-08T12:16:35.250 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:35.187+0000 7fcdffbeaec0 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=182 2019-12-08T12:16:35.271 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:35.208+0000 7fcdddffb700 10 RGWWatcher::handle_notify() notify_id 571230650372 cookie 94142961758176 notifier 4741 bl.length()=182 2019-12-08T12:16:35.512 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:35.449+0000 7fcdffbeaec0 10 removing user buckets index 2019-12-08T12:16:35.512 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:35.449+0000 7fcdffbeaec0 10 distributing notification oid=default.rgw.control:notify.3 bl.length()=173 2019-12-08T12:16:35.556 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:35.493+0000 7fcdddffb700 10 RGWWatcher::handle_notify() notify_id 571230650368 cookie 94142961760000 notifier 4741 bl.length()=173 2019-12-08T12:16:35.695 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:35.632+0000 7fcdffbeaec0 10 removing user index: sysuser.client.0 2019-12-08T12:16:35.695 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:35.632+0000 7fcdffbeaec0 10 removing default.rgw.meta+users.uid+sysuser.client.0 from cache 2019-12-08T12:16:35.695 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:35.632+0000 7fcdffbeaec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=165 2019-12-08T12:16:35.710 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:35.647+0000 7fcdddffb700 10 RGWWatcher::handle_notify() notify_id 571230650373 cookie 94142961756384 notifier 4741 bl.length()=165 2019-12-08T12:16:36.030 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:35.967+0000 7fcdffbeaec0 20 remove_watcher() i=0 2019-12-08T12:16:36.030 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:35.967+0000 7fcdffbeaec0 2 removed watcher, disabling cache 2019-12-08T12:16:36.076 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:36.013+0000 7fcdffbeaec0 20 remove_watcher() i=1 2019-12-08T12:16:36.127 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:36.064+0000 7fcdffbeaec0 20 remove_watcher() i=2 2019-12-08T12:16:36.196 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:36.133+0000 7fcdffbeaec0 20 remove_watcher() i=3 2019-12-08T12:16:36.241 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:36.178+0000 7fcdffbeaec0 20 remove_watcher() i=4 2019-12-08T12:16:36.299 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:36.236+0000 7fcdffbeaec0 20 remove_watcher() i=5 2019-12-08T12:16:36.354 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:36.291+0000 7fcdffbeaec0 20 remove_watcher() i=6 2019-12-08T12:16:36.403 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:36.340+0000 7fcdffbeaec0 20 remove_watcher() i=7 2019-12-08T12:16:36.412 INFO:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid ragweed.client.0 --purge-data 2019-12-08T12:16:36.561 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:36.498+0000 7f7ede88fec0 20 rados->read ofs=0 len=0 2019-12-08T12:16:36.598 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:36.535+0000 7f7ede88fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:16:36.599 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:36.535+0000 7f7ede88fec0 20 rados->read ofs=0 len=0 2019-12-08T12:16:36.605 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:36.542+0000 7f7ede88fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:16:36.605 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:36.542+0000 7f7ede88fec0 20 rados->read ofs=0 len=0 2019-12-08T12:16:36.611 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:36.548+0000 7f7ede88fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:16:36.611 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:36.548+0000 7f7ede88fec0 20 rados->read ofs=0 len=0 2019-12-08T12:16:36.625 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:36.562+0000 7f7ede88fec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:16:36.791 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:36.728+0000 7f7ede88fec0 20 RGWRados::pool_iterate: got zonegroup_info.fee0148b-7ae2-4cf0-a79e-86045a29cb7c 2019-12-08T12:16:36.792 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:36.728+0000 7f7ede88fec0 20 RGWRados::pool_iterate: got zone_info.f8ab349b-4577-410d-b524-4ecaf50bb1bd 2019-12-08T12:16:36.792 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:36.728+0000 7f7ede88fec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-08T12:16:36.792 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:36.728+0000 7f7ede88fec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-08T12:16:36.792 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:36.728+0000 7f7ede88fec0 20 rados->read ofs=0 len=0 2019-12-08T12:16:36.806 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:36.742+0000 7f7ede88fec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:16:36.806 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:36.742+0000 7f7ede88fec0 20 rados->read ofs=0 len=0 2019-12-08T12:16:36.817 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:36.754+0000 7f7ede88fec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-08T12:16:36.818 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:36.754+0000 7f7ede88fec0 20 rados->read ofs=0 len=0 2019-12-08T12:16:36.828 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:36.765+0000 7f7ede88fec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:16:36.828 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:36.765+0000 7f7ede88fec0 20 rados->read ofs=0 len=0 2019-12-08T12:16:36.838 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:36.774+0000 7f7ede88fec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-08T12:16:36.838 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:36.774+0000 7f7ede88fec0 20 rados->read ofs=0 len=0 2019-12-08T12:16:36.846 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:36.783+0000 7f7ede88fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:16:36.846 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:36.783+0000 7f7ede88fec0 10 cannot find current period zonegroup using local zonegroup 2019-12-08T12:16:36.847 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:36.783+0000 7f7ede88fec0 20 rados->read ofs=0 len=0 2019-12-08T12:16:36.858 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:36.795+0000 7f7ede88fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:16:36.859 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:36.795+0000 7f7ede88fec0 20 rados->read ofs=0 len=0 2019-12-08T12:16:36.868 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:36.805+0000 7f7ede88fec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:16:36.869 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:36.805+0000 7f7ede88fec0 20 rados->read ofs=0 len=0 2019-12-08T12:16:36.880 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:36.817+0000 7f7ede88fec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-08T12:16:36.881 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:36.817+0000 7f7ede88fec0 20 zonegroup default 2019-12-08T12:16:36.881 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:36.817+0000 7f7ede88fec0 20 rados->read ofs=0 len=0 2019-12-08T12:16:36.886 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:36.823+0000 7f7ede88fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:16:36.886 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:36.823+0000 7f7ede88fec0 10 Cannot find current period zone using local zone 2019-12-08T12:16:36.886 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:36.823+0000 7f7ede88fec0 20 rados->read ofs=0 len=0 2019-12-08T12:16:36.891 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:36.828+0000 7f7ede88fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:16:36.891 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:36.828+0000 7f7ede88fec0 20 rados->read ofs=0 len=0 2019-12-08T12:16:36.901 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:36.838+0000 7f7ede88fec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:16:36.902 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:36.838+0000 7f7ede88fec0 20 rados->read ofs=0 len=0 2019-12-08T12:16:36.926 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:36.863+0000 7f7ede88fec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-08T12:16:36.927 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:36.863+0000 7f7ede88fec0 20 zone default found 2019-12-08T12:16:36.927 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:36.863+0000 7f7ede88fec0 20 started sync module instance, tier type = 2019-12-08T12:16:36.927 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:36.863+0000 7f7ede88fec0 20 started zone id=f8ab349b-4577-410d-b524-4ecaf50bb1bd (name=default) with tier type = 2019-12-08T12:16:37.343 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:37.280+0000 7f7ede88fec0 20 add_watcher() i=0 2019-12-08T12:16:37.344 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:37.280+0000 7f7ede88fec0 20 add_watcher() i=1 2019-12-08T12:16:37.344 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:37.280+0000 7f7ede88fec0 20 add_watcher() i=2 2019-12-08T12:16:37.344 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:37.280+0000 7f7ede88fec0 20 add_watcher() i=3 2019-12-08T12:16:37.344 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:37.280+0000 7f7ede88fec0 20 add_watcher() i=4 2019-12-08T12:16:37.344 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:37.280+0000 7f7ede88fec0 20 add_watcher() i=5 2019-12-08T12:16:37.344 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:37.280+0000 7f7ede88fec0 20 add_watcher() i=6 2019-12-08T12:16:37.375 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:37.312+0000 7f7ede88fec0 20 add_watcher() i=7 2019-12-08T12:16:37.376 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:37.312+0000 7f7ede88fec0 2 all 8 watchers are set, enabling cache 2019-12-08T12:16:37.376 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:37.312+0000 7f7e1ffff700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-08T12:16:37.378 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:37.315+0000 7f7ecb2b8700 0 -- 172.21.15.79:0/3992048425 >> v2:172.21.15.13:3300/0 conn(0x5588225ffa10 msgr2=0x558822601ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-12-08T12:16:37.420 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:37.357+0000 7f7ecc2ba700 0 -- 172.21.15.79:0/645565343 >> [v2:172.21.15.79:6800/9057,v1:172.21.15.79:6801/9057] conn(0x7f7e0c0252b0 msgr2=0x7f7e0c027740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-12-08T12:16:39.120 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:39.056+0000 7f7e0a7fc700 20 reqs_thread_entry: start 2019-12-08T12:16:39.121 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:39.056+0000 7f7e03fff700 20 reqs_thread_entry: start 2019-12-08T12:16:39.121 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:39.056+0000 7f7ede88fec0 20 init_complete bucket index max shards: 0 2019-12-08T12:16:39.121 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:39.057+0000 7f7e027fc700 20 reqs_thread_entry: start 2019-12-08T12:16:39.121 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:39.057+0000 7f7ede88fec0 20 get_system_obj_state: rctx=0x7ffc112aa218 obj=default.rgw.meta:users.uid:ragweed.client.0 state=0x558822670e70 s->prefetch_data=0 2019-12-08T12:16:39.122 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:39.057+0000 7f7ede88fec0 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2019-12-08T12:16:39.144 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:39.081+0000 7f7ede88fec0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x16 2019-12-08T12:16:39.145 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:39.081+0000 7f7ede88fec0 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2019-12-08T12:16:39.145 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:39.081+0000 7f7ede88fec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-08T12:16:39.145 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:39.081+0000 7f7ede88fec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-08T12:16:39.145 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:39.081+0000 7f7ede88fec0 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : type miss (requested=0x11, cached=0x16) 2019-12-08T12:16:39.146 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:39.081+0000 7f7ede88fec0 20 rados->read ofs=0 len=0 2019-12-08T12:16:39.159 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:39.096+0000 7f7ede88fec0 20 rados_obj.operate() r=0 bl.length=448 2019-12-08T12:16:39.159 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:39.096+0000 7f7ede88fec0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x11 2019-12-08T12:16:39.160 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:39.096+0000 7f7ede88fec0 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2019-12-08T12:16:39.176 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:39.112+0000 7f7ede88fec0 20 get_system_obj_state: rctx=0x7ffc112a9fe0 obj=default.rgw.meta:root:test-client.0-conf state=0x558822672790 s->prefetch_data=0 2019-12-08T12:16:39.176 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:39.112+0000 7f7ede88fec0 10 cache get: name=default.rgw.meta+root+test-client.0-conf : miss 2019-12-08T12:16:39.195 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:39.131+0000 7f7ede88fec0 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x6 2019-12-08T12:16:39.195 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:39.131+0000 7f7ede88fec0 10 adding default.rgw.meta+root+test-client.0-conf to cache LRU end 2019-12-08T12:16:39.195 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:39.131+0000 7f7ede88fec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-08T12:16:39.196 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:39.131+0000 7f7ede88fec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-08T12:16:39.196 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:39.131+0000 7f7ede88fec0 10 cache get: name=default.rgw.meta+root+test-client.0-conf : type miss (requested=0x1, cached=0x6) 2019-12-08T12:16:39.197 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:39.131+0000 7f7ede88fec0 20 rados->read ofs=0 len=0 2019-12-08T12:16:39.205 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:39.141+0000 7f7ede88fec0 20 rados_obj.operate() r=0 bl.length=200 2019-12-08T12:16:39.206 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:39.141+0000 7f7ede88fec0 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x1 2019-12-08T12:16:39.206 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:39.141+0000 7f7ede88fec0 10 moving default.rgw.meta+root+test-client.0-conf to cache LRU end 2019-12-08T12:16:39.206 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:39.141+0000 7f7ede88fec0 20 get_system_obj_state: rctx=0x7ffc112a9fe0 obj=default.rgw.meta:root:.bucket.meta.test-client.0-conf:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.1 state=0x558822676fd0 s->prefetch_data=0 2019-12-08T12:16:39.207 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:39.141+0000 7f7ede88fec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.1 : miss 2019-12-08T12:16:39.242 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:39.178+0000 7f7ede88fec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.1 info.flags=0x16 2019-12-08T12:16:39.242 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:39.178+0000 7f7ede88fec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-conf:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.1 to cache LRU end 2019-12-08T12:16:39.242 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:39.178+0000 7f7ede88fec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-08T12:16:39.243 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:39.178+0000 7f7ede88fec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-08T12:16:39.243 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:39.178+0000 7f7ede88fec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-08T12:16:39.243 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:39.178+0000 7f7ede88fec0 20 Read xattr: user.rgw.acl 2019-12-08T12:16:39.243 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:39.178+0000 7f7ede88fec0 20 Read xattr: user.rgw.idtag 2019-12-08T12:16:39.243 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:39.178+0000 7f7ede88fec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.1 : type miss (requested=0x13, cached=0x16) 2019-12-08T12:16:39.243 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:39.179+0000 7f7ede88fec0 20 rados->read ofs=0 len=0 2019-12-08T12:16:39.265 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:39.202+0000 7f7ede88fec0 20 rados_obj.operate() r=0 bl.length=292 2019-12-08T12:16:39.265 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:39.202+0000 7f7ede88fec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.1 info.flags=0x13 2019-12-08T12:16:39.265 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:39.202+0000 7f7ede88fec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-conf:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.1 to cache LRU end 2019-12-08T12:16:39.266 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:39.202+0000 7f7ede88fec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-08T12:16:39.266 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:39.202+0000 7f7ede88fec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-08T12:16:39.266 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:39.202+0000 7f7ede88fec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-conf:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.1 2019-12-08T12:16:39.293 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:39.229+0000 7f7ede88fec0 10 cls_bucket_list_unordered :test-client.0-conf[f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.1]) start [] num_entries 1100 2019-12-08T12:16:39.340 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:39.272+0000 7f7ede88fec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_multipart_defer_complete[] 2019-12-08T12:16:39.340 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:39.272+0000 7f7ede88fec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_multipart_defer_update_complete[] 2019-12-08T12:16:39.341 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:39.272+0000 7f7ede88fec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_multipart_index_versioning[] 2019-12-08T12:16:39.341 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:39.272+0000 7f7ede88fec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_multipart_simple[] 2019-12-08T12:16:39.341 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:39.272+0000 7f7ede88fec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_obj_storage_class[] 2019-12-08T12:16:39.341 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:39.272+0000 7f7ede88fec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_obj_storage_class_copy[] 2019-12-08T12:16:39.341 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:39.272+0000 7f7ede88fec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart[] 2019-12-08T12:16:39.341 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:39.272+0000 7f7ede88fec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart_copy[] 2019-12-08T12:16:39.341 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:39.272+0000 7f7ede88fec0 10 RGWRados::cls_bucket_list_unordered: got tests/r_test_small_obj_data[] 2019-12-08T12:16:39.342 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:39.272+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x558822679f88 s->prefetch_data=0 2019-12-08T12:16:39.352 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:39.288+0000 7f7ede88fec0 10 manifest: total_size = 3904 2019-12-08T12:16:39.352 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:39.288+0000 7f7ede88fec0 20 get_obj_state: setting s->obj_tag to f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.13 2019-12-08T12:16:39.352 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:39.288+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x558822679f88 s->prefetch_data=0 2019-12-08T12:16:39.352 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:39.288+0000 7f7ede88fec0 20 prepare_atomic_modification: state is not atomic. state=0x558822679f88 2019-12-08T12:16:39.352 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:39.288+0000 7f7ede88fec0 20 bucket index object: default.rgw.buckets.index:.dir.f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.1 2019-12-08T12:16:39.555 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:39.492+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x558822679f88 s->prefetch_data=0 2019-12-08T12:16:39.574 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:39.511+0000 7f7ede88fec0 10 manifest: total_size = 3914 2019-12-08T12:16:39.575 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:39.511+0000 7f7ede88fec0 20 get_obj_state: setting s->obj_tag to f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.30 2019-12-08T12:16:39.575 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:39.511+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x558822679f88 s->prefetch_data=0 2019-12-08T12:16:39.575 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:39.511+0000 7f7ede88fec0 20 prepare_atomic_modification: state is not atomic. state=0x558822679f88 2019-12-08T12:16:39.575 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:39.511+0000 7f7ede88fec0 20 bucket index object: default.rgw.buckets.index:.dir.f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.1 2019-12-08T12:16:39.820 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:39.756+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x558822679f88 s->prefetch_data=0 2019-12-08T12:16:39.835 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:39.771+0000 7f7ede88fec0 10 manifest: total_size = 5697 2019-12-08T12:16:39.835 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:39.771+0000 7f7ede88fec0 20 get_obj_state: setting s->obj_tag to f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.56 2019-12-08T12:16:39.835 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:39.771+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x558822679f88 s->prefetch_data=0 2019-12-08T12:16:39.835 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:39.771+0000 7f7ede88fec0 20 prepare_atomic_modification: state is not atomic. state=0x558822679f88 2019-12-08T12:16:39.835 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:39.771+0000 7f7ede88fec0 20 bucket index object: default.rgw.buckets.index:.dir.f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.1 2019-12-08T12:16:39.994 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:39.931+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x558822679f88 s->prefetch_data=0 2019-12-08T12:16:40.012 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:39.949+0000 7f7ede88fec0 10 manifest: total_size = 5807 2019-12-08T12:16:40.012 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:39.949+0000 7f7ede88fec0 20 get_obj_state: setting s->obj_tag to f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.72 2019-12-08T12:16:40.013 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:39.949+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x558822679f88 s->prefetch_data=0 2019-12-08T12:16:40.013 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:39.949+0000 7f7ede88fec0 20 prepare_atomic_modification: state is not atomic. state=0x558822679f88 2019-12-08T12:16:40.013 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:39.949+0000 7f7ede88fec0 20 bucket index object: default.rgw.buckets.index:.dir.f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.1 2019-12-08T12:16:40.224 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:40.161+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x558822679f88 s->prefetch_data=0 2019-12-08T12:16:40.244 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:40.180+0000 7f7ede88fec0 10 manifest: total_size = 5956 2019-12-08T12:16:40.244 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:40.180+0000 7f7ede88fec0 20 get_obj_state: setting s->obj_tag to f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.87 2019-12-08T12:16:40.244 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:40.180+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x558822679f88 s->prefetch_data=0 2019-12-08T12:16:40.245 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:40.180+0000 7f7ede88fec0 20 prepare_atomic_modification: state is not atomic. state=0x558822679f88 2019-12-08T12:16:40.245 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:40.180+0000 7f7ede88fec0 20 bucket index object: default.rgw.buckets.index:.dir.f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.1 2019-12-08T12:16:40.542 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:40.478+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x558822679f88 s->prefetch_data=0 2019-12-08T12:16:40.556 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:40.493+0000 7f7ede88fec0 10 manifest: total_size = 3981 2019-12-08T12:16:40.557 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:40.493+0000 7f7ede88fec0 20 get_obj_state: setting s->obj_tag to f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.120 2019-12-08T12:16:40.557 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:40.493+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x558822679f88 s->prefetch_data=0 2019-12-08T12:16:40.557 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:40.493+0000 7f7ede88fec0 20 prepare_atomic_modification: state is not atomic. state=0x558822679f88 2019-12-08T12:16:40.557 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:40.493+0000 7f7ede88fec0 20 bucket index object: default.rgw.buckets.index:.dir.f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.1 2019-12-08T12:16:40.757 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:40.694+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x558822679f88 s->prefetch_data=0 2019-12-08T12:16:40.767 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:40.704+0000 7f7ede88fec0 10 manifest: total_size = 6187 2019-12-08T12:16:40.768 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:40.704+0000 7f7ede88fec0 20 get_obj_state: setting s->obj_tag to f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.189 2019-12-08T12:16:40.768 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:40.704+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x558822679f88 s->prefetch_data=0 2019-12-08T12:16:40.768 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:40.704+0000 7f7ede88fec0 20 prepare_atomic_modification: state is not atomic. state=0x558822679f88 2019-12-08T12:16:40.768 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:40.704+0000 7f7ede88fec0 20 bucket index object: default.rgw.buckets.index:.dir.f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.1 2019-12-08T12:16:40.916 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:40.852+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x558822679f88 s->prefetch_data=0 2019-12-08T12:16:40.929 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:40.865+0000 7f7ede88fec0 10 manifest: total_size = 3984 2019-12-08T12:16:40.929 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:40.865+0000 7f7ede88fec0 20 get_obj_state: setting s->obj_tag to f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.246 2019-12-08T12:16:40.929 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:40.865+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x558822679f88 s->prefetch_data=0 2019-12-08T12:16:40.929 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:40.865+0000 7f7ede88fec0 20 prepare_atomic_modification: state is not atomic. state=0x558822679f88 2019-12-08T12:16:40.929 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:40.865+0000 7f7ede88fec0 20 bucket index object: default.rgw.buckets.index:.dir.f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.1 2019-12-08T12:16:41.107 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:41.044+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x558822679f88 s->prefetch_data=0 2019-12-08T12:16:41.129 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:41.065+0000 7f7ede88fec0 10 manifest: total_size = 29155 2019-12-08T12:16:41.129 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:41.065+0000 7f7ede88fec0 20 get_obj_state: setting s->obj_tag to f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.322 2019-12-08T12:16:41.129 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:41.065+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x558822679f88 s->prefetch_data=0 2019-12-08T12:16:41.129 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:41.065+0000 7f7ede88fec0 20 prepare_atomic_modification: state is not atomic. state=0x558822679f88 2019-12-08T12:16:41.130 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:41.065+0000 7f7ede88fec0 20 bucket index object: default.rgw.buckets.index:.dir.f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.1 2019-12-08T12:16:41.283 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:41.219+0000 7f7ede88fec0 10 cls_bucket_list_ordered :test-client.0-conf[f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.1]) start _multipart_[] num_entries 1001 2019-12-08T12:16:41.283 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:41.219+0000 7f7ede88fec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-12-08T12:16:41.341 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:41.277+0000 7f7ede88fec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-conf[f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.1])"; objs.size()=0; is_truncated=0 2019-12-08T12:16:41.407 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:41.343+0000 7f7ede88fec0 20 get_system_obj_state: rctx=0x7ffc112a9998 obj=default.rgw.meta:root:test-client.0-conf state=0x55882267a970 s->prefetch_data=0 2019-12-08T12:16:41.407 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:41.343+0000 7f7ede88fec0 10 cache get: name=default.rgw.meta+root+test-client.0-conf : type miss (requested=0x16, cached=0x3) 2019-12-08T12:16:41.422 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:41.359+0000 7f7ede88fec0 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x16 2019-12-08T12:16:41.423 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:41.359+0000 7f7ede88fec0 10 moving default.rgw.meta+root+test-client.0-conf to cache LRU end 2019-12-08T12:16:41.423 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:41.359+0000 7f7ede88fec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-08T12:16:41.423 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:41.359+0000 7f7ede88fec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-08T12:16:41.424 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:41.359+0000 7f7ede88fec0 10 cache get: name=default.rgw.meta+root+test-client.0-conf : hit (requested=0x11, cached=0x17) 2019-12-08T12:16:41.424 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:41.359+0000 7f7ede88fec0 10 removing default.rgw.meta+root+test-client.0-conf from cache 2019-12-08T12:16:41.424 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:41.359+0000 7f7ede88fec0 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=162 2019-12-08T12:16:41.439 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:41.375+0000 7f7ec17fa700 10 RGWWatcher::handle_notify() notify_id 571230650369 cookie 94043180523120 notifier 4457 bl.length()=162 2019-12-08T12:16:41.995 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:41.932+0000 7f7ede88fec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-conf:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.1 from cache 2019-12-08T12:16:41.995 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:41.932+0000 7f7ede88fec0 10 distributing notification oid=default.rgw.control:notify.3 bl.length()=219 2019-12-08T12:16:42.006 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:41.943+0000 7f7ec17fa700 10 RGWWatcher::handle_notify() notify_id 571230650369 cookie 94043180531216 notifier 4457 bl.length()=219 2019-12-08T12:16:42.777 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:42.714+0000 7f7ede88fec0 20 get_system_obj_state: rctx=0x7ffc112a9fe0 obj=default.rgw.meta:root:test-client.0-r-test-multipart-defer-complete.1 state=0x558822672790 s->prefetch_data=0 2019-12-08T12:16:42.778 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:42.714+0000 7f7ede88fec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : miss 2019-12-08T12:16:42.793 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:42.729+0000 7f7ede88fec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x6 2019-12-08T12:16:42.793 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:42.729+0000 7f7ede88fec0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2019-12-08T12:16:42.793 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:42.729+0000 7f7ede88fec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-08T12:16:42.793 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:42.729+0000 7f7ede88fec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-08T12:16:42.793 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:42.729+0000 7f7ede88fec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : type miss (requested=0x1, cached=0x6) 2019-12-08T12:16:42.794 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:42.729+0000 7f7ede88fec0 20 rados->read ofs=0 len=0 2019-12-08T12:16:42.811 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:42.747+0000 7f7ede88fec0 20 rados_obj.operate() r=0 bl.length=229 2019-12-08T12:16:42.811 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:42.747+0000 7f7ede88fec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x1 2019-12-08T12:16:42.811 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:42.747+0000 7f7ede88fec0 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2019-12-08T12:16:42.812 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:42.747+0000 7f7ede88fec0 20 get_system_obj_state: rctx=0x7ffc112a9fe0 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.2 state=0x558822674920 s->prefetch_data=0 2019-12-08T12:16:42.812 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:42.747+0000 7f7ede88fec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.2 : miss 2019-12-08T12:16:42.855 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:42.791+0000 7f7ede88fec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.2 info.flags=0x16 2019-12-08T12:16:42.855 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:42.791+0000 7f7ede88fec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.2 to cache LRU end 2019-12-08T12:16:42.855 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:42.791+0000 7f7ede88fec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-08T12:16:42.855 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:42.791+0000 7f7ede88fec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-08T12:16:42.856 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:42.791+0000 7f7ede88fec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-08T12:16:42.856 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:42.791+0000 7f7ede88fec0 20 Read xattr: user.rgw.acl 2019-12-08T12:16:42.856 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:42.791+0000 7f7ede88fec0 20 Read xattr: user.rgw.idtag 2019-12-08T12:16:42.856 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:42.791+0000 7f7ede88fec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.2 : type miss (requested=0x13, cached=0x16) 2019-12-08T12:16:42.856 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:42.791+0000 7f7ede88fec0 20 rados->read ofs=0 len=0 2019-12-08T12:16:42.880 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:42.816+0000 7f7ede88fec0 20 rados_obj.operate() r=0 bl.length=321 2019-12-08T12:16:42.881 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:42.816+0000 7f7ede88fec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.2 info.flags=0x13 2019-12-08T12:16:42.881 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:42.816+0000 7f7ede88fec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.2 to cache LRU end 2019-12-08T12:16:42.881 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:42.816+0000 7f7ede88fec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-08T12:16:42.881 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:42.816+0000 7f7ede88fec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-08T12:16:42.882 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:42.816+0000 7f7ede88fec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.2 2019-12-08T12:16:42.896 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:42.832+0000 7f7ede88fec0 10 cls_bucket_list_unordered :test-client.0-r-test-multipart-defer-complete.1[f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.2]) start [] num_entries 1100 2019-12-08T12:16:42.919 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:42.856+0000 7f7ede88fec0 10 RGWRados::cls_bucket_list_unordered: got foo[] 2019-12-08T12:16:42.920 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:42.856+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x55882267b078 s->prefetch_data=0 2019-12-08T12:16:42.931 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:42.867+0000 7f7ede88fec0 10 manifest: total_size = 1848 2019-12-08T12:16:42.931 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:42.867+0000 7f7ede88fec0 20 get_obj_state: setting s->obj_tag to f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.20 2019-12-08T12:16:42.931 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:42.867+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x55882267b078 s->prefetch_data=0 2019-12-08T12:16:42.931 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:42.867+0000 7f7ede88fec0 20 prepare_atomic_modification: state is not atomic. state=0x55882267b078 2019-12-08T12:16:42.931 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:42.867+0000 7f7ede88fec0 20 bucket index object: default.rgw.buckets.index:.dir.f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.2 2019-12-08T12:16:43.066 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:43.002+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=515 rules.size()=2 2019-12-08T12:16:43.066 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:43.002+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): stripe_ofs=4190208 part_ofs=0 rule->part_size=515 2019-12-08T12:16:43.067 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:43.002+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=515 stripe_ofs=515 part_ofs=515 rule->part_size=515 2019-12-08T12:16:43.067 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:43.002+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=515 rules.size()=2 2019-12-08T12:16:43.067 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:43.002+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): stripe_ofs=4190723 part_ofs=515 rule->part_size=515 2019-12-08T12:16:43.067 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:43.002+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=1030 stripe_ofs=1030 part_ofs=1030 rule->part_size=515 2019-12-08T12:16:43.067 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:43.002+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=515 rules.size()=2 2019-12-08T12:16:43.067 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:43.002+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): stripe_ofs=4191238 part_ofs=1030 rule->part_size=515 2019-12-08T12:16:43.067 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:43.002+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=1545 stripe_ofs=1545 part_ofs=1545 rule->part_size=303 2019-12-08T12:16:43.068 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:43.002+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=303 rules.size()=2 2019-12-08T12:16:43.068 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:43.002+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): stripe_ofs=4191753 part_ofs=1545 rule->part_size=303 2019-12-08T12:16:43.068 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:43.002+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=1848 stripe_ofs=1848 part_ofs=1848 rule->part_size=303 2019-12-08T12:16:43.068 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:43.002+0000 7f7ede88fec0 20 garbage collection: RGWGC::send_chain - on object name: gc.24tag is: f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.20 2019-12-08T12:16:43.140 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:43.077+0000 7f7ede88fec0 10 cls_bucket_list_ordered :test-client.0-r-test-multipart-defer-complete.1[f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.2]) start _multipart_[] num_entries 1001 2019-12-08T12:16:43.140 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:43.077+0000 7f7ede88fec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-12-08T12:16:43.149 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:43.086+0000 7f7ede88fec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-complete.1[f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.2])"; objs.size()=0; is_truncated=0 2019-12-08T12:16:43.202 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:43.138+0000 7f7ede88fec0 20 get_system_obj_state: rctx=0x7ffc112a9998 obj=default.rgw.meta:root:test-client.0-r-test-multipart-defer-complete.1 state=0x558822674920 s->prefetch_data=0 2019-12-08T12:16:43.202 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:43.138+0000 7f7ede88fec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : type miss (requested=0x16, cached=0x3) 2019-12-08T12:16:43.212 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:43.148+0000 7f7ede88fec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x16 2019-12-08T12:16:43.212 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:43.148+0000 7f7ede88fec0 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2019-12-08T12:16:43.212 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:43.148+0000 7f7ede88fec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-08T12:16:43.212 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:43.148+0000 7f7ede88fec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-08T12:16:43.212 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:43.148+0000 7f7ede88fec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : hit (requested=0x11, cached=0x17) 2019-12-08T12:16:43.212 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:43.148+0000 7f7ede88fec0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 from cache 2019-12-08T12:16:43.213 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:43.148+0000 7f7ede88fec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=191 2019-12-08T12:16:43.223 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:43.159+0000 7f7ec17fa700 10 RGWWatcher::handle_notify() notify_id 571230650371 cookie 94043180526416 notifier 4457 bl.length()=191 2019-12-08T12:16:43.513 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:43.449+0000 7f7ede88fec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.2 from cache 2019-12-08T12:16:43.514 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:43.449+0000 7f7ede88fec0 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=248 2019-12-08T12:16:43.546 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:43.481+0000 7f7ec17fa700 10 RGWWatcher::handle_notify() notify_id 571230650368 cookie 94043180538672 notifier 4457 bl.length()=248 2019-12-08T12:16:44.043 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:43.979+0000 7f7ede88fec0 20 get_system_obj_state: rctx=0x7ffc112a9fe0 obj=default.rgw.meta:root:test-client.0-r-test-multipart-defer-update-complete.1 state=0x558822672790 s->prefetch_data=0 2019-12-08T12:16:44.043 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:43.980+0000 7f7ede88fec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : miss 2019-12-08T12:16:44.065 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:44.001+0000 7f7ede88fec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x6 2019-12-08T12:16:44.065 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:44.001+0000 7f7ede88fec0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2019-12-08T12:16:44.066 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:44.001+0000 7f7ede88fec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-08T12:16:44.066 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:44.001+0000 7f7ede88fec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-08T12:16:44.066 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:44.001+0000 7f7ede88fec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : type miss (requested=0x1, cached=0x6) 2019-12-08T12:16:44.066 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:44.001+0000 7f7ede88fec0 20 rados->read ofs=0 len=0 2019-12-08T12:16:44.083 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:44.019+0000 7f7ede88fec0 20 rados_obj.operate() r=0 bl.length=236 2019-12-08T12:16:44.083 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:44.019+0000 7f7ede88fec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x1 2019-12-08T12:16:44.083 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:44.019+0000 7f7ede88fec0 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2019-12-08T12:16:44.083 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:44.019+0000 7f7ede88fec0 20 get_system_obj_state: rctx=0x7ffc112a9fe0 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.3 state=0x558822676fd0 s->prefetch_data=0 2019-12-08T12:16:44.084 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:44.019+0000 7f7ede88fec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.3 : miss 2019-12-08T12:16:44.107 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:44.043+0000 7f7ede88fec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.3 info.flags=0x16 2019-12-08T12:16:44.107 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:44.043+0000 7f7ede88fec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.3 to cache LRU end 2019-12-08T12:16:44.107 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:44.043+0000 7f7ede88fec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-08T12:16:44.107 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:44.043+0000 7f7ede88fec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-08T12:16:44.107 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:44.043+0000 7f7ede88fec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-08T12:16:44.108 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:44.043+0000 7f7ede88fec0 20 Read xattr: user.rgw.acl 2019-12-08T12:16:44.108 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:44.043+0000 7f7ede88fec0 20 Read xattr: user.rgw.idtag 2019-12-08T12:16:44.108 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:44.043+0000 7f7ede88fec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.3 : type miss (requested=0x13, cached=0x16) 2019-12-08T12:16:44.108 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:44.043+0000 7f7ede88fec0 20 rados->read ofs=0 len=0 2019-12-08T12:16:44.130 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:44.066+0000 7f7ede88fec0 20 rados_obj.operate() r=0 bl.length=328 2019-12-08T12:16:44.130 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:44.066+0000 7f7ede88fec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.3 info.flags=0x13 2019-12-08T12:16:44.130 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:44.066+0000 7f7ede88fec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.3 to cache LRU end 2019-12-08T12:16:44.131 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:44.066+0000 7f7ede88fec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-08T12:16:44.131 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:44.066+0000 7f7ede88fec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-08T12:16:44.131 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:44.066+0000 7f7ede88fec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.3 2019-12-08T12:16:44.145 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:44.082+0000 7f7ede88fec0 10 cls_bucket_list_unordered :test-client.0-r-test-multipart-defer-update-complete.1[f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.3]) start [] num_entries 1100 2019-12-08T12:16:44.163 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:44.100+0000 7f7ede88fec0 10 RGWRados::cls_bucket_list_unordered: got foo[] 2019-12-08T12:16:44.164 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:44.100+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x558822679ef8 s->prefetch_data=0 2019-12-08T12:16:44.179 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:44.115+0000 7f7ede88fec0 10 manifest: total_size = 886297 2019-12-08T12:16:44.179 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:44.115+0000 7f7ede88fec0 20 get_obj_state: setting s->obj_tag to f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.40 2019-12-08T12:16:44.179 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:44.115+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x558822679ef8 s->prefetch_data=0 2019-12-08T12:16:44.180 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:44.115+0000 7f7ede88fec0 20 prepare_atomic_modification: state is not atomic. state=0x558822679ef8 2019-12-08T12:16:44.180 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:44.115+0000 7f7ede88fec0 20 bucket index object: default.rgw.buckets.index:.dir.f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.3 2019-12-08T12:16:44.356 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:44.292+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2019-12-08T12:16:44.356 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:44.292+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): stripe_ofs=4190208 part_ofs=0 rule->part_size=246247 2019-12-08T12:16:44.356 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:44.292+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2019-12-08T12:16:44.357 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:44.292+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2019-12-08T12:16:44.357 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:44.292+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): stripe_ofs=4436455 part_ofs=246247 rule->part_size=246247 2019-12-08T12:16:44.357 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:44.292+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=246247 2019-12-08T12:16:44.357 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:44.292+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2019-12-08T12:16:44.357 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:44.292+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): stripe_ofs=4682702 part_ofs=492494 rule->part_size=246247 2019-12-08T12:16:44.357 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:44.292+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=738741 stripe_ofs=738741 part_ofs=738741 rule->part_size=147556 2019-12-08T12:16:44.358 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:44.292+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=147556 rules.size()=2 2019-12-08T12:16:44.358 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:44.292+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): stripe_ofs=4928949 part_ofs=738741 rule->part_size=147556 2019-12-08T12:16:44.358 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:44.292+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=886297 stripe_ofs=886297 part_ofs=886297 rule->part_size=147556 2019-12-08T12:16:44.358 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:44.292+0000 7f7ede88fec0 20 garbage collection: RGWGC::send_chain - on object name: gc.26tag is: f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.40 2019-12-08T12:16:44.459 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:44.395+0000 7f7ede88fec0 10 cls_bucket_list_ordered :test-client.0-r-test-multipart-defer-update-complete.1[f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.3]) start _multipart_[] num_entries 1001 2019-12-08T12:16:44.459 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:44.395+0000 7f7ede88fec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-12-08T12:16:44.473 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:44.410+0000 7f7ede88fec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-update-complete.1[f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.3])"; objs.size()=0; is_truncated=0 2019-12-08T12:16:44.583 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:44.519+0000 7f7ede88fec0 20 get_system_obj_state: rctx=0x7ffc112a9998 obj=default.rgw.meta:root:test-client.0-r-test-multipart-defer-update-complete.1 state=0x558822676fd0 s->prefetch_data=0 2019-12-08T12:16:44.583 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:44.519+0000 7f7ede88fec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : type miss (requested=0x16, cached=0x3) 2019-12-08T12:16:44.606 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:44.542+0000 7f7ede88fec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x16 2019-12-08T12:16:44.606 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:44.542+0000 7f7ede88fec0 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2019-12-08T12:16:44.606 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:44.542+0000 7f7ede88fec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-08T12:16:44.606 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:44.542+0000 7f7ede88fec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-08T12:16:44.606 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:44.542+0000 7f7ede88fec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : hit (requested=0x11, cached=0x17) 2019-12-08T12:16:44.607 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:44.542+0000 7f7ede88fec0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 from cache 2019-12-08T12:16:44.607 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:44.542+0000 7f7ede88fec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=198 2019-12-08T12:16:44.621 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:44.558+0000 7f7ec17fa700 10 RGWWatcher::handle_notify() notify_id 571230650374 cookie 94043180528320 notifier 4457 bl.length()=198 2019-12-08T12:16:44.908 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:44.843+0000 7f7ede88fec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.3 from cache 2019-12-08T12:16:44.908 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:44.843+0000 7f7ede88fec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=255 2019-12-08T12:16:44.920 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:44.857+0000 7f7ec17fa700 10 RGWWatcher::handle_notify() notify_id 571230650372 cookie 94043180537696 notifier 4457 bl.length()=255 2019-12-08T12:16:45.428 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:45.364+0000 7f7ede88fec0 20 get_system_obj_state: rctx=0x7ffc112a9fe0 obj=default.rgw.meta:root:test-client.0-r-test-multipart-index-versioning.1 state=0x558822674920 s->prefetch_data=0 2019-12-08T12:16:45.428 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:45.364+0000 7f7ede88fec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : miss 2019-12-08T12:16:45.442 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:45.378+0000 7f7ede88fec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x6 2019-12-08T12:16:45.442 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:45.378+0000 7f7ede88fec0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2019-12-08T12:16:45.443 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:45.378+0000 7f7ede88fec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-08T12:16:45.443 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:45.378+0000 7f7ede88fec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-08T12:16:45.443 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:45.378+0000 7f7ede88fec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : type miss (requested=0x1, cached=0x6) 2019-12-08T12:16:45.443 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:45.378+0000 7f7ede88fec0 20 rados->read ofs=0 len=0 2019-12-08T12:16:45.457 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:45.393+0000 7f7ede88fec0 20 rados_obj.operate() r=0 bl.length=231 2019-12-08T12:16:45.457 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:45.393+0000 7f7ede88fec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x1 2019-12-08T12:16:45.457 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:45.393+0000 7f7ede88fec0 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2019-12-08T12:16:45.457 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:45.393+0000 7f7ede88fec0 20 get_system_obj_state: rctx=0x7ffc112a9fe0 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.4 state=0x558822672790 s->prefetch_data=0 2019-12-08T12:16:45.457 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:45.393+0000 7f7ede88fec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.4 : miss 2019-12-08T12:16:45.510 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:45.446+0000 7f7ede88fec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.4 info.flags=0x16 2019-12-08T12:16:45.510 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:45.446+0000 7f7ede88fec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.4 to cache LRU end 2019-12-08T12:16:45.510 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:45.446+0000 7f7ede88fec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-08T12:16:45.510 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:45.446+0000 7f7ede88fec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-08T12:16:45.511 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:45.446+0000 7f7ede88fec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-08T12:16:45.511 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:45.446+0000 7f7ede88fec0 20 Read xattr: user.rgw.acl 2019-12-08T12:16:45.511 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:45.446+0000 7f7ede88fec0 20 Read xattr: user.rgw.idtag 2019-12-08T12:16:45.511 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:45.446+0000 7f7ede88fec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.4 : type miss (requested=0x13, cached=0x16) 2019-12-08T12:16:45.511 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:45.446+0000 7f7ede88fec0 20 rados->read ofs=0 len=0 2019-12-08T12:16:45.555 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:45.491+0000 7f7ede88fec0 20 rados_obj.operate() r=0 bl.length=323 2019-12-08T12:16:45.556 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:45.492+0000 7f7ede88fec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.4 info.flags=0x13 2019-12-08T12:16:45.556 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:45.492+0000 7f7ede88fec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.4 to cache LRU end 2019-12-08T12:16:45.556 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:45.492+0000 7f7ede88fec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-08T12:16:45.556 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:45.492+0000 7f7ede88fec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-08T12:16:45.556 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:45.492+0000 7f7ede88fec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.4 2019-12-08T12:16:45.574 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:45.510+0000 7f7ede88fec0 10 cls_bucket_list_unordered :test-client.0-r-test-multipart-index-versioning.1[f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.4]) start [] num_entries 1100 2019-12-08T12:16:45.605 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:45.542+0000 7f7ede88fec0 10 RGWRados::cls_bucket_list_unordered: got foo[.UdLtcHFDGu4fwx5gib-Wff89omz5u5] 2019-12-08T12:16:45.606 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:45.542+0000 7f7ede88fec0 20 bucket index object: default.rgw.buckets.index:.dir.f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.4 2019-12-08T12:16:45.627 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:45.564+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x558822679ef8 s->prefetch_data=0 2019-12-08T12:16:45.640 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:45.576+0000 7f7ede88fec0 20 get_obj_state: setting s->obj_tag to zanok0re8pwk4hcs5crw4z52wh8t462q 2019-12-08T12:16:45.640 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:45.576+0000 7f7ede88fec0 20 get_obj_state_impl: setting s->olh_tag to ymam2jxythdx37px3mbs4hyj1c6n6af5 2019-12-08T12:16:45.640 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:45.576+0000 7f7ede88fec0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=ymam2jxythdx37px3mbs4hyj1c6n6af5 2019-12-08T12:16:45.713 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:45.649+0000 7f7ede88fec0 20 bucket index object: default.rgw.buckets.index:.dir.f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.4 2019-12-08T12:16:45.788 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:45.724+0000 7f7ede88fec0 20 bucket index object: default.rgw.buckets.index:.dir.f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.4 2019-12-08T12:16:45.788 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:45.724+0000 7f7ede88fec0 20 bucket index object: default.rgw.buckets.index:.dir.f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.4 2019-12-08T12:16:45.801 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:45.737+0000 7f7ede88fec0 20 olh_log_entry: epoch=3 op=2 key=[] 2019-12-08T12:16:45.801 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:45.737+0000 7f7ede88fec0 20 olh_log_entry: epoch=3 op=3 key=foo[.UdLtcHFDGu4fwx5gib-Wff89omz5u5] 2019-12-08T12:16:45.801 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:45.737+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-multipart-index-versioning.1:_:.UdLtcHFDGu4fwx5gib-Wff89omz5u5_foo state=0x558822686e78 s->prefetch_data=0 2019-12-08T12:16:45.810 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:45.746+0000 7f7ede88fec0 10 manifest: total_size = 886297 2019-12-08T12:16:45.810 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:45.746+0000 7f7ede88fec0 20 get_obj_state: setting s->obj_tag to f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.55 2019-12-08T12:16:45.810 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:45.746+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-multipart-index-versioning.1:_:.UdLtcHFDGu4fwx5gib-Wff89omz5u5_foo state=0x558822686e78 s->prefetch_data=0 2019-12-08T12:16:45.810 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:45.746+0000 7f7ede88fec0 20 prepare_atomic_modification: state is not atomic. state=0x558822686e78 2019-12-08T12:16:45.811 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:45.746+0000 7f7ede88fec0 20 bucket index object: default.rgw.buckets.index:.dir.f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.4 2019-12-08T12:16:45.954 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:45.890+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2019-12-08T12:16:45.954 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:45.890+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): stripe_ofs=4190208 part_ofs=0 rule->part_size=246247 2019-12-08T12:16:45.954 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:45.890+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2019-12-08T12:16:45.954 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:45.890+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2019-12-08T12:16:45.954 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:45.890+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): stripe_ofs=4436455 part_ofs=246247 rule->part_size=246247 2019-12-08T12:16:45.955 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:45.890+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=246247 2019-12-08T12:16:45.955 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:45.890+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2019-12-08T12:16:45.955 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:45.890+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): stripe_ofs=4682702 part_ofs=492494 rule->part_size=246247 2019-12-08T12:16:45.955 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:45.890+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=738741 stripe_ofs=738741 part_ofs=738741 rule->part_size=147556 2019-12-08T12:16:45.955 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:45.890+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=147556 rules.size()=2 2019-12-08T12:16:45.955 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:45.890+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): stripe_ofs=4928949 part_ofs=738741 rule->part_size=147556 2019-12-08T12:16:45.955 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:45.890+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=886297 stripe_ofs=886297 part_ofs=886297 rule->part_size=147556 2019-12-08T12:16:45.956 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:45.890+0000 7f7ede88fec0 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.55 2019-12-08T12:16:46.084 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:46.021+0000 7f7ede88fec0 20 bucket index object: default.rgw.buckets.index:.dir.f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.4 2019-12-08T12:16:46.085 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:46.021+0000 7f7ede88fec0 20 bucket index object: default.rgw.buckets.index:.dir.f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.4 2019-12-08T12:16:46.207 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:46.143+0000 7f7ede88fec0 20 bucket index object: default.rgw.buckets.index:.dir.f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.4 2019-12-08T12:16:46.257 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:46.193+0000 7f7ede88fec0 20 bucket index object: default.rgw.buckets.index:.dir.f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.4 2019-12-08T12:16:46.257 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:46.193+0000 7f7ede88fec0 10 cls_bucket_list_ordered :test-client.0-r-test-multipart-index-versioning.1[f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.4]) start _multipart_[] num_entries 1001 2019-12-08T12:16:46.257 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:46.193+0000 7f7ede88fec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-12-08T12:16:46.273 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:46.209+0000 7f7ede88fec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-index-versioning.1[f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.4])"; objs.size()=0; is_truncated=0 2019-12-08T12:16:46.318 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:46.254+0000 7f7ede88fec0 20 get_system_obj_state: rctx=0x7ffc112a9998 obj=default.rgw.meta:root:test-client.0-r-test-multipart-index-versioning.1 state=0x558822672790 s->prefetch_data=0 2019-12-08T12:16:46.318 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:46.254+0000 7f7ede88fec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : type miss (requested=0x16, cached=0x3) 2019-12-08T12:16:46.331 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:46.264+0000 7f7ede88fec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x16 2019-12-08T12:16:46.331 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:46.264+0000 7f7ede88fec0 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2019-12-08T12:16:46.331 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:46.264+0000 7f7ede88fec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-08T12:16:46.331 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:46.265+0000 7f7ede88fec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-08T12:16:46.331 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:46.265+0000 7f7ede88fec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : hit (requested=0x11, cached=0x17) 2019-12-08T12:16:46.331 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:46.265+0000 7f7ede88fec0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 from cache 2019-12-08T12:16:46.332 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:46.265+0000 7f7ede88fec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=193 2019-12-08T12:16:46.338 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:46.274+0000 7f7ec17fa700 10 RGWWatcher::handle_notify() notify_id 571230650375 cookie 94043180528320 notifier 4457 bl.length()=193 2019-12-08T12:16:46.840 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:46.776+0000 7f7ede88fec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.4 from cache 2019-12-08T12:16:46.840 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:46.776+0000 7f7ede88fec0 10 distributing notification oid=default.rgw.control:notify.7 bl.length()=250 2019-12-08T12:16:46.857 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:46.793+0000 7f7ec17fa700 10 RGWWatcher::handle_notify() notify_id 571230650370 cookie 94043180539312 notifier 4457 bl.length()=250 2019-12-08T12:16:47.478 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:47.414+0000 7f7ede88fec0 20 get_system_obj_state: rctx=0x7ffc112a9fe0 obj=default.rgw.meta:root:test-client.0-r-test-multipart-simple.1 state=0x558822674920 s->prefetch_data=0 2019-12-08T12:16:47.479 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:47.414+0000 7f7ede88fec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : miss 2019-12-08T12:16:47.505 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:47.441+0000 7f7ede88fec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x6 2019-12-08T12:16:47.505 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:47.441+0000 7f7ede88fec0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2019-12-08T12:16:47.505 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:47.441+0000 7f7ede88fec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-08T12:16:47.505 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:47.441+0000 7f7ede88fec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-08T12:16:47.505 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:47.441+0000 7f7ede88fec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : type miss (requested=0x1, cached=0x6) 2019-12-08T12:16:47.506 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:47.441+0000 7f7ede88fec0 20 rados->read ofs=0 len=0 2019-12-08T12:16:47.522 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:47.457+0000 7f7ede88fec0 20 rados_obj.operate() r=0 bl.length=221 2019-12-08T12:16:47.522 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:47.457+0000 7f7ede88fec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x1 2019-12-08T12:16:47.522 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:47.457+0000 7f7ede88fec0 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2019-12-08T12:16:47.522 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:47.457+0000 7f7ede88fec0 20 get_system_obj_state: rctx=0x7ffc112a9fe0 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-simple.1:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.5 state=0x55882267f4d0 s->prefetch_data=0 2019-12-08T12:16:47.522 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:47.457+0000 7f7ede88fec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.5 : miss 2019-12-08T12:16:47.542 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:47.477+0000 7f7ede88fec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.5 info.flags=0x16 2019-12-08T12:16:47.542 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:47.477+0000 7f7ede88fec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.5 to cache LRU end 2019-12-08T12:16:47.542 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:47.477+0000 7f7ede88fec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-08T12:16:47.542 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:47.477+0000 7f7ede88fec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-08T12:16:47.543 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:47.477+0000 7f7ede88fec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-08T12:16:47.543 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:47.477+0000 7f7ede88fec0 20 Read xattr: user.rgw.acl 2019-12-08T12:16:47.543 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:47.477+0000 7f7ede88fec0 20 Read xattr: user.rgw.idtag 2019-12-08T12:16:47.543 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:47.477+0000 7f7ede88fec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.5 : type miss (requested=0x13, cached=0x16) 2019-12-08T12:16:47.543 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:47.477+0000 7f7ede88fec0 20 rados->read ofs=0 len=0 2019-12-08T12:16:47.571 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:47.507+0000 7f7ede88fec0 20 rados_obj.operate() r=0 bl.length=313 2019-12-08T12:16:47.572 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:47.507+0000 7f7ede88fec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.5 info.flags=0x13 2019-12-08T12:16:47.572 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:47.507+0000 7f7ede88fec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.5 to cache LRU end 2019-12-08T12:16:47.572 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:47.507+0000 7f7ede88fec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-08T12:16:47.572 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:47.507+0000 7f7ede88fec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-08T12:16:47.572 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:47.507+0000 7f7ede88fec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.5 2019-12-08T12:16:47.586 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:47.523+0000 7f7ede88fec0 10 cls_bucket_list_unordered :test-client.0-r-test-multipart-simple.1[f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.5]) start [] num_entries 1100 2019-12-08T12:16:47.607 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:47.543+0000 7f7ede88fec0 10 RGWRados::cls_bucket_list_unordered: got foo[] 2019-12-08T12:16:47.607 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:47.543+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-multipart-simple.1:foo state=0x558822679f98 s->prefetch_data=0 2019-12-08T12:16:47.628 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:47.564+0000 7f7ede88fec0 10 manifest: total_size = 1848 2019-12-08T12:16:47.628 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:47.564+0000 7f7ede88fec0 20 get_obj_state: setting s->obj_tag to f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.71 2019-12-08T12:16:47.628 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:47.564+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-multipart-simple.1:foo state=0x558822679f98 s->prefetch_data=0 2019-12-08T12:16:47.628 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:47.564+0000 7f7ede88fec0 20 prepare_atomic_modification: state is not atomic. state=0x558822679f98 2019-12-08T12:16:47.629 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:47.564+0000 7f7ede88fec0 20 bucket index object: default.rgw.buckets.index:.dir.f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.5 2019-12-08T12:16:47.779 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:47.715+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=515 rules.size()=2 2019-12-08T12:16:47.779 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:47.715+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): stripe_ofs=4190208 part_ofs=0 rule->part_size=515 2019-12-08T12:16:47.780 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:47.715+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=515 stripe_ofs=515 part_ofs=515 rule->part_size=515 2019-12-08T12:16:47.780 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:47.715+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=515 rules.size()=2 2019-12-08T12:16:47.780 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:47.715+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): stripe_ofs=4190723 part_ofs=515 rule->part_size=515 2019-12-08T12:16:47.780 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:47.715+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=1030 stripe_ofs=1030 part_ofs=1030 rule->part_size=515 2019-12-08T12:16:47.780 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:47.715+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=515 rules.size()=2 2019-12-08T12:16:47.781 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:47.715+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): stripe_ofs=4191238 part_ofs=1030 rule->part_size=515 2019-12-08T12:16:47.781 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:47.715+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=1545 stripe_ofs=1545 part_ofs=1545 rule->part_size=303 2019-12-08T12:16:47.781 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:47.715+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=303 rules.size()=2 2019-12-08T12:16:47.781 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:47.715+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): stripe_ofs=4191753 part_ofs=1545 rule->part_size=303 2019-12-08T12:16:47.782 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:47.715+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=1848 stripe_ofs=1848 part_ofs=1848 rule->part_size=303 2019-12-08T12:16:47.782 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:47.715+0000 7f7ede88fec0 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.71 2019-12-08T12:16:47.840 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:47.776+0000 7f7ede88fec0 10 cls_bucket_list_ordered :test-client.0-r-test-multipart-simple.1[f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.5]) start _multipart_[] num_entries 1001 2019-12-08T12:16:47.840 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:47.776+0000 7f7ede88fec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-12-08T12:16:47.850 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:47.786+0000 7f7ede88fec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-simple.1[f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.5])"; objs.size()=0; is_truncated=0 2019-12-08T12:16:47.905 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:47.841+0000 7f7ede88fec0 20 get_system_obj_state: rctx=0x7ffc112a9998 obj=default.rgw.meta:root:test-client.0-r-test-multipart-simple.1 state=0x55882267b0e0 s->prefetch_data=0 2019-12-08T12:16:47.905 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:47.841+0000 7f7ede88fec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : type miss (requested=0x16, cached=0x3) 2019-12-08T12:16:47.918 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:47.852+0000 7f7ede88fec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x16 2019-12-08T12:16:47.919 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:47.853+0000 7f7ede88fec0 10 moving default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2019-12-08T12:16:47.919 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:47.853+0000 7f7ede88fec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-08T12:16:47.919 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:47.853+0000 7f7ede88fec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-08T12:16:47.919 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:47.853+0000 7f7ede88fec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : hit (requested=0x11, cached=0x17) 2019-12-08T12:16:47.919 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:47.853+0000 7f7ede88fec0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 from cache 2019-12-08T12:16:47.919 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:47.853+0000 7f7ede88fec0 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=183 2019-12-08T12:16:47.939 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:47.875+0000 7f7ec17fa700 10 RGWWatcher::handle_notify() notify_id 571230650376 cookie 94043180533312 notifier 4457 bl.length()=183 2019-12-08T12:16:48.240 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:48.176+0000 7f7ede88fec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.5 from cache 2019-12-08T12:16:48.240 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:48.176+0000 7f7ede88fec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=240 2019-12-08T12:16:48.253 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:48.188+0000 7f7ec17fa700 10 RGWWatcher::handle_notify() notify_id 571230650373 cookie 94043180526416 notifier 4457 bl.length()=240 2019-12-08T12:16:48.619 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:48.550+0000 7f7ede88fec0 20 get_system_obj_state: rctx=0x7ffc112a9fe0 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class-copy.1 state=0x558822672790 s->prefetch_data=0 2019-12-08T12:16:48.619 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:48.550+0000 7f7ede88fec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : miss 2019-12-08T12:16:48.636 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:48.572+0000 7f7ede88fec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x6 2019-12-08T12:16:48.636 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:48.572+0000 7f7ede88fec0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2019-12-08T12:16:48.636 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:48.572+0000 7f7ede88fec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-08T12:16:48.636 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:48.572+0000 7f7ede88fec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-08T12:16:48.636 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:48.572+0000 7f7ede88fec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x1, cached=0x6) 2019-12-08T12:16:48.637 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:48.572+0000 7f7ede88fec0 20 rados->read ofs=0 len=0 2019-12-08T12:16:48.653 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:48.589+0000 7f7ede88fec0 20 rados_obj.operate() r=0 bl.length=227 2019-12-08T12:16:48.653 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:48.589+0000 7f7ede88fec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x1 2019-12-08T12:16:48.654 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:48.589+0000 7f7ede88fec0 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2019-12-08T12:16:48.654 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:48.589+0000 7f7ede88fec0 20 get_system_obj_state: rctx=0x7ffc112a9fe0 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.7 state=0x558822674920 s->prefetch_data=0 2019-12-08T12:16:48.654 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:48.589+0000 7f7ede88fec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.7 : miss 2019-12-08T12:16:48.670 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:48.605+0000 7f7ede88fec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.7 info.flags=0x16 2019-12-08T12:16:48.670 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:48.605+0000 7f7ede88fec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.7 to cache LRU end 2019-12-08T12:16:48.670 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:48.605+0000 7f7ede88fec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-08T12:16:48.670 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:48.605+0000 7f7ede88fec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-08T12:16:48.670 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:48.605+0000 7f7ede88fec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-08T12:16:48.670 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:48.605+0000 7f7ede88fec0 20 Read xattr: user.rgw.acl 2019-12-08T12:16:48.671 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:48.605+0000 7f7ede88fec0 20 Read xattr: user.rgw.idtag 2019-12-08T12:16:48.671 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:48.605+0000 7f7ede88fec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.7 : type miss (requested=0x13, cached=0x16) 2019-12-08T12:16:48.671 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:48.605+0000 7f7ede88fec0 20 rados->read ofs=0 len=0 2019-12-08T12:16:48.690 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:48.626+0000 7f7ede88fec0 20 rados_obj.operate() r=0 bl.length=319 2019-12-08T12:16:48.690 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:48.626+0000 7f7ede88fec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.7 info.flags=0x13 2019-12-08T12:16:48.690 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:48.626+0000 7f7ede88fec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.7 to cache LRU end 2019-12-08T12:16:48.691 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:48.626+0000 7f7ede88fec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-08T12:16:48.691 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:48.626+0000 7f7ede88fec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-08T12:16:48.691 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:48.626+0000 7f7ede88fec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.7 2019-12-08T12:16:48.719 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:48.655+0000 7f7ede88fec0 10 cls_bucket_list_unordered :test-client.0-r-test-obj-storage-class-copy.1[f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.7]) start [] num_entries 1100 2019-12-08T12:16:48.763 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:48.698+0000 7f7ede88fec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN[] 2019-12-08T12:16:48.763 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:48.698+0000 7f7ede88fec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN-FROZEN[] 2019-12-08T12:16:48.763 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:48.698+0000 7f7ede88fec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM[] 2019-12-08T12:16:48.763 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:48.698+0000 7f7ede88fec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN-STANDARD[] 2019-12-08T12:16:48.763 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:48.698+0000 7f7ede88fec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM[] 2019-12-08T12:16:48.763 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:48.698+0000 7f7ede88fec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN[] 2019-12-08T12:16:48.764 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:48.698+0000 7f7ede88fec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM[] 2019-12-08T12:16:48.764 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:48.698+0000 7f7ede88fec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD[] 2019-12-08T12:16:48.764 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:48.698+0000 7f7ede88fec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD[] 2019-12-08T12:16:48.764 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:48.698+0000 7f7ede88fec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD-FROZEN[] 2019-12-08T12:16:48.764 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:48.698+0000 7f7ede88fec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM[] 2019-12-08T12:16:48.764 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:48.698+0000 7f7ede88fec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD-STANDARD[] 2019-12-08T12:16:48.764 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:48.698+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x558822679f98 s->prefetch_data=0 2019-12-08T12:16:48.787 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:48.722+0000 7f7ede88fec0 10 manifest: total_size = 5242880 2019-12-08T12:16:48.787 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:48.722+0000 7f7ede88fec0 20 get_obj_state: setting s->obj_tag to f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.108 2019-12-08T12:16:48.787 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:48.722+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x558822679f98 s->prefetch_data=0 2019-12-08T12:16:48.787 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:48.722+0000 7f7ede88fec0 20 prepare_atomic_modification: state is not atomic. state=0x558822679f98 2019-12-08T12:16:48.788 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:48.722+0000 7f7ede88fec0 20 bucket index object: default.rgw.buckets.index:.dir.f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.7 2019-12-08T12:16:48.944 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:48.880+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-08T12:16:48.944 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:48.880+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2019-12-08T12:16:48.945 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:48.880+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-08T12:16:48.945 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:48.880+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-12-08T12:16:48.945 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:48.880+0000 7f7ede88fec0 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.108 2019-12-08T12:16:49.024 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:48.960+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x558822679f98 s->prefetch_data=0 2019-12-08T12:16:49.033 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:48.969+0000 7f7ede88fec0 10 manifest: total_size = 5242880 2019-12-08T12:16:49.033 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:48.969+0000 7f7ede88fec0 20 get_obj_state: setting s->obj_tag to f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.109 2019-12-08T12:16:49.034 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:48.969+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x558822679f98 s->prefetch_data=0 2019-12-08T12:16:49.034 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:48.969+0000 7f7ede88fec0 20 prepare_atomic_modification: state is not atomic. state=0x558822679f98 2019-12-08T12:16:49.034 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:48.969+0000 7f7ede88fec0 20 bucket index object: default.rgw.buckets.index:.dir.f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.7 2019-12-08T12:16:49.124 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:49.060+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-08T12:16:49.124 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:49.060+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2019-12-08T12:16:49.125 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:49.060+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-08T12:16:49.125 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:49.060+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-12-08T12:16:49.125 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:49.060+0000 7f7ede88fec0 20 garbage collection: RGWGC::send_chain - on object name: gc.25tag is: f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.109 2019-12-08T12:16:49.196 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:49.132+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x558822679f98 s->prefetch_data=0 2019-12-08T12:16:49.206 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:49.141+0000 7f7ede88fec0 10 manifest: total_size = 5242880 2019-12-08T12:16:49.206 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:49.141+0000 7f7ede88fec0 20 get_obj_state: setting s->obj_tag to _AOwG5COhLW-c3rAYtmr0lNQeIUA_OmZ 2019-12-08T12:16:49.206 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:49.141+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x558822679f98 s->prefetch_data=0 2019-12-08T12:16:49.207 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:49.141+0000 7f7ede88fec0 20 prepare_atomic_modification: state is not atomic. state=0x558822679f98 2019-12-08T12:16:49.207 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:49.141+0000 7f7ede88fec0 20 bucket index object: default.rgw.buckets.index:.dir.f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.7 2019-12-08T12:16:49.305 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:49.241+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-08T12:16:49.305 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:49.241+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2019-12-08T12:16:49.305 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:49.241+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-08T12:16:49.305 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:49.241+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-12-08T12:16:49.306 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:49.241+0000 7f7ede88fec0 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: _AOwG5COhLW-c3rAYtmr0lNQeIUA_OmZ 2019-12-08T12:16:49.408 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:49.344+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x558822679f98 s->prefetch_data=0 2019-12-08T12:16:49.418 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:49.354+0000 7f7ede88fec0 10 manifest: total_size = 5242880 2019-12-08T12:16:49.418 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:49.354+0000 7f7ede88fec0 20 get_obj_state: setting s->obj_tag to _LsKu0t6JputAICfPkVzVL1EOenCfs8b 2019-12-08T12:16:49.419 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:49.354+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x558822679f98 s->prefetch_data=0 2019-12-08T12:16:49.419 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:49.354+0000 7f7ede88fec0 20 prepare_atomic_modification: state is not atomic. state=0x558822679f98 2019-12-08T12:16:49.419 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:49.354+0000 7f7ede88fec0 20 bucket index object: default.rgw.buckets.index:.dir.f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.7 2019-12-08T12:16:49.514 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:49.450+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-08T12:16:49.514 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:49.450+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-12-08T12:16:49.514 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:49.450+0000 7f7ede88fec0 20 garbage collection: RGWGC::send_chain - on object name: gc.15tag is: _LsKu0t6JputAICfPkVzVL1EOenCfs8b 2019-12-08T12:16:49.600 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:49.536+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x558822679f98 s->prefetch_data=0 2019-12-08T12:16:49.612 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:49.546+0000 7f7ede88fec0 10 manifest: total_size = 5242880 2019-12-08T12:16:49.612 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:49.546+0000 7f7ede88fec0 20 get_obj_state: setting s->obj_tag to f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.112 2019-12-08T12:16:49.612 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:49.546+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x558822679f98 s->prefetch_data=0 2019-12-08T12:16:49.612 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:49.546+0000 7f7ede88fec0 20 prepare_atomic_modification: state is not atomic. state=0x558822679f98 2019-12-08T12:16:49.612 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:49.546+0000 7f7ede88fec0 20 bucket index object: default.rgw.buckets.index:.dir.f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.7 2019-12-08T12:16:49.720 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:49.656+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-08T12:16:49.721 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:49.656+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2019-12-08T12:16:49.721 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:49.656+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-08T12:16:49.721 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:49.656+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-12-08T12:16:49.721 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:49.656+0000 7f7ede88fec0 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.112 2019-12-08T12:16:49.793 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:49.716+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x558822679f98 s->prefetch_data=0 2019-12-08T12:16:49.793 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:49.727+0000 7f7ede88fec0 10 manifest: total_size = 5242880 2019-12-08T12:16:49.793 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:49.727+0000 7f7ede88fec0 20 get_obj_state: setting s->obj_tag to _wE5xn43oadRIh4EXe9n8IUF4_KHFgjo 2019-12-08T12:16:49.793 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:49.727+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x558822679f98 s->prefetch_data=0 2019-12-08T12:16:49.794 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:49.727+0000 7f7ede88fec0 20 prepare_atomic_modification: state is not atomic. state=0x558822679f98 2019-12-08T12:16:49.794 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:49.727+0000 7f7ede88fec0 20 bucket index object: default.rgw.buckets.index:.dir.f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.7 2019-12-08T12:16:49.942 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:49.878+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-08T12:16:49.942 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:49.878+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2019-12-08T12:16:49.943 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:49.878+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-08T12:16:49.943 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:49.878+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-12-08T12:16:49.943 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:49.878+0000 7f7ede88fec0 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: _wE5xn43oadRIh4EXe9n8IUF4_KHFgjo 2019-12-08T12:16:49.989 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:49.925+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x558822679f98 s->prefetch_data=0 2019-12-08T12:16:50.000 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:49.935+0000 7f7ede88fec0 10 manifest: total_size = 5242880 2019-12-08T12:16:50.000 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:49.935+0000 7f7ede88fec0 20 get_obj_state: setting s->obj_tag to f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.114 2019-12-08T12:16:50.000 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:49.935+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x558822679f98 s->prefetch_data=0 2019-12-08T12:16:50.000 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:49.935+0000 7f7ede88fec0 20 prepare_atomic_modification: state is not atomic. state=0x558822679f98 2019-12-08T12:16:50.001 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:49.935+0000 7f7ede88fec0 20 bucket index object: default.rgw.buckets.index:.dir.f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.7 2019-12-08T12:16:50.179 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:50.115+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-08T12:16:50.179 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:50.115+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2019-12-08T12:16:50.180 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:50.115+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-08T12:16:50.180 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:50.115+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-12-08T12:16:50.180 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:50.115+0000 7f7ede88fec0 20 garbage collection: RGWGC::send_chain - on object name: gc.20tag is: f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.114 2019-12-08T12:16:50.247 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:50.182+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x558822679f98 s->prefetch_data=0 2019-12-08T12:16:50.264 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:50.199+0000 7f7ede88fec0 10 manifest: total_size = 5242880 2019-12-08T12:16:50.264 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:50.199+0000 7f7ede88fec0 20 get_obj_state: setting s->obj_tag to _sPiS_1330ZyetB82Xm4ZuC_HBLwYeNV 2019-12-08T12:16:50.264 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:50.199+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x558822679f98 s->prefetch_data=0 2019-12-08T12:16:50.264 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:50.199+0000 7f7ede88fec0 20 prepare_atomic_modification: state is not atomic. state=0x558822679f98 2019-12-08T12:16:50.265 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:50.199+0000 7f7ede88fec0 20 bucket index object: default.rgw.buckets.index:.dir.f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.7 2019-12-08T12:16:50.379 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:50.315+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-08T12:16:50.380 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:50.315+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2019-12-08T12:16:50.380 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:50.315+0000 7f7ede88fec0 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: _sPiS_1330ZyetB82Xm4ZuC_HBLwYeNV 2019-12-08T12:16:50.432 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:50.368+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x558822679f98 s->prefetch_data=0 2019-12-08T12:16:50.444 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:50.379+0000 7f7ede88fec0 10 manifest: total_size = 22651 2019-12-08T12:16:50.444 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:50.379+0000 7f7ede88fec0 20 get_obj_state: setting s->obj_tag to f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.116 2019-12-08T12:16:50.444 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:50.379+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x558822679f98 s->prefetch_data=0 2019-12-08T12:16:50.445 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:50.379+0000 7f7ede88fec0 20 prepare_atomic_modification: state is not atomic. state=0x558822679f98 2019-12-08T12:16:50.445 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:50.379+0000 7f7ede88fec0 20 bucket index object: default.rgw.buckets.index:.dir.f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.7 2019-12-08T12:16:50.563 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:50.499+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x558822679f98 s->prefetch_data=0 2019-12-08T12:16:50.580 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:50.515+0000 7f7ede88fec0 10 manifest: total_size = 22651 2019-12-08T12:16:50.580 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:50.515+0000 7f7ede88fec0 20 get_obj_state: setting s->obj_tag to _gV3UPYsUXFWORUQ3e0gU15ehNCU1NjC 2019-12-08T12:16:50.580 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:50.516+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x558822679f98 s->prefetch_data=0 2019-12-08T12:16:50.580 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:50.516+0000 7f7ede88fec0 20 prepare_atomic_modification: state is not atomic. state=0x558822679f98 2019-12-08T12:16:50.580 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:50.516+0000 7f7ede88fec0 20 bucket index object: default.rgw.buckets.index:.dir.f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.7 2019-12-08T12:16:50.799 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:50.734+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-08T12:16:50.799 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:50.734+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=22651 stripe_ofs=22651 part_ofs=0 rule->part_size=0 2019-12-08T12:16:50.799 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:50.734+0000 7f7ede88fec0 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: _gV3UPYsUXFWORUQ3e0gU15ehNCU1NjC 2019-12-08T12:16:50.859 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:50.794+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x558822679f98 s->prefetch_data=0 2019-12-08T12:16:50.870 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:50.806+0000 7f7ede88fec0 10 manifest: total_size = 22651 2019-12-08T12:16:50.870 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:50.806+0000 7f7ede88fec0 20 get_obj_state: setting s->obj_tag to _fciwpBm_fJiyIHtICdBXB6LpNyIFzOw 2019-12-08T12:16:50.870 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:50.806+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x558822679f98 s->prefetch_data=0 2019-12-08T12:16:50.871 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:50.806+0000 7f7ede88fec0 20 prepare_atomic_modification: state is not atomic. state=0x558822679f98 2019-12-08T12:16:50.871 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:50.806+0000 7f7ede88fec0 20 bucket index object: default.rgw.buckets.index:.dir.f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.7 2019-12-08T12:16:50.977 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:50.913+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-08T12:16:50.977 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:50.913+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=22651 stripe_ofs=22651 part_ofs=0 rule->part_size=0 2019-12-08T12:16:50.977 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:50.913+0000 7f7ede88fec0 20 garbage collection: RGWGC::send_chain - on object name: gc.7tag is: _fciwpBm_fJiyIHtICdBXB6LpNyIFzOw 2019-12-08T12:16:51.036 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:50.972+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x558822679f98 s->prefetch_data=0 2019-12-08T12:16:51.058 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:50.993+0000 7f7ede88fec0 10 manifest: total_size = 22651 2019-12-08T12:16:51.058 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:50.993+0000 7f7ede88fec0 20 get_obj_state: setting s->obj_tag to _ch1vrj4Es-zeYb2R3aOVM2y1_XNsTdt 2019-12-08T12:16:51.058 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:50.993+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x558822679f98 s->prefetch_data=0 2019-12-08T12:16:51.058 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:50.993+0000 7f7ede88fec0 20 prepare_atomic_modification: state is not atomic. state=0x558822679f98 2019-12-08T12:16:51.058 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:50.993+0000 7f7ede88fec0 20 bucket index object: default.rgw.buckets.index:.dir.f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.7 2019-12-08T12:16:51.158 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:51.093+0000 7f7ede88fec0 10 cls_bucket_list_ordered :test-client.0-r-test-obj-storage-class-copy.1[f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.7]) start _multipart_[] num_entries 1001 2019-12-08T12:16:51.158 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:51.093+0000 7f7ede88fec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-12-08T12:16:51.227 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:51.163+0000 7f7ede88fec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-copy.1[f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.7])"; objs.size()=0; is_truncated=0 2019-12-08T12:16:51.305 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:51.241+0000 7f7ede88fec0 20 get_system_obj_state: rctx=0x7ffc112a9998 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class-copy.1 state=0x55882267a950 s->prefetch_data=0 2019-12-08T12:16:51.305 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:51.241+0000 7f7ede88fec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : type miss (requested=0x16, cached=0x3) 2019-12-08T12:16:51.322 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:51.257+0000 7f7ede88fec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x16 2019-12-08T12:16:51.322 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:51.257+0000 7f7ede88fec0 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2019-12-08T12:16:51.322 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:51.257+0000 7f7ede88fec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-08T12:16:51.322 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:51.257+0000 7f7ede88fec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-08T12:16:51.322 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:51.257+0000 7f7ede88fec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : hit (requested=0x11, cached=0x17) 2019-12-08T12:16:51.322 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:51.257+0000 7f7ede88fec0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 from cache 2019-12-08T12:16:51.323 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:51.257+0000 7f7ede88fec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=189 2019-12-08T12:16:51.335 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:51.271+0000 7f7ec17fa700 10 RGWWatcher::handle_notify() notify_id 571230650377 cookie 94043180528320 notifier 4457 bl.length()=189 2019-12-08T12:16:51.698 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:51.634+0000 7f7ede88fec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.7 from cache 2019-12-08T12:16:51.698 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:51.634+0000 7f7ede88fec0 10 distributing notification oid=default.rgw.control:notify.7 bl.length()=246 2019-12-08T12:16:51.715 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:51.651+0000 7f7ec17fa700 10 RGWWatcher::handle_notify() notify_id 571230650371 cookie 94043180539312 notifier 4457 bl.length()=246 2019-12-08T12:16:52.174 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.109+0000 7f7ede88fec0 20 get_system_obj_state: rctx=0x7ffc112a9fe0 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart-copy.1 state=0x558822674920 s->prefetch_data=0 2019-12-08T12:16:52.174 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.109+0000 7f7ede88fec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : miss 2019-12-08T12:16:52.191 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.127+0000 7f7ede88fec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x6 2019-12-08T12:16:52.191 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.127+0000 7f7ede88fec0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2019-12-08T12:16:52.192 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.127+0000 7f7ede88fec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-08T12:16:52.192 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.127+0000 7f7ede88fec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-08T12:16:52.192 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.127+0000 7f7ede88fec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x1, cached=0x6) 2019-12-08T12:16:52.192 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.127+0000 7f7ede88fec0 20 rados->read ofs=0 len=0 2019-12-08T12:16:52.203 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.139+0000 7f7ede88fec0 20 rados_obj.operate() r=0 bl.length=237 2019-12-08T12:16:52.204 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.139+0000 7f7ede88fec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x1 2019-12-08T12:16:52.204 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.139+0000 7f7ede88fec0 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2019-12-08T12:16:52.204 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.139+0000 7f7ede88fec0 20 get_system_obj_state: rctx=0x7ffc112a9fe0 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.9 state=0x558822672790 s->prefetch_data=0 2019-12-08T12:16:52.204 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.139+0000 7f7ede88fec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.9 : miss 2019-12-08T12:16:52.219 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.154+0000 7f7ede88fec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.9 info.flags=0x16 2019-12-08T12:16:52.219 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.154+0000 7f7ede88fec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.9 to cache LRU end 2019-12-08T12:16:52.219 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.154+0000 7f7ede88fec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-08T12:16:52.219 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.154+0000 7f7ede88fec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-08T12:16:52.219 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.154+0000 7f7ede88fec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-08T12:16:52.219 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.154+0000 7f7ede88fec0 20 Read xattr: user.rgw.acl 2019-12-08T12:16:52.220 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.154+0000 7f7ede88fec0 20 Read xattr: user.rgw.idtag 2019-12-08T12:16:52.220 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.154+0000 7f7ede88fec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.9 : type miss (requested=0x13, cached=0x16) 2019-12-08T12:16:52.220 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.154+0000 7f7ede88fec0 20 rados->read ofs=0 len=0 2019-12-08T12:16:52.248 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.184+0000 7f7ede88fec0 20 rados_obj.operate() r=0 bl.length=329 2019-12-08T12:16:52.249 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.184+0000 7f7ede88fec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.9 info.flags=0x13 2019-12-08T12:16:52.249 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.184+0000 7f7ede88fec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.9 to cache LRU end 2019-12-08T12:16:52.249 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.184+0000 7f7ede88fec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-08T12:16:52.249 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.184+0000 7f7ede88fec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-08T12:16:52.249 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.184+0000 7f7ede88fec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.9 2019-12-08T12:16:52.260 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.196+0000 7f7ede88fec0 10 cls_bucket_list_unordered :test-client.0-r-test-obj-storage-class-multipart-copy.1[f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.9]) start [] num_entries 1100 2019-12-08T12:16:52.283 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.218+0000 7f7ede88fec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN[] 2019-12-08T12:16:52.283 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.218+0000 7f7ede88fec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN-FROZEN[] 2019-12-08T12:16:52.283 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.218+0000 7f7ede88fec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM[] 2019-12-08T12:16:52.283 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.218+0000 7f7ede88fec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN-STANDARD[] 2019-12-08T12:16:52.284 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.218+0000 7f7ede88fec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM[] 2019-12-08T12:16:52.284 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.218+0000 7f7ede88fec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN[] 2019-12-08T12:16:52.284 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.218+0000 7f7ede88fec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM[] 2019-12-08T12:16:52.284 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.218+0000 7f7ede88fec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD[] 2019-12-08T12:16:52.284 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.218+0000 7f7ede88fec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD[] 2019-12-08T12:16:52.284 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.218+0000 7f7ede88fec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD-FROZEN[] 2019-12-08T12:16:52.284 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.218+0000 7f7ede88fec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM[] 2019-12-08T12:16:52.285 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.218+0000 7f7ede88fec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD-STANDARD[] 2019-12-08T12:16:52.285 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.218+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x558822679ef8 s->prefetch_data=0 2019-12-08T12:16:52.304 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.240+0000 7f7ede88fec0 10 manifest: total_size = 11534336 2019-12-08T12:16:52.304 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.240+0000 7f7ede88fec0 20 get_obj_state: setting s->obj_tag to f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.224 2019-12-08T12:16:52.305 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.240+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x558822679ef8 s->prefetch_data=0 2019-12-08T12:16:52.305 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.240+0000 7f7ede88fec0 20 prepare_atomic_modification: state is not atomic. state=0x558822679ef8 2019-12-08T12:16:52.305 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.240+0000 7f7ede88fec0 20 bucket index object: default.rgw.buckets.index:.dir.f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.9 2019-12-08T12:16:52.438 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.374+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-08T12:16:52.438 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.374+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-12-08T12:16:52.438 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.374+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-12-08T12:16:52.439 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.374+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-08T12:16:52.439 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.374+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2019-12-08T12:16:52.439 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.374+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2019-12-08T12:16:52.439 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.374+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-08T12:16:52.439 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.374+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-12-08T12:16:52.439 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.374+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-12-08T12:16:52.439 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.374+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-08T12:16:52.440 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.374+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2019-12-08T12:16:52.440 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.374+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2019-12-08T12:16:52.440 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.374+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2019-12-08T12:16:52.440 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.374+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2019-12-08T12:16:52.440 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.374+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2019-12-08T12:16:52.440 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.374+0000 7f7ede88fec0 20 garbage collection: RGWGC::send_chain - on object name: gc.15tag is: f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.224 2019-12-08T12:16:52.480 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.414+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x558822679ef8 s->prefetch_data=0 2019-12-08T12:16:52.489 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.425+0000 7f7ede88fec0 10 manifest: total_size = 11534336 2019-12-08T12:16:52.489 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.425+0000 7f7ede88fec0 20 get_obj_state: setting s->obj_tag to f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.225 2019-12-08T12:16:52.489 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.425+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x558822679ef8 s->prefetch_data=0 2019-12-08T12:16:52.490 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.425+0000 7f7ede88fec0 20 prepare_atomic_modification: state is not atomic. state=0x558822679ef8 2019-12-08T12:16:52.490 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.425+0000 7f7ede88fec0 20 bucket index object: default.rgw.buckets.index:.dir.f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.9 2019-12-08T12:16:52.591 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.526+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-08T12:16:52.592 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.526+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-12-08T12:16:52.592 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.526+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-12-08T12:16:52.592 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.526+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-08T12:16:52.592 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.526+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2019-12-08T12:16:52.592 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.526+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2019-12-08T12:16:52.593 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.526+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-08T12:16:52.593 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.526+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-12-08T12:16:52.593 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.526+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-12-08T12:16:52.593 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.526+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-08T12:16:52.593 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.526+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2019-12-08T12:16:52.593 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.526+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2019-12-08T12:16:52.593 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.526+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2019-12-08T12:16:52.594 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.526+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2019-12-08T12:16:52.594 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.526+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2019-12-08T12:16:52.594 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.526+0000 7f7ede88fec0 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.225 2019-12-08T12:16:52.672 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.608+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x5588226779a8 s->prefetch_data=0 2019-12-08T12:16:52.685 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.620+0000 7f7ede88fec0 10 manifest: total_size = 11534336 2019-12-08T12:16:52.685 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.620+0000 7f7ede88fec0 20 get_obj_state: setting s->obj_tag to _QySozO70fBTEJZ8yb3OHWisU27clau8 2019-12-08T12:16:52.685 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.620+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x5588226779a8 s->prefetch_data=0 2019-12-08T12:16:52.685 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.620+0000 7f7ede88fec0 20 prepare_atomic_modification: state is not atomic. state=0x5588226779a8 2019-12-08T12:16:52.685 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.620+0000 7f7ede88fec0 20 bucket index object: default.rgw.buckets.index:.dir.f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.9 2019-12-08T12:16:52.806 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.742+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-08T12:16:52.807 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.742+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2019-12-08T12:16:52.807 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.742+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-08T12:16:52.807 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.742+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=8380416 stripe_ofs=8380416 part_ofs=0 rule->part_size=0 2019-12-08T12:16:52.807 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.742+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-08T12:16:52.807 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.742+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2019-12-08T12:16:52.807 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.742+0000 7f7ede88fec0 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: _QySozO70fBTEJZ8yb3OHWisU27clau8 2019-12-08T12:16:52.874 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.810+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x5588226779a8 s->prefetch_data=0 2019-12-08T12:16:52.884 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.819+0000 7f7ede88fec0 10 manifest: total_size = 11534336 2019-12-08T12:16:52.884 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.819+0000 7f7ede88fec0 20 get_obj_state: setting s->obj_tag to _xijSZbNDcO80SFXP1bPiL1_wXC0QTAV 2019-12-08T12:16:52.884 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.819+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x5588226779a8 s->prefetch_data=0 2019-12-08T12:16:52.885 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.819+0000 7f7ede88fec0 20 prepare_atomic_modification: state is not atomic. state=0x5588226779a8 2019-12-08T12:16:52.885 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.820+0000 7f7ede88fec0 20 bucket index object: default.rgw.buckets.index:.dir.f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.9 2019-12-08T12:16:53.032 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.968+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-08T12:16:53.033 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.968+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=8380416 stripe_ofs=8380416 part_ofs=0 rule->part_size=0 2019-12-08T12:16:53.033 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.968+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-08T12:16:53.033 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.968+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2019-12-08T12:16:53.033 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:52.968+0000 7f7ede88fec0 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: _xijSZbNDcO80SFXP1bPiL1_wXC0QTAV 2019-12-08T12:16:53.089 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:53.025+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x5588226779a8 s->prefetch_data=0 2019-12-08T12:16:53.099 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:53.035+0000 7f7ede88fec0 10 manifest: total_size = 11534336 2019-12-08T12:16:53.099 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:53.035+0000 7f7ede88fec0 20 get_obj_state: setting s->obj_tag to f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.233 2019-12-08T12:16:53.099 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:53.035+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x5588226779a8 s->prefetch_data=0 2019-12-08T12:16:53.100 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:53.035+0000 7f7ede88fec0 20 prepare_atomic_modification: state is not atomic. state=0x5588226779a8 2019-12-08T12:16:53.100 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:53.035+0000 7f7ede88fec0 20 bucket index object: default.rgw.buckets.index:.dir.f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.9 2019-12-08T12:16:53.308 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:53.244+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-08T12:16:53.309 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:53.244+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-12-08T12:16:53.309 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:53.244+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-12-08T12:16:53.309 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:53.244+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-08T12:16:53.309 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:53.244+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2019-12-08T12:16:53.309 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:53.244+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2019-12-08T12:16:53.309 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:53.244+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-08T12:16:53.310 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:53.244+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-12-08T12:16:53.310 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:53.244+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-12-08T12:16:53.310 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:53.244+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-08T12:16:53.310 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:53.244+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2019-12-08T12:16:53.310 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:53.244+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2019-12-08T12:16:53.310 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:53.244+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2019-12-08T12:16:53.310 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:53.244+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2019-12-08T12:16:53.311 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:53.244+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2019-12-08T12:16:53.311 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:53.244+0000 7f7ede88fec0 20 garbage collection: RGWGC::send_chain - on object name: gc.5tag is: f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.233 2019-12-08T12:16:53.363 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:53.298+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x5588226779a8 s->prefetch_data=0 2019-12-08T12:16:53.379 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:53.308+0000 7f7ede88fec0 10 manifest: total_size = 11534336 2019-12-08T12:16:53.379 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:53.308+0000 7f7ede88fec0 20 get_obj_state: setting s->obj_tag to _PlVQEH9yKkfxagizazK4xgaYeWswPGA 2019-12-08T12:16:53.379 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:53.308+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x5588226779a8 s->prefetch_data=0 2019-12-08T12:16:53.380 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:53.308+0000 7f7ede88fec0 20 prepare_atomic_modification: state is not atomic. state=0x5588226779a8 2019-12-08T12:16:53.380 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:53.308+0000 7f7ede88fec0 20 bucket index object: default.rgw.buckets.index:.dir.f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.9 2019-12-08T12:16:53.466 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:53.402+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-08T12:16:53.466 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:53.402+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2019-12-08T12:16:53.466 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:53.402+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-08T12:16:53.466 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:53.402+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=8380416 stripe_ofs=8380416 part_ofs=0 rule->part_size=0 2019-12-08T12:16:53.467 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:53.402+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-08T12:16:53.467 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:53.402+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2019-12-08T12:16:53.467 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:53.402+0000 7f7ede88fec0 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: _PlVQEH9yKkfxagizazK4xgaYeWswPGA 2019-12-08T12:16:53.530 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:53.466+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x55882267a1e8 s->prefetch_data=0 2019-12-08T12:16:53.539 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:53.475+0000 7f7ede88fec0 10 manifest: total_size = 11534336 2019-12-08T12:16:53.539 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:53.475+0000 7f7ede88fec0 20 get_obj_state: setting s->obj_tag to f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.235 2019-12-08T12:16:53.539 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:53.475+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x55882267a1e8 s->prefetch_data=0 2019-12-08T12:16:53.540 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:53.475+0000 7f7ede88fec0 20 prepare_atomic_modification: state is not atomic. state=0x55882267a1e8 2019-12-08T12:16:53.540 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:53.475+0000 7f7ede88fec0 20 bucket index object: default.rgw.buckets.index:.dir.f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.9 2019-12-08T12:16:53.633 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:53.569+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-08T12:16:53.634 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:53.569+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-12-08T12:16:53.634 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:53.569+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-12-08T12:16:53.634 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:53.569+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-08T12:16:53.634 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:53.569+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2019-12-08T12:16:53.634 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:53.569+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2019-12-08T12:16:53.634 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:53.569+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-08T12:16:53.635 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:53.569+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-12-08T12:16:53.635 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:53.569+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-12-08T12:16:53.635 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:53.569+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-08T12:16:53.635 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:53.569+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2019-12-08T12:16:53.635 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:53.569+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2019-12-08T12:16:53.635 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:53.569+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2019-12-08T12:16:53.635 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:53.569+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2019-12-08T12:16:53.636 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:53.569+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2019-12-08T12:16:53.636 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:53.569+0000 7f7ede88fec0 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.235 2019-12-08T12:16:53.770 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:53.705+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x55882267a1e8 s->prefetch_data=0 2019-12-08T12:16:53.789 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:53.725+0000 7f7ede88fec0 10 manifest: total_size = 11534336 2019-12-08T12:16:53.790 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:53.725+0000 7f7ede88fec0 20 get_obj_state: setting s->obj_tag to _SRCYVvR42yzN_tR3y9pC1TMDxcQsuLD 2019-12-08T12:16:53.790 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:53.725+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x55882267a1e8 s->prefetch_data=0 2019-12-08T12:16:53.790 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:53.725+0000 7f7ede88fec0 20 prepare_atomic_modification: state is not atomic. state=0x55882267a1e8 2019-12-08T12:16:53.790 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:53.725+0000 7f7ede88fec0 20 bucket index object: default.rgw.buckets.index:.dir.f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.9 2019-12-08T12:16:53.966 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:53.902+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-08T12:16:53.966 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:53.902+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=8380416 stripe_ofs=8380416 part_ofs=0 rule->part_size=0 2019-12-08T12:16:53.967 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:53.902+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-08T12:16:53.967 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:53.902+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2019-12-08T12:16:53.967 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:53.902+0000 7f7ede88fec0 20 garbage collection: RGWGC::send_chain - on object name: gc.25tag is: _SRCYVvR42yzN_tR3y9pC1TMDxcQsuLD 2019-12-08T12:16:54.043 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:53.977+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x55882267a1e8 s->prefetch_data=0 2019-12-08T12:16:54.058 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:53.993+0000 7f7ede88fec0 10 manifest: total_size = 11534336 2019-12-08T12:16:54.058 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:53.993+0000 7f7ede88fec0 20 get_obj_state: setting s->obj_tag to f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.242 2019-12-08T12:16:54.059 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:53.993+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x55882267a1e8 s->prefetch_data=0 2019-12-08T12:16:54.059 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:53.993+0000 7f7ede88fec0 20 prepare_atomic_modification: state is not atomic. state=0x55882267a1e8 2019-12-08T12:16:54.059 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:53.993+0000 7f7ede88fec0 20 bucket index object: default.rgw.buckets.index:.dir.f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.9 2019-12-08T12:16:54.174 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:54.108+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-08T12:16:54.174 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:54.108+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): stripe_ofs=4190208 part_ofs=0 rule->part_size=5242880 2019-12-08T12:16:54.174 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:54.108+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=5242880 2019-12-08T12:16:54.174 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:54.108+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-08T12:16:54.174 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:54.108+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): stripe_ofs=8380416 part_ofs=0 rule->part_size=5242880 2019-12-08T12:16:54.175 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:54.108+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2019-12-08T12:16:54.175 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:54.108+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-08T12:16:54.175 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:54.108+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): stripe_ofs=9433088 part_ofs=5242880 rule->part_size=5242880 2019-12-08T12:16:54.175 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:54.108+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=9433088 stripe_ofs=9433088 part_ofs=5242880 rule->part_size=5242880 2019-12-08T12:16:54.175 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:54.108+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-08T12:16:54.175 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:54.108+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): stripe_ofs=13623296 part_ofs=5242880 rule->part_size=5242880 2019-12-08T12:16:54.175 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:54.108+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2019-12-08T12:16:54.176 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:54.108+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2019-12-08T12:16:54.176 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:54.108+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): stripe_ofs=14675968 part_ofs=10485760 rule->part_size=1048576 2019-12-08T12:16:54.176 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:54.108+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2019-12-08T12:16:54.176 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:54.108+0000 7f7ede88fec0 20 garbage collection: RGWGC::send_chain - on object name: gc.22tag is: f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.242 2019-12-08T12:16:54.216 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:54.150+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x55882267a1e8 s->prefetch_data=0 2019-12-08T12:16:54.226 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:54.160+0000 7f7ede88fec0 10 manifest: total_size = 11534336 2019-12-08T12:16:54.226 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:54.160+0000 7f7ede88fec0 20 get_obj_state: setting s->obj_tag to _Z8qjDI0SDlXrqpMB1IdER0zy1hCJe5W 2019-12-08T12:16:54.226 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:54.160+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x55882267a1e8 s->prefetch_data=0 2019-12-08T12:16:54.226 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:54.160+0000 7f7ede88fec0 20 prepare_atomic_modification: state is not atomic. state=0x55882267a1e8 2019-12-08T12:16:54.227 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:54.160+0000 7f7ede88fec0 20 bucket index object: default.rgw.buckets.index:.dir.f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.9 2019-12-08T12:16:54.316 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:54.250+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-08T12:16:54.316 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:54.250+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2019-12-08T12:16:54.316 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:54.250+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-08T12:16:54.317 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:54.250+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=8380416 stripe_ofs=8380416 part_ofs=0 rule->part_size=0 2019-12-08T12:16:54.317 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:54.250+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-08T12:16:54.317 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:54.250+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2019-12-08T12:16:54.317 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:54.250+0000 7f7ede88fec0 20 garbage collection: RGWGC::send_chain - on object name: gc.30tag is: _Z8qjDI0SDlXrqpMB1IdER0zy1hCJe5W 2019-12-08T12:16:54.415 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:54.349+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x55882267a1e8 s->prefetch_data=0 2019-12-08T12:16:54.433 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:54.367+0000 7f7ede88fec0 10 manifest: total_size = 11534336 2019-12-08T12:16:54.433 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:54.367+0000 7f7ede88fec0 20 get_obj_state: setting s->obj_tag to _6k4ePL6AXwOsF_6ZKZy6k0qGZqXwsqA 2019-12-08T12:16:54.433 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:54.367+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x55882267a1e8 s->prefetch_data=0 2019-12-08T12:16:54.434 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:54.367+0000 7f7ede88fec0 20 prepare_atomic_modification: state is not atomic. state=0x55882267a1e8 2019-12-08T12:16:54.434 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:54.367+0000 7f7ede88fec0 20 bucket index object: default.rgw.buckets.index:.dir.f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.9 2019-12-08T12:16:54.561 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:54.496+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-08T12:16:54.561 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:54.496+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2019-12-08T12:16:54.561 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:54.496+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-08T12:16:54.561 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:54.496+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=8380416 stripe_ofs=8380416 part_ofs=0 rule->part_size=0 2019-12-08T12:16:54.562 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:54.496+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-08T12:16:54.562 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:54.496+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2019-12-08T12:16:54.562 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:54.496+0000 7f7ede88fec0 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: _6k4ePL6AXwOsF_6ZKZy6k0qGZqXwsqA 2019-12-08T12:16:54.646 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:54.581+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x55882267a1e8 s->prefetch_data=0 2019-12-08T12:16:54.656 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:54.591+0000 7f7ede88fec0 10 manifest: total_size = 11534336 2019-12-08T12:16:54.656 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:54.591+0000 7f7ede88fec0 20 get_obj_state: setting s->obj_tag to f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.245 2019-12-08T12:16:54.656 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:54.591+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x55882267a1e8 s->prefetch_data=0 2019-12-08T12:16:54.656 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:54.591+0000 7f7ede88fec0 20 prepare_atomic_modification: state is not atomic. state=0x55882267a1e8 2019-12-08T12:16:54.656 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:54.591+0000 7f7ede88fec0 20 bucket index object: default.rgw.buckets.index:.dir.f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.9 2019-12-08T12:16:54.824 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:54.759+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-08T12:16:54.824 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:54.759+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): stripe_ofs=4190208 part_ofs=0 rule->part_size=5242880 2019-12-08T12:16:54.824 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:54.759+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=5242880 2019-12-08T12:16:54.824 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:54.759+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-08T12:16:54.824 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:54.759+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): stripe_ofs=8380416 part_ofs=0 rule->part_size=5242880 2019-12-08T12:16:54.825 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:54.759+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2019-12-08T12:16:54.825 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:54.759+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-08T12:16:54.825 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:54.759+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): stripe_ofs=9433088 part_ofs=5242880 rule->part_size=5242880 2019-12-08T12:16:54.825 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:54.759+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=9433088 stripe_ofs=9433088 part_ofs=5242880 rule->part_size=5242880 2019-12-08T12:16:54.825 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:54.759+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-08T12:16:54.825 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:54.759+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): stripe_ofs=13623296 part_ofs=5242880 rule->part_size=5242880 2019-12-08T12:16:54.825 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:54.759+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2019-12-08T12:16:54.826 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:54.759+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2019-12-08T12:16:54.826 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:54.759+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): stripe_ofs=14675968 part_ofs=10485760 rule->part_size=1048576 2019-12-08T12:16:54.826 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:54.759+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2019-12-08T12:16:54.826 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:54.759+0000 7f7ede88fec0 20 garbage collection: RGWGC::send_chain - on object name: gc.6tag is: f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.245 2019-12-08T12:16:54.887 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:54.823+0000 7f7ede88fec0 10 cls_bucket_list_ordered :test-client.0-r-test-obj-storage-class-multipart-copy.1[f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.9]) start _multipart_[] num_entries 1001 2019-12-08T12:16:54.888 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:54.823+0000 7f7ede88fec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-12-08T12:16:54.905 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:54.841+0000 7f7ede88fec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart-copy.1[f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.9])"; objs.size()=0; is_truncated=0 2019-12-08T12:16:54.962 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:54.897+0000 7f7ede88fec0 20 get_system_obj_state: rctx=0x7ffc112a9998 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart-copy.1 state=0x5588226774b0 s->prefetch_data=0 2019-12-08T12:16:54.962 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:54.897+0000 7f7ede88fec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : type miss (requested=0x16, cached=0x3) 2019-12-08T12:16:54.979 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:54.914+0000 7f7ede88fec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x16 2019-12-08T12:16:54.979 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:54.914+0000 7f7ede88fec0 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2019-12-08T12:16:54.979 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:54.914+0000 7f7ede88fec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-08T12:16:54.980 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:54.914+0000 7f7ede88fec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-08T12:16:54.980 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:54.914+0000 7f7ede88fec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : hit (requested=0x11, cached=0x17) 2019-12-08T12:16:54.980 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:54.914+0000 7f7ede88fec0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 from cache 2019-12-08T12:16:54.980 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:54.914+0000 7f7ede88fec0 10 distributing notification oid=default.rgw.control:notify.3 bl.length()=199 2019-12-08T12:16:54.996 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:54.926+0000 7f7ec17fa700 10 RGWWatcher::handle_notify() notify_id 571230650370 cookie 94043180531216 notifier 4457 bl.length()=199 2019-12-08T12:16:55.250 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:55.185+0000 7f7ede88fec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.9 from cache 2019-12-08T12:16:55.250 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:55.185+0000 7f7ede88fec0 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=256 2019-12-08T12:16:55.268 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:55.204+0000 7f7ec17fa700 10 RGWWatcher::handle_notify() notify_id 571230650372 cookie 94043180523120 notifier 4457 bl.length()=256 2019-12-08T12:16:55.732 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:55.668+0000 7f7ede88fec0 20 get_system_obj_state: rctx=0x7ffc112a9fe0 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart.1 state=0x558822674920 s->prefetch_data=0 2019-12-08T12:16:55.733 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:55.668+0000 7f7ede88fec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : miss 2019-12-08T12:16:55.746 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:55.681+0000 7f7ede88fec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x6 2019-12-08T12:16:55.746 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:55.681+0000 7f7ede88fec0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2019-12-08T12:16:55.746 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:55.681+0000 7f7ede88fec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-08T12:16:55.746 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:55.681+0000 7f7ede88fec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-08T12:16:55.747 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:55.681+0000 7f7ede88fec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : type miss (requested=0x1, cached=0x6) 2019-12-08T12:16:55.747 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:55.681+0000 7f7ede88fec0 20 rados->read ofs=0 len=0 2019-12-08T12:16:55.759 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:55.695+0000 7f7ede88fec0 20 rados_obj.operate() r=0 bl.length=232 2019-12-08T12:16:55.760 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:55.695+0000 7f7ede88fec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x1 2019-12-08T12:16:55.760 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:55.695+0000 7f7ede88fec0 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2019-12-08T12:16:55.760 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:55.695+0000 7f7ede88fec0 20 get_system_obj_state: rctx=0x7ffc112a9fe0 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.8 state=0x558822677740 s->prefetch_data=0 2019-12-08T12:16:55.760 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:55.695+0000 7f7ede88fec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.8 : miss 2019-12-08T12:16:55.782 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:55.717+0000 7f7ede88fec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.8 info.flags=0x16 2019-12-08T12:16:55.782 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:55.717+0000 7f7ede88fec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.8 to cache LRU end 2019-12-08T12:16:55.783 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:55.717+0000 7f7ede88fec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-08T12:16:55.783 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:55.717+0000 7f7ede88fec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-08T12:16:55.783 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:55.717+0000 7f7ede88fec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-08T12:16:55.783 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:55.717+0000 7f7ede88fec0 20 Read xattr: user.rgw.acl 2019-12-08T12:16:55.783 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:55.717+0000 7f7ede88fec0 20 Read xattr: user.rgw.idtag 2019-12-08T12:16:55.783 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:55.717+0000 7f7ede88fec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.8 : type miss (requested=0x13, cached=0x16) 2019-12-08T12:16:55.783 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:55.717+0000 7f7ede88fec0 20 rados->read ofs=0 len=0 2019-12-08T12:16:55.810 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:55.746+0000 7f7ede88fec0 20 rados_obj.operate() r=0 bl.length=324 2019-12-08T12:16:55.811 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:55.746+0000 7f7ede88fec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.8 info.flags=0x13 2019-12-08T12:16:55.811 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:55.746+0000 7f7ede88fec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.8 to cache LRU end 2019-12-08T12:16:55.811 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:55.746+0000 7f7ede88fec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-08T12:16:55.811 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:55.746+0000 7f7ede88fec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-08T12:16:55.811 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:55.746+0000 7f7ede88fec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.8 2019-12-08T12:16:55.824 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:55.760+0000 7f7ede88fec0 10 cls_bucket_list_unordered :test-client.0-r-test-obj-storage-class-multipart.1[f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.8]) start [] num_entries 1100 2019-12-08T12:16:55.842 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:55.774+0000 7f7ede88fec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN[] 2019-12-08T12:16:55.842 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:55.774+0000 7f7ede88fec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM[] 2019-12-08T12:16:55.842 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:55.774+0000 7f7ede88fec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD[] 2019-12-08T12:16:55.842 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:55.774+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x55882267a1e8 s->prefetch_data=0 2019-12-08T12:16:55.852 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:55.787+0000 7f7ede88fec0 10 manifest: total_size = 11534336 2019-12-08T12:16:55.852 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:55.787+0000 7f7ede88fec0 20 get_obj_state: setting s->obj_tag to f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.196 2019-12-08T12:16:55.852 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:55.787+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x55882267a1e8 s->prefetch_data=0 2019-12-08T12:16:55.852 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:55.787+0000 7f7ede88fec0 20 prepare_atomic_modification: state is not atomic. state=0x55882267a1e8 2019-12-08T12:16:55.852 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:55.787+0000 7f7ede88fec0 20 bucket index object: default.rgw.buckets.index:.dir.f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.8 2019-12-08T12:16:55.986 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:55.921+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-08T12:16:55.986 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:55.921+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-12-08T12:16:55.986 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:55.921+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-12-08T12:16:55.986 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:55.921+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-08T12:16:55.987 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:55.921+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2019-12-08T12:16:55.987 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:55.921+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2019-12-08T12:16:55.987 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:55.921+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-08T12:16:55.987 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:55.921+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-12-08T12:16:55.987 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:55.921+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-12-08T12:16:55.987 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:55.921+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-08T12:16:55.987 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:55.921+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2019-12-08T12:16:55.988 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:55.921+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2019-12-08T12:16:55.988 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:55.921+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2019-12-08T12:16:55.988 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:55.921+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2019-12-08T12:16:55.988 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:55.921+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2019-12-08T12:16:55.988 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:55.921+0000 7f7ede88fec0 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.196 2019-12-08T12:16:56.062 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:55.997+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x55882267a1e8 s->prefetch_data=0 2019-12-08T12:16:56.077 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:56.012+0000 7f7ede88fec0 10 manifest: total_size = 11534336 2019-12-08T12:16:56.077 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:56.012+0000 7f7ede88fec0 20 get_obj_state: setting s->obj_tag to f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.203 2019-12-08T12:16:56.077 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:56.012+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x55882267a1e8 s->prefetch_data=0 2019-12-08T12:16:56.077 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:56.012+0000 7f7ede88fec0 20 prepare_atomic_modification: state is not atomic. state=0x55882267a1e8 2019-12-08T12:16:56.077 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:56.012+0000 7f7ede88fec0 20 bucket index object: default.rgw.buckets.index:.dir.f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.8 2019-12-08T12:16:56.173 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:56.108+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-08T12:16:56.174 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:56.108+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-12-08T12:16:56.174 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:56.108+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2019-12-08T12:16:56.174 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:56.108+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-08T12:16:56.174 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:56.108+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2019-12-08T12:16:56.174 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:56.108+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2019-12-08T12:16:56.174 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:56.108+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-08T12:16:56.174 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:56.108+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-12-08T12:16:56.175 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:56.108+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2019-12-08T12:16:56.175 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:56.108+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2019-12-08T12:16:56.175 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:56.108+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2019-12-08T12:16:56.175 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:56.108+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2019-12-08T12:16:56.175 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:56.108+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2019-12-08T12:16:56.175 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:56.108+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2019-12-08T12:16:56.175 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:56.108+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2019-12-08T12:16:56.176 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:56.108+0000 7f7ede88fec0 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.203 2019-12-08T12:16:56.228 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:56.163+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x55882267a1e8 s->prefetch_data=0 2019-12-08T12:16:56.240 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:56.175+0000 7f7ede88fec0 10 manifest: total_size = 541681 2019-12-08T12:16:56.240 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:56.175+0000 7f7ede88fec0 20 get_obj_state: setting s->obj_tag to f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.210 2019-12-08T12:16:56.241 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:56.175+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x55882267a1e8 s->prefetch_data=0 2019-12-08T12:16:56.241 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:56.175+0000 7f7ede88fec0 20 prepare_atomic_modification: state is not atomic. state=0x55882267a1e8 2019-12-08T12:16:56.241 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:56.175+0000 7f7ede88fec0 20 bucket index object: default.rgw.buckets.index:.dir.f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.8 2019-12-08T12:16:56.338 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:56.273+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2019-12-08T12:16:56.338 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:56.273+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): stripe_ofs=4190208 part_ofs=0 rule->part_size=246247 2019-12-08T12:16:56.338 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:56.273+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2019-12-08T12:16:56.338 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:56.273+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2019-12-08T12:16:56.338 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:56.273+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): stripe_ofs=4436455 part_ofs=246247 rule->part_size=246247 2019-12-08T12:16:56.338 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:56.273+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=49187 2019-12-08T12:16:56.339 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:56.273+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=49187 rules.size()=2 2019-12-08T12:16:56.339 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:56.273+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): stripe_ofs=4682702 part_ofs=492494 rule->part_size=49187 2019-12-08T12:16:56.339 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:56.273+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=541681 stripe_ofs=541681 part_ofs=541681 rule->part_size=49187 2019-12-08T12:16:56.339 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:56.273+0000 7f7ede88fec0 20 garbage collection: RGWGC::send_chain - on object name: gc.19tag is: f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.210 2019-12-08T12:16:56.383 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:56.318+0000 7f7ede88fec0 10 cls_bucket_list_ordered :test-client.0-r-test-obj-storage-class-multipart.1[f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.8]) start _multipart_[] num_entries 1001 2019-12-08T12:16:56.383 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:56.318+0000 7f7ede88fec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-12-08T12:16:56.397 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:56.331+0000 7f7ede88fec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart.1[f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.8])"; objs.size()=0; is_truncated=0 2019-12-08T12:16:56.456 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:56.391+0000 7f7ede88fec0 20 get_system_obj_state: rctx=0x7ffc112a9998 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart.1 state=0x55882267b390 s->prefetch_data=0 2019-12-08T12:16:56.456 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:56.391+0000 7f7ede88fec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : type miss (requested=0x16, cached=0x3) 2019-12-08T12:16:56.467 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:56.402+0000 7f7ede88fec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x16 2019-12-08T12:16:56.467 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:56.402+0000 7f7ede88fec0 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2019-12-08T12:16:56.468 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:56.402+0000 7f7ede88fec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-08T12:16:56.468 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:56.402+0000 7f7ede88fec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-08T12:16:56.468 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:56.402+0000 7f7ede88fec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : hit (requested=0x11, cached=0x17) 2019-12-08T12:16:56.468 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:56.402+0000 7f7ede88fec0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 from cache 2019-12-08T12:16:56.468 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:56.402+0000 7f7ede88fec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=194 2019-12-08T12:16:56.474 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:56.410+0000 7f7ec17fa700 10 RGWWatcher::handle_notify() notify_id 571230650374 cookie 94043180537696 notifier 4457 bl.length()=194 2019-12-08T12:16:56.890 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:56.825+0000 7f7ede88fec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.8 from cache 2019-12-08T12:16:56.890 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:56.825+0000 7f7ede88fec0 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=251 2019-12-08T12:16:56.902 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:56.837+0000 7f7ec17fa700 10 RGWWatcher::handle_notify() notify_id 571230650373 cookie 94043180523120 notifier 4457 bl.length()=251 2019-12-08T12:16:57.346 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:57.282+0000 7f7ede88fec0 20 get_system_obj_state: rctx=0x7ffc112a9fe0 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class.1 state=0x558822674920 s->prefetch_data=0 2019-12-08T12:16:57.347 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:57.282+0000 7f7ede88fec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : miss 2019-12-08T12:16:57.358 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:57.293+0000 7f7ede88fec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x6 2019-12-08T12:16:57.358 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:57.293+0000 7f7ede88fec0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2019-12-08T12:16:57.359 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:57.293+0000 7f7ede88fec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-08T12:16:57.359 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:57.293+0000 7f7ede88fec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-08T12:16:57.359 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:57.293+0000 7f7ede88fec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : type miss (requested=0x1, cached=0x6) 2019-12-08T12:16:57.359 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:57.293+0000 7f7ede88fec0 20 rados->read ofs=0 len=0 2019-12-08T12:16:57.369 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:57.304+0000 7f7ede88fec0 20 rados_obj.operate() r=0 bl.length=222 2019-12-08T12:16:57.369 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:57.304+0000 7f7ede88fec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x1 2019-12-08T12:16:57.369 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:57.304+0000 7f7ede88fec0 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2019-12-08T12:16:57.369 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:57.304+0000 7f7ede88fec0 20 get_system_obj_state: rctx=0x7ffc112a9fe0 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class.1:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.6 state=0x558822677740 s->prefetch_data=0 2019-12-08T12:16:57.369 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:57.304+0000 7f7ede88fec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.6 : miss 2019-12-08T12:16:57.391 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:57.325+0000 7f7ede88fec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.6 info.flags=0x16 2019-12-08T12:16:57.392 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:57.325+0000 7f7ede88fec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.6 to cache LRU end 2019-12-08T12:16:57.392 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:57.325+0000 7f7ede88fec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-08T12:16:57.392 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:57.325+0000 7f7ede88fec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-08T12:16:57.392 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:57.325+0000 7f7ede88fec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-08T12:16:57.392 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:57.325+0000 7f7ede88fec0 20 Read xattr: user.rgw.acl 2019-12-08T12:16:57.393 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:57.325+0000 7f7ede88fec0 20 Read xattr: user.rgw.idtag 2019-12-08T12:16:57.393 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:57.325+0000 7f7ede88fec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.6 : type miss (requested=0x13, cached=0x16) 2019-12-08T12:16:57.393 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:57.325+0000 7f7ede88fec0 20 rados->read ofs=0 len=0 2019-12-08T12:16:57.418 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:57.353+0000 7f7ede88fec0 20 rados_obj.operate() r=0 bl.length=314 2019-12-08T12:16:57.418 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:57.353+0000 7f7ede88fec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.6 info.flags=0x13 2019-12-08T12:16:57.418 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:57.353+0000 7f7ede88fec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.6 to cache LRU end 2019-12-08T12:16:57.418 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:57.353+0000 7f7ede88fec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-08T12:16:57.418 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:57.353+0000 7f7ede88fec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-08T12:16:57.418 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:57.353+0000 7f7ede88fec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.6 2019-12-08T12:16:57.442 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:57.377+0000 7f7ede88fec0 10 cls_bucket_list_unordered :test-client.0-r-test-obj-storage-class.1[f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.6]) start [] num_entries 1100 2019-12-08T12:16:57.465 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:57.400+0000 7f7ede88fec0 10 RGWRados::cls_bucket_list_unordered: got foo-FROZEN[] 2019-12-08T12:16:57.465 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:57.400+0000 7f7ede88fec0 10 RGWRados::cls_bucket_list_unordered: got foo-LUKEWARM[] 2019-12-08T12:16:57.466 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:57.400+0000 7f7ede88fec0 10 RGWRados::cls_bucket_list_unordered: got foo-STANDARD[] 2019-12-08T12:16:57.466 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:57.400+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x55882267a1e8 s->prefetch_data=0 2019-12-08T12:16:57.482 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:57.418+0000 7f7ede88fec0 10 manifest: total_size = 10485760 2019-12-08T12:16:57.482 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:57.418+0000 7f7ede88fec0 20 get_obj_state: setting s->obj_tag to f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.84 2019-12-08T12:16:57.483 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:57.418+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x55882267a1e8 s->prefetch_data=0 2019-12-08T12:16:57.483 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:57.418+0000 7f7ede88fec0 20 prepare_atomic_modification: state is not atomic. state=0x55882267a1e8 2019-12-08T12:16:57.483 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:57.418+0000 7f7ede88fec0 20 bucket index object: default.rgw.buckets.index:.dir.f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.6 2019-12-08T12:16:57.610 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:57.545+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-08T12:16:57.610 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:57.545+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2019-12-08T12:16:57.610 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:57.545+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-08T12:16:57.610 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:57.545+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=8380416 stripe_ofs=8380416 part_ofs=0 rule->part_size=0 2019-12-08T12:16:57.610 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:57.545+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-08T12:16:57.610 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:57.545+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2019-12-08T12:16:57.611 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:57.545+0000 7f7ede88fec0 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.84 2019-12-08T12:16:57.658 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:57.594+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x55882267a1e8 s->prefetch_data=0 2019-12-08T12:16:57.668 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:57.603+0000 7f7ede88fec0 10 manifest: total_size = 10485760 2019-12-08T12:16:57.668 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:57.603+0000 7f7ede88fec0 20 get_obj_state: setting s->obj_tag to f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.85 2019-12-08T12:16:57.668 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:57.603+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x55882267a1e8 s->prefetch_data=0 2019-12-08T12:16:57.668 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:57.603+0000 7f7ede88fec0 20 prepare_atomic_modification: state is not atomic. state=0x55882267a1e8 2019-12-08T12:16:57.668 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:57.603+0000 7f7ede88fec0 20 bucket index object: default.rgw.buckets.index:.dir.f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.6 2019-12-08T12:16:57.795 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:57.730+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-08T12:16:57.795 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:57.730+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=4190208 stripe_ofs=4190208 part_ofs=0 rule->part_size=0 2019-12-08T12:16:57.795 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:57.730+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-08T12:16:57.795 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:57.730+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=8380416 stripe_ofs=8380416 part_ofs=0 rule->part_size=0 2019-12-08T12:16:57.796 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:57.730+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2019-12-08T12:16:57.796 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:57.730+0000 7f7ede88fec0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2019-12-08T12:16:57.796 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:57.730+0000 7f7ede88fec0 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.85 2019-12-08T12:16:57.851 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:57.787+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x55882267a1e8 s->prefetch_data=0 2019-12-08T12:16:57.862 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:57.798+0000 7f7ede88fec0 10 manifest: total_size = 44258 2019-12-08T12:16:57.863 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:57.798+0000 7f7ede88fec0 20 get_obj_state: setting s->obj_tag to f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.86 2019-12-08T12:16:57.863 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:57.798+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x55882267a1e8 s->prefetch_data=0 2019-12-08T12:16:57.863 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:57.798+0000 7f7ede88fec0 20 prepare_atomic_modification: state is not atomic. state=0x55882267a1e8 2019-12-08T12:16:57.863 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:57.798+0000 7f7ede88fec0 20 bucket index object: default.rgw.buckets.index:.dir.f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.6 2019-12-08T12:16:57.987 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:57.922+0000 7f7ede88fec0 10 cls_bucket_list_ordered :test-client.0-r-test-obj-storage-class.1[f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.6]) start _multipart_[] num_entries 1001 2019-12-08T12:16:57.987 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:57.922+0000 7f7ede88fec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-12-08T12:16:58.051 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:57.986+0000 7f7ede88fec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class.1[f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.6])"; objs.size()=0; is_truncated=0 2019-12-08T12:16:58.119 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:58.054+0000 7f7ede88fec0 20 get_system_obj_state: rctx=0x7ffc112a9998 obj=default.rgw.meta:root:test-client.0-r-test-obj-storage-class.1 state=0x558822674920 s->prefetch_data=0 2019-12-08T12:16:58.120 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:58.054+0000 7f7ede88fec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : type miss (requested=0x16, cached=0x3) 2019-12-08T12:16:58.142 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:58.077+0000 7f7ede88fec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x16 2019-12-08T12:16:58.142 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:58.077+0000 7f7ede88fec0 10 moving default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2019-12-08T12:16:58.142 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:58.077+0000 7f7ede88fec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-08T12:16:58.142 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:58.077+0000 7f7ede88fec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-08T12:16:58.143 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:58.077+0000 7f7ede88fec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : hit (requested=0x11, cached=0x17) 2019-12-08T12:16:58.143 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:58.077+0000 7f7ede88fec0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 from cache 2019-12-08T12:16:58.143 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:58.077+0000 7f7ede88fec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=184 2019-12-08T12:16:58.164 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:58.100+0000 7f7ec17fa700 10 RGWWatcher::handle_notify() notify_id 571230650378 cookie 94043180528320 notifier 4457 bl.length()=184 2019-12-08T12:16:58.457 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:58.393+0000 7f7ede88fec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.6 from cache 2019-12-08T12:16:58.458 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:58.393+0000 7f7ede88fec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=241 2019-12-08T12:16:58.481 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:58.417+0000 7f7ec17fa700 10 RGWWatcher::handle_notify() notify_id 571230650375 cookie 94043180537696 notifier 4457 bl.length()=241 2019-12-08T12:16:59.074 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:59.009+0000 7f7ede88fec0 20 get_system_obj_state: rctx=0x7ffc112a9fe0 obj=default.rgw.meta:root:test-client.0-r-test-small-obj-data.1 state=0x558822674920 s->prefetch_data=0 2019-12-08T12:16:59.074 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:59.009+0000 7f7ede88fec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : miss 2019-12-08T12:16:59.089 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:59.024+0000 7f7ede88fec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x6 2019-12-08T12:16:59.089 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:59.024+0000 7f7ede88fec0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2019-12-08T12:16:59.089 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:59.024+0000 7f7ede88fec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-08T12:16:59.089 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:59.024+0000 7f7ede88fec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-08T12:16:59.089 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:59.024+0000 7f7ede88fec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : type miss (requested=0x1, cached=0x6) 2019-12-08T12:16:59.089 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:59.024+0000 7f7ede88fec0 20 rados->read ofs=0 len=0 2019-12-08T12:16:59.105 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:59.040+0000 7f7ede88fec0 20 rados_obj.operate() r=0 bl.length=221 2019-12-08T12:16:59.105 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:59.040+0000 7f7ede88fec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x1 2019-12-08T12:16:59.106 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:59.040+0000 7f7ede88fec0 10 moving default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2019-12-08T12:16:59.106 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:59.040+0000 7f7ede88fec0 20 get_system_obj_state: rctx=0x7ffc112a9fe0 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.1:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.10 state=0x558822677740 s->prefetch_data=0 2019-12-08T12:16:59.106 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:59.040+0000 7f7ede88fec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.10 : miss 2019-12-08T12:16:59.122 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:59.057+0000 7f7ede88fec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.10 info.flags=0x16 2019-12-08T12:16:59.122 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:59.057+0000 7f7ede88fec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.10 to cache LRU end 2019-12-08T12:16:59.122 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:59.057+0000 7f7ede88fec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-08T12:16:59.123 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:59.057+0000 7f7ede88fec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-08T12:16:59.123 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:59.057+0000 7f7ede88fec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-08T12:16:59.123 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:59.057+0000 7f7ede88fec0 20 Read xattr: user.rgw.acl 2019-12-08T12:16:59.123 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:59.057+0000 7f7ede88fec0 20 Read xattr: user.rgw.idtag 2019-12-08T12:16:59.123 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:59.057+0000 7f7ede88fec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.10 : type miss (requested=0x13, cached=0x16) 2019-12-08T12:16:59.123 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:59.057+0000 7f7ede88fec0 20 rados->read ofs=0 len=0 2019-12-08T12:16:59.139 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:59.074+0000 7f7ede88fec0 20 rados_obj.operate() r=0 bl.length=313 2019-12-08T12:16:59.139 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:59.074+0000 7f7ede88fec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.10 info.flags=0x13 2019-12-08T12:16:59.139 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:59.074+0000 7f7ede88fec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.10 to cache LRU end 2019-12-08T12:16:59.139 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:59.074+0000 7f7ede88fec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-08T12:16:59.139 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:59.074+0000 7f7ede88fec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-08T12:16:59.139 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:59.074+0000 7f7ede88fec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.10 2019-12-08T12:16:59.166 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:59.101+0000 7f7ede88fec0 10 cls_bucket_list_unordered :test-client.0-r-test-small-obj-data.1[f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.10]) start [] num_entries 1100 2019-12-08T12:16:59.201 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:59.136+0000 7f7ede88fec0 10 RGWRados::cls_bucket_list_unordered: got __[] 2019-12-08T12:16:59.201 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:59.136+0000 7f7ede88fec0 10 RGWRados::cls_bucket_list_unordered: got __ _[] 2019-12-08T12:16:59.201 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:59.136+0000 7f7ede88fec0 10 RGWRados::cls_bucket_list_unordered: got ___[] 2019-12-08T12:16:59.201 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:59.136+0000 7f7ede88fec0 10 RGWRados::cls_bucket_list_unordered: got obj[] 2019-12-08T12:16:59.202 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:59.136+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-small-obj-data.1:__ state=0x55882267a1e8 s->prefetch_data=0 2019-12-08T12:16:59.215 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:59.150+0000 7f7ede88fec0 10 manifest: total_size = 4134 2019-12-08T12:16:59.216 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:59.150+0000 7f7ede88fec0 20 get_obj_state: setting s->obj_tag to f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.305 2019-12-08T12:16:59.216 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:59.150+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-small-obj-data.1:__ state=0x55882267a1e8 s->prefetch_data=0 2019-12-08T12:16:59.216 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:59.151+0000 7f7ede88fec0 20 prepare_atomic_modification: state is not atomic. state=0x55882267a1e8 2019-12-08T12:16:59.216 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:59.151+0000 7f7ede88fec0 20 bucket index object: default.rgw.buckets.index:.dir.f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.10 2019-12-08T12:16:59.377 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:59.312+0000 7f7e1ffff700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-08T12:16:59.378 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:59.313+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x55882267a1e8 s->prefetch_data=0 2019-12-08T12:16:59.400 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:59.335+0000 7f7ede88fec0 10 manifest: total_size = 110 2019-12-08T12:16:59.400 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:59.335+0000 7f7ede88fec0 20 get_obj_state: setting s->obj_tag to f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.307 2019-12-08T12:16:59.401 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:59.335+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x55882267a1e8 s->prefetch_data=0 2019-12-08T12:16:59.401 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:59.335+0000 7f7ede88fec0 20 prepare_atomic_modification: state is not atomic. state=0x55882267a1e8 2019-12-08T12:16:59.401 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:59.335+0000 7f7ede88fec0 20 bucket index object: default.rgw.buckets.index:.dir.f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.10 2019-12-08T12:16:59.610 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:59.545+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-small-obj-data.1:___ state=0x55882267a1e8 s->prefetch_data=0 2019-12-08T12:16:59.621 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:59.556+0000 7f7ede88fec0 10 manifest: total_size = 1035 2019-12-08T12:16:59.621 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:59.556+0000 7f7ede88fec0 20 get_obj_state: setting s->obj_tag to f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.306 2019-12-08T12:16:59.621 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:59.556+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-small-obj-data.1:___ state=0x55882267a1e8 s->prefetch_data=0 2019-12-08T12:16:59.621 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:59.556+0000 7f7ede88fec0 20 prepare_atomic_modification: state is not atomic. state=0x55882267a1e8 2019-12-08T12:16:59.621 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:59.556+0000 7f7ede88fec0 20 bucket index object: default.rgw.buckets.index:.dir.f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.10 2019-12-08T12:16:59.827 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:59.762+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-small-obj-data.1:obj state=0x55882267a1e8 s->prefetch_data=0 2019-12-08T12:16:59.847 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:59.782+0000 7f7ede88fec0 10 manifest: total_size = 1048576 2019-12-08T12:16:59.847 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:59.782+0000 7f7ede88fec0 20 get_obj_state: setting s->obj_tag to f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.304 2019-12-08T12:16:59.847 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:59.782+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-small-obj-data.1:obj state=0x55882267a1e8 s->prefetch_data=0 2019-12-08T12:16:59.847 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:59.782+0000 7f7ede88fec0 20 prepare_atomic_modification: state is not atomic. state=0x55882267a1e8 2019-12-08T12:16:59.847 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:59.782+0000 7f7ede88fec0 20 bucket index object: default.rgw.buckets.index:.dir.f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.10 2019-12-08T12:17:00.017 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:59.953+0000 7f7ede88fec0 10 cls_bucket_list_ordered :test-client.0-r-test-small-obj-data.1[f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.10]) start _multipart_[] num_entries 1001 2019-12-08T12:17:00.018 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:16:59.953+0000 7f7ede88fec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-12-08T12:17:00.074 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:00.009+0000 7f7ede88fec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.1[f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.10])"; objs.size()=0; is_truncated=0 2019-12-08T12:17:00.153 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:00.085+0000 7f7ede88fec0 20 get_system_obj_state: rctx=0x7ffc112a9998 obj=default.rgw.meta:root:test-client.0-r-test-small-obj-data.1 state=0x55882267b0c0 s->prefetch_data=0 2019-12-08T12:17:00.153 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:00.085+0000 7f7ede88fec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : type miss (requested=0x16, cached=0x3) 2019-12-08T12:17:00.173 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:00.108+0000 7f7ede88fec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x16 2019-12-08T12:17:00.173 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:00.108+0000 7f7ede88fec0 10 moving default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2019-12-08T12:17:00.173 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:00.108+0000 7f7ede88fec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-08T12:17:00.173 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:00.108+0000 7f7ede88fec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-08T12:17:00.173 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:00.108+0000 7f7ede88fec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : hit (requested=0x11, cached=0x17) 2019-12-08T12:17:00.174 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:00.108+0000 7f7ede88fec0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 from cache 2019-12-08T12:17:00.174 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:00.108+0000 7f7ede88fec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=181 2019-12-08T12:17:00.189 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:00.124+0000 7f7ec17fa700 10 RGWWatcher::handle_notify() notify_id 571230650376 cookie 94043180526416 notifier 4457 bl.length()=181 2019-12-08T12:17:00.671 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:00.606+0000 7f7ede88fec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.10 from cache 2019-12-08T12:17:00.671 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:00.606+0000 7f7ede88fec0 10 distributing notification oid=default.rgw.control:notify.3 bl.length()=239 2019-12-08T12:17:00.685 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:00.620+0000 7f7ec17fa700 10 RGWWatcher::handle_notify() notify_id 571230650371 cookie 94043180531216 notifier 4457 bl.length()=239 2019-12-08T12:17:00.872 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:00.806+0000 7f7ede88fec0 20 get_system_obj_state: rctx=0x7ffc112a9fe0 obj=default.rgw.meta:root:test-client.0-r-test-small-obj-data.2 state=0x558822677740 s->prefetch_data=0 2019-12-08T12:17:00.872 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:00.806+0000 7f7ede88fec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : miss 2019-12-08T12:17:00.882 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:00.817+0000 7f7ede88fec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x6 2019-12-08T12:17:00.883 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:00.817+0000 7f7ede88fec0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2019-12-08T12:17:00.883 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:00.817+0000 7f7ede88fec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-08T12:17:00.883 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:00.817+0000 7f7ede88fec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-08T12:17:00.883 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:00.817+0000 7f7ede88fec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : type miss (requested=0x1, cached=0x6) 2019-12-08T12:17:00.883 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:00.817+0000 7f7ede88fec0 20 rados->read ofs=0 len=0 2019-12-08T12:17:00.893 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:00.828+0000 7f7ede88fec0 20 rados_obj.operate() r=0 bl.length=221 2019-12-08T12:17:00.893 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:00.828+0000 7f7ede88fec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x1 2019-12-08T12:17:00.894 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:00.828+0000 7f7ede88fec0 10 moving default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2019-12-08T12:17:00.894 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:00.828+0000 7f7ede88fec0 20 get_system_obj_state: rctx=0x7ffc112a9fe0 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.2:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.11 state=0x558822674920 s->prefetch_data=0 2019-12-08T12:17:00.894 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:00.828+0000 7f7ede88fec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.11 : miss 2019-12-08T12:17:00.910 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:00.845+0000 7f7ede88fec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.11 info.flags=0x16 2019-12-08T12:17:00.910 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:00.845+0000 7f7ede88fec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.11 to cache LRU end 2019-12-08T12:17:00.910 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:00.845+0000 7f7ede88fec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-08T12:17:00.911 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:00.845+0000 7f7ede88fec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-08T12:17:00.911 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:00.845+0000 7f7ede88fec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-08T12:17:00.911 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:00.845+0000 7f7ede88fec0 20 Read xattr: user.rgw.acl 2019-12-08T12:17:00.911 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:00.845+0000 7f7ede88fec0 20 Read xattr: user.rgw.idtag 2019-12-08T12:17:00.911 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:00.845+0000 7f7ede88fec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.11 : type miss (requested=0x13, cached=0x16) 2019-12-08T12:17:00.911 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:00.845+0000 7f7ede88fec0 20 rados->read ofs=0 len=0 2019-12-08T12:17:00.933 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:00.859+0000 7f7ede88fec0 20 rados_obj.operate() r=0 bl.length=313 2019-12-08T12:17:00.933 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:00.859+0000 7f7ede88fec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.11 info.flags=0x13 2019-12-08T12:17:00.933 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:00.859+0000 7f7ede88fec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.11 to cache LRU end 2019-12-08T12:17:00.933 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:00.859+0000 7f7ede88fec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-08T12:17:00.934 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:00.859+0000 7f7ede88fec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-08T12:17:00.934 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:00.859+0000 7f7ede88fec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.11 2019-12-08T12:17:00.935 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:00.870+0000 7f7ede88fec0 10 cls_bucket_list_unordered :test-client.0-r-test-small-obj-data.2[f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.11]) start [] num_entries 1100 2019-12-08T12:17:00.948 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:00.883+0000 7f7ede88fec0 10 RGWRados::cls_bucket_list_unordered: got __[] 2019-12-08T12:17:00.948 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:00.883+0000 7f7ede88fec0 10 RGWRados::cls_bucket_list_unordered: got __ _[] 2019-12-08T12:17:00.949 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:00.883+0000 7f7ede88fec0 10 RGWRados::cls_bucket_list_unordered: got ___[] 2019-12-08T12:17:00.949 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:00.883+0000 7f7ede88fec0 10 RGWRados::cls_bucket_list_unordered: got obj[] 2019-12-08T12:17:00.949 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:00.883+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-small-obj-data.2:__ state=0x55882267a1e8 s->prefetch_data=0 2019-12-08T12:17:00.957 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:00.892+0000 7f7ede88fec0 10 manifest: total_size = 62 2019-12-08T12:17:00.957 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:00.892+0000 7f7ede88fec0 20 get_obj_state: setting s->obj_tag to f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.312 2019-12-08T12:17:00.957 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:00.892+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-small-obj-data.2:__ state=0x55882267a1e8 s->prefetch_data=0 2019-12-08T12:17:00.957 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:00.892+0000 7f7ede88fec0 20 prepare_atomic_modification: state is not atomic. state=0x55882267a1e8 2019-12-08T12:17:00.957 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:00.892+0000 7f7ede88fec0 20 bucket index object: default.rgw.buckets.index:.dir.f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.11 2019-12-08T12:17:01.076 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:01.010+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x55882267a1e8 s->prefetch_data=0 2019-12-08T12:17:01.092 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:01.027+0000 7f7ede88fec0 10 manifest: total_size = 24595 2019-12-08T12:17:01.092 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:01.027+0000 7f7ede88fec0 20 get_obj_state: setting s->obj_tag to f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.314 2019-12-08T12:17:01.092 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:01.027+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x55882267a1e8 s->prefetch_data=0 2019-12-08T12:17:01.092 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:01.027+0000 7f7ede88fec0 20 prepare_atomic_modification: state is not atomic. state=0x55882267a1e8 2019-12-08T12:17:01.092 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:01.027+0000 7f7ede88fec0 20 bucket index object: default.rgw.buckets.index:.dir.f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.11 2019-12-08T12:17:01.243 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:01.178+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-small-obj-data.2:___ state=0x558822678c08 s->prefetch_data=0 2019-12-08T12:17:01.259 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:01.193+0000 7f7ede88fec0 10 manifest: total_size = 62 2019-12-08T12:17:01.259 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:01.194+0000 7f7ede88fec0 20 get_obj_state: setting s->obj_tag to f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.313 2019-12-08T12:17:01.259 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:01.194+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-small-obj-data.2:___ state=0x558822678c08 s->prefetch_data=0 2019-12-08T12:17:01.259 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:01.194+0000 7f7ede88fec0 20 prepare_atomic_modification: state is not atomic. state=0x558822678c08 2019-12-08T12:17:01.260 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:01.194+0000 7f7ede88fec0 20 bucket index object: default.rgw.buckets.index:.dir.f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.11 2019-12-08T12:17:01.405 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:01.340+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-small-obj-data.2:obj state=0x558822678b78 s->prefetch_data=0 2019-12-08T12:17:01.439 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:01.374+0000 7f7ede88fec0 10 manifest: total_size = 24595 2019-12-08T12:17:01.439 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:01.374+0000 7f7ede88fec0 20 get_obj_state: setting s->obj_tag to f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.311 2019-12-08T12:17:01.439 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:01.374+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-small-obj-data.2:obj state=0x558822678b78 s->prefetch_data=0 2019-12-08T12:17:01.440 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:01.374+0000 7f7ede88fec0 20 prepare_atomic_modification: state is not atomic. state=0x558822678b78 2019-12-08T12:17:01.440 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:01.374+0000 7f7ede88fec0 20 bucket index object: default.rgw.buckets.index:.dir.f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.11 2019-12-08T12:17:01.639 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:01.574+0000 7f7ede88fec0 10 cls_bucket_list_ordered :test-client.0-r-test-small-obj-data.2[f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.11]) start _multipart_[] num_entries 1001 2019-12-08T12:17:01.639 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:01.574+0000 7f7ede88fec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-12-08T12:17:01.699 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:01.634+0000 7f7ede88fec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.2[f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.11])"; objs.size()=0; is_truncated=0 2019-12-08T12:17:01.750 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:01.685+0000 7f7ede88fec0 20 get_system_obj_state: rctx=0x7ffc112a9998 obj=default.rgw.meta:root:test-client.0-r-test-small-obj-data.2 state=0x558822679ef0 s->prefetch_data=0 2019-12-08T12:17:01.750 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:01.685+0000 7f7ede88fec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : type miss (requested=0x16, cached=0x3) 2019-12-08T12:17:01.767 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:01.701+0000 7f7ede88fec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x16 2019-12-08T12:17:01.767 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:01.701+0000 7f7ede88fec0 10 moving default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2019-12-08T12:17:01.767 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:01.701+0000 7f7ede88fec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-08T12:17:01.767 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:01.701+0000 7f7ede88fec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-08T12:17:01.767 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:01.701+0000 7f7ede88fec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : hit (requested=0x11, cached=0x17) 2019-12-08T12:17:01.767 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:01.701+0000 7f7ede88fec0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 from cache 2019-12-08T12:17:01.768 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:01.701+0000 7f7ede88fec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=181 2019-12-08T12:17:01.781 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:01.715+0000 7f7ec17fa700 10 RGWWatcher::handle_notify() notify_id 571230650377 cookie 94043180526416 notifier 4457 bl.length()=181 2019-12-08T12:17:02.052 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:01.986+0000 7f7ede88fec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.11 from cache 2019-12-08T12:17:02.052 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:01.986+0000 7f7ede88fec0 10 distributing notification oid=default.rgw.control:notify.3 bl.length()=239 2019-12-08T12:17:02.068 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:02.003+0000 7f7ec17fa700 10 RGWWatcher::handle_notify() notify_id 571230650372 cookie 94043180531216 notifier 4457 bl.length()=239 2019-12-08T12:17:02.480 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:02.415+0000 7f7ede88fec0 20 get_system_obj_state: rctx=0x7ffc112a9fe0 obj=default.rgw.meta:root:test-client.0-r-test-small-obj-data.3 state=0x558822677740 s->prefetch_data=0 2019-12-08T12:17:02.480 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:02.415+0000 7f7ede88fec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : miss 2019-12-08T12:17:02.501 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:02.436+0000 7f7ede88fec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x6 2019-12-08T12:17:02.501 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:02.436+0000 7f7ede88fec0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2019-12-08T12:17:02.501 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:02.436+0000 7f7ede88fec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-08T12:17:02.501 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:02.436+0000 7f7ede88fec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-08T12:17:02.501 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:02.436+0000 7f7ede88fec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : type miss (requested=0x1, cached=0x6) 2019-12-08T12:17:02.501 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:02.436+0000 7f7ede88fec0 20 rados->read ofs=0 len=0 2019-12-08T12:17:02.516 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:02.451+0000 7f7ede88fec0 20 rados_obj.operate() r=0 bl.length=221 2019-12-08T12:17:02.516 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:02.451+0000 7f7ede88fec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x1 2019-12-08T12:17:02.517 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:02.451+0000 7f7ede88fec0 10 moving default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2019-12-08T12:17:02.517 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:02.451+0000 7f7ede88fec0 20 get_system_obj_state: rctx=0x7ffc112a9fe0 obj=default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.3:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.12 state=0x558822674920 s->prefetch_data=0 2019-12-08T12:17:02.517 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:02.451+0000 7f7ede88fec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.12 : miss 2019-12-08T12:17:02.531 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:02.466+0000 7f7ede88fec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.12 info.flags=0x16 2019-12-08T12:17:02.532 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:02.466+0000 7f7ede88fec0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.12 to cache LRU end 2019-12-08T12:17:02.532 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:02.466+0000 7f7ede88fec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-08T12:17:02.532 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:02.466+0000 7f7ede88fec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-08T12:17:02.532 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:02.466+0000 7f7ede88fec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-08T12:17:02.532 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:02.466+0000 7f7ede88fec0 20 Read xattr: user.rgw.acl 2019-12-08T12:17:02.532 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:02.466+0000 7f7ede88fec0 20 Read xattr: user.rgw.idtag 2019-12-08T12:17:02.532 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:02.466+0000 7f7ede88fec0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.12 : type miss (requested=0x13, cached=0x16) 2019-12-08T12:17:02.533 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:02.466+0000 7f7ede88fec0 20 rados->read ofs=0 len=0 2019-12-08T12:17:02.545 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:02.480+0000 7f7ede88fec0 20 rados_obj.operate() r=0 bl.length=313 2019-12-08T12:17:02.545 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:02.480+0000 7f7ede88fec0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.12 info.flags=0x13 2019-12-08T12:17:02.546 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:02.480+0000 7f7ede88fec0 10 moving default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.12 to cache LRU end 2019-12-08T12:17:02.546 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:02.480+0000 7f7ede88fec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-08T12:17:02.546 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:02.480+0000 7f7ede88fec0 10 updating xattr: name=user.rgw.acl bl.length()=209 2019-12-08T12:17:02.546 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:02.480+0000 7f7ede88fec0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.12 2019-12-08T12:17:02.556 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:02.491+0000 7f7ede88fec0 10 cls_bucket_list_unordered :test-client.0-r-test-small-obj-data.3[f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.12]) start [] num_entries 1100 2019-12-08T12:17:02.569 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:02.504+0000 7f7ede88fec0 10 RGWRados::cls_bucket_list_unordered: got __[] 2019-12-08T12:17:02.570 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:02.504+0000 7f7ede88fec0 10 RGWRados::cls_bucket_list_unordered: got __ _[] 2019-12-08T12:17:02.570 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:02.504+0000 7f7ede88fec0 10 RGWRados::cls_bucket_list_unordered: got ___[] 2019-12-08T12:17:02.570 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:02.504+0000 7f7ede88fec0 10 RGWRados::cls_bucket_list_unordered: got obj[] 2019-12-08T12:17:02.570 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:02.504+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-small-obj-data.3:__ state=0x55882267a1e8 s->prefetch_data=0 2019-12-08T12:17:02.578 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:02.513+0000 7f7ede88fec0 10 manifest: total_size = 0 2019-12-08T12:17:02.579 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:02.513+0000 7f7ede88fec0 20 get_obj_state: setting s->obj_tag to f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.319 2019-12-08T12:17:02.579 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:02.513+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-small-obj-data.3:__ state=0x55882267a1e8 s->prefetch_data=0 2019-12-08T12:17:02.579 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:02.513+0000 7f7ede88fec0 20 prepare_atomic_modification: state is not atomic. state=0x55882267a1e8 2019-12-08T12:17:02.579 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:02.513+0000 7f7ede88fec0 20 bucket index object: default.rgw.buckets.index:.dir.f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.12 2019-12-08T12:17:02.710 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:02.645+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x55882267a1e8 s->prefetch_data=0 2019-12-08T12:17:02.727 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:02.662+0000 7f7ede88fec0 10 manifest: total_size = 0 2019-12-08T12:17:02.727 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:02.662+0000 7f7ede88fec0 20 get_obj_state: setting s->obj_tag to f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.321 2019-12-08T12:17:02.728 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:02.662+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x55882267a1e8 s->prefetch_data=0 2019-12-08T12:17:02.728 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:02.662+0000 7f7ede88fec0 20 prepare_atomic_modification: state is not atomic. state=0x55882267a1e8 2019-12-08T12:17:02.728 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:02.662+0000 7f7ede88fec0 20 bucket index object: default.rgw.buckets.index:.dir.f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.12 2019-12-08T12:17:02.946 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:02.881+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-small-obj-data.3:___ state=0x55882267a1e8 s->prefetch_data=0 2019-12-08T12:17:02.977 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:02.911+0000 7f7ede88fec0 10 manifest: total_size = 0 2019-12-08T12:17:02.977 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:02.911+0000 7f7ede88fec0 20 get_obj_state: setting s->obj_tag to f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.320 2019-12-08T12:17:02.977 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:02.911+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-small-obj-data.3:___ state=0x55882267a1e8 s->prefetch_data=0 2019-12-08T12:17:02.977 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:02.911+0000 7f7ede88fec0 20 prepare_atomic_modification: state is not atomic. state=0x55882267a1e8 2019-12-08T12:17:02.977 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:02.911+0000 7f7ede88fec0 20 bucket index object: default.rgw.buckets.index:.dir.f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.12 2019-12-08T12:17:03.158 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:03.093+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-small-obj-data.3:obj state=0x55882267a1e8 s->prefetch_data=0 2019-12-08T12:17:03.175 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:03.107+0000 7f7ede88fec0 10 manifest: total_size = 0 2019-12-08T12:17:03.175 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:03.107+0000 7f7ede88fec0 20 get_obj_state: setting s->obj_tag to f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.318 2019-12-08T12:17:03.175 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:03.107+0000 7f7ede88fec0 20 get_obj_state: rctx=0x7ffc112aa000 obj=test-client.0-r-test-small-obj-data.3:obj state=0x55882267a1e8 s->prefetch_data=0 2019-12-08T12:17:03.175 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:03.107+0000 7f7ede88fec0 20 prepare_atomic_modification: state is not atomic. state=0x55882267a1e8 2019-12-08T12:17:03.175 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:03.108+0000 7f7ede88fec0 20 bucket index object: default.rgw.buckets.index:.dir.f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.12 2019-12-08T12:17:03.373 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:03.308+0000 7f7ede88fec0 10 cls_bucket_list_ordered :test-client.0-r-test-small-obj-data.3[f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.12]) start _multipart_[] num_entries 1001 2019-12-08T12:17:03.374 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:03.308+0000 7f7ede88fec0 10 cls_bucket_list_ordered request from each of 1 shard(s) for 1002 entries to get 1001 total entries 2019-12-08T12:17:03.450 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:03.385+0000 7f7ede88fec0 20 abort_bucket_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.3[f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.12])"; objs.size()=0; is_truncated=0 2019-12-08T12:17:03.513 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:03.448+0000 7f7ede88fec0 20 get_system_obj_state: rctx=0x7ffc112a9998 obj=default.rgw.meta:root:test-client.0-r-test-small-obj-data.3 state=0x558822677740 s->prefetch_data=0 2019-12-08T12:17:03.513 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:03.448+0000 7f7ede88fec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : type miss (requested=0x16, cached=0x3) 2019-12-08T12:17:03.546 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:03.480+0000 7f7ede88fec0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x16 2019-12-08T12:17:03.546 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:03.480+0000 7f7ede88fec0 10 moving default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2019-12-08T12:17:03.546 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:03.480+0000 7f7ede88fec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-08T12:17:03.546 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:03.480+0000 7f7ede88fec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-08T12:17:03.546 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:03.480+0000 7f7ede88fec0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : hit (requested=0x11, cached=0x17) 2019-12-08T12:17:03.546 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:03.480+0000 7f7ede88fec0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 from cache 2019-12-08T12:17:03.547 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:03.480+0000 7f7ede88fec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=181 2019-12-08T12:17:03.565 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:03.500+0000 7f7ec17fa700 10 RGWWatcher::handle_notify() notify_id 571230650378 cookie 94043180526416 notifier 4457 bl.length()=181 2019-12-08T12:17:03.937 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:03.872+0000 7f7ede88fec0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.12 from cache 2019-12-08T12:17:03.938 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:03.872+0000 7f7ede88fec0 10 distributing notification oid=default.rgw.control:notify.3 bl.length()=239 2019-12-08T12:17:03.954 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:03.889+0000 7f7ec17fa700 10 RGWWatcher::handle_notify() notify_id 571230650373 cookie 94043180531216 notifier 4457 bl.length()=239 2019-12-08T12:17:04.224 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:04.159+0000 7f7ede88fec0 10 removing key index: PEAIWRQJBYHGHZDWIHUK 2019-12-08T12:17:04.224 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:04.159+0000 7f7ede88fec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=170 2019-12-08T12:17:04.243 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:04.178+0000 7f7ec17fa700 10 RGWWatcher::handle_notify() notify_id 571230650379 cookie 94043180537696 notifier 4457 bl.length()=170 2019-12-08T12:17:04.757 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:04.691+0000 7f7ede88fec0 10 removing email index: ragweed.client.0+test@test.test 2019-12-08T12:17:04.757 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:04.691+0000 7f7ede88fec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=182 2019-12-08T12:17:04.774 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:04.708+0000 7f7ec17fa700 10 RGWWatcher::handle_notify() notify_id 571230650379 cookie 94043180528320 notifier 4457 bl.length()=182 2019-12-08T12:17:05.105 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:05.038+0000 7f7ede88fec0 10 removing user buckets index 2019-12-08T12:17:05.105 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:05.038+0000 7f7ede88fec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=173 2019-12-08T12:17:05.139 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:05.074+0000 7f7ec17fa700 10 RGWWatcher::handle_notify() notify_id 571230650380 cookie 94043180537696 notifier 4457 bl.length()=173 2019-12-08T12:17:05.585 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:05.520+0000 7f7ede88fec0 10 removing user index: ragweed.client.0 2019-12-08T12:17:05.585 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:05.520+0000 7f7ede88fec0 10 removing default.rgw.meta+users.uid+ragweed.client.0 from cache 2019-12-08T12:17:05.585 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:05.520+0000 7f7ede88fec0 10 distributing notification oid=default.rgw.control:notify.4 bl.length()=165 2019-12-08T12:17:05.609 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:05.544+0000 7f7ec17fa700 10 RGWWatcher::handle_notify() notify_id 571230650380 cookie 94043180533312 notifier 4457 bl.length()=165 2019-12-08T12:17:06.039 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:05.974+0000 7f7ede88fec0 20 remove_watcher() i=0 2019-12-08T12:17:06.039 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:05.974+0000 7f7ede88fec0 2 removed watcher, disabling cache 2019-12-08T12:17:06.120 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:06.055+0000 7f7ede88fec0 20 remove_watcher() i=1 2019-12-08T12:17:06.195 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:06.129+0000 7f7ede88fec0 20 remove_watcher() i=2 2019-12-08T12:17:06.260 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:06.194+0000 7f7ede88fec0 20 remove_watcher() i=3 2019-12-08T12:17:06.329 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:06.264+0000 7f7ede88fec0 20 remove_watcher() i=4 2019-12-08T12:17:06.424 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:06.359+0000 7f7ede88fec0 20 remove_watcher() i=5 2019-12-08T12:17:06.478 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:06.413+0000 7f7ede88fec0 20 remove_watcher() i=6 2019-12-08T12:17:06.527 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:06.462+0000 7f7ede88fec0 20 remove_watcher() i=7 2019-12-08T12:17:06.535 INFO:tasks.ragweed:Removing ragweed... 2019-12-08T12:17:06.535 INFO:teuthology.orchestra.run.smithi079:> rm -rf /home/ubuntu/cephtest/ragweed 2019-12-08T12:17:06.621 INFO:teuthology.run_tasks:Running task s3tests-java... 2019-12-08T12:17:06.636 DEBUG:tasks.s3tests_java:S3 Tests Java: __INIT__ 2019-12-08T12:17:06.636 DEBUG:tasks.s3tests_java:S3 Tests Java: SETUP 2019-12-08T12:17:06.636 INFO:tasks.s3tests_java:S3 Tests Java: Downloading test suite... 2019-12-08T12:17:06.636 INFO:teuthology.orchestra.run.smithi079:> git clone -b master https://github.com/ceph/java_s3tests.git /home/ubuntu/cephtest/s3-tests-java 2019-12-08T12:17:06.685 INFO:teuthology.orchestra.run.smithi079.stdout:Cloning into '/home/ubuntu/cephtest/s3-tests-java'... 2019-12-08T12:17:10.574 INFO:tasks.s3tests_java:S3 Tests Java: Installing required packages... 2019-12-08T12:17:10.574 INFO:teuthology.orchestra.run.smithi079:> /home/ubuntu/cephtest/s3-tests-java/bootstrap.sh 2019-12-08T12:17:13.002 INFO:teuthology.orchestra.run.smithi079.stdout: Gradle will be installed under /opt/gradle 2019-12-08T12:17:13.045 INFO:teuthology.orchestra.run.smithi079.stderr:--2019-12-08 12:17:12-- https://services.gradle.org/distributions/gradle-4.7-bin.zip 2019-12-08T12:17:13.061 INFO:teuthology.orchestra.run.smithi079.stderr:Resolving services.gradle.org (services.gradle.org)... 104.18.190.9, 104.18.191.9, 2606:4700::6812:bf09, ... 2019-12-08T12:17:13.075 INFO:teuthology.orchestra.run.smithi079.stderr:Connecting to services.gradle.org (services.gradle.org)|104.18.190.9|:443... connected. 2019-12-08T12:17:13.103 INFO:teuthology.orchestra.run.smithi079.stderr:HTTP request sent, awaiting response... 301 Moved Permanently 2019-12-08T12:17:13.104 INFO:teuthology.orchestra.run.smithi079.stderr:Location: https://downloads.gradle-dn.com/distributions/gradle-4.7-bin.zip [following] 2019-12-08T12:17:13.104 INFO:teuthology.orchestra.run.smithi079.stderr:--2019-12-08 12:17:13-- https://downloads.gradle-dn.com/distributions/gradle-4.7-bin.zip 2019-12-08T12:17:13.114 INFO:teuthology.orchestra.run.smithi079.stderr:Resolving downloads.gradle-dn.com (downloads.gradle-dn.com)... 104.17.160.20, 104.17.159.20, 2606:4700::6811:a014, ... 2019-12-08T12:17:13.122 INFO:teuthology.orchestra.run.smithi079.stderr:Connecting to downloads.gradle-dn.com (downloads.gradle-dn.com)|104.17.160.20|:443... connected. 2019-12-08T12:17:13.185 INFO:teuthology.orchestra.run.smithi079.stderr:HTTP request sent, awaiting response... 200 OK 2019-12-08T12:17:13.186 INFO:teuthology.orchestra.run.smithi079.stderr:Length: 75323957 (72M) [application/zip] 2019-12-08T12:17:13.186 INFO:teuthology.orchestra.run.smithi079.stderr:Saving to: ‘gradle-4.7-bin.zip’ 2019-12-08T12:17:13.186 INFO:teuthology.orchestra.run.smithi079.stderr: 2019-12-08T12:17:13.195 INFO:teuthology.orchestra.run.smithi079.stderr: 0K .......... .......... .......... .......... .......... 0% 6.44M 11s 2019-12-08T12:17:13.195 INFO:teuthology.orchestra.run.smithi079.stderr: 50K .......... .......... .......... .......... .......... 0% 87.7M 6s 2019-12-08T12:17:13.205 INFO:teuthology.orchestra.run.smithi079.stderr: 100K .......... .......... .......... .......... .......... 0% 7.66M 7s 2019-12-08T12:17:13.205 INFO:teuthology.orchestra.run.smithi079.stderr: 150K .......... .......... .......... .......... .......... 0% 70.3M 6s 2019-12-08T12:17:13.205 INFO:teuthology.orchestra.run.smithi079.stderr: 200K .......... .......... .......... .......... .......... 0% 167M 5s 2019-12-08T12:17:13.205 INFO:teuthology.orchestra.run.smithi079.stderr: 250K .......... .......... .......... .......... .......... 0% 142M 4s 2019-12-08T12:17:13.211 INFO:teuthology.orchestra.run.smithi079.stderr: 300K .......... .......... .......... .......... .......... 0% 7.93M 5s 2019-12-08T12:17:13.211 INFO:teuthology.orchestra.run.smithi079.stderr: 350K .......... .......... .......... .......... .......... 0% 72.3M 4s 2019-12-08T12:17:13.211 INFO:teuthology.orchestra.run.smithi079.stderr: 400K .......... .......... .......... .......... .......... 0% 132M 4s 2019-12-08T12:17:13.211 INFO:teuthology.orchestra.run.smithi079.stderr: 450K .......... .......... .......... .......... .......... 0% 210M 3s 2019-12-08T12:17:13.220 INFO:teuthology.orchestra.run.smithi079.stderr: 500K .......... .......... .......... .......... .......... 0% 144M 3s 2019-12-08T12:17:13.220 INFO:teuthology.orchestra.run.smithi079.stderr: 550K .......... .......... .......... .......... .......... 0% 119M 3s 2019-12-08T12:17:13.220 INFO:teuthology.orchestra.run.smithi079.stderr: 600K .......... .......... .......... .......... .......... 0% 144M 3s 2019-12-08T12:17:13.220 INFO:teuthology.orchestra.run.smithi079.stderr: 650K .......... .......... .......... .......... .......... 0% 127M 3s 2019-12-08T12:17:13.220 INFO:teuthology.orchestra.run.smithi079.stderr: 700K .......... .......... .......... .......... .......... 1% 221M 2s 2019-12-08T12:17:13.221 INFO:teuthology.orchestra.run.smithi079.stderr: 750K .......... .......... .......... .......... .......... 1% 10.2M 3s 2019-12-08T12:17:14.423 INFO:teuthology.orchestra.run.smithi079.stderr: 800K .......... .......... .......... .......... .......... 1% 216M 3s 2019-12-08T12:17:14.423 INFO:teuthology.orchestra.run.smithi079.stderr: 850K .......... .......... .......... .......... .......... 1% 140M 2s 2019-12-08T12:17:14.424 INFO:teuthology.orchestra.run.smithi079.stderr: 900K .......... .......... .......... .......... .......... 1% 118M 2s 2019-12-08T12:17:14.424 INFO:teuthology.orchestra.run.smithi079.stderr: 950K .......... .......... .......... .......... .......... 1% 119M 2s 2019-12-08T12:17:14.424 INFO:teuthology.orchestra.run.smithi079.stderr: 1000K .......... .......... .......... .......... .......... 1% 127M 2s 2019-12-08T12:17:14.424 INFO:teuthology.orchestra.run.smithi079.stderr: 1050K .......... .......... .......... .......... .......... 1% 119M 2s 2019-12-08T12:17:14.424 INFO:teuthology.orchestra.run.smithi079.stderr: 1100K .......... .......... .......... .......... .......... 1% 133M 2s 2019-12-08T12:17:14.424 INFO:teuthology.orchestra.run.smithi079.stderr: 1150K .......... .......... .......... .......... .......... 1% 130M 2s 2019-12-08T12:17:14.424 INFO:teuthology.orchestra.run.smithi079.stderr: 1200K .......... .......... .......... .......... .......... 1% 127M 2s 2019-12-08T12:17:14.425 INFO:teuthology.orchestra.run.smithi079.stderr: 1250K .......... .......... .......... .......... .......... 1% 209M 2s 2019-12-08T12:17:14.425 INFO:teuthology.orchestra.run.smithi079.stderr: 1300K .......... .......... .......... .......... .......... 1% 148M 2s 2019-12-08T12:17:14.425 INFO:teuthology.orchestra.run.smithi079.stderr: 1350K .......... .......... .......... .......... .......... 1% 109M 2s 2019-12-08T12:17:14.425 INFO:teuthology.orchestra.run.smithi079.stderr: 1400K .......... .......... .......... .......... .......... 1% 131M 2s 2019-12-08T12:17:14.425 INFO:teuthology.orchestra.run.smithi079.stderr: 1450K .......... .......... .......... .......... .......... 2% 135M 2s 2019-12-08T12:17:14.425 INFO:teuthology.orchestra.run.smithi079.stderr: 1500K .......... .......... .......... .......... .......... 2% 145M 2s 2019-12-08T12:17:14.426 INFO:teuthology.orchestra.run.smithi079.stderr: 1550K .......... .......... .......... .......... .......... 2% 113M 2s 2019-12-08T12:17:14.426 INFO:teuthology.orchestra.run.smithi079.stderr: 1600K .......... .......... .......... .......... .......... 2% 219M 2s 2019-12-08T12:17:14.426 INFO:teuthology.orchestra.run.smithi079.stderr: 1650K .......... .......... .......... .......... .......... 2% 115M 2s 2019-12-08T12:17:14.426 INFO:teuthology.orchestra.run.smithi079.stderr: 1700K .......... .......... .......... .......... .......... 2% 84.1M 2s 2019-12-08T12:17:14.426 INFO:teuthology.orchestra.run.smithi079.stderr: 1750K .......... .......... .......... .......... .......... 2% 62.8M 1s 2019-12-08T12:17:14.426 INFO:teuthology.orchestra.run.smithi079.stderr: 1800K .......... .......... .......... .......... .......... 2% 199M 1s 2019-12-08T12:17:14.426 INFO:teuthology.orchestra.run.smithi079.stderr: 1850K .......... .......... .......... .......... .......... 2% 224M 1s 2019-12-08T12:17:14.426 INFO:teuthology.orchestra.run.smithi079.stderr: 1900K .......... .......... .......... .......... .......... 2% 99.3M 1s 2019-12-08T12:17:14.427 INFO:teuthology.orchestra.run.smithi079.stderr: 1950K .......... .......... .......... .......... .......... 2% 189M 1s 2019-12-08T12:17:14.427 INFO:teuthology.orchestra.run.smithi079.stderr: 2000K .......... .......... .......... .......... .......... 2% 85.0M 1s 2019-12-08T12:17:14.427 INFO:teuthology.orchestra.run.smithi079.stderr: 2050K .......... .......... .......... .......... .......... 2% 202M 1s 2019-12-08T12:17:14.427 INFO:teuthology.orchestra.run.smithi079.stderr: 2100K .......... .......... .......... .......... .......... 2% 223M 1s 2019-12-08T12:17:14.427 INFO:teuthology.orchestra.run.smithi079.stderr: 2150K .......... .......... .......... .......... .......... 2% 212M 1s 2019-12-08T12:17:14.427 INFO:teuthology.orchestra.run.smithi079.stderr: 2200K .......... .......... .......... .......... .......... 3% 251M 1s 2019-12-08T12:17:14.427 INFO:teuthology.orchestra.run.smithi079.stderr: 2250K .......... .......... .......... .......... .......... 3% 186M 1s 2019-12-08T12:17:14.428 INFO:teuthology.orchestra.run.smithi079.stderr: 2300K .......... .......... .......... .......... .......... 3% 228M 1s 2019-12-08T12:17:14.428 INFO:teuthology.orchestra.run.smithi079.stderr: 2350K .......... .......... .......... .......... .......... 3% 74.2M 1s 2019-12-08T12:17:14.428 INFO:teuthology.orchestra.run.smithi079.stderr: 2400K .......... .......... .......... .......... .......... 3% 198M 1s 2019-12-08T12:17:14.428 INFO:teuthology.orchestra.run.smithi079.stderr: 2450K .......... .......... .......... .......... .......... 3% 251M 1s 2019-12-08T12:17:14.429 INFO:teuthology.orchestra.run.smithi079.stderr: 2500K .......... .......... .......... .......... .......... 3% 248M 1s 2019-12-08T12:17:14.429 INFO:teuthology.orchestra.run.smithi079.stderr: 2550K .......... .......... .......... .......... .......... 3% 213M 1s 2019-12-08T12:17:14.429 INFO:teuthology.orchestra.run.smithi079.stderr: 2600K .......... .......... .......... .......... .......... 3% 243M 1s 2019-12-08T12:17:14.430 INFO:teuthology.orchestra.run.smithi079.stderr: 2650K .......... .......... .......... .......... .......... 3% 248M 1s 2019-12-08T12:17:14.430 INFO:teuthology.orchestra.run.smithi079.stderr: 2700K .......... .......... .......... .......... .......... 3% 221M 1s 2019-12-08T12:17:14.430 INFO:teuthology.orchestra.run.smithi079.stderr: 2750K .......... .......... .......... .......... .......... 3% 201M 1s 2019-12-08T12:17:14.430 INFO:teuthology.orchestra.run.smithi079.stderr: 2800K .......... .......... .......... .......... .......... 3% 245M 1s 2019-12-08T12:17:14.431 INFO:teuthology.orchestra.run.smithi079.stderr: 2850K .......... .......... .......... .......... .......... 3% 247M 1s 2019-12-08T12:17:14.431 INFO:teuthology.orchestra.run.smithi079.stderr: 2900K .......... .......... .......... .......... .......... 4% 249M 1s 2019-12-08T12:17:14.431 INFO:teuthology.orchestra.run.smithi079.stderr: 2950K .......... .......... .......... .......... .......... 4% 214M 1s 2019-12-08T12:17:14.431 INFO:teuthology.orchestra.run.smithi079.stderr: 3000K .......... .......... .......... .......... .......... 4% 242M 1s 2019-12-08T12:17:14.432 INFO:teuthology.orchestra.run.smithi079.stderr: 3050K .......... .......... .......... .......... .......... 4% 231M 1s 2019-12-08T12:17:14.432 INFO:teuthology.orchestra.run.smithi079.stderr: 3100K .......... .......... .......... .......... .......... 4% 223M 1s 2019-12-08T12:17:14.432 INFO:teuthology.orchestra.run.smithi079.stderr: 3150K .......... .......... .......... .......... .......... 4% 187M 1s 2019-12-08T12:17:14.432 INFO:teuthology.orchestra.run.smithi079.stderr: 3200K .......... .......... .......... .......... .......... 4% 183M 1s 2019-12-08T12:17:14.433 INFO:teuthology.orchestra.run.smithi079.stderr: 3250K .......... .......... .......... .......... .......... 4% 231M 1s 2019-12-08T12:17:14.433 INFO:teuthology.orchestra.run.smithi079.stderr: 3300K .......... .......... .......... .......... .......... 4% 233M 1s 2019-12-08T12:17:14.434 INFO:teuthology.orchestra.run.smithi079.stderr: 3350K .......... .......... .......... .......... .......... 4% 232M 1s 2019-12-08T12:17:14.434 INFO:teuthology.orchestra.run.smithi079.stderr: 3400K .......... .......... .......... .......... .......... 4% 258M 1s 2019-12-08T12:17:14.434 INFO:teuthology.orchestra.run.smithi079.stderr: 3450K .......... .......... .......... .......... .......... 4% 251M 1s 2019-12-08T12:17:14.434 INFO:teuthology.orchestra.run.smithi079.stderr: 3500K .......... .......... .......... .......... .......... 4% 262M 1s 2019-12-08T12:17:14.434 INFO:teuthology.orchestra.run.smithi079.stderr: 3550K .......... .......... .......... .......... .......... 4% 225M 1s 2019-12-08T12:17:14.434 INFO:teuthology.orchestra.run.smithi079.stderr: 3600K .......... .......... .......... .......... .......... 4% 267M 1s 2019-12-08T12:17:14.434 INFO:teuthology.orchestra.run.smithi079.stderr: 3650K .......... .......... .......... .......... .......... 5% 261M 1s 2019-12-08T12:17:14.435 INFO:teuthology.orchestra.run.smithi079.stderr: 3700K .......... .......... .......... .......... .......... 5% 251M 1s 2019-12-08T12:17:14.435 INFO:teuthology.orchestra.run.smithi079.stderr: 3750K .......... .......... .......... .......... .......... 5% 238M 1s 2019-12-08T12:17:14.435 INFO:teuthology.orchestra.run.smithi079.stderr: 3800K .......... .......... .......... .......... .......... 5% 273M 1s 2019-12-08T12:17:14.435 INFO:teuthology.orchestra.run.smithi079.stderr: 3850K .......... .......... .......... .......... .......... 5% 260M 1s 2019-12-08T12:17:14.435 INFO:teuthology.orchestra.run.smithi079.stderr: 3900K .......... .......... .......... .......... .......... 5% 259M 1s 2019-12-08T12:17:14.435 INFO:teuthology.orchestra.run.smithi079.stderr: 3950K .......... .......... .......... .......... .......... 5% 212M 1s 2019-12-08T12:17:14.435 INFO:teuthology.orchestra.run.smithi079.stderr: 4000K .......... .......... .......... .......... .......... 5% 254M 1s 2019-12-08T12:17:14.436 INFO:teuthology.orchestra.run.smithi079.stderr: 4050K .......... .......... .......... .......... .......... 5% 261M 1s 2019-12-08T12:17:14.436 INFO:teuthology.orchestra.run.smithi079.stderr: 4100K .......... .......... .......... .......... .......... 5% 266M 1s 2019-12-08T12:17:14.436 INFO:teuthology.orchestra.run.smithi079.stderr: 4150K .......... .......... .......... .......... .......... 5% 230M 1s 2019-12-08T12:17:14.436 INFO:teuthology.orchestra.run.smithi079.stderr: 4200K .......... .......... .......... .......... .......... 5% 250M 1s 2019-12-08T12:17:14.436 INFO:teuthology.orchestra.run.smithi079.stderr: 4250K .......... .......... .......... .......... .......... 5% 257M 1s 2019-12-08T12:17:14.436 INFO:teuthology.orchestra.run.smithi079.stderr: 4300K .......... .......... .......... .......... .......... 5% 247M 1s 2019-12-08T12:17:14.436 INFO:teuthology.orchestra.run.smithi079.stderr: 4350K .......... .......... .......... .......... .......... 5% 212M 1s 2019-12-08T12:17:14.437 INFO:teuthology.orchestra.run.smithi079.stderr: 4400K .......... .......... .......... .......... .......... 6% 253M 1s 2019-12-08T12:17:14.437 INFO:teuthology.orchestra.run.smithi079.stderr: 4450K .......... .......... .......... .......... .......... 6% 241M 1s 2019-12-08T12:17:14.437 INFO:teuthology.orchestra.run.smithi079.stderr: 4500K .......... .......... .......... .......... .......... 6% 253M 1s 2019-12-08T12:17:14.437 INFO:teuthology.orchestra.run.smithi079.stderr: 4550K .......... .......... .......... .......... .......... 6% 234M 1s 2019-12-08T12:17:14.437 INFO:teuthology.orchestra.run.smithi079.stderr: 4600K .......... .......... .......... .......... .......... 6% 258M 1s 2019-12-08T12:17:14.437 INFO:teuthology.orchestra.run.smithi079.stderr: 4650K .......... .......... .......... .......... .......... 6% 259M 1s 2019-12-08T12:17:14.437 INFO:teuthology.orchestra.run.smithi079.stderr: 4700K .......... .......... .......... .......... .......... 6% 246M 1s 2019-12-08T12:17:14.438 INFO:teuthology.orchestra.run.smithi079.stderr: 4750K .......... .......... .......... .......... .......... 6% 214M 1s 2019-12-08T12:17:14.438 INFO:teuthology.orchestra.run.smithi079.stderr: 4800K .......... .......... .......... .......... .......... 6% 236M 1s 2019-12-08T12:17:14.438 INFO:teuthology.orchestra.run.smithi079.stderr: 4850K .......... .......... .......... .......... .......... 6% 259M 1s 2019-12-08T12:17:14.438 INFO:teuthology.orchestra.run.smithi079.stderr: 4900K .......... .......... .......... .......... .......... 6% 255M 1s 2019-12-08T12:17:14.438 INFO:teuthology.orchestra.run.smithi079.stderr: 4950K .......... .......... .......... .......... .......... 6% 218M 1s 2019-12-08T12:17:14.438 INFO:teuthology.orchestra.run.smithi079.stderr: 5000K .......... .......... .......... .......... .......... 6% 266M 1s 2019-12-08T12:17:14.439 INFO:teuthology.orchestra.run.smithi079.stderr: 5050K .......... .......... .......... .......... .......... 6% 271M 1s 2019-12-08T12:17:14.439 INFO:teuthology.orchestra.run.smithi079.stderr: 5100K .......... .......... .......... .......... .......... 7% 271M 1s 2019-12-08T12:17:14.439 INFO:teuthology.orchestra.run.smithi079.stderr: 5150K .......... .......... .......... .......... .......... 7% 211M 1s 2019-12-08T12:17:14.439 INFO:teuthology.orchestra.run.smithi079.stderr: 5200K .......... .......... .......... .......... .......... 7% 218M 1s 2019-12-08T12:17:14.439 INFO:teuthology.orchestra.run.smithi079.stderr: 5250K .......... .......... .......... .......... .......... 7% 244M 1s 2019-12-08T12:17:14.439 INFO:teuthology.orchestra.run.smithi079.stderr: 5300K .......... .......... .......... .......... .......... 7% 246M 1s 2019-12-08T12:17:14.439 INFO:teuthology.orchestra.run.smithi079.stderr: 5350K .......... .......... .......... .......... .......... 7% 220M 1s 2019-12-08T12:17:14.440 INFO:teuthology.orchestra.run.smithi079.stderr: 5400K .......... .......... .......... .......... .......... 7% 254M 1s 2019-12-08T12:17:14.440 INFO:teuthology.orchestra.run.smithi079.stderr: 5450K .......... .......... .......... .......... .......... 7% 258M 1s 2019-12-08T12:17:14.440 INFO:teuthology.orchestra.run.smithi079.stderr: 5500K .......... .......... .......... .......... .......... 7% 185M 1s 2019-12-08T12:17:14.440 INFO:teuthology.orchestra.run.smithi079.stderr: 5550K .......... .......... .......... .......... .......... 7% 225M 1s 2019-12-08T12:17:14.440 INFO:teuthology.orchestra.run.smithi079.stderr: 5600K .......... .......... .......... .......... .......... 7% 191M 1s 2019-12-08T12:17:14.440 INFO:teuthology.orchestra.run.smithi079.stderr: 5650K .......... .......... .......... .......... .......... 7% 257M 1s 2019-12-08T12:17:14.440 INFO:teuthology.orchestra.run.smithi079.stderr: 5700K .......... .......... .......... .......... .......... 7% 245M 1s 2019-12-08T12:17:14.441 INFO:teuthology.orchestra.run.smithi079.stderr: 5750K .......... .......... .......... .......... .......... 7% 241M 1s 2019-12-08T12:17:14.441 INFO:teuthology.orchestra.run.smithi079.stderr: 5800K .......... .......... .......... .......... .......... 7% 282M 1s 2019-12-08T12:17:14.441 INFO:teuthology.orchestra.run.smithi079.stderr: 5850K .......... .......... .......... .......... .......... 8% 272M 1s 2019-12-08T12:17:14.441 INFO:teuthology.orchestra.run.smithi079.stderr: 5900K .......... .......... .......... .......... .......... 8% 270M 1s 2019-12-08T12:17:14.441 INFO:teuthology.orchestra.run.smithi079.stderr: 5950K .......... .......... .......... .......... .......... 8% 227M 1s 2019-12-08T12:17:14.441 INFO:teuthology.orchestra.run.smithi079.stderr: 6000K .......... .......... .......... .......... .......... 8% 269M 1s 2019-12-08T12:17:14.441 INFO:teuthology.orchestra.run.smithi079.stderr: 6050K .......... .......... .......... .......... .......... 8% 275M 1s 2019-12-08T12:17:14.442 INFO:teuthology.orchestra.run.smithi079.stderr: 6100K .......... .......... .......... .......... .......... 8% 245M 1s 2019-12-08T12:17:14.442 INFO:teuthology.orchestra.run.smithi079.stderr: 6150K .......... .......... .......... .......... .......... 8% 233M 1s 2019-12-08T12:17:14.442 INFO:teuthology.orchestra.run.smithi079.stderr: 6200K .......... .......... .......... .......... .......... 8% 266M 1s 2019-12-08T12:17:14.442 INFO:teuthology.orchestra.run.smithi079.stderr: 6250K .......... .......... .......... .......... .......... 8% 259M 1s 2019-12-08T12:17:14.442 INFO:teuthology.orchestra.run.smithi079.stderr: 6300K .......... .......... .......... .......... .......... 8% 270M 1s 2019-12-08T12:17:14.442 INFO:teuthology.orchestra.run.smithi079.stderr: 6350K .......... .......... .......... .......... .......... 8% 228M 1s 2019-12-08T12:17:14.442 INFO:teuthology.orchestra.run.smithi079.stderr: 6400K .......... .......... .......... .......... .......... 8% 269M 1s 2019-12-08T12:17:14.443 INFO:teuthology.orchestra.run.smithi079.stderr: 6450K .......... .......... .......... .......... .......... 8% 278M 1s 2019-12-08T12:17:14.443 INFO:teuthology.orchestra.run.smithi079.stderr: 6500K .......... .......... .......... .......... .......... 8% 278M 1s 2019-12-08T12:17:14.443 INFO:teuthology.orchestra.run.smithi079.stderr: 6550K .......... .......... .......... .......... .......... 8% 240M 1s 2019-12-08T12:17:14.443 INFO:teuthology.orchestra.run.smithi079.stderr: 6600K .......... .......... .......... .......... .......... 9% 248M 1s 2019-12-08T12:17:14.443 INFO:teuthology.orchestra.run.smithi079.stderr: 6650K .......... .......... .......... .......... .......... 9% 263M 1s 2019-12-08T12:17:14.443 INFO:teuthology.orchestra.run.smithi079.stderr: 6700K .......... .......... .......... .......... .......... 9% 240M 1s 2019-12-08T12:17:14.443 INFO:teuthology.orchestra.run.smithi079.stderr: 6750K .......... .......... .......... .......... .......... 9% 222M 1s 2019-12-08T12:17:14.444 INFO:teuthology.orchestra.run.smithi079.stderr: 6800K .......... .......... .......... .......... .......... 9% 264M 1s 2019-12-08T12:17:14.444 INFO:teuthology.orchestra.run.smithi079.stderr: 6850K .......... .......... .......... .......... .......... 9% 275M 1s 2019-12-08T12:17:14.444 INFO:teuthology.orchestra.run.smithi079.stderr: 6900K .......... .......... .......... .......... .......... 9% 260M 1s 2019-12-08T12:17:14.444 INFO:teuthology.orchestra.run.smithi079.stderr: 6950K .......... .......... .......... .......... .......... 9% 239M 1s 2019-12-08T12:17:14.444 INFO:teuthology.orchestra.run.smithi079.stderr: 7000K .......... .......... .......... .......... .......... 9% 267M 1s 2019-12-08T12:17:14.445 INFO:teuthology.orchestra.run.smithi079.stderr: 7050K .......... .......... .......... .......... .......... 9% 255M 1s 2019-12-08T12:17:14.445 INFO:teuthology.orchestra.run.smithi079.stderr: 7100K .......... .......... .......... .......... .......... 9% 279M 1s 2019-12-08T12:17:14.445 INFO:teuthology.orchestra.run.smithi079.stderr: 7150K .......... .......... .......... .......... .......... 9% 218M 1s 2019-12-08T12:17:14.445 INFO:teuthology.orchestra.run.smithi079.stderr: 7200K .......... .......... .......... .......... .......... 9% 261M 1s 2019-12-08T12:17:14.445 INFO:teuthology.orchestra.run.smithi079.stderr: 7250K .......... .......... .......... .......... .......... 9% 258M 1s 2019-12-08T12:17:14.445 INFO:teuthology.orchestra.run.smithi079.stderr: 7300K .......... .......... .......... .......... .......... 9% 267M 1s 2019-12-08T12:17:14.445 INFO:teuthology.orchestra.run.smithi079.stderr: 7350K .......... .......... .......... .......... .......... 10% 244M 1s 2019-12-08T12:17:14.446 INFO:teuthology.orchestra.run.smithi079.stderr: 7400K .......... .......... .......... .......... .......... 10% 256M 1s 2019-12-08T12:17:14.446 INFO:teuthology.orchestra.run.smithi079.stderr: 7450K .......... .......... .......... .......... .......... 10% 265M 1s 2019-12-08T12:17:14.446 INFO:teuthology.orchestra.run.smithi079.stderr: 7500K .......... .......... .......... .......... .......... 10% 253M 1s 2019-12-08T12:17:14.446 INFO:teuthology.orchestra.run.smithi079.stderr: 7550K .......... .......... .......... .......... .......... 10% 226M 1s 2019-12-08T12:17:14.446 INFO:teuthology.orchestra.run.smithi079.stderr: 7600K .......... .......... .......... .......... .......... 10% 239M 1s 2019-12-08T12:17:14.446 INFO:teuthology.orchestra.run.smithi079.stderr: 7650K .......... .......... .......... .......... .......... 10% 267M 1s 2019-12-08T12:17:14.446 INFO:teuthology.orchestra.run.smithi079.stderr: 7700K .......... .......... .......... .......... .......... 10% 265M 1s 2019-12-08T12:17:14.447 INFO:teuthology.orchestra.run.smithi079.stderr: 7750K .......... .......... .......... .......... .......... 10% 234M 1s 2019-12-08T12:17:14.447 INFO:teuthology.orchestra.run.smithi079.stderr: 7800K .......... .......... .......... .......... .......... 10% 244M 1s 2019-12-08T12:17:14.447 INFO:teuthology.orchestra.run.smithi079.stderr: 7850K .......... .......... .......... .......... .......... 10% 243M 1s 2019-12-08T12:17:14.447 INFO:teuthology.orchestra.run.smithi079.stderr: 7900K .......... .......... .......... .......... .......... 10% 237M 1s 2019-12-08T12:17:14.447 INFO:teuthology.orchestra.run.smithi079.stderr: 7950K .......... .......... .......... .......... .......... 10% 214M 1s 2019-12-08T12:17:14.447 INFO:teuthology.orchestra.run.smithi079.stderr: 8000K .......... .......... .......... .......... .......... 10% 200M 1s 2019-12-08T12:17:14.447 INFO:teuthology.orchestra.run.smithi079.stderr: 8050K .......... .......... .......... .......... .......... 11% 182M 1s 2019-12-08T12:17:14.448 INFO:teuthology.orchestra.run.smithi079.stderr: 8100K .......... .......... .......... .......... .......... 11% 182M 1s 2019-12-08T12:17:14.448 INFO:teuthology.orchestra.run.smithi079.stderr: 8150K .......... .......... .......... .......... .......... 11% 166M 1s 2019-12-08T12:17:14.448 INFO:teuthology.orchestra.run.smithi079.stderr: 8200K .......... .......... .......... .......... .......... 11% 187M 1s 2019-12-08T12:17:14.448 INFO:teuthology.orchestra.run.smithi079.stderr: 8250K .......... .......... .......... .......... .......... 11% 186M 1s 2019-12-08T12:17:14.448 INFO:teuthology.orchestra.run.smithi079.stderr: 8300K .......... .......... .......... .......... .......... 11% 192M 1s 2019-12-08T12:17:14.448 INFO:teuthology.orchestra.run.smithi079.stderr: 8350K .......... .......... .......... .......... .......... 11% 163M 1s 2019-12-08T12:17:14.449 INFO:teuthology.orchestra.run.smithi079.stderr: 8400K .......... .......... .......... .......... .......... 11% 191M 1s 2019-12-08T12:17:14.449 INFO:teuthology.orchestra.run.smithi079.stderr: 8450K .......... .......... .......... .......... .......... 11% 203M 1s 2019-12-08T12:17:14.449 INFO:teuthology.orchestra.run.smithi079.stderr: 8500K .......... .......... .......... .......... .......... 11% 196M 1s 2019-12-08T12:17:14.449 INFO:teuthology.orchestra.run.smithi079.stderr: 8550K .......... .......... .......... .......... .......... 11% 174M 1s 2019-12-08T12:17:14.449 INFO:teuthology.orchestra.run.smithi079.stderr: 8600K .......... .......... .......... .......... .......... 11% 197M 1s 2019-12-08T12:17:14.449 INFO:teuthology.orchestra.run.smithi079.stderr: 8650K .......... .......... .......... .......... .......... 11% 195M 1s 2019-12-08T12:17:14.449 INFO:teuthology.orchestra.run.smithi079.stderr: 8700K .......... .......... .......... .......... .......... 11% 198M 1s 2019-12-08T12:17:14.450 INFO:teuthology.orchestra.run.smithi079.stderr: 8750K .......... .......... .......... .......... .......... 11% 161M 1s 2019-12-08T12:17:14.450 INFO:teuthology.orchestra.run.smithi079.stderr: 8800K .......... .......... .......... .......... .......... 12% 201M 1s 2019-12-08T12:17:14.450 INFO:teuthology.orchestra.run.smithi079.stderr: 8850K .......... .......... .......... .......... .......... 12% 202M 0s 2019-12-08T12:17:14.450 INFO:teuthology.orchestra.run.smithi079.stderr: 8900K .......... .......... .......... .......... .......... 12% 187M 0s 2019-12-08T12:17:14.450 INFO:teuthology.orchestra.run.smithi079.stderr: 8950K .......... .......... .......... .......... .......... 12% 171M 0s 2019-12-08T12:17:14.450 INFO:teuthology.orchestra.run.smithi079.stderr: 9000K .......... .......... .......... .......... .......... 12% 188M 0s 2019-12-08T12:17:14.450 INFO:teuthology.orchestra.run.smithi079.stderr: 9050K .......... .......... .......... .......... .......... 12% 191M 0s 2019-12-08T12:17:14.450 INFO:teuthology.orchestra.run.smithi079.stderr: 9100K .......... .......... .......... .......... .......... 12% 193M 0s 2019-12-08T12:17:14.451 INFO:teuthology.orchestra.run.smithi079.stderr: 9150K .......... .......... .......... .......... .......... 12% 152M 0s 2019-12-08T12:17:14.451 INFO:teuthology.orchestra.run.smithi079.stderr: 9200K .......... .......... .......... .......... .......... 12% 193M 0s 2019-12-08T12:17:14.451 INFO:teuthology.orchestra.run.smithi079.stderr: 9250K .......... .......... .......... .......... .......... 12% 190M 0s 2019-12-08T12:17:14.451 INFO:teuthology.orchestra.run.smithi079.stderr: 9300K .......... .......... .......... .......... .......... 12% 182M 0s 2019-12-08T12:17:14.451 INFO:teuthology.orchestra.run.smithi079.stderr: 9350K .......... .......... .......... .......... .......... 12% 164M 0s 2019-12-08T12:17:14.451 INFO:teuthology.orchestra.run.smithi079.stderr: 9400K .......... .......... .......... .......... .......... 12% 187M 0s 2019-12-08T12:17:14.451 INFO:teuthology.orchestra.run.smithi079.stderr: 9450K .......... .......... .......... .......... .......... 12% 196M 0s 2019-12-08T12:17:14.452 INFO:teuthology.orchestra.run.smithi079.stderr: 9500K .......... .......... .......... .......... .......... 12% 180M 0s 2019-12-08T12:17:14.452 INFO:teuthology.orchestra.run.smithi079.stderr: 9550K .......... .......... .......... .......... .......... 13% 156M 0s 2019-12-08T12:17:14.452 INFO:teuthology.orchestra.run.smithi079.stderr: 9600K .......... .......... .......... .......... .......... 13% 190M 0s 2019-12-08T12:17:14.452 INFO:teuthology.orchestra.run.smithi079.stderr: 9650K .......... .......... .......... .......... .......... 13% 199M 0s 2019-12-08T12:17:14.452 INFO:teuthology.orchestra.run.smithi079.stderr: 9700K .......... .......... .......... .......... .......... 13% 189M 0s 2019-12-08T12:17:14.452 INFO:teuthology.orchestra.run.smithi079.stderr: 9750K .......... .......... .......... .......... .......... 13% 181M 0s 2019-12-08T12:17:14.452 INFO:teuthology.orchestra.run.smithi079.stderr: 9800K .......... .......... .......... .......... .......... 13% 232M 0s 2019-12-08T12:17:14.453 INFO:teuthology.orchestra.run.smithi079.stderr: 9850K .......... .......... .......... .......... .......... 13% 255M 0s 2019-12-08T12:17:14.453 INFO:teuthology.orchestra.run.smithi079.stderr: 9900K .......... .......... .......... .......... .......... 13% 258M 0s 2019-12-08T12:17:14.453 INFO:teuthology.orchestra.run.smithi079.stderr: 9950K .......... .......... .......... .......... .......... 13% 211M 0s 2019-12-08T12:17:14.453 INFO:teuthology.orchestra.run.smithi079.stderr: 10000K .......... .......... .......... .......... .......... 13% 264M 0s 2019-12-08T12:17:14.453 INFO:teuthology.orchestra.run.smithi079.stderr: 10050K .......... .......... .......... .......... .......... 13% 259M 0s 2019-12-08T12:17:14.453 INFO:teuthology.orchestra.run.smithi079.stderr: 10100K .......... .......... .......... .......... .......... 13% 260M 0s 2019-12-08T12:17:14.453 INFO:teuthology.orchestra.run.smithi079.stderr: 10150K .......... .......... .......... .......... .......... 13% 227M 0s 2019-12-08T12:17:14.454 INFO:teuthology.orchestra.run.smithi079.stderr: 10200K .......... .......... .......... .......... .......... 13% 256M 0s 2019-12-08T12:17:14.454 INFO:teuthology.orchestra.run.smithi079.stderr: 10250K .......... .......... .......... .......... .......... 14% 252M 0s 2019-12-08T12:17:14.454 INFO:teuthology.orchestra.run.smithi079.stderr: 10300K .......... .......... .......... .......... .......... 14% 252M 0s 2019-12-08T12:17:14.454 INFO:teuthology.orchestra.run.smithi079.stderr: 10350K .......... .......... .......... .......... .......... 14% 214M 0s 2019-12-08T12:17:14.454 INFO:teuthology.orchestra.run.smithi079.stderr: 10400K .......... .......... .......... .......... .......... 14% 226M 0s 2019-12-08T12:17:14.454 INFO:teuthology.orchestra.run.smithi079.stderr: 10450K .......... .......... .......... .......... .......... 14% 266M 0s 2019-12-08T12:17:14.454 INFO:teuthology.orchestra.run.smithi079.stderr: 10500K .......... .......... .......... .......... .......... 14% 264M 0s 2019-12-08T12:17:14.455 INFO:teuthology.orchestra.run.smithi079.stderr: 10550K .......... .......... .......... .......... .......... 14% 229M 0s 2019-12-08T12:17:14.455 INFO:teuthology.orchestra.run.smithi079.stderr: 10600K .......... .......... .......... .......... .......... 14% 257M 0s 2019-12-08T12:17:14.455 INFO:teuthology.orchestra.run.smithi079.stderr: 10650K .......... .......... .......... .......... .......... 14% 254M 0s 2019-12-08T12:17:14.455 INFO:teuthology.orchestra.run.smithi079.stderr: 10700K .......... .......... .......... .......... .......... 14% 250M 0s 2019-12-08T12:17:14.455 INFO:teuthology.orchestra.run.smithi079.stderr: 10750K .......... .......... .......... .......... .......... 14% 199M 0s 2019-12-08T12:17:14.455 INFO:teuthology.orchestra.run.smithi079.stderr: 10800K .......... .......... .......... .......... .......... 14% 246M 0s 2019-12-08T12:17:14.455 INFO:teuthology.orchestra.run.smithi079.stderr: 10850K .......... .......... .......... .......... .......... 14% 258M 0s 2019-12-08T12:17:14.456 INFO:teuthology.orchestra.run.smithi079.stderr: 10900K .......... .......... .......... .......... .......... 14% 253M 0s 2019-12-08T12:17:14.456 INFO:teuthology.orchestra.run.smithi079.stderr: 10950K .......... .......... .......... .......... .......... 14% 219M 0s 2019-12-08T12:17:14.456 INFO:teuthology.orchestra.run.smithi079.stderr: 11000K .......... .......... .......... .......... .......... 15% 249M 0s 2019-12-08T12:17:14.456 INFO:teuthology.orchestra.run.smithi079.stderr: 11050K .......... .......... .......... .......... .......... 15% 234M 0s 2019-12-08T12:17:14.456 INFO:teuthology.orchestra.run.smithi079.stderr: 11100K .......... .......... .......... .......... .......... 15% 235M 0s 2019-12-08T12:17:14.456 INFO:teuthology.orchestra.run.smithi079.stderr: 11150K .......... .......... .......... .......... .......... 15% 195M 0s 2019-12-08T12:17:14.456 INFO:teuthology.orchestra.run.smithi079.stderr: 11200K .......... .......... .......... .......... .......... 15% 242M 0s 2019-12-08T12:17:14.457 INFO:teuthology.orchestra.run.smithi079.stderr: 11250K .......... .......... .......... .......... .......... 15% 251M 0s 2019-12-08T12:17:14.457 INFO:teuthology.orchestra.run.smithi079.stderr: 11300K .......... .......... .......... .......... .......... 15% 258M 0s 2019-12-08T12:17:14.457 INFO:teuthology.orchestra.run.smithi079.stderr: 11350K .......... .......... .......... .......... .......... 15% 232M 0s 2019-12-08T12:17:14.457 INFO:teuthology.orchestra.run.smithi079.stderr: 11400K .......... .......... .......... .......... .......... 15% 261M 0s 2019-12-08T12:17:14.457 INFO:teuthology.orchestra.run.smithi079.stderr: 11450K .......... .......... .......... .......... .......... 15% 262M 0s 2019-12-08T12:17:14.457 INFO:teuthology.orchestra.run.smithi079.stderr: 11500K .......... .......... .......... .......... .......... 15% 269M 0s 2019-12-08T12:17:14.457 INFO:teuthology.orchestra.run.smithi079.stderr: 11550K .......... .......... .......... .......... .......... 15% 225M 0s 2019-12-08T12:17:14.457 INFO:teuthology.orchestra.run.smithi079.stderr: 11600K .......... .......... .......... .......... .......... 15% 251M 0s 2019-12-08T12:17:14.458 INFO:teuthology.orchestra.run.smithi079.stderr: 11650K .......... .......... .......... .......... .......... 15% 264M 0s 2019-12-08T12:17:14.458 INFO:teuthology.orchestra.run.smithi079.stderr: 11700K .......... .......... .......... .......... .......... 15% 268M 0s 2019-12-08T12:17:14.458 INFO:teuthology.orchestra.run.smithi079.stderr: 11750K .......... .......... .......... .......... .......... 16% 338M 0s 2019-12-08T12:17:14.458 INFO:teuthology.orchestra.run.smithi079.stderr: 11800K .......... .......... .......... .......... .......... 16% 356M 0s 2019-12-08T12:17:14.458 INFO:teuthology.orchestra.run.smithi079.stderr: 11850K .......... .......... .......... .......... .......... 16% 361M 0s 2019-12-08T12:17:14.458 INFO:teuthology.orchestra.run.smithi079.stderr: 11900K .......... .......... .......... .......... .......... 16% 360M 0s 2019-12-08T12:17:14.458 INFO:teuthology.orchestra.run.smithi079.stderr: 11950K .......... .......... .......... .......... .......... 16% 307M 0s 2019-12-08T12:17:14.459 INFO:teuthology.orchestra.run.smithi079.stderr: 12000K .......... .......... .......... .......... .......... 16% 352M 0s 2019-12-08T12:17:14.459 INFO:teuthology.orchestra.run.smithi079.stderr: 12050K .......... .......... .......... .......... .......... 16% 362M 0s 2019-12-08T12:17:14.459 INFO:teuthology.orchestra.run.smithi079.stderr: 12100K .......... .......... .......... .......... .......... 16% 348M 0s 2019-12-08T12:17:14.459 INFO:teuthology.orchestra.run.smithi079.stderr: 12150K .......... .......... .......... .......... .......... 16% 290M 0s 2019-12-08T12:17:14.459 INFO:teuthology.orchestra.run.smithi079.stderr: 12200K .......... .......... .......... .......... .......... 16% 350M 0s 2019-12-08T12:17:14.459 INFO:teuthology.orchestra.run.smithi079.stderr: 12250K .......... .......... .......... .......... .......... 16% 369M 0s 2019-12-08T12:17:14.459 INFO:teuthology.orchestra.run.smithi079.stderr: 12300K .......... .......... .......... .......... .......... 16% 344M 0s 2019-12-08T12:17:14.460 INFO:teuthology.orchestra.run.smithi079.stderr: 12350K .......... .......... .......... .......... .......... 16% 290M 0s 2019-12-08T12:17:14.460 INFO:teuthology.orchestra.run.smithi079.stderr: 12400K .......... .......... .......... .......... .......... 16% 358M 0s 2019-12-08T12:17:14.460 INFO:teuthology.orchestra.run.smithi079.stderr: 12450K .......... .......... .......... .......... .......... 16% 345M 0s 2019-12-08T12:17:14.460 INFO:teuthology.orchestra.run.smithi079.stderr: 12500K .......... .......... .......... .......... .......... 17% 344M 0s 2019-12-08T12:17:14.460 INFO:teuthology.orchestra.run.smithi079.stderr: 12550K .......... .......... .......... .......... .......... 17% 309M 0s 2019-12-08T12:17:14.460 INFO:teuthology.orchestra.run.smithi079.stderr: 12600K .......... .......... .......... .......... .......... 17% 336M 0s 2019-12-08T12:17:14.460 INFO:teuthology.orchestra.run.smithi079.stderr: 12650K .......... .......... .......... .......... .......... 17% 344M 0s 2019-12-08T12:17:14.461 INFO:teuthology.orchestra.run.smithi079.stderr: 12700K .......... .......... .......... .......... .......... 17% 363M 0s 2019-12-08T12:17:14.461 INFO:teuthology.orchestra.run.smithi079.stderr: 12750K .......... .......... .......... .......... .......... 17% 293M 0s 2019-12-08T12:17:14.461 INFO:teuthology.orchestra.run.smithi079.stderr: 12800K .......... .......... .......... .......... .......... 17% 365M 0s 2019-12-08T12:17:14.461 INFO:teuthology.orchestra.run.smithi079.stderr: 12850K .......... .......... .......... .......... .......... 17% 353M 0s 2019-12-08T12:17:14.461 INFO:teuthology.orchestra.run.smithi079.stderr: 12900K .......... .......... .......... .......... .......... 17% 363M 0s 2019-12-08T12:17:14.461 INFO:teuthology.orchestra.run.smithi079.stderr: 12950K .......... .......... .......... .......... .......... 17% 301M 0s 2019-12-08T12:17:14.462 INFO:teuthology.orchestra.run.smithi079.stderr: 13000K .......... .......... .......... .......... .......... 17% 363M 0s 2019-12-08T12:17:14.462 INFO:teuthology.orchestra.run.smithi079.stderr: 13050K .......... .......... .......... .......... .......... 17% 365M 0s 2019-12-08T12:17:14.462 INFO:teuthology.orchestra.run.smithi079.stderr: 13100K .......... .......... .......... .......... .......... 17% 362M 0s 2019-12-08T12:17:14.462 INFO:teuthology.orchestra.run.smithi079.stderr: 13150K .......... .......... .......... .......... .......... 17% 280M 0s 2019-12-08T12:17:14.462 INFO:teuthology.orchestra.run.smithi079.stderr: 13200K .......... .......... .......... .......... .......... 18% 266M 0s 2019-12-08T12:17:14.462 INFO:teuthology.orchestra.run.smithi079.stderr: 13250K .......... .......... .......... .......... .......... 18% 369M 0s 2019-12-08T12:17:14.462 INFO:teuthology.orchestra.run.smithi079.stderr: 13300K .......... .......... .......... .......... .......... 18% 382M 0s 2019-12-08T12:17:14.463 INFO:teuthology.orchestra.run.smithi079.stderr: 13350K .......... .......... .......... .......... .......... 18% 332M 0s 2019-12-08T12:17:14.463 INFO:teuthology.orchestra.run.smithi079.stderr: 13400K .......... .......... .......... .......... .......... 18% 377M 0s 2019-12-08T12:17:14.463 INFO:teuthology.orchestra.run.smithi079.stderr: 13450K .......... .......... .......... .......... .......... 18% 387M 0s 2019-12-08T12:17:14.463 INFO:teuthology.orchestra.run.smithi079.stderr: 13500K .......... .......... .......... .......... .......... 18% 378M 0s 2019-12-08T12:17:14.463 INFO:teuthology.orchestra.run.smithi079.stderr: 13550K .......... .......... .......... .......... .......... 18% 321M 0s 2019-12-08T12:17:14.463 INFO:teuthology.orchestra.run.smithi079.stderr: 13600K .......... .......... .......... .......... .......... 18% 368M 0s 2019-12-08T12:17:14.463 INFO:teuthology.orchestra.run.smithi079.stderr: 13650K .......... .......... .......... .......... .......... 18% 386M 0s 2019-12-08T12:17:14.464 INFO:teuthology.orchestra.run.smithi079.stderr: 13700K .......... .......... .......... .......... .......... 18% 341M 0s 2019-12-08T12:17:14.464 INFO:teuthology.orchestra.run.smithi079.stderr: 13750K .......... .......... .......... .......... .......... 18% 313M 0s 2019-12-08T12:17:14.464 INFO:teuthology.orchestra.run.smithi079.stderr: 13800K .......... .......... .......... .......... .......... 18% 359M 0s 2019-12-08T12:17:14.464 INFO:teuthology.orchestra.run.smithi079.stderr: 13850K .......... .......... .......... .......... .......... 18% 364M 0s 2019-12-08T12:17:14.464 INFO:teuthology.orchestra.run.smithi079.stderr: 13900K .......... .......... .......... .......... .......... 18% 369M 0s 2019-12-08T12:17:14.464 INFO:teuthology.orchestra.run.smithi079.stderr: 13950K .......... .......... .......... .......... .......... 19% 305M 0s 2019-12-08T12:17:14.464 INFO:teuthology.orchestra.run.smithi079.stderr: 14000K .......... .......... .......... .......... .......... 19% 364M 0s 2019-12-08T12:17:14.464 INFO:teuthology.orchestra.run.smithi079.stderr: 14050K .......... .......... .......... .......... .......... 19% 369M 0s 2019-12-08T12:17:14.465 INFO:teuthology.orchestra.run.smithi079.stderr: 14100K .......... .......... .......... .......... .......... 19% 344M 0s 2019-12-08T12:17:14.465 INFO:teuthology.orchestra.run.smithi079.stderr: 14150K .......... .......... .......... .......... .......... 19% 311M 0s 2019-12-08T12:17:14.465 INFO:teuthology.orchestra.run.smithi079.stderr: 14200K .......... .......... .......... .......... .......... 19% 360M 0s 2019-12-08T12:17:14.465 INFO:teuthology.orchestra.run.smithi079.stderr: 14250K .......... .......... .......... .......... .......... 19% 355M 0s 2019-12-08T12:17:14.465 INFO:teuthology.orchestra.run.smithi079.stderr: 14300K .......... .......... .......... .......... .......... 19% 338M 0s 2019-12-08T12:17:14.465 INFO:teuthology.orchestra.run.smithi079.stderr: 14350K .......... .......... .......... .......... .......... 19% 281M 0s 2019-12-08T12:17:14.465 INFO:teuthology.orchestra.run.smithi079.stderr: 14400K .......... .......... .......... .......... .......... 19% 270M 0s 2019-12-08T12:17:14.466 INFO:teuthology.orchestra.run.smithi079.stderr: 14450K .......... .......... .......... .......... .......... 19% 376M 0s 2019-12-08T12:17:14.466 INFO:teuthology.orchestra.run.smithi079.stderr: 14500K .......... .......... .......... .......... .......... 19% 366M 0s 2019-12-08T12:17:14.466 INFO:teuthology.orchestra.run.smithi079.stderr: 14550K .......... .......... .......... .......... .......... 19% 343M 0s 2019-12-08T12:17:14.466 INFO:teuthology.orchestra.run.smithi079.stderr: 14600K .......... .......... .......... .......... .......... 19% 354M 0s 2019-12-08T12:17:14.466 INFO:teuthology.orchestra.run.smithi079.stderr: 14650K .......... .......... .......... .......... .......... 19% 326M 0s 2019-12-08T12:17:14.466 INFO:teuthology.orchestra.run.smithi079.stderr: 14700K .......... .......... .......... .......... .......... 20% 365M 0s 2019-12-08T12:17:14.466 INFO:teuthology.orchestra.run.smithi079.stderr: 14750K .......... .......... .......... .......... .......... 20% 305M 0s 2019-12-08T12:17:14.467 INFO:teuthology.orchestra.run.smithi079.stderr: 14800K .......... .......... .......... .......... .......... 20% 375M 0s 2019-12-08T12:17:14.467 INFO:teuthology.orchestra.run.smithi079.stderr: 14850K .......... .......... .......... .......... .......... 20% 362M 0s 2019-12-08T12:17:14.467 INFO:teuthology.orchestra.run.smithi079.stderr: 14900K .......... .......... .......... .......... .......... 20% 386M 0s 2019-12-08T12:17:14.467 INFO:teuthology.orchestra.run.smithi079.stderr: 14950K .......... .......... .......... .......... .......... 20% 333M 0s 2019-12-08T12:17:14.467 INFO:teuthology.orchestra.run.smithi079.stderr: 15000K .......... .......... .......... .......... .......... 20% 359M 0s 2019-12-08T12:17:14.467 INFO:teuthology.orchestra.run.smithi079.stderr: 15050K .......... .......... .......... .......... .......... 20% 364M 0s 2019-12-08T12:17:14.467 INFO:teuthology.orchestra.run.smithi079.stderr: 15100K .......... .......... .......... .......... .......... 20% 357M 0s 2019-12-08T12:17:14.467 INFO:teuthology.orchestra.run.smithi079.stderr: 15150K .......... .......... .......... .......... .......... 20% 308M 0s 2019-12-08T12:17:14.468 INFO:teuthology.orchestra.run.smithi079.stderr: 15200K .......... .......... .......... .......... .......... 20% 384M 0s 2019-12-08T12:17:14.468 INFO:teuthology.orchestra.run.smithi079.stderr: 15250K .......... .......... .......... .......... .......... 20% 373M 0s 2019-12-08T12:17:14.468 INFO:teuthology.orchestra.run.smithi079.stderr: 15300K .......... .......... .......... .......... .......... 20% 375M 0s 2019-12-08T12:17:14.468 INFO:teuthology.orchestra.run.smithi079.stderr: 15350K .......... .......... .......... .......... .......... 20% 335M 0s 2019-12-08T12:17:14.468 INFO:teuthology.orchestra.run.smithi079.stderr: 15400K .......... .......... .......... .......... .......... 21% 381M 0s 2019-12-08T12:17:14.468 INFO:teuthology.orchestra.run.smithi079.stderr: 15450K .......... .......... .......... .......... .......... 21% 357M 0s 2019-12-08T12:17:14.469 INFO:teuthology.orchestra.run.smithi079.stderr: 15500K .......... .......... .......... .......... .......... 21% 342M 0s 2019-12-08T12:17:14.469 INFO:teuthology.orchestra.run.smithi079.stderr: 15550K .......... .......... .......... .......... .......... 21% 307M 0s 2019-12-08T12:17:14.469 INFO:teuthology.orchestra.run.smithi079.stderr: 15600K .......... .......... .......... .......... .......... 21% 364M 0s 2019-12-08T12:17:14.469 INFO:teuthology.orchestra.run.smithi079.stderr: 15650K .......... .......... .......... .......... .......... 21% 321M 0s 2019-12-08T12:17:14.469 INFO:teuthology.orchestra.run.smithi079.stderr: 15700K .......... .......... .......... .......... .......... 21% 314M 0s 2019-12-08T12:17:14.469 INFO:teuthology.orchestra.run.smithi079.stderr: 15750K .......... .......... .......... .......... .......... 21% 292M 0s 2019-12-08T12:17:14.469 INFO:teuthology.orchestra.run.smithi079.stderr: 15800K .......... .......... .......... .......... .......... 21% 369M 0s 2019-12-08T12:17:14.469 INFO:teuthology.orchestra.run.smithi079.stderr: 15850K .......... .......... .......... .......... .......... 21% 372M 0s 2019-12-08T12:17:14.470 INFO:teuthology.orchestra.run.smithi079.stderr: 15900K .......... .......... .......... .......... .......... 21% 380M 0s 2019-12-08T12:17:14.470 INFO:teuthology.orchestra.run.smithi079.stderr: 15950K .......... .......... .......... .......... .......... 21% 310M 0s 2019-12-08T12:17:14.470 INFO:teuthology.orchestra.run.smithi079.stderr: 16000K .......... .......... .......... .......... .......... 21% 309M 0s 2019-12-08T12:17:14.470 INFO:teuthology.orchestra.run.smithi079.stderr: 16050K .......... .......... .......... .......... .......... 21% 229M 0s 2019-12-08T12:17:14.470 INFO:teuthology.orchestra.run.smithi079.stderr: 16100K .......... .......... .......... .......... .......... 21% 223M 0s 2019-12-08T12:17:14.470 INFO:teuthology.orchestra.run.smithi079.stderr: 16150K .......... .......... .......... .......... .......... 22% 218M 0s 2019-12-08T12:17:14.470 INFO:teuthology.orchestra.run.smithi079.stderr: 16200K .......... .......... .......... .......... .......... 22% 243M 0s 2019-12-08T12:17:14.471 INFO:teuthology.orchestra.run.smithi079.stderr: 16250K .......... .......... .......... .......... .......... 22% 243M 0s 2019-12-08T12:17:14.471 INFO:teuthology.orchestra.run.smithi079.stderr: 16300K .......... .......... .......... .......... .......... 22% 244M 0s 2019-12-08T12:17:14.471 INFO:teuthology.orchestra.run.smithi079.stderr: 16350K .......... .......... .......... .......... .......... 22% 196M 0s 2019-12-08T12:17:14.471 INFO:teuthology.orchestra.run.smithi079.stderr: 16400K .......... .......... .......... .......... .......... 22% 239M 0s 2019-12-08T12:17:14.471 INFO:teuthology.orchestra.run.smithi079.stderr: 16450K .......... .......... .......... .......... .......... 22% 236M 0s 2019-12-08T12:17:14.471 INFO:teuthology.orchestra.run.smithi079.stderr: 16500K .......... .......... .......... .......... .......... 22% 218M 0s 2019-12-08T12:17:14.471 INFO:teuthology.orchestra.run.smithi079.stderr: 16550K .......... .......... .......... .......... .......... 22% 242M 0s 2019-12-08T12:17:14.471 INFO:teuthology.orchestra.run.smithi079.stderr: 16600K .......... .......... .......... .......... .......... 22% 316M 0s 2019-12-08T12:17:14.472 INFO:teuthology.orchestra.run.smithi079.stderr: 16650K .......... .......... .......... .......... .......... 22% 312M 0s 2019-12-08T12:17:14.472 INFO:teuthology.orchestra.run.smithi079.stderr: 16700K .......... .......... .......... .......... .......... 22% 314M 0s 2019-12-08T12:17:14.472 INFO:teuthology.orchestra.run.smithi079.stderr: 16750K .......... .......... .......... .......... .......... 22% 201M 0s 2019-12-08T12:17:14.472 INFO:teuthology.orchestra.run.smithi079.stderr: 16800K .......... .......... .......... .......... .......... 22% 366M 0s 2019-12-08T12:17:14.472 INFO:teuthology.orchestra.run.smithi079.stderr: 16850K .......... .......... .......... .......... .......... 22% 349M 0s 2019-12-08T12:17:14.473 INFO:teuthology.orchestra.run.smithi079.stderr: 16900K .......... .......... .......... .......... .......... 23% 351M 0s 2019-12-08T12:17:14.473 INFO:teuthology.orchestra.run.smithi079.stderr: 16950K .......... .......... .......... .......... .......... 23% 325M 0s 2019-12-08T12:17:14.473 INFO:teuthology.orchestra.run.smithi079.stderr: 17000K .......... .......... .......... .......... .......... 23% 262M 0s 2019-12-08T12:17:14.473 INFO:teuthology.orchestra.run.smithi079.stderr: 17050K .......... .......... .......... .......... .......... 23% 251M 0s 2019-12-08T12:17:14.473 INFO:teuthology.orchestra.run.smithi079.stderr: 17100K .......... .......... .......... .......... .......... 23% 261M 0s 2019-12-08T12:17:14.473 INFO:teuthology.orchestra.run.smithi079.stderr: 17150K .......... .......... .......... .......... .......... 23% 207M 0s 2019-12-08T12:17:14.473 INFO:teuthology.orchestra.run.smithi079.stderr: 17200K .......... .......... .......... .......... .......... 23% 246M 0s 2019-12-08T12:17:14.474 INFO:teuthology.orchestra.run.smithi079.stderr: 17250K .......... .......... .......... .......... .......... 23% 239M 0s 2019-12-08T12:17:14.474 INFO:teuthology.orchestra.run.smithi079.stderr: 17300K .......... .......... .......... .......... .......... 23% 251M 0s 2019-12-08T12:17:14.474 INFO:teuthology.orchestra.run.smithi079.stderr: 17350K .......... .......... .......... .......... .......... 23% 230M 0s 2019-12-08T12:17:14.474 INFO:teuthology.orchestra.run.smithi079.stderr: 17400K .......... .......... .......... .......... .......... 23% 256M 0s 2019-12-08T12:17:14.474 INFO:teuthology.orchestra.run.smithi079.stderr: 17450K .......... .......... .......... .......... .......... 23% 233M 0s 2019-12-08T12:17:14.474 INFO:teuthology.orchestra.run.smithi079.stderr: 17500K .......... .......... .......... .......... .......... 23% 252M 0s 2019-12-08T12:17:14.474 INFO:teuthology.orchestra.run.smithi079.stderr: 17550K .......... .......... .......... .......... .......... 23% 217M 0s 2019-12-08T12:17:14.474 INFO:teuthology.orchestra.run.smithi079.stderr: 17600K .......... .......... .......... .......... .......... 23% 220M 0s 2019-12-08T12:17:14.475 INFO:teuthology.orchestra.run.smithi079.stderr: 17650K .......... .......... .......... .......... .......... 24% 241M 0s 2019-12-08T12:17:14.475 INFO:teuthology.orchestra.run.smithi079.stderr: 17700K .......... .......... .......... .......... .......... 24% 253M 0s 2019-12-08T12:17:14.475 INFO:teuthology.orchestra.run.smithi079.stderr: 17750K .......... .......... .......... .......... .......... 24% 238M 0s 2019-12-08T12:17:14.475 INFO:teuthology.orchestra.run.smithi079.stderr: 17800K .......... .......... .......... .......... .......... 24% 259M 0s 2019-12-08T12:17:14.475 INFO:teuthology.orchestra.run.smithi079.stderr: 17850K .......... .......... .......... .......... .......... 24% 259M 0s 2019-12-08T12:17:14.475 INFO:teuthology.orchestra.run.smithi079.stderr: 17900K .......... .......... .......... .......... .......... 24% 255M 0s 2019-12-08T12:17:14.475 INFO:teuthology.orchestra.run.smithi079.stderr: 17950K .......... .......... .......... .......... .......... 24% 211M 0s 2019-12-08T12:17:14.476 INFO:teuthology.orchestra.run.smithi079.stderr: 18000K .......... .......... .......... .......... .......... 24% 240M 0s 2019-12-08T12:17:14.476 INFO:teuthology.orchestra.run.smithi079.stderr: 18050K .......... .......... .......... .......... .......... 24% 253M 0s 2019-12-08T12:17:14.476 INFO:teuthology.orchestra.run.smithi079.stderr: 18100K .......... .......... .......... .......... .......... 24% 231M 0s 2019-12-08T12:17:14.476 INFO:teuthology.orchestra.run.smithi079.stderr: 18150K .......... .......... .......... .......... .......... 24% 219M 0s 2019-12-08T12:17:14.476 INFO:teuthology.orchestra.run.smithi079.stderr: 18200K .......... .......... .......... .......... .......... 24% 241M 0s 2019-12-08T12:17:14.476 INFO:teuthology.orchestra.run.smithi079.stderr: 18250K .......... .......... .......... .......... .......... 24% 255M 0s 2019-12-08T12:17:14.476 INFO:teuthology.orchestra.run.smithi079.stderr: 18300K .......... .......... .......... .......... .......... 24% 247M 0s 2019-12-08T12:17:14.477 INFO:teuthology.orchestra.run.smithi079.stderr: 18350K .......... .......... .......... .......... .......... 25% 203M 0s 2019-12-08T12:17:14.477 INFO:teuthology.orchestra.run.smithi079.stderr: 18400K .......... .......... .......... .......... .......... 25% 235M 0s 2019-12-08T12:17:14.477 INFO:teuthology.orchestra.run.smithi079.stderr: 18450K .......... .......... .......... .......... .......... 25% 239M 0s 2019-12-08T12:17:14.477 INFO:teuthology.orchestra.run.smithi079.stderr: 18500K .......... .......... .......... .......... .......... 25% 254M 0s 2019-12-08T12:17:14.477 INFO:teuthology.orchestra.run.smithi079.stderr: 18550K .......... .......... .......... .......... .......... 25% 215M 0s 2019-12-08T12:17:14.477 INFO:teuthology.orchestra.run.smithi079.stderr: 18600K .......... .......... .......... .......... .......... 25% 250M 0s 2019-12-08T12:17:14.477 INFO:teuthology.orchestra.run.smithi079.stderr: 18650K .......... .......... .......... .......... .......... 25% 243M 0s 2019-12-08T12:17:14.477 INFO:teuthology.orchestra.run.smithi079.stderr: 18700K .......... .......... .......... .......... .......... 25% 239M 0s 2019-12-08T12:17:14.478 INFO:teuthology.orchestra.run.smithi079.stderr: 18750K .......... .......... .......... .......... .......... 25% 208M 0s 2019-12-08T12:17:14.478 INFO:teuthology.orchestra.run.smithi079.stderr: 18800K .......... .......... .......... .......... .......... 25% 274M 0s 2019-12-08T12:17:14.478 INFO:teuthology.orchestra.run.smithi079.stderr: 18850K .......... .......... .......... .......... .......... 25% 263M 0s 2019-12-08T12:17:14.478 INFO:teuthology.orchestra.run.smithi079.stderr: 18900K .......... .......... .......... .......... .......... 25% 258M 0s 2019-12-08T12:17:14.478 INFO:teuthology.orchestra.run.smithi079.stderr: 18950K .......... .......... .......... .......... .......... 25% 243M 0s 2019-12-08T12:17:14.478 INFO:teuthology.orchestra.run.smithi079.stderr: 19000K .......... .......... .......... .......... .......... 25% 265M 0s 2019-12-08T12:17:14.478 INFO:teuthology.orchestra.run.smithi079.stderr: 19050K .......... .......... .......... .......... .......... 25% 264M 0s 2019-12-08T12:17:14.479 INFO:teuthology.orchestra.run.smithi079.stderr: 19100K .......... .......... .......... .......... .......... 26% 262M 0s 2019-12-08T12:17:14.479 INFO:teuthology.orchestra.run.smithi079.stderr: 19150K .......... .......... .......... .......... .......... 26% 218M 0s 2019-12-08T12:17:14.479 INFO:teuthology.orchestra.run.smithi079.stderr: 19200K .......... .......... .......... .......... .......... 26% 261M 0s 2019-12-08T12:17:14.479 INFO:teuthology.orchestra.run.smithi079.stderr: 19250K .......... .......... .......... .......... .......... 26% 261M 0s 2019-12-08T12:17:14.479 INFO:teuthology.orchestra.run.smithi079.stderr: 19300K .......... .......... .......... .......... .......... 26% 249M 0s 2019-12-08T12:17:14.479 INFO:teuthology.orchestra.run.smithi079.stderr: 19350K .......... .......... .......... .......... .......... 26% 235M 0s 2019-12-08T12:17:14.479 INFO:teuthology.orchestra.run.smithi079.stderr: 19400K .......... .......... .......... .......... .......... 26% 247M 0s 2019-12-08T12:17:14.480 INFO:teuthology.orchestra.run.smithi079.stderr: 19450K .......... .......... .......... .......... .......... 26% 256M 0s 2019-12-08T12:17:14.480 INFO:teuthology.orchestra.run.smithi079.stderr: 19500K .......... .......... .......... .......... .......... 26% 260M 0s 2019-12-08T12:17:14.480 INFO:teuthology.orchestra.run.smithi079.stderr: 19550K .......... .......... .......... .......... .......... 26% 221M 0s 2019-12-08T12:17:14.480 INFO:teuthology.orchestra.run.smithi079.stderr: 19600K .......... .......... .......... .......... .......... 26% 267M 0s 2019-12-08T12:17:14.480 INFO:teuthology.orchestra.run.smithi079.stderr: 19650K .......... .......... .......... .......... .......... 26% 265M 0s 2019-12-08T12:17:14.480 INFO:teuthology.orchestra.run.smithi079.stderr: 19700K .......... .......... .......... .......... .......... 26% 262M 0s 2019-12-08T12:17:14.480 INFO:teuthology.orchestra.run.smithi079.stderr: 19750K .......... .......... .......... .......... .......... 26% 239M 0s 2019-12-08T12:17:14.481 INFO:teuthology.orchestra.run.smithi079.stderr: 19800K .......... .......... .......... .......... .......... 26% 270M 0s 2019-12-08T12:17:14.481 INFO:teuthology.orchestra.run.smithi079.stderr: 19850K .......... .......... .......... .......... .......... 27% 241M 0s 2019-12-08T12:17:14.481 INFO:teuthology.orchestra.run.smithi079.stderr: 19900K .......... .......... .......... .......... .......... 27% 243M 0s 2019-12-08T12:17:14.481 INFO:teuthology.orchestra.run.smithi079.stderr: 19950K .......... .......... .......... .......... .......... 27% 219M 0s 2019-12-08T12:17:14.481 INFO:teuthology.orchestra.run.smithi079.stderr: 20000K .......... .......... .......... .......... .......... 27% 276M 0s 2019-12-08T12:17:14.481 INFO:teuthology.orchestra.run.smithi079.stderr: 20050K .......... .......... .......... .......... .......... 27% 259M 0s 2019-12-08T12:17:14.481 INFO:teuthology.orchestra.run.smithi079.stderr: 20100K .......... .......... .......... .......... .......... 27% 268M 0s 2019-12-08T12:17:14.482 INFO:teuthology.orchestra.run.smithi079.stderr: 20150K .......... .......... .......... .......... .......... 27% 241M 0s 2019-12-08T12:17:14.482 INFO:teuthology.orchestra.run.smithi079.stderr: 20200K .......... .......... .......... .......... .......... 27% 268M 0s 2019-12-08T12:17:14.482 INFO:teuthology.orchestra.run.smithi079.stderr: 20250K .......... .......... .......... .......... .......... 27% 265M 0s 2019-12-08T12:17:14.482 INFO:teuthology.orchestra.run.smithi079.stderr: 20300K .......... .......... .......... .......... .......... 27% 255M 0s 2019-12-08T12:17:14.482 INFO:teuthology.orchestra.run.smithi079.stderr: 20350K .......... .......... .......... .......... .......... 27% 217M 0s 2019-12-08T12:17:14.482 INFO:teuthology.orchestra.run.smithi079.stderr: 20400K .......... .......... .......... .......... .......... 27% 271M 0s 2019-12-08T12:17:14.482 INFO:teuthology.orchestra.run.smithi079.stderr: 20450K .......... .......... .......... .......... .......... 27% 265M 0s 2019-12-08T12:17:14.483 INFO:teuthology.orchestra.run.smithi079.stderr: 20500K .......... .......... .......... .......... .......... 27% 265M 0s 2019-12-08T12:17:14.483 INFO:teuthology.orchestra.run.smithi079.stderr: 20550K .......... .......... .......... .......... .......... 28% 239M 0s 2019-12-08T12:17:14.483 INFO:teuthology.orchestra.run.smithi079.stderr: 20600K .......... .......... .......... .......... .......... 28% 272M 0s 2019-12-08T12:17:14.483 INFO:teuthology.orchestra.run.smithi079.stderr: 20650K .......... .......... .......... .......... .......... 28% 249M 0s 2019-12-08T12:17:14.483 INFO:teuthology.orchestra.run.smithi079.stderr: 20700K .......... .......... .......... .......... .......... 28% 247M 0s 2019-12-08T12:17:14.483 INFO:teuthology.orchestra.run.smithi079.stderr: 20750K .......... .......... .......... .......... .......... 28% 203M 0s 2019-12-08T12:17:14.483 INFO:teuthology.orchestra.run.smithi079.stderr: 20800K .......... .......... .......... .......... .......... 28% 255M 0s 2019-12-08T12:17:14.483 INFO:teuthology.orchestra.run.smithi079.stderr: 20850K .......... .......... .......... .......... .......... 28% 255M 0s 2019-12-08T12:17:14.484 INFO:teuthology.orchestra.run.smithi079.stderr: 20900K .......... .......... .......... .......... .......... 28% 261M 0s 2019-12-08T12:17:14.484 INFO:teuthology.orchestra.run.smithi079.stderr: 20950K .......... .......... .......... .......... .......... 28% 229M 0s 2019-12-08T12:17:14.484 INFO:teuthology.orchestra.run.smithi079.stderr: 21000K .......... .......... .......... .......... .......... 28% 257M 0s 2019-12-08T12:17:14.484 INFO:teuthology.orchestra.run.smithi079.stderr: 21050K .......... .......... .......... .......... .......... 28% 255M 0s 2019-12-08T12:17:14.484 INFO:teuthology.orchestra.run.smithi079.stderr: 21100K .......... .......... .......... .......... .......... 28% 261M 0s 2019-12-08T12:17:14.484 INFO:teuthology.orchestra.run.smithi079.stderr: 21150K .......... .......... .......... .......... .......... 28% 213M 0s 2019-12-08T12:17:14.484 INFO:teuthology.orchestra.run.smithi079.stderr: 21200K .......... .......... .......... .......... .......... 28% 222M 0s 2019-12-08T12:17:14.485 INFO:teuthology.orchestra.run.smithi079.stderr: 21250K .......... .......... .......... .......... .......... 28% 280M 0s 2019-12-08T12:17:14.485 INFO:teuthology.orchestra.run.smithi079.stderr: 21300K .......... .......... .......... .......... .......... 29% 268M 0s 2019-12-08T12:17:14.485 INFO:teuthology.orchestra.run.smithi079.stderr: 21350K .......... .......... .......... .......... .......... 29% 238M 0s 2019-12-08T12:17:14.485 INFO:teuthology.orchestra.run.smithi079.stderr: 21400K .......... .......... .......... .......... .......... 29% 266M 0s 2019-12-08T12:17:14.485 INFO:teuthology.orchestra.run.smithi079.stderr: 21450K .......... .......... .......... .......... .......... 29% 261M 0s 2019-12-08T12:17:14.485 INFO:teuthology.orchestra.run.smithi079.stderr: 21500K .......... .......... .......... .......... .......... 29% 273M 0s 2019-12-08T12:17:14.485 INFO:teuthology.orchestra.run.smithi079.stderr: 21550K .......... .......... .......... .......... .......... 29% 229M 0s 2019-12-08T12:17:14.486 INFO:teuthology.orchestra.run.smithi079.stderr: 21600K .......... .......... .......... .......... .......... 29% 267M 0s 2019-12-08T12:17:14.486 INFO:teuthology.orchestra.run.smithi079.stderr: 21650K .......... .......... .......... .......... .......... 29% 268M 0s 2019-12-08T12:17:14.486 INFO:teuthology.orchestra.run.smithi079.stderr: 21700K .......... .......... .......... .......... .......... 29% 266M 0s 2019-12-08T12:17:14.486 INFO:teuthology.orchestra.run.smithi079.stderr: 21750K .......... .......... .......... .......... .......... 29% 241M 0s 2019-12-08T12:17:14.486 INFO:teuthology.orchestra.run.smithi079.stderr: 21800K .......... .......... .......... .......... .......... 29% 259M 0s 2019-12-08T12:17:14.486 INFO:teuthology.orchestra.run.smithi079.stderr: 21850K .......... .......... .......... .......... .......... 29% 279M 0s 2019-12-08T12:17:14.486 INFO:teuthology.orchestra.run.smithi079.stderr: 21900K .......... .......... .......... .......... .......... 29% 263M 0s 2019-12-08T12:17:14.486 INFO:teuthology.orchestra.run.smithi079.stderr: 21950K .......... .......... .......... .......... .......... 29% 221M 0s 2019-12-08T12:17:14.487 INFO:teuthology.orchestra.run.smithi079.stderr: 22000K .......... .......... .......... .......... .......... 29% 282M 0s 2019-12-08T12:17:14.487 INFO:teuthology.orchestra.run.smithi079.stderr: 22050K .......... .......... .......... .......... .......... 30% 280M 0s 2019-12-08T12:17:14.487 INFO:teuthology.orchestra.run.smithi079.stderr: 22100K .......... .......... .......... .......... .......... 30% 273M 0s 2019-12-08T12:17:14.487 INFO:teuthology.orchestra.run.smithi079.stderr: 22150K .......... .......... .......... .......... .......... 30% 248M 0s 2019-12-08T12:17:14.487 INFO:teuthology.orchestra.run.smithi079.stderr: 22200K .......... .......... .......... .......... .......... 30% 278M 0s 2019-12-08T12:17:14.487 INFO:teuthology.orchestra.run.smithi079.stderr: 22250K .......... .......... .......... .......... .......... 30% 223M 0s 2019-12-08T12:17:14.487 INFO:teuthology.orchestra.run.smithi079.stderr: 22300K .......... .......... .......... .......... .......... 30% 261M 0s 2019-12-08T12:17:14.488 INFO:teuthology.orchestra.run.smithi079.stderr: 22350K .......... .......... .......... .......... .......... 30% 222M 0s 2019-12-08T12:17:14.488 INFO:teuthology.orchestra.run.smithi079.stderr: 22400K .......... .......... .......... .......... .......... 30% 259M 0s 2019-12-08T12:17:14.488 INFO:teuthology.orchestra.run.smithi079.stderr: 22450K .......... .......... .......... .......... .......... 30% 254M 0s 2019-12-08T12:17:14.488 INFO:teuthology.orchestra.run.smithi079.stderr: 22500K .......... .......... .......... .......... .......... 30% 263M 0s 2019-12-08T12:17:14.488 INFO:teuthology.orchestra.run.smithi079.stderr: 22550K .......... .......... .......... .......... .......... 30% 239M 0s 2019-12-08T12:17:14.488 INFO:teuthology.orchestra.run.smithi079.stderr: 22600K .......... .......... .......... .......... .......... 30% 256M 0s 2019-12-08T12:17:14.488 INFO:teuthology.orchestra.run.smithi079.stderr: 22650K .......... .......... .......... .......... .......... 30% 268M 0s 2019-12-08T12:17:14.489 INFO:teuthology.orchestra.run.smithi079.stderr: 22700K .......... .......... .......... .......... .......... 30% 277M 0s 2019-12-08T12:17:14.489 INFO:teuthology.orchestra.run.smithi079.stderr: 22750K .......... .......... .......... .......... .......... 30% 217M 0s 2019-12-08T12:17:14.489 INFO:teuthology.orchestra.run.smithi079.stderr: 22800K .......... .......... .......... .......... .......... 31% 279M 0s 2019-12-08T12:17:14.489 INFO:teuthology.orchestra.run.smithi079.stderr: 22850K .......... .......... .......... .......... .......... 31% 280M 0s 2019-12-08T12:17:14.489 INFO:teuthology.orchestra.run.smithi079.stderr: 22900K .......... .......... .......... .......... .......... 31% 261M 0s 2019-12-08T12:17:14.489 INFO:teuthology.orchestra.run.smithi079.stderr: 22950K .......... .......... .......... .......... .......... 31% 240M 0s 2019-12-08T12:17:14.489 INFO:teuthology.orchestra.run.smithi079.stderr: 23000K .......... .......... .......... .......... .......... 31% 262M 0s 2019-12-08T12:17:14.490 INFO:teuthology.orchestra.run.smithi079.stderr: 23050K .......... .......... .......... .......... .......... 31% 264M 0s 2019-12-08T12:17:14.490 INFO:teuthology.orchestra.run.smithi079.stderr: 23100K .......... .......... .......... .......... .......... 31% 276M 0s 2019-12-08T12:17:14.490 INFO:teuthology.orchestra.run.smithi079.stderr: 23150K .......... .......... .......... .......... .......... 31% 219M 0s 2019-12-08T12:17:14.490 INFO:teuthology.orchestra.run.smithi079.stderr: 23200K .......... .......... .......... .......... .......... 31% 273M 0s 2019-12-08T12:17:14.490 INFO:teuthology.orchestra.run.smithi079.stderr: 23250K .......... .......... .......... .......... .......... 31% 270M 0s 2019-12-08T12:17:14.490 INFO:teuthology.orchestra.run.smithi079.stderr: 23300K .......... .......... .......... .......... .......... 31% 252M 0s 2019-12-08T12:17:14.490 INFO:teuthology.orchestra.run.smithi079.stderr: 23350K .......... .......... .......... .......... .......... 31% 239M 0s 2019-12-08T12:17:14.490 INFO:teuthology.orchestra.run.smithi079.stderr: 23400K .......... .......... .......... .......... .......... 31% 250M 0s 2019-12-08T12:17:14.491 INFO:teuthology.orchestra.run.smithi079.stderr: 23450K .......... .......... .......... .......... .......... 31% 267M 0s 2019-12-08T12:17:14.491 INFO:teuthology.orchestra.run.smithi079.stderr: 23500K .......... .......... .......... .......... .......... 32% 264M 0s 2019-12-08T12:17:14.491 INFO:teuthology.orchestra.run.smithi079.stderr: 23550K .......... .......... .......... .......... .......... 32% 213M 0s 2019-12-08T12:17:14.491 INFO:teuthology.orchestra.run.smithi079.stderr: 23600K .......... .......... .......... .......... .......... 32% 274M 0s 2019-12-08T12:17:14.491 INFO:teuthology.orchestra.run.smithi079.stderr: 23650K .......... .......... .......... .......... .......... 32% 272M 0s 2019-12-08T12:17:14.491 INFO:teuthology.orchestra.run.smithi079.stderr: 23700K .......... .......... .......... .......... .......... 32% 244M 0s 2019-12-08T12:17:14.492 INFO:teuthology.orchestra.run.smithi079.stderr: 23750K .......... .......... .......... .......... .......... 32% 248M 0s 2019-12-08T12:17:14.492 INFO:teuthology.orchestra.run.smithi079.stderr: 23800K .......... .......... .......... .......... .......... 32% 267M 0s 2019-12-08T12:17:14.492 INFO:teuthology.orchestra.run.smithi079.stderr: 23850K .......... .......... .......... .......... .......... 32% 258M 0s 2019-12-08T12:17:14.492 INFO:teuthology.orchestra.run.smithi079.stderr: 23900K .......... .......... .......... .......... .......... 32% 259M 0s 2019-12-08T12:17:14.492 INFO:teuthology.orchestra.run.smithi079.stderr: 23950K .......... .......... .......... .......... .......... 32% 234M 0s 2019-12-08T12:17:14.492 INFO:teuthology.orchestra.run.smithi079.stderr: 24000K .......... .......... .......... .......... .......... 32% 285M 0s 2019-12-08T12:17:14.493 INFO:teuthology.orchestra.run.smithi079.stderr: 24050K .......... .......... .......... .......... .......... 32% 270M 0s 2019-12-08T12:17:14.493 INFO:teuthology.orchestra.run.smithi079.stderr: 24100K .......... .......... .......... .......... .......... 32% 275M 0s 2019-12-08T12:17:14.493 INFO:teuthology.orchestra.run.smithi079.stderr: 24150K .......... .......... .......... .......... .......... 32% 257M 0s 2019-12-08T12:17:14.493 INFO:teuthology.orchestra.run.smithi079.stderr: 24200K .......... .......... .......... .......... .......... 32% 279M 0s 2019-12-08T12:17:14.493 INFO:teuthology.orchestra.run.smithi079.stderr: 24250K .......... .......... .......... .......... .......... 33% 280M 0s 2019-12-08T12:17:14.493 INFO:teuthology.orchestra.run.smithi079.stderr: 24300K .......... .......... .......... .......... .......... 33% 277M 0s 2019-12-08T12:17:14.493 INFO:teuthology.orchestra.run.smithi079.stderr: 24350K .......... .......... .......... .......... .......... 33% 221M 0s 2019-12-08T12:17:14.493 INFO:teuthology.orchestra.run.smithi079.stderr: 24400K .......... .......... .......... .......... .......... 33% 261M 0s 2019-12-08T12:17:14.494 INFO:teuthology.orchestra.run.smithi079.stderr: 24450K .......... .......... .......... .......... .......... 33% 266M 0s 2019-12-08T12:17:14.494 INFO:teuthology.orchestra.run.smithi079.stderr: 24500K .......... .......... .......... .......... .......... 33% 264M 0s 2019-12-08T12:17:14.494 INFO:teuthology.orchestra.run.smithi079.stderr: 24550K .......... .......... .......... .......... .......... 33% 239M 0s 2019-12-08T12:17:14.494 INFO:teuthology.orchestra.run.smithi079.stderr: 24600K .......... .......... .......... .......... .......... 33% 256M 0s 2019-12-08T12:17:14.494 INFO:teuthology.orchestra.run.smithi079.stderr: 24650K .......... .......... .......... .......... .......... 33% 271M 0s 2019-12-08T12:17:14.494 INFO:teuthology.orchestra.run.smithi079.stderr: 24700K .......... .......... .......... .......... .......... 33% 272M 0s 2019-12-08T12:17:14.494 INFO:teuthology.orchestra.run.smithi079.stderr: 24750K .......... .......... .......... .......... .......... 33% 225M 0s 2019-12-08T12:17:14.495 INFO:teuthology.orchestra.run.smithi079.stderr: 24800K .......... .......... .......... .......... .......... 33% 268M 0s 2019-12-08T12:17:14.495 INFO:teuthology.orchestra.run.smithi079.stderr: 24850K .......... .......... .......... .......... .......... 33% 263M 0s 2019-12-08T12:17:14.495 INFO:teuthology.orchestra.run.smithi079.stderr: 24900K .......... .......... .......... .......... .......... 33% 265M 0s 2019-12-08T12:17:14.495 INFO:teuthology.orchestra.run.smithi079.stderr: 24950K .......... .......... .......... .......... .......... 33% 245M 0s 2019-12-08T12:17:14.495 INFO:teuthology.orchestra.run.smithi079.stderr: 25000K .......... .......... .......... .......... .......... 34% 283M 0s 2019-12-08T12:17:14.495 INFO:teuthology.orchestra.run.smithi079.stderr: 25050K .......... .......... .......... .......... .......... 34% 275M 0s 2019-12-08T12:17:14.495 INFO:teuthology.orchestra.run.smithi079.stderr: 25100K .......... .......... .......... .......... .......... 34% 273M 0s 2019-12-08T12:17:14.495 INFO:teuthology.orchestra.run.smithi079.stderr: 25150K .......... .......... .......... .......... .......... 34% 224M 0s 2019-12-08T12:17:14.496 INFO:teuthology.orchestra.run.smithi079.stderr: 25200K .......... .......... .......... .......... .......... 34% 274M 0s 2019-12-08T12:17:14.496 INFO:teuthology.orchestra.run.smithi079.stderr: 25250K .......... .......... .......... .......... .......... 34% 290M 0s 2019-12-08T12:17:14.496 INFO:teuthology.orchestra.run.smithi079.stderr: 25300K .......... .......... .......... .......... .......... 34% 277M 0s 2019-12-08T12:17:14.496 INFO:teuthology.orchestra.run.smithi079.stderr: 25350K .......... .......... .......... .......... .......... 34% 250M 0s 2019-12-08T12:17:14.496 INFO:teuthology.orchestra.run.smithi079.stderr: 25400K .......... .......... .......... .......... .......... 34% 262M 0s 2019-12-08T12:17:14.496 INFO:teuthology.orchestra.run.smithi079.stderr: 25450K .......... .......... .......... .......... .......... 34% 258M 0s 2019-12-08T12:17:14.496 INFO:teuthology.orchestra.run.smithi079.stderr: 25500K .......... .......... .......... .......... .......... 34% 274M 0s 2019-12-08T12:17:14.497 INFO:teuthology.orchestra.run.smithi079.stderr: 25550K .......... .......... .......... .......... .......... 34% 234M 0s 2019-12-08T12:17:14.497 INFO:teuthology.orchestra.run.smithi079.stderr: 25600K .......... .......... .......... .......... .......... 34% 278M 0s 2019-12-08T12:17:14.497 INFO:teuthology.orchestra.run.smithi079.stderr: 25650K .......... .......... .......... .......... .......... 34% 285M 0s 2019-12-08T12:17:14.497 INFO:teuthology.orchestra.run.smithi079.stderr: 25700K .......... .......... .......... .......... .......... 35% 272M 0s 2019-12-08T12:17:14.497 INFO:teuthology.orchestra.run.smithi079.stderr: 25750K .......... .......... .......... .......... .......... 35% 253M 0s 2019-12-08T12:17:14.497 INFO:teuthology.orchestra.run.smithi079.stderr: 25800K .......... .......... .......... .......... .......... 35% 281M 0s 2019-12-08T12:17:14.497 INFO:teuthology.orchestra.run.smithi079.stderr: 25850K .......... .......... .......... .......... .......... 35% 275M 0s 2019-12-08T12:17:14.498 INFO:teuthology.orchestra.run.smithi079.stderr: 25900K .......... .......... .......... .......... .......... 35% 270M 0s 2019-12-08T12:17:14.498 INFO:teuthology.orchestra.run.smithi079.stderr: 25950K .......... .......... .......... .......... .......... 35% 224M 0s 2019-12-08T12:17:14.498 INFO:teuthology.orchestra.run.smithi079.stderr: 26000K .......... .......... .......... .......... .......... 35% 284M 0s 2019-12-08T12:17:14.498 INFO:teuthology.orchestra.run.smithi079.stderr: 26050K .......... .......... .......... .......... .......... 35% 283M 0s 2019-12-08T12:17:14.498 INFO:teuthology.orchestra.run.smithi079.stderr: 26100K .......... .......... .......... .......... .......... 35% 271M 0s 2019-12-08T12:17:14.498 INFO:teuthology.orchestra.run.smithi079.stderr: 26150K .......... .......... .......... .......... .......... 35% 247M 0s 2019-12-08T12:17:14.498 INFO:teuthology.orchestra.run.smithi079.stderr: 26200K .......... .......... .......... .......... .......... 35% 261M 0s 2019-12-08T12:17:14.498 INFO:teuthology.orchestra.run.smithi079.stderr: 26250K .......... .......... .......... .......... .......... 35% 268M 0s 2019-12-08T12:17:14.499 INFO:teuthology.orchestra.run.smithi079.stderr: 26300K .......... .......... .......... .......... .......... 35% 262M 0s 2019-12-08T12:17:14.499 INFO:teuthology.orchestra.run.smithi079.stderr: 26350K .......... .......... .......... .......... .......... 35% 215M 0s 2019-12-08T12:17:14.499 INFO:teuthology.orchestra.run.smithi079.stderr: 26400K .......... .......... .......... .......... .......... 35% 274M 0s 2019-12-08T12:17:14.499 INFO:teuthology.orchestra.run.smithi079.stderr: 26450K .......... .......... .......... .......... .......... 36% 281M 0s 2019-12-08T12:17:14.499 INFO:teuthology.orchestra.run.smithi079.stderr: 26500K .......... .......... .......... .......... .......... 36% 273M 0s 2019-12-08T12:17:14.499 INFO:teuthology.orchestra.run.smithi079.stderr: 26550K .......... .......... .......... .......... .......... 36% 256M 0s 2019-12-08T12:17:14.499 INFO:teuthology.orchestra.run.smithi079.stderr: 26600K .......... .......... .......... .......... .......... 36% 277M 0s 2019-12-08T12:17:14.500 INFO:teuthology.orchestra.run.smithi079.stderr: 26650K .......... .......... .......... .......... .......... 36% 271M 0s 2019-12-08T12:17:14.500 INFO:teuthology.orchestra.run.smithi079.stderr: 26700K .......... .......... .......... .......... .......... 36% 279M 0s 2019-12-08T12:17:14.500 INFO:teuthology.orchestra.run.smithi079.stderr: 26750K .......... .......... .......... .......... .......... 36% 236M 0s 2019-12-08T12:17:14.500 INFO:teuthology.orchestra.run.smithi079.stderr: 26800K .......... .......... .......... .......... .......... 36% 284M 0s 2019-12-08T12:17:14.500 INFO:teuthology.orchestra.run.smithi079.stderr: 26850K .......... .......... .......... .......... .......... 36% 282M 0s 2019-12-08T12:17:14.501 INFO:teuthology.orchestra.run.smithi079.stderr: 26900K .......... .......... .......... .......... .......... 36% 281M 0s 2019-12-08T12:17:14.501 INFO:teuthology.orchestra.run.smithi079.stderr: 26950K .......... .......... .......... .......... .......... 36% 240M 0s 2019-12-08T12:17:14.501 INFO:teuthology.orchestra.run.smithi079.stderr: 27000K .......... .......... .......... .......... .......... 36% 285M 0s 2019-12-08T12:17:14.501 INFO:teuthology.orchestra.run.smithi079.stderr: 27050K .......... .......... .......... .......... .......... 36% 267M 0s 2019-12-08T12:17:14.501 INFO:teuthology.orchestra.run.smithi079.stderr: 27100K .......... .......... .......... .......... .......... 36% 272M 0s 2019-12-08T12:17:14.501 INFO:teuthology.orchestra.run.smithi079.stderr: 27150K .......... .......... .......... .......... .......... 36% 228M 0s 2019-12-08T12:17:14.502 INFO:teuthology.orchestra.run.smithi079.stderr: 27200K .......... .......... .......... .......... .......... 37% 257M 0s 2019-12-08T12:17:14.502 INFO:teuthology.orchestra.run.smithi079.stderr: 27250K .......... .......... .......... .......... .......... 37% 270M 0s 2019-12-08T12:17:14.502 INFO:teuthology.orchestra.run.smithi079.stderr: 27300K .......... .......... .......... .......... .......... 37% 277M 0s 2019-12-08T12:17:14.502 INFO:teuthology.orchestra.run.smithi079.stderr: 27350K .......... .......... .......... .......... .......... 37% 238M 0s 2019-12-08T12:17:14.502 INFO:teuthology.orchestra.run.smithi079.stderr: 27400K .......... .......... .......... .......... .......... 37% 287M 0s 2019-12-08T12:17:14.502 INFO:teuthology.orchestra.run.smithi079.stderr: 27450K .......... .......... .......... .......... .......... 37% 289M 0s 2019-12-08T12:17:14.502 INFO:teuthology.orchestra.run.smithi079.stderr: 27500K .......... .......... .......... .......... .......... 37% 287M 0s 2019-12-08T12:17:14.502 INFO:teuthology.orchestra.run.smithi079.stderr: 27550K .......... .......... .......... .......... .......... 37% 239M 0s 2019-12-08T12:17:14.503 INFO:teuthology.orchestra.run.smithi079.stderr: 27600K .......... .......... .......... .......... .......... 37% 282M 0s 2019-12-08T12:17:14.503 INFO:teuthology.orchestra.run.smithi079.stderr: 27650K .......... .......... .......... .......... .......... 37% 281M 0s 2019-12-08T12:17:14.503 INFO:teuthology.orchestra.run.smithi079.stderr: 27700K .......... .......... .......... .......... .......... 37% 290M 0s 2019-12-08T12:17:14.503 INFO:teuthology.orchestra.run.smithi079.stderr: 27750K .......... .......... .......... .......... .......... 37% 244M 0s 2019-12-08T12:17:14.503 INFO:teuthology.orchestra.run.smithi079.stderr: 27800K .......... .......... .......... .......... .......... 37% 285M 0s 2019-12-08T12:17:14.503 INFO:teuthology.orchestra.run.smithi079.stderr: 27850K .......... .......... .......... .......... .......... 37% 288M 0s 2019-12-08T12:17:14.503 INFO:teuthology.orchestra.run.smithi079.stderr: 27900K .......... .......... .......... .......... .......... 37% 283M 0s 2019-12-08T12:17:14.504 INFO:teuthology.orchestra.run.smithi079.stderr: 27950K .......... .......... .......... .......... .......... 38% 234M 0s 2019-12-08T12:17:14.504 INFO:teuthology.orchestra.run.smithi079.stderr: 28000K .......... .......... .......... .......... .......... 38% 265M 0s 2019-12-08T12:17:14.504 INFO:teuthology.orchestra.run.smithi079.stderr: 28050K .......... .......... .......... .......... .......... 38% 271M 0s 2019-12-08T12:17:14.504 INFO:teuthology.orchestra.run.smithi079.stderr: 28100K .......... .......... .......... .......... .......... 38% 271M 0s 2019-12-08T12:17:14.504 INFO:teuthology.orchestra.run.smithi079.stderr: 28150K .......... .......... .......... .......... .......... 38% 256M 0s 2019-12-08T12:17:14.504 INFO:teuthology.orchestra.run.smithi079.stderr: 28200K .......... .......... .......... .......... .......... 38% 267M 0s 2019-12-08T12:17:14.504 INFO:teuthology.orchestra.run.smithi079.stderr: 28250K .......... .......... .......... .......... .......... 38% 270M 0s 2019-12-08T12:17:14.505 INFO:teuthology.orchestra.run.smithi079.stderr: 28300K .......... .......... .......... .......... .......... 38% 283M 0s 2019-12-08T12:17:14.505 INFO:teuthology.orchestra.run.smithi079.stderr: 28350K .......... .......... .......... .......... .......... 38% 220M 0s 2019-12-08T12:17:14.505 INFO:teuthology.orchestra.run.smithi079.stderr: 28400K .......... .......... .......... .......... .......... 38% 282M 0s 2019-12-08T12:17:14.505 INFO:teuthology.orchestra.run.smithi079.stderr: 28450K .......... .......... .......... .......... .......... 38% 283M 0s 2019-12-08T12:17:14.505 INFO:teuthology.orchestra.run.smithi079.stderr: 28500K .......... .......... .......... .......... .......... 38% 299M 0s 2019-12-08T12:17:14.505 INFO:teuthology.orchestra.run.smithi079.stderr: 28550K .......... .......... .......... .......... .......... 38% 259M 0s 2019-12-08T12:17:14.505 INFO:teuthology.orchestra.run.smithi079.stderr: 28600K .......... .......... .......... .......... .......... 38% 295M 0s 2019-12-08T12:17:14.506 INFO:teuthology.orchestra.run.smithi079.stderr: 28650K .......... .......... .......... .......... .......... 39% 286M 0s 2019-12-08T12:17:14.506 INFO:teuthology.orchestra.run.smithi079.stderr: 28700K .......... .......... .......... .......... .......... 39% 275M 0s 2019-12-08T12:17:14.506 INFO:teuthology.orchestra.run.smithi079.stderr: 28750K .......... .......... .......... .......... .......... 39% 227M 0s 2019-12-08T12:17:14.506 INFO:teuthology.orchestra.run.smithi079.stderr: 28800K .......... .......... .......... .......... .......... 39% 278M 0s 2019-12-08T12:17:14.506 INFO:teuthology.orchestra.run.smithi079.stderr: 28850K .......... .......... .......... .......... .......... 39% 279M 0s 2019-12-08T12:17:14.506 INFO:teuthology.orchestra.run.smithi079.stderr: 28900K .......... .......... .......... .......... .......... 39% 277M 0s 2019-12-08T12:17:14.506 INFO:teuthology.orchestra.run.smithi079.stderr: 28950K .......... .......... .......... .......... .......... 39% 256M 0s 2019-12-08T12:17:14.506 INFO:teuthology.orchestra.run.smithi079.stderr: 29000K .......... .......... .......... .......... .......... 39% 283M 0s 2019-12-08T12:17:14.507 INFO:teuthology.orchestra.run.smithi079.stderr: 29050K .......... .......... .......... .......... .......... 39% 286M 0s 2019-12-08T12:17:14.507 INFO:teuthology.orchestra.run.smithi079.stderr: 29100K .......... .......... .......... .......... .......... 39% 271M 0s 2019-12-08T12:17:14.507 INFO:teuthology.orchestra.run.smithi079.stderr: 29150K .......... .......... .......... .......... .......... 39% 230M 0s 2019-12-08T12:17:14.507 INFO:teuthology.orchestra.run.smithi079.stderr: 29200K .......... .......... .......... .......... .......... 39% 269M 0s 2019-12-08T12:17:14.507 INFO:teuthology.orchestra.run.smithi079.stderr: 29250K .......... .......... .......... .......... .......... 39% 276M 0s 2019-12-08T12:17:14.507 INFO:teuthology.orchestra.run.smithi079.stderr: 29300K .......... .......... .......... .......... .......... 39% 248M 0s 2019-12-08T12:17:14.507 INFO:teuthology.orchestra.run.smithi079.stderr: 29350K .......... .......... .......... .......... .......... 39% 247M 0s 2019-12-08T12:17:14.508 INFO:teuthology.orchestra.run.smithi079.stderr: 29400K .......... .......... .......... .......... .......... 40% 269M 0s 2019-12-08T12:17:14.508 INFO:teuthology.orchestra.run.smithi079.stderr: 29450K .......... .......... .......... .......... .......... 40% 262M 0s 2019-12-08T12:17:14.508 INFO:teuthology.orchestra.run.smithi079.stderr: 29500K .......... .......... .......... .......... .......... 40% 264M 0s 2019-12-08T12:17:14.508 INFO:teuthology.orchestra.run.smithi079.stderr: 29550K .......... .......... .......... .......... .......... 40% 226M 0s 2019-12-08T12:17:14.508 INFO:teuthology.orchestra.run.smithi079.stderr: 29600K .......... .......... .......... .......... .......... 40% 277M 0s 2019-12-08T12:17:14.508 INFO:teuthology.orchestra.run.smithi079.stderr: 29650K .......... .......... .......... .......... .......... 40% 253M 0s 2019-12-08T12:17:14.509 INFO:teuthology.orchestra.run.smithi079.stderr: 29700K .......... .......... .......... .......... .......... 40% 277M 0s 2019-12-08T12:17:14.509 INFO:teuthology.orchestra.run.smithi079.stderr: 29750K .......... .......... .......... .......... .......... 40% 191M 0s 2019-12-08T12:17:14.509 INFO:teuthology.orchestra.run.smithi079.stderr: 29800K .......... .......... .......... .......... .......... 40% 286M 0s 2019-12-08T12:17:14.509 INFO:teuthology.orchestra.run.smithi079.stderr: 29850K .......... .......... .......... .......... .......... 40% 287M 0s 2019-12-08T12:17:14.509 INFO:teuthology.orchestra.run.smithi079.stderr: 29900K .......... .......... .......... .......... .......... 40% 289M 0s 2019-12-08T12:17:14.509 INFO:teuthology.orchestra.run.smithi079.stderr: 29950K .......... .......... .......... .......... .......... 40% 231M 0s 2019-12-08T12:17:14.509 INFO:teuthology.orchestra.run.smithi079.stderr: 30000K .......... .......... .......... .......... .......... 40% 275M 0s 2019-12-08T12:17:14.510 INFO:teuthology.orchestra.run.smithi079.stderr: 30050K .......... .......... .......... .......... .......... 40% 285M 0s 2019-12-08T12:17:14.510 INFO:teuthology.orchestra.run.smithi079.stderr: 30100K .......... .......... .......... .......... .......... 40% 284M 0s 2019-12-08T12:17:14.510 INFO:teuthology.orchestra.run.smithi079.stderr: 30150K .......... .......... .......... .......... .......... 41% 263M 0s 2019-12-08T12:17:14.510 INFO:teuthology.orchestra.run.smithi079.stderr: 30200K .......... .......... .......... .......... .......... 41% 290M 0s 2019-12-08T12:17:14.510 INFO:teuthology.orchestra.run.smithi079.stderr: 30250K .......... .......... .......... .......... .......... 41% 286M 0s 2019-12-08T12:17:14.510 INFO:teuthology.orchestra.run.smithi079.stderr: 30300K .......... .......... .......... .......... .......... 41% 280M 0s 2019-12-08T12:17:14.510 INFO:teuthology.orchestra.run.smithi079.stderr: 30350K .......... .......... .......... .......... .......... 41% 232M 0s 2019-12-08T12:17:14.511 INFO:teuthology.orchestra.run.smithi079.stderr: 30400K .......... .......... .......... .......... .......... 41% 264M 0s 2019-12-08T12:17:14.511 INFO:teuthology.orchestra.run.smithi079.stderr: 30450K .......... .......... .......... .......... .......... 41% 267M 0s 2019-12-08T12:17:14.511 INFO:teuthology.orchestra.run.smithi079.stderr: 30500K .......... .......... .......... .......... .......... 41% 274M 0s 2019-12-08T12:17:14.511 INFO:teuthology.orchestra.run.smithi079.stderr: 30550K .......... .......... .......... .......... .......... 41% 222M 0s 2019-12-08T12:17:14.511 INFO:teuthology.orchestra.run.smithi079.stderr: 30600K .......... .......... .......... .......... .......... 41% 259M 0s 2019-12-08T12:17:14.511 INFO:teuthology.orchestra.run.smithi079.stderr: 30650K .......... .......... .......... .......... .......... 41% 285M 0s 2019-12-08T12:17:14.511 INFO:teuthology.orchestra.run.smithi079.stderr: 30700K .......... .......... .......... .......... .......... 41% 273M 0s 2019-12-08T12:17:14.512 INFO:teuthology.orchestra.run.smithi079.stderr: 30750K .......... .......... .......... .......... .......... 41% 223M 0s 2019-12-08T12:17:14.512 INFO:teuthology.orchestra.run.smithi079.stderr: 30800K .......... .......... .......... .......... .......... 41% 283M 0s 2019-12-08T12:17:14.512 INFO:teuthology.orchestra.run.smithi079.stderr: 30850K .......... .......... .......... .......... .......... 42% 266M 0s 2019-12-08T12:17:14.512 INFO:teuthology.orchestra.run.smithi079.stderr: 30900K .......... .......... .......... .......... .......... 42% 266M 0s 2019-12-08T12:17:14.512 INFO:teuthology.orchestra.run.smithi079.stderr: 30950K .......... .......... .......... .......... .......... 42% 264M 0s 2019-12-08T12:17:14.512 INFO:teuthology.orchestra.run.smithi079.stderr: 31000K .......... .......... .......... .......... .......... 42% 280M 0s 2019-12-08T12:17:14.512 INFO:teuthology.orchestra.run.smithi079.stderr: 31050K .......... .......... .......... .......... .......... 42% 288M 0s 2019-12-08T12:17:14.512 INFO:teuthology.orchestra.run.smithi079.stderr: 31100K .......... .......... .......... .......... .......... 42% 272M 0s 2019-12-08T12:17:14.513 INFO:teuthology.orchestra.run.smithi079.stderr: 31150K .......... .......... .......... .......... .......... 42% 223M 0s 2019-12-08T12:17:14.513 INFO:teuthology.orchestra.run.smithi079.stderr: 31200K .......... .......... .......... .......... .......... 42% 276M 0s 2019-12-08T12:17:14.513 INFO:teuthology.orchestra.run.smithi079.stderr: 31250K .......... .......... .......... .......... .......... 42% 275M 0s 2019-12-08T12:17:14.513 INFO:teuthology.orchestra.run.smithi079.stderr: 31300K .......... .......... .......... .......... .......... 42% 287M 0s 2019-12-08T12:17:14.513 INFO:teuthology.orchestra.run.smithi079.stderr: 31350K .......... .......... .......... .......... .......... 42% 248M 0s 2019-12-08T12:17:14.513 INFO:teuthology.orchestra.run.smithi079.stderr: 31400K .......... .......... .......... .......... .......... 42% 285M 0s 2019-12-08T12:17:14.513 INFO:teuthology.orchestra.run.smithi079.stderr: 31450K .......... .......... .......... .......... .......... 42% 287M 0s 2019-12-08T12:17:14.514 INFO:teuthology.orchestra.run.smithi079.stderr: 31500K .......... .......... .......... .......... .......... 42% 271M 0s 2019-12-08T12:17:14.514 INFO:teuthology.orchestra.run.smithi079.stderr: 31550K .......... .......... .......... .......... .......... 42% 236M 0s 2019-12-08T12:17:14.514 INFO:teuthology.orchestra.run.smithi079.stderr: 31600K .......... .......... .......... .......... .......... 43% 289M 0s 2019-12-08T12:17:14.514 INFO:teuthology.orchestra.run.smithi079.stderr: 31650K .......... .......... .......... .......... .......... 43% 273M 0s 2019-12-08T12:17:14.514 INFO:teuthology.orchestra.run.smithi079.stderr: 31700K .......... .......... .......... .......... .......... 43% 281M 0s 2019-12-08T12:17:14.514 INFO:teuthology.orchestra.run.smithi079.stderr: 31750K .......... .......... .......... .......... .......... 43% 253M 0s 2019-12-08T12:17:14.514 INFO:teuthology.orchestra.run.smithi079.stderr: 31800K .......... .......... .......... .......... .......... 43% 287M 0s 2019-12-08T12:17:14.515 INFO:teuthology.orchestra.run.smithi079.stderr: 31850K .......... .......... .......... .......... .......... 43% 270M 0s 2019-12-08T12:17:14.515 INFO:teuthology.orchestra.run.smithi079.stderr: 31900K .......... .......... .......... .......... .......... 43% 283M 0s 2019-12-08T12:17:14.515 INFO:teuthology.orchestra.run.smithi079.stderr: 31950K .......... .......... .......... .......... .......... 43% 228M 0s 2019-12-08T12:17:14.515 INFO:teuthology.orchestra.run.smithi079.stderr: 32000K .......... .......... .......... .......... .......... 43% 282M 0s 2019-12-08T12:17:14.515 INFO:teuthology.orchestra.run.smithi079.stderr: 32050K .......... .......... .......... .......... .......... 43% 283M 0s 2019-12-08T12:17:14.515 INFO:teuthology.orchestra.run.smithi079.stderr: 32100K .......... .......... .......... .......... .......... 43% 286M 0s 2019-12-08T12:17:14.515 INFO:teuthology.orchestra.run.smithi079.stderr: 32150K .......... .......... .......... .......... .......... 43% 253M 0s 2019-12-08T12:17:14.515 INFO:teuthology.orchestra.run.smithi079.stderr: 32200K .......... .......... .......... .......... .......... 43% 278M 0s 2019-12-08T12:17:14.516 INFO:teuthology.orchestra.run.smithi079.stderr: 32250K .......... .......... .......... .......... .......... 43% 281M 0s 2019-12-08T12:17:14.516 INFO:teuthology.orchestra.run.smithi079.stderr: 32300K .......... .......... .......... .......... .......... 43% 285M 0s 2019-12-08T12:17:14.516 INFO:teuthology.orchestra.run.smithi079.stderr: 32350K .......... .......... .......... .......... .......... 44% 232M 0s 2019-12-08T12:17:14.516 INFO:teuthology.orchestra.run.smithi079.stderr: 32400K .......... .......... .......... .......... .......... 44% 272M 0s 2019-12-08T12:17:14.516 INFO:teuthology.orchestra.run.smithi079.stderr: 32450K .......... .......... .......... .......... .......... 44% 265M 0s 2019-12-08T12:17:14.516 INFO:teuthology.orchestra.run.smithi079.stderr: 32500K .......... .......... .......... .......... .......... 44% 261M 0s 2019-12-08T12:17:14.516 INFO:teuthology.orchestra.run.smithi079.stderr: 32550K .......... .......... .......... .......... .......... 44% 258M 0s 2019-12-08T12:17:14.517 INFO:teuthology.orchestra.run.smithi079.stderr: 32600K .......... .......... .......... .......... .......... 44% 265M 0s 2019-12-08T12:17:14.517 INFO:teuthology.orchestra.run.smithi079.stderr: 32650K .......... .......... .......... .......... .......... 44% 274M 0s 2019-12-08T12:17:14.517 INFO:teuthology.orchestra.run.smithi079.stderr: 32700K .......... .......... .......... .......... .......... 44% 276M 0s 2019-12-08T12:17:14.517 INFO:teuthology.orchestra.run.smithi079.stderr: 32750K .......... .......... .......... .......... .......... 44% 228M 0s 2019-12-08T12:17:14.517 INFO:teuthology.orchestra.run.smithi079.stderr: 32800K .......... .......... .......... .......... .......... 44% 262M 0s 2019-12-08T12:17:14.517 INFO:teuthology.orchestra.run.smithi079.stderr: 32850K .......... .......... .......... .......... .......... 44% 276M 0s 2019-12-08T12:17:14.517 INFO:teuthology.orchestra.run.smithi079.stderr: 32900K .......... .......... .......... .......... .......... 44% 270M 0s 2019-12-08T12:17:14.518 INFO:teuthology.orchestra.run.smithi079.stderr: 32950K .......... .......... .......... .......... .......... 44% 244M 0s 2019-12-08T12:17:14.518 INFO:teuthology.orchestra.run.smithi079.stderr: 33000K .......... .......... .......... .......... .......... 44% 273M 0s 2019-12-08T12:17:14.518 INFO:teuthology.orchestra.run.smithi079.stderr: 33050K .......... .......... .......... .......... .......... 44% 266M 0s 2019-12-08T12:17:14.518 INFO:teuthology.orchestra.run.smithi079.stderr: 33100K .......... .......... .......... .......... .......... 45% 268M 0s 2019-12-08T12:17:14.518 INFO:teuthology.orchestra.run.smithi079.stderr: 33150K .......... .......... .......... .......... .......... 45% 237M 0s 2019-12-08T12:17:14.518 INFO:teuthology.orchestra.run.smithi079.stderr: 33200K .......... .......... .......... .......... .......... 45% 279M 0s 2019-12-08T12:17:14.518 INFO:teuthology.orchestra.run.smithi079.stderr: 33250K .......... .......... .......... .......... .......... 45% 227M 0s 2019-12-08T12:17:14.519 INFO:teuthology.orchestra.run.smithi079.stderr: 33300K .......... .......... .......... .......... .......... 45% 267M 0s 2019-12-08T12:17:14.519 INFO:teuthology.orchestra.run.smithi079.stderr: 33350K .......... .......... .......... .......... .......... 45% 260M 0s 2019-12-08T12:17:14.519 INFO:teuthology.orchestra.run.smithi079.stderr: 33400K .......... .......... .......... .......... .......... 45% 287M 0s 2019-12-08T12:17:14.519 INFO:teuthology.orchestra.run.smithi079.stderr: 33450K .......... .......... .......... .......... .......... 45% 291M 0s 2019-12-08T12:17:14.519 INFO:teuthology.orchestra.run.smithi079.stderr: 33500K .......... .......... .......... .......... .......... 45% 295M 0s 2019-12-08T12:17:14.519 INFO:teuthology.orchestra.run.smithi079.stderr: 33550K .......... .......... .......... .......... .......... 45% 229M 0s 2019-12-08T12:17:14.520 INFO:teuthology.orchestra.run.smithi079.stderr: 33600K .......... .......... .......... .......... .......... 45% 286M 0s 2019-12-08T12:17:14.520 INFO:teuthology.orchestra.run.smithi079.stderr: 33650K .......... .......... .......... .......... .......... 45% 284M 0s 2019-12-08T12:17:14.520 INFO:teuthology.orchestra.run.smithi079.stderr: 33700K .......... .......... .......... .......... .......... 45% 285M 0s 2019-12-08T12:17:14.520 INFO:teuthology.orchestra.run.smithi079.stderr: 33750K .......... .......... .......... .......... .......... 45% 254M 0s 2019-12-08T12:17:14.520 INFO:teuthology.orchestra.run.smithi079.stderr: 33800K .......... .......... .......... .......... .......... 46% 297M 0s 2019-12-08T12:17:14.520 INFO:teuthology.orchestra.run.smithi079.stderr: 33850K .......... .......... .......... .......... .......... 46% 283M 0s 2019-12-08T12:17:14.520 INFO:teuthology.orchestra.run.smithi079.stderr: 33900K .......... .......... .......... .......... .......... 46% 282M 0s 2019-12-08T12:17:14.521 INFO:teuthology.orchestra.run.smithi079.stderr: 33950K .......... .......... .......... .......... .......... 46% 235M 0s 2019-12-08T12:17:14.521 INFO:teuthology.orchestra.run.smithi079.stderr: 34000K .......... .......... .......... .......... .......... 46% 276M 0s 2019-12-08T12:17:14.521 INFO:teuthology.orchestra.run.smithi079.stderr: 34050K .......... .......... .......... .......... .......... 46% 281M 0s 2019-12-08T12:17:14.521 INFO:teuthology.orchestra.run.smithi079.stderr: 34100K .......... .......... .......... .......... .......... 46% 290M 0s 2019-12-08T12:17:14.521 INFO:teuthology.orchestra.run.smithi079.stderr: 34150K .......... .......... .......... .......... .......... 46% 257M 0s 2019-12-08T12:17:14.521 INFO:teuthology.orchestra.run.smithi079.stderr: 34200K .......... .......... .......... .......... .......... 46% 271M 0s 2019-12-08T12:17:14.521 INFO:teuthology.orchestra.run.smithi079.stderr: 34250K .......... .......... .......... .......... .......... 46% 264M 0s 2019-12-08T12:17:14.522 INFO:teuthology.orchestra.run.smithi079.stderr: 34300K .......... .......... .......... .......... .......... 46% 279M 0s 2019-12-08T12:17:14.522 INFO:teuthology.orchestra.run.smithi079.stderr: 34350K .......... .......... .......... .......... .......... 46% 238M 0s 2019-12-08T12:17:14.522 INFO:teuthology.orchestra.run.smithi079.stderr: 34400K .......... .......... .......... .......... .......... 46% 275M 0s 2019-12-08T12:17:14.522 INFO:teuthology.orchestra.run.smithi079.stderr: 34450K .......... .......... .......... .......... .......... 46% 278M 0s 2019-12-08T12:17:14.522 INFO:teuthology.orchestra.run.smithi079.stderr: 34500K .......... .......... .......... .......... .......... 46% 285M 0s 2019-12-08T12:17:14.522 INFO:teuthology.orchestra.run.smithi079.stderr: 34550K .......... .......... .......... .......... .......... 47% 265M 0s 2019-12-08T12:17:14.522 INFO:teuthology.orchestra.run.smithi079.stderr: 34600K .......... .......... .......... .......... .......... 47% 266M 0s 2019-12-08T12:17:14.523 INFO:teuthology.orchestra.run.smithi079.stderr: 34650K .......... .......... .......... .......... .......... 47% 285M 0s 2019-12-08T12:17:14.523 INFO:teuthology.orchestra.run.smithi079.stderr: 34700K .......... .......... .......... .......... .......... 47% 294M 0s 2019-12-08T12:17:14.523 INFO:teuthology.orchestra.run.smithi079.stderr: 34750K .......... .......... .......... .......... .......... 47% 231M 0s 2019-12-08T12:17:14.523 INFO:teuthology.orchestra.run.smithi079.stderr: 34800K .......... .......... .......... .......... .......... 47% 299M 0s 2019-12-08T12:17:14.523 INFO:teuthology.orchestra.run.smithi079.stderr: 34850K .......... .......... .......... .......... .......... 47% 234M 0s 2019-12-08T12:17:14.523 INFO:teuthology.orchestra.run.smithi079.stderr: 34900K .......... .......... .......... .......... .......... 47% 252M 0s 2019-12-08T12:17:14.523 INFO:teuthology.orchestra.run.smithi079.stderr: 34950K .......... .......... .......... .......... .......... 47% 195M 0s 2019-12-08T12:17:14.523 INFO:teuthology.orchestra.run.smithi079.stderr: 35000K .......... .......... .......... .......... .......... 47% 237M 0s 2019-12-08T12:17:14.524 INFO:teuthology.orchestra.run.smithi079.stderr: 35050K .......... .......... .......... .......... .......... 47% 284M 0s 2019-12-08T12:17:14.524 INFO:teuthology.orchestra.run.smithi079.stderr: 35100K .......... .......... .......... .......... .......... 47% 266M 0s 2019-12-08T12:17:14.524 INFO:teuthology.orchestra.run.smithi079.stderr: 35150K .......... .......... .......... .......... .......... 47% 227M 0s 2019-12-08T12:17:14.524 INFO:teuthology.orchestra.run.smithi079.stderr: 35200K .......... .......... .......... .......... .......... 47% 286M 0s 2019-12-08T12:17:14.524 INFO:teuthology.orchestra.run.smithi079.stderr: 35250K .......... .......... .......... .......... .......... 47% 283M 0s 2019-12-08T12:17:14.524 INFO:teuthology.orchestra.run.smithi079.stderr: 35300K .......... .......... .......... .......... .......... 48% 274M 0s 2019-12-08T12:17:14.524 INFO:teuthology.orchestra.run.smithi079.stderr: 35350K .......... .......... .......... .......... .......... 48% 254M 0s 2019-12-08T12:17:14.525 INFO:teuthology.orchestra.run.smithi079.stderr: 35400K .......... .......... .......... .......... .......... 48% 271M 0s 2019-12-08T12:17:14.525 INFO:teuthology.orchestra.run.smithi079.stderr: 35450K .......... .......... .......... .......... .......... 48% 284M 0s 2019-12-08T12:17:14.525 INFO:teuthology.orchestra.run.smithi079.stderr: 35500K .......... .......... .......... .......... .......... 48% 275M 0s 2019-12-08T12:17:14.525 INFO:teuthology.orchestra.run.smithi079.stderr: 35550K .......... .......... .......... .......... .......... 48% 245M 0s 2019-12-08T12:17:14.525 INFO:teuthology.orchestra.run.smithi079.stderr: 35600K .......... .......... .......... .......... .......... 48% 296M 0s 2019-12-08T12:17:14.525 INFO:teuthology.orchestra.run.smithi079.stderr: 35650K .......... .......... .......... .......... .......... 48% 296M 0s 2019-12-08T12:17:14.525 INFO:teuthology.orchestra.run.smithi079.stderr: 35700K .......... .......... .......... .......... .......... 48% 298M 0s 2019-12-08T12:17:14.526 INFO:teuthology.orchestra.run.smithi079.stderr: 35750K .......... .......... .......... .......... .......... 48% 247M 0s 2019-12-08T12:17:14.526 INFO:teuthology.orchestra.run.smithi079.stderr: 35800K .......... .......... .......... .......... .......... 48% 281M 0s 2019-12-08T12:17:14.526 INFO:teuthology.orchestra.run.smithi079.stderr: 35850K .......... .......... .......... .......... .......... 48% 285M 0s 2019-12-08T12:17:14.526 INFO:teuthology.orchestra.run.smithi079.stderr: 35900K .......... .......... .......... .......... .......... 48% 280M 0s 2019-12-08T12:17:14.526 INFO:teuthology.orchestra.run.smithi079.stderr: 35950K .......... .......... .......... .......... .......... 48% 240M 0s 2019-12-08T12:17:14.526 INFO:teuthology.orchestra.run.smithi079.stderr: 36000K .......... .......... .......... .......... .......... 49% 291M 0s 2019-12-08T12:17:14.526 INFO:teuthology.orchestra.run.smithi079.stderr: 36050K .......... .......... .......... .......... .......... 49% 290M 0s 2019-12-08T12:17:14.527 INFO:teuthology.orchestra.run.smithi079.stderr: 36100K .......... .......... .......... .......... .......... 49% 295M 0s 2019-12-08T12:17:14.527 INFO:teuthology.orchestra.run.smithi079.stderr: 36150K .......... .......... .......... .......... .......... 49% 268M 0s 2019-12-08T12:17:14.527 INFO:teuthology.orchestra.run.smithi079.stderr: 36200K .......... .......... .......... .......... .......... 49% 301M 0s 2019-12-08T12:17:14.527 INFO:teuthology.orchestra.run.smithi079.stderr: 36250K .......... .......... .......... .......... .......... 49% 301M 0s 2019-12-08T12:17:14.527 INFO:teuthology.orchestra.run.smithi079.stderr: 36300K .......... .......... .......... .......... .......... 49% 276M 0s 2019-12-08T12:17:14.527 INFO:teuthology.orchestra.run.smithi079.stderr: 36350K .......... .......... .......... .......... .......... 49% 248M 0s 2019-12-08T12:17:14.528 INFO:teuthology.orchestra.run.smithi079.stderr: 36400K .......... .......... .......... .......... .......... 49% 283M 0s 2019-12-08T12:17:14.528 INFO:teuthology.orchestra.run.smithi079.stderr: 36450K .......... .......... .......... .......... .......... 49% 295M 0s 2019-12-08T12:17:14.528 INFO:teuthology.orchestra.run.smithi079.stderr: 36500K .......... .......... .......... .......... .......... 49% 293M 0s 2019-12-08T12:17:14.528 INFO:teuthology.orchestra.run.smithi079.stderr: 36550K .......... .......... .......... .......... .......... 49% 255M 0s 2019-12-08T12:17:14.528 INFO:teuthology.orchestra.run.smithi079.stderr: 36600K .......... .......... .......... .......... .......... 49% 292M 0s 2019-12-08T12:17:14.528 INFO:teuthology.orchestra.run.smithi079.stderr: 36650K .......... .......... .......... .......... .......... 49% 285M 0s 2019-12-08T12:17:14.528 INFO:teuthology.orchestra.run.smithi079.stderr: 36700K .......... .......... .......... .......... .......... 49% 294M 0s 2019-12-08T12:17:14.529 INFO:teuthology.orchestra.run.smithi079.stderr: 36750K .......... .......... .......... .......... .......... 50% 224M 0s 2019-12-08T12:17:14.529 INFO:teuthology.orchestra.run.smithi079.stderr: 36800K .......... .......... .......... .......... .......... 50% 263M 0s 2019-12-08T12:17:14.529 INFO:teuthology.orchestra.run.smithi079.stderr: 36850K .......... .......... .......... .......... .......... 50% 273M 0s 2019-12-08T12:17:14.529 INFO:teuthology.orchestra.run.smithi079.stderr: 36900K .......... .......... .......... .......... .......... 50% 273M 0s 2019-12-08T12:17:14.529 INFO:teuthology.orchestra.run.smithi079.stderr: 36950K .......... .......... .......... .......... .......... 50% 262M 0s 2019-12-08T12:17:14.529 INFO:teuthology.orchestra.run.smithi079.stderr: 37000K .......... .......... .......... .......... .......... 50% 279M 0s 2019-12-08T12:17:14.529 INFO:teuthology.orchestra.run.smithi079.stderr: 37050K .......... .......... .......... .......... .......... 50% 280M 0s 2019-12-08T12:17:14.530 INFO:teuthology.orchestra.run.smithi079.stderr: 37100K .......... .......... .......... .......... .......... 50% 282M 0s 2019-12-08T12:17:14.530 INFO:teuthology.orchestra.run.smithi079.stderr: 37150K .......... .......... .......... .......... .......... 50% 230M 0s 2019-12-08T12:17:14.530 INFO:teuthology.orchestra.run.smithi079.stderr: 37200K .......... .......... .......... .......... .......... 50% 296M 0s 2019-12-08T12:17:14.530 INFO:teuthology.orchestra.run.smithi079.stderr: 37250K .......... .......... .......... .......... .......... 50% 283M 0s 2019-12-08T12:17:14.530 INFO:teuthology.orchestra.run.smithi079.stderr: 37300K .......... .......... .......... .......... .......... 50% 279M 0s 2019-12-08T12:17:14.530 INFO:teuthology.orchestra.run.smithi079.stderr: 37350K .......... .......... .......... .......... .......... 50% 254M 0s 2019-12-08T12:17:14.530 INFO:teuthology.orchestra.run.smithi079.stderr: 37400K .......... .......... .......... .......... .......... 50% 265M 0s 2019-12-08T12:17:14.530 INFO:teuthology.orchestra.run.smithi079.stderr: 37450K .......... .......... .......... .......... .......... 50% 298M 0s 2019-12-08T12:17:14.531 INFO:teuthology.orchestra.run.smithi079.stderr: 37500K .......... .......... .......... .......... .......... 51% 283M 0s 2019-12-08T12:17:14.531 INFO:teuthology.orchestra.run.smithi079.stderr: 37550K .......... .......... .......... .......... .......... 51% 247M 0s 2019-12-08T12:17:14.531 INFO:teuthology.orchestra.run.smithi079.stderr: 37600K .......... .......... .......... .......... .......... 51% 290M 0s 2019-12-08T12:17:14.531 INFO:teuthology.orchestra.run.smithi079.stderr: 37650K .......... .......... .......... .......... .......... 51% 297M 0s 2019-12-08T12:17:14.531 INFO:teuthology.orchestra.run.smithi079.stderr: 37700K .......... .......... .......... .......... .......... 51% 285M 0s 2019-12-08T12:17:14.531 INFO:teuthology.orchestra.run.smithi079.stderr: 37750K .......... .......... .......... .......... .......... 51% 246M 0s 2019-12-08T12:17:14.531 INFO:teuthology.orchestra.run.smithi079.stderr: 37800K .......... .......... .......... .......... .......... 51% 279M 0s 2019-12-08T12:17:14.532 INFO:teuthology.orchestra.run.smithi079.stderr: 37850K .......... .......... .......... .......... .......... 51% 268M 0s 2019-12-08T12:17:14.532 INFO:teuthology.orchestra.run.smithi079.stderr: 37900K .......... .......... .......... .......... .......... 51% 237M 0s 2019-12-08T12:17:14.532 INFO:teuthology.orchestra.run.smithi079.stderr: 37950K .......... .......... .......... .......... .......... 51% 239M 0s 2019-12-08T12:17:14.532 INFO:teuthology.orchestra.run.smithi079.stderr: 38000K .......... .......... .......... .......... .......... 51% 294M 0s 2019-12-08T12:17:14.532 INFO:teuthology.orchestra.run.smithi079.stderr: 38050K .......... .......... .......... .......... .......... 51% 287M 0s 2019-12-08T12:17:14.532 INFO:teuthology.orchestra.run.smithi079.stderr: 38100K .......... .......... .......... .......... .......... 51% 279M 0s 2019-12-08T12:17:14.532 INFO:teuthology.orchestra.run.smithi079.stderr: 38150K .......... .......... .......... .......... .......... 51% 260M 0s 2019-12-08T12:17:14.533 INFO:teuthology.orchestra.run.smithi079.stderr: 38200K .......... .......... .......... .......... .......... 51% 290M 0s 2019-12-08T12:17:14.533 INFO:teuthology.orchestra.run.smithi079.stderr: 38250K .......... .......... .......... .......... .......... 52% 280M 0s 2019-12-08T12:17:14.533 INFO:teuthology.orchestra.run.smithi079.stderr: 38300K .......... .......... .......... .......... .......... 52% 284M 0s 2019-12-08T12:17:14.533 INFO:teuthology.orchestra.run.smithi079.stderr: 38350K .......... .......... .......... .......... .......... 52% 236M 0s 2019-12-08T12:17:14.533 INFO:teuthology.orchestra.run.smithi079.stderr: 38400K .......... .......... .......... .......... .......... 52% 283M 0s 2019-12-08T12:17:14.533 INFO:teuthology.orchestra.run.smithi079.stderr: 38450K .......... .......... .......... .......... .......... 52% 285M 0s 2019-12-08T12:17:14.533 INFO:teuthology.orchestra.run.smithi079.stderr: 38500K .......... .......... .......... .......... .......... 52% 388M 0s 2019-12-08T12:17:14.534 INFO:teuthology.orchestra.run.smithi079.stderr: 38550K .......... .......... .......... .......... .......... 52% 200M 0s 2019-12-08T12:17:14.534 INFO:teuthology.orchestra.run.smithi079.stderr: 38600K .......... .......... .......... .......... .......... 52% 218M 0s 2019-12-08T12:17:14.534 INFO:teuthology.orchestra.run.smithi079.stderr: 38650K .......... .......... .......... .......... .......... 52% 244M 0s 2019-12-08T12:17:14.534 INFO:teuthology.orchestra.run.smithi079.stderr: 38700K .......... .......... .......... .......... .......... 52% 214M 0s 2019-12-08T12:17:14.534 INFO:teuthology.orchestra.run.smithi079.stderr: 38750K .......... .......... .......... .......... .......... 52% 181M 0s 2019-12-08T12:17:14.534 INFO:teuthology.orchestra.run.smithi079.stderr: 38800K .......... .......... .......... .......... .......... 52% 227M 0s 2019-12-08T12:17:14.534 INFO:teuthology.orchestra.run.smithi079.stderr: 38850K .......... .......... .......... .......... .......... 52% 229M 0s 2019-12-08T12:17:14.535 INFO:teuthology.orchestra.run.smithi079.stderr: 38900K .......... .......... .......... .......... .......... 52% 335M 0s 2019-12-08T12:17:14.535 INFO:teuthology.orchestra.run.smithi079.stderr: 38950K .......... .......... .......... .......... .......... 53% 341M 0s 2019-12-08T12:17:14.535 INFO:teuthology.orchestra.run.smithi079.stderr: 39000K .......... .......... .......... .......... .......... 53% 377M 0s 2019-12-08T12:17:14.535 INFO:teuthology.orchestra.run.smithi079.stderr: 39050K .......... .......... .......... .......... .......... 53% 369M 0s 2019-12-08T12:17:14.535 INFO:teuthology.orchestra.run.smithi079.stderr: 39100K .......... .......... .......... .......... .......... 53% 394M 0s 2019-12-08T12:17:14.535 INFO:teuthology.orchestra.run.smithi079.stderr: 39150K .......... .......... .......... .......... .......... 53% 338M 0s 2019-12-08T12:17:14.535 INFO:teuthology.orchestra.run.smithi079.stderr: 39200K .......... .......... .......... .......... .......... 53% 371M 0s 2019-12-08T12:17:14.536 INFO:teuthology.orchestra.run.smithi079.stderr: 39250K .......... .......... .......... .......... .......... 53% 390M 0s 2019-12-08T12:17:14.536 INFO:teuthology.orchestra.run.smithi079.stderr: 39300K .......... .......... .......... .......... .......... 53% 364M 0s 2019-12-08T12:17:14.536 INFO:teuthology.orchestra.run.smithi079.stderr: 39350K .......... .......... .......... .......... .......... 53% 316M 0s 2019-12-08T12:17:14.536 INFO:teuthology.orchestra.run.smithi079.stderr: 39400K .......... .......... .......... .......... .......... 53% 363M 0s 2019-12-08T12:17:14.536 INFO:teuthology.orchestra.run.smithi079.stderr: 39450K .......... .......... .......... .......... .......... 53% 295M 0s 2019-12-08T12:17:14.536 INFO:teuthology.orchestra.run.smithi079.stderr: 39500K .......... .......... .......... .......... .......... 53% 382M 0s 2019-12-08T12:17:14.536 INFO:teuthology.orchestra.run.smithi079.stderr: 39550K .......... .......... .......... .......... .......... 53% 315M 0s 2019-12-08T12:17:14.537 INFO:teuthology.orchestra.run.smithi079.stderr: 39600K .......... .......... .......... .......... .......... 53% 250M 0s 2019-12-08T12:17:14.537 INFO:teuthology.orchestra.run.smithi079.stderr: 39650K .......... .......... .......... .......... .......... 53% 240M 0s 2019-12-08T12:17:14.537 INFO:teuthology.orchestra.run.smithi079.stderr: 39700K .......... .......... .......... .......... .......... 54% 245M 0s 2019-12-08T12:17:14.537 INFO:teuthology.orchestra.run.smithi079.stderr: 39750K .......... .......... .......... .......... .......... 54% 202M 0s 2019-12-08T12:17:14.537 INFO:teuthology.orchestra.run.smithi079.stderr: 39800K .......... .......... .......... .......... .......... 54% 245M 0s 2019-12-08T12:17:14.537 INFO:teuthology.orchestra.run.smithi079.stderr: 39850K .......... .......... .......... .......... .......... 54% 231M 0s 2019-12-08T12:17:14.537 INFO:teuthology.orchestra.run.smithi079.stderr: 39900K .......... .......... .......... .......... .......... 54% 233M 0s 2019-12-08T12:17:14.537 INFO:teuthology.orchestra.run.smithi079.stderr: 39950K .......... .......... .......... .......... .......... 54% 188M 0s 2019-12-08T12:17:14.538 INFO:teuthology.orchestra.run.smithi079.stderr: 40000K .......... .......... .......... .......... .......... 54% 254M 0s 2019-12-08T12:17:14.538 INFO:teuthology.orchestra.run.smithi079.stderr: 40050K .......... .......... .......... .......... .......... 54% 312M 0s 2019-12-08T12:17:14.538 INFO:teuthology.orchestra.run.smithi079.stderr: 40100K .......... .......... .......... .......... .......... 54% 393M 0s 2019-12-08T12:17:14.538 INFO:teuthology.orchestra.run.smithi079.stderr: 40150K .......... .......... .......... .......... .......... 54% 358M 0s 2019-12-08T12:17:14.538 INFO:teuthology.orchestra.run.smithi079.stderr: 40200K .......... .......... .......... .......... .......... 54% 405M 0s 2019-12-08T12:17:14.538 INFO:teuthology.orchestra.run.smithi079.stderr: 40250K .......... .......... .......... .......... .......... 54% 357M 0s 2019-12-08T12:17:14.538 INFO:teuthology.orchestra.run.smithi079.stderr: 40300K .......... .......... .......... .......... .......... 54% 412M 0s 2019-12-08T12:17:14.539 INFO:teuthology.orchestra.run.smithi079.stderr: 40350K .......... .......... .......... .......... .......... 54% 335M 0s 2019-12-08T12:17:14.539 INFO:teuthology.orchestra.run.smithi079.stderr: 40400K .......... .......... .......... .......... .......... 54% 397M 0s 2019-12-08T12:17:14.539 INFO:teuthology.orchestra.run.smithi079.stderr: 40450K .......... .......... .......... .......... .......... 55% 416M 0s 2019-12-08T12:17:14.539 INFO:teuthology.orchestra.run.smithi079.stderr: 40500K .......... .......... .......... .......... .......... 55% 377M 0s 2019-12-08T12:17:14.539 INFO:teuthology.orchestra.run.smithi079.stderr: 40550K .......... .......... .......... .......... .......... 55% 350M 0s 2019-12-08T12:17:14.539 INFO:teuthology.orchestra.run.smithi079.stderr: 40600K .......... .......... .......... .......... .......... 55% 369M 0s 2019-12-08T12:17:14.539 INFO:teuthology.orchestra.run.smithi079.stderr: 40650K .......... .......... .......... .......... .......... 55% 381M 0s 2019-12-08T12:17:14.540 INFO:teuthology.orchestra.run.smithi079.stderr: 40700K .......... .......... .......... .......... .......... 55% 335M 0s 2019-12-08T12:17:14.540 INFO:teuthology.orchestra.run.smithi079.stderr: 40750K .......... .......... .......... .......... .......... 55% 204M 0s 2019-12-08T12:17:14.540 INFO:teuthology.orchestra.run.smithi079.stderr: 40800K .......... .......... .......... .......... .......... 55% 210M 0s 2019-12-08T12:17:14.540 INFO:teuthology.orchestra.run.smithi079.stderr: 40850K .......... .......... .......... .......... .......... 55% 219M 0s 2019-12-08T12:17:14.540 INFO:teuthology.orchestra.run.smithi079.stderr: 40900K .......... .......... .......... .......... .......... 55% 236M 0s 2019-12-08T12:17:14.540 INFO:teuthology.orchestra.run.smithi079.stderr: 40950K .......... .......... .......... .......... .......... 55% 196M 0s 2019-12-08T12:17:14.540 INFO:teuthology.orchestra.run.smithi079.stderr: 41000K .......... .......... .......... .......... .......... 55% 247M 0s 2019-12-08T12:17:14.541 INFO:teuthology.orchestra.run.smithi079.stderr: 41050K .......... .......... .......... .......... .......... 55% 370M 0s 2019-12-08T12:17:14.541 INFO:teuthology.orchestra.run.smithi079.stderr: 41100K .......... .......... .......... .......... .......... 55% 375M 0s 2019-12-08T12:17:14.541 INFO:teuthology.orchestra.run.smithi079.stderr: 41150K .......... .......... .......... .......... .......... 56% 320M 0s 2019-12-08T12:17:14.541 INFO:teuthology.orchestra.run.smithi079.stderr: 41200K .......... .......... .......... .......... .......... 56% 362M 0s 2019-12-08T12:17:14.541 INFO:teuthology.orchestra.run.smithi079.stderr: 41250K .......... .......... .......... .......... .......... 56% 311M 0s 2019-12-08T12:17:14.541 INFO:teuthology.orchestra.run.smithi079.stderr: 41300K .......... .......... .......... .......... .......... 56% 390M 0s 2019-12-08T12:17:14.541 INFO:teuthology.orchestra.run.smithi079.stderr: 41350K .......... .......... .......... .......... .......... 56% 362M 0s 2019-12-08T12:17:14.541 INFO:teuthology.orchestra.run.smithi079.stderr: 41400K .......... .......... .......... .......... .......... 56% 415M 0s 2019-12-08T12:17:14.542 INFO:teuthology.orchestra.run.smithi079.stderr: 41450K .......... .......... .......... .......... .......... 56% 400M 0s 2019-12-08T12:17:14.542 INFO:teuthology.orchestra.run.smithi079.stderr: 41500K .......... .......... .......... .......... .......... 56% 397M 0s 2019-12-08T12:17:14.542 INFO:teuthology.orchestra.run.smithi079.stderr: 41550K .......... .......... .......... .......... .......... 56% 323M 0s 2019-12-08T12:17:14.542 INFO:teuthology.orchestra.run.smithi079.stderr: 41600K .......... .......... .......... .......... .......... 56% 395M 0s 2019-12-08T12:17:14.542 INFO:teuthology.orchestra.run.smithi079.stderr: 41650K .......... .......... .......... .......... .......... 56% 404M 0s 2019-12-08T12:17:14.542 INFO:teuthology.orchestra.run.smithi079.stderr: 41700K .......... .......... .......... .......... .......... 56% 410M 0s 2019-12-08T12:17:14.542 INFO:teuthology.orchestra.run.smithi079.stderr: 41750K .......... .......... .......... .......... .......... 56% 366M 0s 2019-12-08T12:17:14.543 INFO:teuthology.orchestra.run.smithi079.stderr: 41800K .......... .......... .......... .......... .......... 56% 390M 0s 2019-12-08T12:17:14.543 INFO:teuthology.orchestra.run.smithi079.stderr: 41850K .......... .......... .......... .......... .......... 56% 407M 0s 2019-12-08T12:17:14.543 INFO:teuthology.orchestra.run.smithi079.stderr: 41900K .......... .......... .......... .......... .......... 57% 408M 0s 2019-12-08T12:17:14.543 INFO:teuthology.orchestra.run.smithi079.stderr: 41950K .......... .......... .......... .......... .......... 57% 330M 0s 2019-12-08T12:17:14.543 INFO:teuthology.orchestra.run.smithi079.stderr: 42000K .......... .......... .......... .......... .......... 57% 407M 0s 2019-12-08T12:17:14.543 INFO:teuthology.orchestra.run.smithi079.stderr: 42050K .......... .......... .......... .......... .......... 57% 403M 0s 2019-12-08T12:17:14.543 INFO:teuthology.orchestra.run.smithi079.stderr: 42100K .......... .......... .......... .......... .......... 57% 407M 0s 2019-12-08T12:17:14.544 INFO:teuthology.orchestra.run.smithi079.stderr: 42150K .......... .......... .......... .......... .......... 57% 360M 0s 2019-12-08T12:17:14.544 INFO:teuthology.orchestra.run.smithi079.stderr: 42200K .......... .......... .......... .......... .......... 57% 407M 0s 2019-12-08T12:17:14.544 INFO:teuthology.orchestra.run.smithi079.stderr: 42250K .......... .......... .......... .......... .......... 57% 400M 0s 2019-12-08T12:17:14.544 INFO:teuthology.orchestra.run.smithi079.stderr: 42300K .......... .......... .......... .......... .......... 57% 413M 0s 2019-12-08T12:17:14.544 INFO:teuthology.orchestra.run.smithi079.stderr: 42350K .......... .......... .......... .......... .......... 57% 335M 0s 2019-12-08T12:17:14.544 INFO:teuthology.orchestra.run.smithi079.stderr: 42400K .......... .......... .......... .......... .......... 57% 419M 0s 2019-12-08T12:17:14.544 INFO:teuthology.orchestra.run.smithi079.stderr: 42450K .......... .......... .......... .......... .......... 57% 398M 0s 2019-12-08T12:17:14.545 INFO:teuthology.orchestra.run.smithi079.stderr: 42500K .......... .......... .......... .......... .......... 57% 411M 0s 2019-12-08T12:17:14.545 INFO:teuthology.orchestra.run.smithi079.stderr: 42550K .......... .......... .......... .......... .......... 57% 354M 0s 2019-12-08T12:17:14.545 INFO:teuthology.orchestra.run.smithi079.stderr: 42600K .......... .......... .......... .......... .......... 57% 386M 0s 2019-12-08T12:17:14.545 INFO:teuthology.orchestra.run.smithi079.stderr: 42650K .......... .......... .......... .......... .......... 58% 403M 0s 2019-12-08T12:17:14.545 INFO:teuthology.orchestra.run.smithi079.stderr: 42700K .......... .......... .......... .......... .......... 58% 399M 0s 2019-12-08T12:17:14.545 INFO:teuthology.orchestra.run.smithi079.stderr: 42750K .......... .......... .......... .......... .......... 58% 330M 0s 2019-12-08T12:17:14.545 INFO:teuthology.orchestra.run.smithi079.stderr: 42800K .......... .......... .......... .......... .......... 58% 402M 0s 2019-12-08T12:17:14.546 INFO:teuthology.orchestra.run.smithi079.stderr: 42850K .......... .......... .......... .......... .......... 58% 409M 0s 2019-12-08T12:17:14.546 INFO:teuthology.orchestra.run.smithi079.stderr: 42900K .......... .......... .......... .......... .......... 58% 402M 0s 2019-12-08T12:17:14.546 INFO:teuthology.orchestra.run.smithi079.stderr: 42950K .......... .......... .......... .......... .......... 58% 364M 0s 2019-12-08T12:17:14.546 INFO:teuthology.orchestra.run.smithi079.stderr: 43000K .......... .......... .......... .......... .......... 58% 422M 0s 2019-12-08T12:17:14.546 INFO:teuthology.orchestra.run.smithi079.stderr: 43050K .......... .......... .......... .......... .......... 58% 389M 0s 2019-12-08T12:17:14.546 INFO:teuthology.orchestra.run.smithi079.stderr: 43100K .......... .......... .......... .......... .......... 58% 424M 0s 2019-12-08T12:17:14.546 INFO:teuthology.orchestra.run.smithi079.stderr: 43150K .......... .......... .......... .......... .......... 58% 303M 0s 2019-12-08T12:17:14.546 INFO:teuthology.orchestra.run.smithi079.stderr: 43200K .......... .......... .......... .......... .......... 58% 386M 0s 2019-12-08T12:17:14.547 INFO:teuthology.orchestra.run.smithi079.stderr: 43250K .......... .......... .......... .......... .......... 58% 405M 0s 2019-12-08T12:17:14.547 INFO:teuthology.orchestra.run.smithi079.stderr: 43300K .......... .......... .......... .......... .......... 58% 421M 0s 2019-12-08T12:17:14.547 INFO:teuthology.orchestra.run.smithi079.stderr: 43350K .......... .......... .......... .......... .......... 59% 363M 0s 2019-12-08T12:17:14.547 INFO:teuthology.orchestra.run.smithi079.stderr: 43400K .......... .......... .......... .......... .......... 59% 416M 0s 2019-12-08T12:17:14.547 INFO:teuthology.orchestra.run.smithi079.stderr: 43450K .......... .......... .......... .......... .......... 59% 405M 0s 2019-12-08T12:17:14.547 INFO:teuthology.orchestra.run.smithi079.stderr: 43500K .......... .......... .......... .......... .......... 59% 416M 0s 2019-12-08T12:17:14.547 INFO:teuthology.orchestra.run.smithi079.stderr: 43550K .......... .......... .......... .......... .......... 59% 350M 0s 2019-12-08T12:17:14.548 INFO:teuthology.orchestra.run.smithi079.stderr: 43600K .......... .......... .......... .......... .......... 59% 420M 0s 2019-12-08T12:17:14.548 INFO:teuthology.orchestra.run.smithi079.stderr: 43650K .......... .......... .......... .......... .......... 59% 426M 0s 2019-12-08T12:17:14.548 INFO:teuthology.orchestra.run.smithi079.stderr: 43700K .......... .......... .......... .......... .......... 59% 426M 0s 2019-12-08T12:17:14.548 INFO:teuthology.orchestra.run.smithi079.stderr: 43750K .......... .......... .......... .......... .......... 59% 379M 0s 2019-12-08T12:17:14.548 INFO:teuthology.orchestra.run.smithi079.stderr: 43800K .......... .......... .......... .......... .......... 59% 401M 0s 2019-12-08T12:17:14.548 INFO:teuthology.orchestra.run.smithi079.stderr: 43850K .......... .......... .......... .......... .......... 59% 420M 0s 2019-12-08T12:17:14.548 INFO:teuthology.orchestra.run.smithi079.stderr: 43900K .......... .......... .......... .......... .......... 59% 425M 0s 2019-12-08T12:17:14.549 INFO:teuthology.orchestra.run.smithi079.stderr: 43950K .......... .......... .......... .......... .......... 59% 346M 0s 2019-12-08T12:17:14.549 INFO:teuthology.orchestra.run.smithi079.stderr: 44000K .......... .......... .......... .......... .......... 59% 415M 0s 2019-12-08T12:17:14.549 INFO:teuthology.orchestra.run.smithi079.stderr: 44050K .......... .......... .......... .......... .......... 59% 411M 0s 2019-12-08T12:17:14.549 INFO:teuthology.orchestra.run.smithi079.stderr: 44100K .......... .......... .......... .......... .......... 60% 423M 0s 2019-12-08T12:17:14.549 INFO:teuthology.orchestra.run.smithi079.stderr: 44150K .......... .......... .......... .......... .......... 60% 364M 0s 2019-12-08T12:17:14.549 INFO:teuthology.orchestra.run.smithi079.stderr: 44200K .......... .......... .......... .......... .......... 60% 419M 0s 2019-12-08T12:17:14.550 INFO:teuthology.orchestra.run.smithi079.stderr: 44250K .......... .......... .......... .......... .......... 60% 418M 0s 2019-12-08T12:17:14.550 INFO:teuthology.orchestra.run.smithi079.stderr: 44300K .......... .......... .......... .......... .......... 60% 413M 0s 2019-12-08T12:17:14.550 INFO:teuthology.orchestra.run.smithi079.stderr: 44350K .......... .......... .......... .......... .......... 60% 342M 0s 2019-12-08T12:17:14.550 INFO:teuthology.orchestra.run.smithi079.stderr: 44400K .......... .......... .......... .......... .......... 60% 418M 0s 2019-12-08T12:17:14.550 INFO:teuthology.orchestra.run.smithi079.stderr: 44450K .......... .......... .......... .......... .......... 60% 416M 0s 2019-12-08T12:17:14.550 INFO:teuthology.orchestra.run.smithi079.stderr: 44500K .......... .......... .......... .......... .......... 60% 408M 0s 2019-12-08T12:17:14.550 INFO:teuthology.orchestra.run.smithi079.stderr: 44550K .......... .......... .......... .......... .......... 60% 374M 0s 2019-12-08T12:17:14.550 INFO:teuthology.orchestra.run.smithi079.stderr: 44600K .......... .......... .......... .......... .......... 60% 404M 0s 2019-12-08T12:17:14.551 INFO:teuthology.orchestra.run.smithi079.stderr: 44650K .......... .......... .......... .......... .......... 60% 419M 0s 2019-12-08T12:17:14.551 INFO:teuthology.orchestra.run.smithi079.stderr: 44700K .......... .......... .......... .......... .......... 60% 415M 0s 2019-12-08T12:17:14.551 INFO:teuthology.orchestra.run.smithi079.stderr: 44750K .......... .......... .......... .......... .......... 60% 336M 0s 2019-12-08T12:17:14.551 INFO:teuthology.orchestra.run.smithi079.stderr: 44800K .......... .......... .......... .......... .......... 60% 404M 0s 2019-12-08T12:17:14.551 INFO:teuthology.orchestra.run.smithi079.stderr: 44850K .......... .......... .......... .......... .......... 61% 404M 0s 2019-12-08T12:17:14.551 INFO:teuthology.orchestra.run.smithi079.stderr: 44900K .......... .......... .......... .......... .......... 61% 415M 0s 2019-12-08T12:17:14.551 INFO:teuthology.orchestra.run.smithi079.stderr: 44950K .......... .......... .......... .......... .......... 61% 355M 0s 2019-12-08T12:17:14.552 INFO:teuthology.orchestra.run.smithi079.stderr: 45000K .......... .......... .......... .......... .......... 61% 418M 0s 2019-12-08T12:17:14.552 INFO:teuthology.orchestra.run.smithi079.stderr: 45050K .......... .......... .......... .......... .......... 61% 395M 0s 2019-12-08T12:17:14.552 INFO:teuthology.orchestra.run.smithi079.stderr: 45100K .......... .......... .......... .......... .......... 61% 399M 0s 2019-12-08T12:17:14.552 INFO:teuthology.orchestra.run.smithi079.stderr: 45150K .......... .......... .......... .......... .......... 61% 337M 0s 2019-12-08T12:17:14.552 INFO:teuthology.orchestra.run.smithi079.stderr: 45200K .......... .......... .......... .......... .......... 61% 395M 0s 2019-12-08T12:17:14.552 INFO:teuthology.orchestra.run.smithi079.stderr: 45250K .......... .......... .......... .......... .......... 61% 407M 0s 2019-12-08T12:17:14.552 INFO:teuthology.orchestra.run.smithi079.stderr: 45300K .......... .......... .......... .......... .......... 61% 405M 0s 2019-12-08T12:17:14.553 INFO:teuthology.orchestra.run.smithi079.stderr: 45350K .......... .......... .......... .......... .......... 61% 361M 0s 2019-12-08T12:17:14.553 INFO:teuthology.orchestra.run.smithi079.stderr: 45400K .......... .......... .......... .......... .......... 61% 404M 0s 2019-12-08T12:17:14.553 INFO:teuthology.orchestra.run.smithi079.stderr: 45450K .......... .......... .......... .......... .......... 61% 409M 0s 2019-12-08T12:17:14.553 INFO:teuthology.orchestra.run.smithi079.stderr: 45500K .......... .......... .......... .......... .......... 61% 417M 0s 2019-12-08T12:17:14.553 INFO:teuthology.orchestra.run.smithi079.stderr: 45550K .......... .......... .......... .......... .......... 61% 260M 0s 2019-12-08T12:17:14.553 INFO:teuthology.orchestra.run.smithi079.stderr: 45600K .......... .......... .......... .......... .......... 62% 419M 0s 2019-12-08T12:17:14.553 INFO:teuthology.orchestra.run.smithi079.stderr: 45650K .......... .......... .......... .......... .......... 62% 420M 0s 2019-12-08T12:17:14.554 INFO:teuthology.orchestra.run.smithi079.stderr: 45700K .......... .......... .......... .......... .......... 62% 419M 0s 2019-12-08T12:17:14.554 INFO:teuthology.orchestra.run.smithi079.stderr: 45750K .......... .......... .......... .......... .......... 62% 376M 0s 2019-12-08T12:17:14.554 INFO:teuthology.orchestra.run.smithi079.stderr: 45800K .......... .......... .......... .......... .......... 62% 413M 0s 2019-12-08T12:17:14.554 INFO:teuthology.orchestra.run.smithi079.stderr: 45850K .......... .......... .......... .......... .......... 62% 415M 0s 2019-12-08T12:17:14.554 INFO:teuthology.orchestra.run.smithi079.stderr: 45900K .......... .......... .......... .......... .......... 62% 429M 0s 2019-12-08T12:17:14.555 INFO:teuthology.orchestra.run.smithi079.stderr: 45950K .......... .......... .......... .......... .......... 62% 351M 0s 2019-12-08T12:17:14.555 INFO:teuthology.orchestra.run.smithi079.stderr: 46000K .......... .......... .......... .......... .......... 62% 410M 0s 2019-12-08T12:17:14.555 INFO:teuthology.orchestra.run.smithi079.stderr: 46050K .......... .......... .......... .......... .......... 62% 425M 0s 2019-12-08T12:17:14.555 INFO:teuthology.orchestra.run.smithi079.stderr: 46100K .......... .......... .......... .......... .......... 62% 410M 0s 2019-12-08T12:17:14.555 INFO:teuthology.orchestra.run.smithi079.stderr: 46150K .......... .......... .......... .......... .......... 62% 378M 0s 2019-12-08T12:17:14.556 INFO:teuthology.orchestra.run.smithi079.stderr: 46200K .......... .......... .......... .......... .......... 62% 420M 0s 2019-12-08T12:17:14.556 INFO:teuthology.orchestra.run.smithi079.stderr: 46250K .......... .......... .......... .......... .......... 62% 427M 0s 2019-12-08T12:17:14.556 INFO:teuthology.orchestra.run.smithi079.stderr: 46300K .......... .......... .......... .......... .......... 63% 426M 0s 2019-12-08T12:17:14.556 INFO:teuthology.orchestra.run.smithi079.stderr: 46350K .......... .......... .......... .......... .......... 63% 341M 0s 2019-12-08T12:17:14.556 INFO:teuthology.orchestra.run.smithi079.stderr: 46400K .......... .......... .......... .......... .......... 63% 410M 0s 2019-12-08T12:17:14.556 INFO:teuthology.orchestra.run.smithi079.stderr: 46450K .......... .......... .......... .......... .......... 63% 395M 0s 2019-12-08T12:17:14.556 INFO:teuthology.orchestra.run.smithi079.stderr: 46500K .......... .......... .......... .......... .......... 63% 415M 0s 2019-12-08T12:17:14.557 INFO:teuthology.orchestra.run.smithi079.stderr: 46550K .......... .......... .......... .......... .......... 63% 367M 0s 2019-12-08T12:17:14.557 INFO:teuthology.orchestra.run.smithi079.stderr: 46600K .......... .......... .......... .......... .......... 63% 422M 0s 2019-12-08T12:17:14.557 INFO:teuthology.orchestra.run.smithi079.stderr: 46650K .......... .......... .......... .......... .......... 63% 425M 0s 2019-12-08T12:17:14.557 INFO:teuthology.orchestra.run.smithi079.stderr: 46700K .......... .......... .......... .......... .......... 63% 316M 0s 2019-12-08T12:17:14.557 INFO:teuthology.orchestra.run.smithi079.stderr: 46750K .......... .......... .......... .......... .......... 63% 332M 0s 2019-12-08T12:17:14.557 INFO:teuthology.orchestra.run.smithi079.stderr: 46800K .......... .......... .......... .......... .......... 63% 398M 0s 2019-12-08T12:17:14.557 INFO:teuthology.orchestra.run.smithi079.stderr: 46850K .......... .......... .......... .......... .......... 63% 383M 0s 2019-12-08T12:17:14.558 INFO:teuthology.orchestra.run.smithi079.stderr: 46900K .......... .......... .......... .......... .......... 63% 407M 0s 2019-12-08T12:17:14.558 INFO:teuthology.orchestra.run.smithi079.stderr: 46950K .......... .......... .......... .......... .......... 63% 140M 0s 2019-12-08T12:17:14.558 INFO:teuthology.orchestra.run.smithi079.stderr: 47000K .......... .......... .......... .......... .......... 63% 406M 0s 2019-12-08T12:17:14.558 INFO:teuthology.orchestra.run.smithi079.stderr: 47050K .......... .......... .......... .......... .......... 64% 420M 0s 2019-12-08T12:17:14.558 INFO:teuthology.orchestra.run.smithi079.stderr: 47100K .......... .......... .......... .......... .......... 64% 373M 0s 2019-12-08T12:17:14.558 INFO:teuthology.orchestra.run.smithi079.stderr: 47150K .......... .......... .......... .......... .......... 64% 327M 0s 2019-12-08T12:17:14.558 INFO:teuthology.orchestra.run.smithi079.stderr: 47200K .......... .......... .......... .......... .......... 64% 399M 0s 2019-12-08T12:17:14.558 INFO:teuthology.orchestra.run.smithi079.stderr: 47250K .......... .......... .......... .......... .......... 64% 384M 0s 2019-12-08T12:17:14.559 INFO:teuthology.orchestra.run.smithi079.stderr: 47300K .......... .......... .......... .......... .......... 64% 397M 0s 2019-12-08T12:17:14.559 INFO:teuthology.orchestra.run.smithi079.stderr: 47350K .......... .......... .......... .......... .......... 64% 359M 0s 2019-12-08T12:17:14.559 INFO:teuthology.orchestra.run.smithi079.stderr: 47400K .......... .......... .......... .......... .......... 64% 402M 0s 2019-12-08T12:17:14.559 INFO:teuthology.orchestra.run.smithi079.stderr: 47450K .......... .......... .......... .......... .......... 64% 386M 0s 2019-12-08T12:17:14.559 INFO:teuthology.orchestra.run.smithi079.stderr: 47500K .......... .......... .......... .......... .......... 64% 409M 0s 2019-12-08T12:17:14.559 INFO:teuthology.orchestra.run.smithi079.stderr: 47550K .......... .......... .......... .......... .......... 64% 334M 0s 2019-12-08T12:17:14.559 INFO:teuthology.orchestra.run.smithi079.stderr: 47600K .......... .......... .......... .......... .......... 64% 410M 0s 2019-12-08T12:17:14.560 INFO:teuthology.orchestra.run.smithi079.stderr: 47650K .......... .......... .......... .......... .......... 64% 396M 0s 2019-12-08T12:17:14.560 INFO:teuthology.orchestra.run.smithi079.stderr: 47700K .......... .......... .......... .......... .......... 64% 394M 0s 2019-12-08T12:17:14.560 INFO:teuthology.orchestra.run.smithi079.stderr: 47750K .......... .......... .......... .......... .......... 64% 367M 0s 2019-12-08T12:17:14.560 INFO:teuthology.orchestra.run.smithi079.stderr: 47800K .......... .......... .......... .......... .......... 65% 259M 0s 2019-12-08T12:17:14.560 INFO:teuthology.orchestra.run.smithi079.stderr: 47850K .......... .......... .......... .......... .......... 65% 214M 0s 2019-12-08T12:17:14.560 INFO:teuthology.orchestra.run.smithi079.stderr: 47900K .......... .......... .......... .......... .......... 65% 247M 0s 2019-12-08T12:17:14.560 INFO:teuthology.orchestra.run.smithi079.stderr: 47950K .......... .......... .......... .......... .......... 65% 183M 0s 2019-12-08T12:17:14.561 INFO:teuthology.orchestra.run.smithi079.stderr: 48000K .......... .......... .......... .......... .......... 65% 268M 0s 2019-12-08T12:17:14.561 INFO:teuthology.orchestra.run.smithi079.stderr: 48050K .......... .......... .......... .......... .......... 65% 264M 0s 2019-12-08T12:17:14.561 INFO:teuthology.orchestra.run.smithi079.stderr: 48100K .......... .......... .......... .......... .......... 65% 269M 0s 2019-12-08T12:17:14.561 INFO:teuthology.orchestra.run.smithi079.stderr: 48150K .......... .......... .......... .......... .......... 65% 232M 0s 2019-12-08T12:17:14.561 INFO:teuthology.orchestra.run.smithi079.stderr: 48200K .......... .......... .......... .......... .......... 65% 269M 0s 2019-12-08T12:17:14.561 INFO:teuthology.orchestra.run.smithi079.stderr: 48250K .......... .......... .......... .......... .......... 65% 263M 0s 2019-12-08T12:17:14.561 INFO:teuthology.orchestra.run.smithi079.stderr: 48300K .......... .......... .......... .......... .......... 65% 268M 0s 2019-12-08T12:17:14.562 INFO:teuthology.orchestra.run.smithi079.stderr: 48350K .......... .......... .......... .......... .......... 65% 199M 0s 2019-12-08T12:17:14.562 INFO:teuthology.orchestra.run.smithi079.stderr: 48400K .......... .......... .......... .......... .......... 65% 232M 0s 2019-12-08T12:17:14.562 INFO:teuthology.orchestra.run.smithi079.stderr: 48450K .......... .......... .......... .......... .......... 65% 253M 0s 2019-12-08T12:17:14.562 INFO:teuthology.orchestra.run.smithi079.stderr: 48500K .......... .......... .......... .......... .......... 66% 226M 0s 2019-12-08T12:17:14.562 INFO:teuthology.orchestra.run.smithi079.stderr: 48550K .......... .......... .......... .......... .......... 66% 198M 0s 2019-12-08T12:17:14.562 INFO:teuthology.orchestra.run.smithi079.stderr: 48600K .......... .......... .......... .......... .......... 66% 253M 0s 2019-12-08T12:17:14.562 INFO:teuthology.orchestra.run.smithi079.stderr: 48650K .......... .......... .......... .......... .......... 66% 282M 0s 2019-12-08T12:17:14.563 INFO:teuthology.orchestra.run.smithi079.stderr: 48700K .......... .......... .......... .......... .......... 66% 263M 0s 2019-12-08T12:17:14.563 INFO:teuthology.orchestra.run.smithi079.stderr: 48750K .......... .......... .......... .......... .......... 66% 228M 0s 2019-12-08T12:17:14.563 INFO:teuthology.orchestra.run.smithi079.stderr: 48800K .......... .......... .......... .......... .......... 66% 269M 0s 2019-12-08T12:17:14.563 INFO:teuthology.orchestra.run.smithi079.stderr: 48850K .......... .......... .......... .......... .......... 66% 272M 0s 2019-12-08T12:17:14.563 INFO:teuthology.orchestra.run.smithi079.stderr: 48900K .......... .......... .......... .......... .......... 66% 279M 0s 2019-12-08T12:17:14.563 INFO:teuthology.orchestra.run.smithi079.stderr: 48950K .......... .......... .......... .......... .......... 66% 246M 0s 2019-12-08T12:17:14.564 INFO:teuthology.orchestra.run.smithi079.stderr: 49000K .......... .......... .......... .......... .......... 66% 274M 0s 2019-12-08T12:17:14.564 INFO:teuthology.orchestra.run.smithi079.stderr: 49050K .......... .......... .......... .......... .......... 66% 275M 0s 2019-12-08T12:17:14.564 INFO:teuthology.orchestra.run.smithi079.stderr: 49100K .......... .......... .......... .......... .......... 66% 268M 0s 2019-12-08T12:17:14.564 INFO:teuthology.orchestra.run.smithi079.stderr: 49150K .......... .......... .......... .......... .......... 66% 262M 0s 2019-12-08T12:17:14.564 INFO:teuthology.orchestra.run.smithi079.stderr: 49200K .......... .......... .......... .......... .......... 66% 278M 0s 2019-12-08T12:17:14.564 INFO:teuthology.orchestra.run.smithi079.stderr: 49250K .......... .......... .......... .......... .......... 67% 278M 0s 2019-12-08T12:17:14.564 INFO:teuthology.orchestra.run.smithi079.stderr: 49300K .......... .......... .......... .......... .......... 67% 286M 0s 2019-12-08T12:17:14.565 INFO:teuthology.orchestra.run.smithi079.stderr: 49350K .......... .......... .......... .......... .......... 67% 244M 0s 2019-12-08T12:17:14.565 INFO:teuthology.orchestra.run.smithi079.stderr: 49400K .......... .......... .......... .......... .......... 67% 275M 0s 2019-12-08T12:17:14.565 INFO:teuthology.orchestra.run.smithi079.stderr: 49450K .......... .......... .......... .......... .......... 67% 284M 0s 2019-12-08T12:17:14.565 INFO:teuthology.orchestra.run.smithi079.stderr: 49500K .......... .......... .......... .......... .......... 67% 282M 0s 2019-12-08T12:17:14.565 INFO:teuthology.orchestra.run.smithi079.stderr: 49550K .......... .......... .......... .......... .......... 67% 238M 0s 2019-12-08T12:17:14.565 INFO:teuthology.orchestra.run.smithi079.stderr: 49600K .......... .......... .......... .......... .......... 67% 287M 0s 2019-12-08T12:17:14.565 INFO:teuthology.orchestra.run.smithi079.stderr: 49650K .......... .......... .......... .......... .......... 67% 264M 0s 2019-12-08T12:17:14.566 INFO:teuthology.orchestra.run.smithi079.stderr: 49700K .......... .......... .......... .......... .......... 67% 226M 0s 2019-12-08T12:17:14.566 INFO:teuthology.orchestra.run.smithi079.stderr: 49750K .......... .......... .......... .......... .......... 67% 235M 0s 2019-12-08T12:17:14.566 INFO:teuthology.orchestra.run.smithi079.stderr: 49800K .......... .......... .......... .......... .......... 67% 235M 0s 2019-12-08T12:17:14.566 INFO:teuthology.orchestra.run.smithi079.stderr: 49850K .......... .......... .......... .......... .......... 67% 242M 0s 2019-12-08T12:17:14.566 INFO:teuthology.orchestra.run.smithi079.stderr: 49900K .......... .......... .......... .......... .......... 67% 194M 0s 2019-12-08T12:17:14.566 INFO:teuthology.orchestra.run.smithi079.stderr: 49950K .......... .......... .......... .......... .......... 67% 235M 0s 2019-12-08T12:17:14.566 INFO:teuthology.orchestra.run.smithi079.stderr: 50000K .......... .......... .......... .......... .......... 68% 268M 0s 2019-12-08T12:17:14.567 INFO:teuthology.orchestra.run.smithi079.stderr: 50050K .......... .......... .......... .......... .......... 68% 281M 0s 2019-12-08T12:17:14.567 INFO:teuthology.orchestra.run.smithi079.stderr: 50100K .......... .......... .......... .......... .......... 68% 281M 0s 2019-12-08T12:17:14.567 INFO:teuthology.orchestra.run.smithi079.stderr: 50150K .......... .......... .......... .......... .......... 68% 243M 0s 2019-12-08T12:17:14.567 INFO:teuthology.orchestra.run.smithi079.stderr: 50200K .......... .......... .......... .......... .......... 68% 269M 0s 2019-12-08T12:17:14.567 INFO:teuthology.orchestra.run.smithi079.stderr: 50250K .......... .......... .......... .......... .......... 68% 279M 0s 2019-12-08T12:17:14.567 INFO:teuthology.orchestra.run.smithi079.stderr: 50300K .......... .......... .......... .......... .......... 68% 277M 0s 2019-12-08T12:17:14.567 INFO:teuthology.orchestra.run.smithi079.stderr: 50350K .......... .......... .......... .......... .......... 68% 241M 0s 2019-12-08T12:17:14.567 INFO:teuthology.orchestra.run.smithi079.stderr: 50400K .......... .......... .......... .......... .......... 68% 282M 0s 2019-12-08T12:17:14.568 INFO:teuthology.orchestra.run.smithi079.stderr: 50450K .......... .......... .......... .......... .......... 68% 288M 0s 2019-12-08T12:17:14.568 INFO:teuthology.orchestra.run.smithi079.stderr: 50500K .......... .......... .......... .......... .......... 68% 276M 0s 2019-12-08T12:17:14.568 INFO:teuthology.orchestra.run.smithi079.stderr: 50550K .......... .......... .......... .......... .......... 68% 259M 0s 2019-12-08T12:17:14.568 INFO:teuthology.orchestra.run.smithi079.stderr: 50600K .......... .......... .......... .......... .......... 68% 276M 0s 2019-12-08T12:17:14.568 INFO:teuthology.orchestra.run.smithi079.stderr: 50650K .......... .......... .......... .......... .......... 68% 289M 0s 2019-12-08T12:17:14.568 INFO:teuthology.orchestra.run.smithi079.stderr: 50700K .......... .......... .......... .......... .......... 68% 266M 0s 2019-12-08T12:17:14.568 INFO:teuthology.orchestra.run.smithi079.stderr: 50750K .......... .......... .......... .......... .......... 69% 246M 0s 2019-12-08T12:17:14.569 INFO:teuthology.orchestra.run.smithi079.stderr: 50800K .......... .......... .......... .......... .......... 69% 289M 0s 2019-12-08T12:17:14.569 INFO:teuthology.orchestra.run.smithi079.stderr: 50850K .......... .......... .......... .......... .......... 69% 282M 0s 2019-12-08T12:17:14.569 INFO:teuthology.orchestra.run.smithi079.stderr: 50900K .......... .......... .......... .......... .......... 69% 277M 0s 2019-12-08T12:17:14.569 INFO:teuthology.orchestra.run.smithi079.stderr: 50950K .......... .......... .......... .......... .......... 69% 249M 0s 2019-12-08T12:17:14.569 INFO:teuthology.orchestra.run.smithi079.stderr: 51000K .......... .......... .......... .......... .......... 69% 283M 0s 2019-12-08T12:17:14.569 INFO:teuthology.orchestra.run.smithi079.stderr: 51050K .......... .......... .......... .......... .......... 69% 288M 0s 2019-12-08T12:17:14.569 INFO:teuthology.orchestra.run.smithi079.stderr: 51100K .......... .......... .......... .......... .......... 69% 279M 0s 2019-12-08T12:17:14.570 INFO:teuthology.orchestra.run.smithi079.stderr: 51150K .......... .......... .......... .......... .......... 69% 238M 0s 2019-12-08T12:17:14.570 INFO:teuthology.orchestra.run.smithi079.stderr: 51200K .......... .......... .......... .......... .......... 69% 281M 0s 2019-12-08T12:17:14.570 INFO:teuthology.orchestra.run.smithi079.stderr: 51250K .......... .......... .......... .......... .......... 69% 271M 0s 2019-12-08T12:17:14.570 INFO:teuthology.orchestra.run.smithi079.stderr: 51300K .......... .......... .......... .......... .......... 69% 277M 0s 2019-12-08T12:17:14.570 INFO:teuthology.orchestra.run.smithi079.stderr: 51350K .......... .......... .......... .......... .......... 69% 252M 0s 2019-12-08T12:17:14.570 INFO:teuthology.orchestra.run.smithi079.stderr: 51400K .......... .......... .......... .......... .......... 69% 281M 0s 2019-12-08T12:17:14.570 INFO:teuthology.orchestra.run.smithi079.stderr: 51450K .......... .......... .......... .......... .......... 70% 282M 0s 2019-12-08T12:17:14.570 INFO:teuthology.orchestra.run.smithi079.stderr: 51500K .......... .......... .......... .......... .......... 70% 283M 0s 2019-12-08T12:17:14.571 INFO:teuthology.orchestra.run.smithi079.stderr: 51550K .......... .......... .......... .......... .......... 70% 228M 0s 2019-12-08T12:17:14.571 INFO:teuthology.orchestra.run.smithi079.stderr: 51600K .......... .......... .......... .......... .......... 70% 278M 0s 2019-12-08T12:17:14.571 INFO:teuthology.orchestra.run.smithi079.stderr: 51650K .......... .......... .......... .......... .......... 70% 279M 0s 2019-12-08T12:17:14.571 INFO:teuthology.orchestra.run.smithi079.stderr: 51700K .......... .......... .......... .......... .......... 70% 276M 0s 2019-12-08T12:17:14.571 INFO:teuthology.orchestra.run.smithi079.stderr: 51750K .......... .......... .......... .......... .......... 70% 255M 0s 2019-12-08T12:17:14.571 INFO:teuthology.orchestra.run.smithi079.stderr: 51800K .......... .......... .......... .......... .......... 70% 273M 0s 2019-12-08T12:17:14.571 INFO:teuthology.orchestra.run.smithi079.stderr: 51850K .......... .......... .......... .......... .......... 70% 264M 0s 2019-12-08T12:17:14.572 INFO:teuthology.orchestra.run.smithi079.stderr: 51900K .......... .......... .......... .......... .......... 70% 266M 0s 2019-12-08T12:17:14.572 INFO:teuthology.orchestra.run.smithi079.stderr: 51950K .......... .......... .......... .......... .......... 70% 215M 0s 2019-12-08T12:17:14.572 INFO:teuthology.orchestra.run.smithi079.stderr: 52000K .......... .......... .......... .......... .......... 70% 261M 0s 2019-12-08T12:17:14.572 INFO:teuthology.orchestra.run.smithi079.stderr: 52050K .......... .......... .......... .......... .......... 70% 248M 0s 2019-12-08T12:17:14.572 INFO:teuthology.orchestra.run.smithi079.stderr: 52100K .......... .......... .......... .......... .......... 70% 260M 0s 2019-12-08T12:17:14.572 INFO:teuthology.orchestra.run.smithi079.stderr: 52150K .......... .......... .......... .......... .......... 70% 231M 0s 2019-12-08T12:17:14.572 INFO:teuthology.orchestra.run.smithi079.stderr: 52200K .......... .......... .......... .......... .......... 71% 268M 0s 2019-12-08T12:17:14.573 INFO:teuthology.orchestra.run.smithi079.stderr: 52250K .......... .......... .......... .......... .......... 71% 255M 0s 2019-12-08T12:17:14.573 INFO:teuthology.orchestra.run.smithi079.stderr: 52300K .......... .......... .......... .......... .......... 71% 262M 0s 2019-12-08T12:17:14.573 INFO:teuthology.orchestra.run.smithi079.stderr: 52350K .......... .......... .......... .......... .......... 71% 219M 0s 2019-12-08T12:17:14.573 INFO:teuthology.orchestra.run.smithi079.stderr: 52400K .......... .......... .......... .......... .......... 71% 269M 0s 2019-12-08T12:17:14.573 INFO:teuthology.orchestra.run.smithi079.stderr: 52450K .......... .......... .......... .......... .......... 71% 259M 0s 2019-12-08T12:17:14.573 INFO:teuthology.orchestra.run.smithi079.stderr: 52500K .......... .......... .......... .......... .......... 71% 258M 0s 2019-12-08T12:17:14.573 INFO:teuthology.orchestra.run.smithi079.stderr: 52550K .......... .......... .......... .......... .......... 71% 238M 0s 2019-12-08T12:17:14.574 INFO:teuthology.orchestra.run.smithi079.stderr: 52600K .......... .......... .......... .......... .......... 71% 280M 0s 2019-12-08T12:17:14.574 INFO:teuthology.orchestra.run.smithi079.stderr: 52650K .......... .......... .......... .......... .......... 71% 277M 0s 2019-12-08T12:17:14.574 INFO:teuthology.orchestra.run.smithi079.stderr: 52700K .......... .......... .......... .......... .......... 71% 276M 0s 2019-12-08T12:17:14.574 INFO:teuthology.orchestra.run.smithi079.stderr: 52750K .......... .......... .......... .......... .......... 71% 234M 0s 2019-12-08T12:17:14.574 INFO:teuthology.orchestra.run.smithi079.stderr: 52800K .......... .......... .......... .......... .......... 71% 270M 0s 2019-12-08T12:17:14.574 INFO:teuthology.orchestra.run.smithi079.stderr: 52850K .......... .......... .......... .......... .......... 71% 265M 0s 2019-12-08T12:17:14.575 INFO:teuthology.orchestra.run.smithi079.stderr: 52900K .......... .......... .......... .......... .......... 71% 257M 0s 2019-12-08T12:17:14.575 INFO:teuthology.orchestra.run.smithi079.stderr: 52950K .......... .......... .......... .......... .......... 72% 236M 0s 2019-12-08T12:17:14.576 INFO:teuthology.orchestra.run.smithi079.stderr: 53000K .......... .......... .......... .......... .......... 72% 275M 0s 2019-12-08T12:17:14.576 INFO:teuthology.orchestra.run.smithi079.stderr: 53050K .......... .......... .......... .......... .......... 72% 262M 0s 2019-12-08T12:17:14.576 INFO:teuthology.orchestra.run.smithi079.stderr: 53100K .......... .......... .......... .......... .......... 72% 274M 0s 2019-12-08T12:17:14.576 INFO:teuthology.orchestra.run.smithi079.stderr: 53150K .......... .......... .......... .......... .......... 72% 223M 0s 2019-12-08T12:17:14.576 INFO:teuthology.orchestra.run.smithi079.stderr: 53200K .......... .......... .......... .......... .......... 72% 267M 0s 2019-12-08T12:17:14.576 INFO:teuthology.orchestra.run.smithi079.stderr: 53250K .......... .......... .......... .......... .......... 72% 283M 0s 2019-12-08T12:17:14.577 INFO:teuthology.orchestra.run.smithi079.stderr: 53300K .......... .......... .......... .......... .......... 72% 273M 0s 2019-12-08T12:17:14.577 INFO:teuthology.orchestra.run.smithi079.stderr: 53350K .......... .......... .......... .......... .......... 72% 247M 0s 2019-12-08T12:17:14.577 INFO:teuthology.orchestra.run.smithi079.stderr: 53400K .......... .......... .......... .......... .......... 72% 285M 0s 2019-12-08T12:17:14.577 INFO:teuthology.orchestra.run.smithi079.stderr: 53450K .......... .......... .......... .......... .......... 72% 258M 0s 2019-12-08T12:17:14.577 INFO:teuthology.orchestra.run.smithi079.stderr: 53500K .......... .......... .......... .......... .......... 72% 279M 0s 2019-12-08T12:17:14.577 INFO:teuthology.orchestra.run.smithi079.stderr: 53550K .......... .......... .......... .......... .......... 72% 232M 0s 2019-12-08T12:17:14.577 INFO:teuthology.orchestra.run.smithi079.stderr: 53600K .......... .......... .......... .......... .......... 72% 273M 0s 2019-12-08T12:17:14.578 INFO:teuthology.orchestra.run.smithi079.stderr: 53650K .......... .......... .......... .......... .......... 73% 263M 0s 2019-12-08T12:17:14.578 INFO:teuthology.orchestra.run.smithi079.stderr: 53700K .......... .......... .......... .......... .......... 73% 281M 0s 2019-12-08T12:17:14.578 INFO:teuthology.orchestra.run.smithi079.stderr: 53750K .......... .......... .......... .......... .......... 73% 250M 0s 2019-12-08T12:17:14.578 INFO:teuthology.orchestra.run.smithi079.stderr: 53800K .......... .......... .......... .......... .......... 73% 287M 0s 2019-12-08T12:17:14.578 INFO:teuthology.orchestra.run.smithi079.stderr: 53850K .......... .......... .......... .......... .......... 73% 280M 0s 2019-12-08T12:17:14.578 INFO:teuthology.orchestra.run.smithi079.stderr: 53900K .......... .......... .......... .......... .......... 73% 276M 0s 2019-12-08T12:17:14.578 INFO:teuthology.orchestra.run.smithi079.stderr: 53950K .......... .......... .......... .......... .......... 73% 184M 0s 2019-12-08T12:17:14.578 INFO:teuthology.orchestra.run.smithi079.stderr: 54000K .......... .......... .......... .......... .......... 73% 232M 0s 2019-12-08T12:17:14.579 INFO:teuthology.orchestra.run.smithi079.stderr: 54050K .......... .......... .......... .......... .......... 73% 284M 0s 2019-12-08T12:17:14.579 INFO:teuthology.orchestra.run.smithi079.stderr: 54100K .......... .......... .......... .......... .......... 73% 277M 0s 2019-12-08T12:17:14.579 INFO:teuthology.orchestra.run.smithi079.stderr: 54150K .......... .......... .......... .......... .......... 73% 245M 0s 2019-12-08T12:17:14.579 INFO:teuthology.orchestra.run.smithi079.stderr: 54200K .......... .......... .......... .......... .......... 73% 280M 0s 2019-12-08T12:17:14.580 INFO:teuthology.orchestra.run.smithi079.stderr: 54250K .......... .......... .......... .......... .......... 73% 284M 0s 2019-12-08T12:17:14.580 INFO:teuthology.orchestra.run.smithi079.stderr: 54300K .......... .......... .......... .......... .......... 73% 281M 0s 2019-12-08T12:17:14.580 INFO:teuthology.orchestra.run.smithi079.stderr: 54350K .......... .......... .......... .......... .......... 73% 235M 0s 2019-12-08T12:17:14.580 INFO:teuthology.orchestra.run.smithi079.stderr: 54400K .......... .......... .......... .......... .......... 74% 284M 0s 2019-12-08T12:17:14.580 INFO:teuthology.orchestra.run.smithi079.stderr: 54450K .......... .......... .......... .......... .......... 74% 266M 0s 2019-12-08T12:17:14.580 INFO:teuthology.orchestra.run.smithi079.stderr: 54500K .......... .......... .......... .......... .......... 74% 254M 0s 2019-12-08T12:17:14.580 INFO:teuthology.orchestra.run.smithi079.stderr: 54550K .......... .......... .......... .......... .......... 74% 226M 0s 2019-12-08T12:17:14.581 INFO:teuthology.orchestra.run.smithi079.stderr: 54600K .......... .......... .......... .......... .......... 74% 262M 0s 2019-12-08T12:17:14.581 INFO:teuthology.orchestra.run.smithi079.stderr: 54650K .......... .......... .......... .......... .......... 74% 290M 0s 2019-12-08T12:17:14.581 INFO:teuthology.orchestra.run.smithi079.stderr: 54700K .......... .......... .......... .......... .......... 74% 277M 0s 2019-12-08T12:17:14.581 INFO:teuthology.orchestra.run.smithi079.stderr: 54750K .......... .......... .......... .......... .......... 74% 240M 0s 2019-12-08T12:17:14.581 INFO:teuthology.orchestra.run.smithi079.stderr: 54800K .......... .......... .......... .......... .......... 74% 272M 0s 2019-12-08T12:17:14.581 INFO:teuthology.orchestra.run.smithi079.stderr: 54850K .......... .......... .......... .......... .......... 74% 283M 0s 2019-12-08T12:17:14.581 INFO:teuthology.orchestra.run.smithi079.stderr: 54900K .......... .......... .......... .......... .......... 74% 275M 0s 2019-12-08T12:17:14.582 INFO:teuthology.orchestra.run.smithi079.stderr: 54950K .......... .......... .......... .......... .......... 74% 253M 0s 2019-12-08T12:17:14.582 INFO:teuthology.orchestra.run.smithi079.stderr: 55000K .......... .......... .......... .......... .......... 74% 254M 0s 2019-12-08T12:17:14.582 INFO:teuthology.orchestra.run.smithi079.stderr: 55050K .......... .......... .......... .......... .......... 74% 270M 0s 2019-12-08T12:17:14.582 INFO:teuthology.orchestra.run.smithi079.stderr: 55100K .......... .......... .......... .......... .......... 74% 295M 0s 2019-12-08T12:17:14.582 INFO:teuthology.orchestra.run.smithi079.stderr: 55150K .......... .......... .......... .......... .......... 75% 216M 0s 2019-12-08T12:17:14.582 INFO:teuthology.orchestra.run.smithi079.stderr: 55200K .......... .......... .......... .......... .......... 75% 277M 0s 2019-12-08T12:17:14.582 INFO:teuthology.orchestra.run.smithi079.stderr: 55250K .......... .......... .......... .......... .......... 75% 260M 0s 2019-12-08T12:17:14.583 INFO:teuthology.orchestra.run.smithi079.stderr: 55300K .......... .......... .......... .......... .......... 75% 273M 0s 2019-12-08T12:17:14.583 INFO:teuthology.orchestra.run.smithi079.stderr: 55350K .......... .......... .......... .......... .......... 75% 250M 0s 2019-12-08T12:17:14.583 INFO:teuthology.orchestra.run.smithi079.stderr: 55400K .......... .......... .......... .......... .......... 75% 268M 0s 2019-12-08T12:17:14.583 INFO:teuthology.orchestra.run.smithi079.stderr: 55450K .......... .......... .......... .......... .......... 75% 248M 0s 2019-12-08T12:17:14.583 INFO:teuthology.orchestra.run.smithi079.stderr: 55500K .......... .......... .......... .......... .......... 75% 266M 0s 2019-12-08T12:17:14.583 INFO:teuthology.orchestra.run.smithi079.stderr: 55550K .......... .......... .......... .......... .......... 75% 215M 0s 2019-12-08T12:17:14.583 INFO:teuthology.orchestra.run.smithi079.stderr: 55600K .......... .......... .......... .......... .......... 75% 251M 0s 2019-12-08T12:17:14.584 INFO:teuthology.orchestra.run.smithi079.stderr: 55650K .......... .......... .......... .......... .......... 75% 259M 0s 2019-12-08T12:17:14.584 INFO:teuthology.orchestra.run.smithi079.stderr: 55700K .......... .......... .......... .......... .......... 75% 274M 0s 2019-12-08T12:17:14.584 INFO:teuthology.orchestra.run.smithi079.stderr: 55750K .......... .......... .......... .......... .......... 75% 246M 0s 2019-12-08T12:17:14.584 INFO:teuthology.orchestra.run.smithi079.stderr: 55800K .......... .......... .......... .......... .......... 75% 254M 0s 2019-12-08T12:17:14.584 INFO:teuthology.orchestra.run.smithi079.stderr: 55850K .......... .......... .......... .......... .......... 75% 269M 0s 2019-12-08T12:17:14.584 INFO:teuthology.orchestra.run.smithi079.stderr: 55900K .......... .......... .......... .......... .......... 76% 266M 0s 2019-12-08T12:17:14.584 INFO:teuthology.orchestra.run.smithi079.stderr: 55950K .......... .......... .......... .......... .......... 76% 214M 0s 2019-12-08T12:17:14.585 INFO:teuthology.orchestra.run.smithi079.stderr: 56000K .......... .......... .......... .......... .......... 76% 266M 0s 2019-12-08T12:17:14.585 INFO:teuthology.orchestra.run.smithi079.stderr: 56050K .......... .......... .......... .......... .......... 76% 269M 0s 2019-12-08T12:17:14.585 INFO:teuthology.orchestra.run.smithi079.stderr: 56100K .......... .......... .......... .......... .......... 76% 263M 0s 2019-12-08T12:17:14.585 INFO:teuthology.orchestra.run.smithi079.stderr: 56150K .......... .......... .......... .......... .......... 76% 249M 0s 2019-12-08T12:17:14.585 INFO:teuthology.orchestra.run.smithi079.stderr: 56200K .......... .......... .......... .......... .......... 76% 271M 0s 2019-12-08T12:17:14.585 INFO:teuthology.orchestra.run.smithi079.stderr: 56250K .......... .......... .......... .......... .......... 76% 280M 0s 2019-12-08T12:17:14.585 INFO:teuthology.orchestra.run.smithi079.stderr: 56300K .......... .......... .......... .......... .......... 76% 274M 0s 2019-12-08T12:17:14.585 INFO:teuthology.orchestra.run.smithi079.stderr: 56350K .......... .......... .......... .......... .......... 76% 238M 0s 2019-12-08T12:17:14.586 INFO:teuthology.orchestra.run.smithi079.stderr: 56400K .......... .......... .......... .......... .......... 76% 275M 0s 2019-12-08T12:17:14.586 INFO:teuthology.orchestra.run.smithi079.stderr: 56450K .......... .......... .......... .......... .......... 76% 274M 0s 2019-12-08T12:17:14.586 INFO:teuthology.orchestra.run.smithi079.stderr: 56500K .......... .......... .......... .......... .......... 76% 281M 0s 2019-12-08T12:17:14.586 INFO:teuthology.orchestra.run.smithi079.stderr: 56550K .......... .......... .......... .......... .......... 76% 248M 0s 2019-12-08T12:17:14.586 INFO:teuthology.orchestra.run.smithi079.stderr: 56600K .......... .......... .......... .......... .......... 77% 290M 0s 2019-12-08T12:17:14.586 INFO:teuthology.orchestra.run.smithi079.stderr: 56650K .......... .......... .......... .......... .......... 77% 281M 0s 2019-12-08T12:17:14.586 INFO:teuthology.orchestra.run.smithi079.stderr: 56700K .......... .......... .......... .......... .......... 77% 280M 0s 2019-12-08T12:17:14.587 INFO:teuthology.orchestra.run.smithi079.stderr: 56750K .......... .......... .......... .......... .......... 77% 214M 0s 2019-12-08T12:17:14.587 INFO:teuthology.orchestra.run.smithi079.stderr: 56800K .......... .......... .......... .......... .......... 77% 238M 0s 2019-12-08T12:17:14.587 INFO:teuthology.orchestra.run.smithi079.stderr: 56850K .......... .......... .......... .......... .......... 77% 268M 0s 2019-12-08T12:17:14.587 INFO:teuthology.orchestra.run.smithi079.stderr: 56900K .......... .......... .......... .......... .......... 77% 275M 0s 2019-12-08T12:17:14.587 INFO:teuthology.orchestra.run.smithi079.stderr: 56950K .......... .......... .......... .......... .......... 77% 258M 0s 2019-12-08T12:17:14.587 INFO:teuthology.orchestra.run.smithi079.stderr: 57000K .......... .......... .......... .......... .......... 77% 268M 0s 2019-12-08T12:17:14.587 INFO:teuthology.orchestra.run.smithi079.stderr: 57050K .......... .......... .......... .......... .......... 77% 283M 0s 2019-12-08T12:17:14.587 INFO:teuthology.orchestra.run.smithi079.stderr: 57100K .......... .......... .......... .......... .......... 77% 278M 0s 2019-12-08T12:17:14.588 INFO:teuthology.orchestra.run.smithi079.stderr: 57150K .......... .......... .......... .......... .......... 77% 233M 0s 2019-12-08T12:17:14.588 INFO:teuthology.orchestra.run.smithi079.stderr: 57200K .......... .......... .......... .......... .......... 77% 277M 0s 2019-12-08T12:17:14.588 INFO:teuthology.orchestra.run.smithi079.stderr: 57250K .......... .......... .......... .......... .......... 77% 273M 0s 2019-12-08T12:17:14.588 INFO:teuthology.orchestra.run.smithi079.stderr: 57300K .......... .......... .......... .......... .......... 77% 284M 0s 2019-12-08T12:17:14.588 INFO:teuthology.orchestra.run.smithi079.stderr: 57350K .......... .......... .......... .......... .......... 78% 238M 0s 2019-12-08T12:17:14.588 INFO:teuthology.orchestra.run.smithi079.stderr: 57400K .......... .......... .......... .......... .......... 78% 261M 0s 2019-12-08T12:17:14.588 INFO:teuthology.orchestra.run.smithi079.stderr: 57450K .......... .......... .......... .......... .......... 78% 267M 0s 2019-12-08T12:17:14.589 INFO:teuthology.orchestra.run.smithi079.stderr: 57500K .......... .......... .......... .......... .......... 78% 252M 0s 2019-12-08T12:17:14.589 INFO:teuthology.orchestra.run.smithi079.stderr: 57550K .......... .......... .......... .......... .......... 78% 217M 0s 2019-12-08T12:17:14.589 INFO:teuthology.orchestra.run.smithi079.stderr: 57600K .......... .......... .......... .......... .......... 78% 262M 0s 2019-12-08T12:17:14.589 INFO:teuthology.orchestra.run.smithi079.stderr: 57650K .......... .......... .......... .......... .......... 78% 257M 0s 2019-12-08T12:17:14.589 INFO:teuthology.orchestra.run.smithi079.stderr: 57700K .......... .......... .......... .......... .......... 78% 269M 0s 2019-12-08T12:17:14.589 INFO:teuthology.orchestra.run.smithi079.stderr: 57750K .......... .......... .......... .......... .......... 78% 238M 0s 2019-12-08T12:17:14.589 INFO:teuthology.orchestra.run.smithi079.stderr: 57800K .......... .......... .......... .......... .......... 78% 252M 0s 2019-12-08T12:17:14.590 INFO:teuthology.orchestra.run.smithi079.stderr: 57850K .......... .......... .......... .......... .......... 78% 248M 0s 2019-12-08T12:17:14.590 INFO:teuthology.orchestra.run.smithi079.stderr: 57900K .......... .......... .......... .......... .......... 78% 260M 0s 2019-12-08T12:17:14.590 INFO:teuthology.orchestra.run.smithi079.stderr: 57950K .......... .......... .......... .......... .......... 78% 197M 0s 2019-12-08T12:17:14.590 INFO:teuthology.orchestra.run.smithi079.stderr: 58000K .......... .......... .......... .......... .......... 78% 267M 0s 2019-12-08T12:17:14.590 INFO:teuthology.orchestra.run.smithi079.stderr: 58050K .......... .......... .......... .......... .......... 78% 277M 0s 2019-12-08T12:17:14.590 INFO:teuthology.orchestra.run.smithi079.stderr: 58100K .......... .......... .......... .......... .......... 79% 268M 0s 2019-12-08T12:17:14.590 INFO:teuthology.orchestra.run.smithi079.stderr: 58150K .......... .......... .......... .......... .......... 79% 236M 0s 2019-12-08T12:17:14.591 INFO:teuthology.orchestra.run.smithi079.stderr: 58200K .......... .......... .......... .......... .......... 79% 288M 0s 2019-12-08T12:17:14.591 INFO:teuthology.orchestra.run.smithi079.stderr: 58250K .......... .......... .......... .......... .......... 79% 280M 0s 2019-12-08T12:17:14.591 INFO:teuthology.orchestra.run.smithi079.stderr: 58300K .......... .......... .......... .......... .......... 79% 281M 0s 2019-12-08T12:17:14.591 INFO:teuthology.orchestra.run.smithi079.stderr: 58350K .......... .......... .......... .......... .......... 79% 244M 0s 2019-12-08T12:17:14.591 INFO:teuthology.orchestra.run.smithi079.stderr: 58400K .......... .......... .......... .......... .......... 79% 267M 0s 2019-12-08T12:17:14.591 INFO:teuthology.orchestra.run.smithi079.stderr: 58450K .......... .......... .......... .......... .......... 79% 283M 0s 2019-12-08T12:17:14.591 INFO:teuthology.orchestra.run.smithi079.stderr: 58500K .......... .......... .......... .......... .......... 79% 268M 0s 2019-12-08T12:17:14.591 INFO:teuthology.orchestra.run.smithi079.stderr: 58550K .......... .......... .......... .......... .......... 79% 255M 0s 2019-12-08T12:17:14.592 INFO:teuthology.orchestra.run.smithi079.stderr: 58600K .......... .......... .......... .......... .......... 79% 267M 0s 2019-12-08T12:17:14.592 INFO:teuthology.orchestra.run.smithi079.stderr: 58650K .......... .......... .......... .......... .......... 79% 270M 0s 2019-12-08T12:17:14.592 INFO:teuthology.orchestra.run.smithi079.stderr: 58700K .......... .......... .......... .......... .......... 79% 271M 0s 2019-12-08T12:17:14.592 INFO:teuthology.orchestra.run.smithi079.stderr: 58750K .......... .......... .......... .......... .......... 79% 226M 0s 2019-12-08T12:17:14.592 INFO:teuthology.orchestra.run.smithi079.stderr: 58800K .......... .......... .......... .......... .......... 80% 287M 0s 2019-12-08T12:17:14.592 INFO:teuthology.orchestra.run.smithi079.stderr: 58850K .......... .......... .......... .......... .......... 80% 292M 0s 2019-12-08T12:17:14.592 INFO:teuthology.orchestra.run.smithi079.stderr: 58900K .......... .......... .......... .......... .......... 80% 255M 0s 2019-12-08T12:17:14.593 INFO:teuthology.orchestra.run.smithi079.stderr: 58950K .......... .......... .......... .......... .......... 80% 227M 0s 2019-12-08T12:17:14.593 INFO:teuthology.orchestra.run.smithi079.stderr: 59000K .......... .......... .......... .......... .......... 80% 257M 0s 2019-12-08T12:17:14.593 INFO:teuthology.orchestra.run.smithi079.stderr: 59050K .......... .......... .......... .......... .......... 80% 251M 0s 2019-12-08T12:17:14.593 INFO:teuthology.orchestra.run.smithi079.stderr: 59100K .......... .......... .......... .......... .......... 80% 258M 0s 2019-12-08T12:17:14.593 INFO:teuthology.orchestra.run.smithi079.stderr: 59150K .......... .......... .......... .......... .......... 80% 211M 0s 2019-12-08T12:17:14.593 INFO:teuthology.orchestra.run.smithi079.stderr: 59200K .......... .......... .......... .......... .......... 80% 228M 0s 2019-12-08T12:17:14.593 INFO:teuthology.orchestra.run.smithi079.stderr: 59250K .......... .......... .......... .......... .......... 80% 284M 0s 2019-12-08T12:17:14.594 INFO:teuthology.orchestra.run.smithi079.stderr: 59300K .......... .......... .......... .......... .......... 80% 286M 0s 2019-12-08T12:17:14.594 INFO:teuthology.orchestra.run.smithi079.stderr: 59350K .......... .......... .......... .......... .......... 80% 247M 0s 2019-12-08T12:17:14.594 INFO:teuthology.orchestra.run.smithi079.stderr: 59400K .......... .......... .......... .......... .......... 80% 284M 0s 2019-12-08T12:17:14.594 INFO:teuthology.orchestra.run.smithi079.stderr: 59450K .......... .......... .......... .......... .......... 80% 255M 0s 2019-12-08T12:17:14.594 INFO:teuthology.orchestra.run.smithi079.stderr: 59500K .......... .......... .......... .......... .......... 80% 255M 0s 2019-12-08T12:17:14.594 INFO:teuthology.orchestra.run.smithi079.stderr: 59550K .......... .......... .......... .......... .......... 81% 206M 0s 2019-12-08T12:17:14.594 INFO:teuthology.orchestra.run.smithi079.stderr: 59600K .......... .......... .......... .......... .......... 81% 259M 0s 2019-12-08T12:17:14.594 INFO:teuthology.orchestra.run.smithi079.stderr: 59650K .......... .......... .......... .......... .......... 81% 288M 0s 2019-12-08T12:17:14.595 INFO:teuthology.orchestra.run.smithi079.stderr: 59700K .......... .......... .......... .......... .......... 81% 271M 0s 2019-12-08T12:17:14.595 INFO:teuthology.orchestra.run.smithi079.stderr: 59750K .......... .......... .......... .......... .......... 81% 242M 0s 2019-12-08T12:17:14.595 INFO:teuthology.orchestra.run.smithi079.stderr: 59800K .......... .......... .......... .......... .......... 81% 265M 0s 2019-12-08T12:17:14.595 INFO:teuthology.orchestra.run.smithi079.stderr: 59850K .......... .......... .......... .......... .......... 81% 275M 0s 2019-12-08T12:17:14.595 INFO:teuthology.orchestra.run.smithi079.stderr: 59900K .......... .......... .......... .......... .......... 81% 267M 0s 2019-12-08T12:17:14.595 INFO:teuthology.orchestra.run.smithi079.stderr: 59950K .......... .......... .......... .......... .......... 81% 234M 0s 2019-12-08T12:17:14.595 INFO:teuthology.orchestra.run.smithi079.stderr: 60000K .......... .......... .......... .......... .......... 81% 278M 0s 2019-12-08T12:17:14.596 INFO:teuthology.orchestra.run.smithi079.stderr: 60050K .......... .......... .......... .......... .......... 81% 273M 0s 2019-12-08T12:17:14.596 INFO:teuthology.orchestra.run.smithi079.stderr: 60100K .......... .......... .......... .......... .......... 81% 286M 0s 2019-12-08T12:17:14.597 INFO:teuthology.orchestra.run.smithi079.stderr: 60150K .......... .......... .......... .......... .......... 81% 256M 0s 2019-12-08T12:17:14.598 INFO:teuthology.orchestra.run.smithi079.stderr: 60200K .......... .......... .......... .......... .......... 81% 286M 0s 2019-12-08T12:17:14.598 INFO:teuthology.orchestra.run.smithi079.stderr: 60250K .......... .......... .......... .......... .......... 81% 286M 0s 2019-12-08T12:17:14.598 INFO:teuthology.orchestra.run.smithi079.stderr: 60300K .......... .......... .......... .......... .......... 82% 280M 0s 2019-12-08T12:17:14.598 INFO:teuthology.orchestra.run.smithi079.stderr: 60350K .......... .......... .......... .......... .......... 82% 234M 0s 2019-12-08T12:17:14.598 INFO:teuthology.orchestra.run.smithi079.stderr: 60400K .......... .......... .......... .......... .......... 82% 268M 0s 2019-12-08T12:17:14.598 INFO:teuthology.orchestra.run.smithi079.stderr: 60450K .......... .......... .......... .......... .......... 82% 278M 0s 2019-12-08T12:17:14.598 INFO:teuthology.orchestra.run.smithi079.stderr: 60500K .......... .......... .......... .......... .......... 82% 281M 0s 2019-12-08T12:17:14.599 INFO:teuthology.orchestra.run.smithi079.stderr: 60550K .......... .......... .......... .......... .......... 82% 248M 0s 2019-12-08T12:17:14.599 INFO:teuthology.orchestra.run.smithi079.stderr: 60600K .......... .......... .......... .......... .......... 82% 263M 0s 2019-12-08T12:17:14.599 INFO:teuthology.orchestra.run.smithi079.stderr: 60650K .......... .......... .......... .......... .......... 82% 290M 0s 2019-12-08T12:17:14.599 INFO:teuthology.orchestra.run.smithi079.stderr: 60700K .......... .......... .......... .......... .......... 82% 284M 0s 2019-12-08T12:17:14.599 INFO:teuthology.orchestra.run.smithi079.stderr: 60750K .......... .......... .......... .......... .......... 82% 232M 0s 2019-12-08T12:17:14.599 INFO:teuthology.orchestra.run.smithi079.stderr: 60800K .......... .......... .......... .......... .......... 82% 287M 0s 2019-12-08T12:17:14.599 INFO:teuthology.orchestra.run.smithi079.stderr: 60850K .......... .......... .......... .......... .......... 82% 287M 0s 2019-12-08T12:17:14.600 INFO:teuthology.orchestra.run.smithi079.stderr: 60900K .......... .......... .......... .......... .......... 82% 278M 0s 2019-12-08T12:17:14.600 INFO:teuthology.orchestra.run.smithi079.stderr: 60950K .......... .......... .......... .......... .......... 82% 241M 0s 2019-12-08T12:17:14.600 INFO:teuthology.orchestra.run.smithi079.stderr: 61000K .......... .......... .......... .......... .......... 82% 282M 0s 2019-12-08T12:17:14.600 INFO:teuthology.orchestra.run.smithi079.stderr: 61050K .......... .......... .......... .......... .......... 83% 276M 0s 2019-12-08T12:17:14.600 INFO:teuthology.orchestra.run.smithi079.stderr: 61100K .......... .......... .......... .......... .......... 83% 257M 0s 2019-12-08T12:17:14.600 INFO:teuthology.orchestra.run.smithi079.stderr: 61150K .......... .......... .......... .......... .......... 83% 209M 0s 2019-12-08T12:17:14.600 INFO:teuthology.orchestra.run.smithi079.stderr: 61200K .......... .......... .......... .......... .......... 83% 261M 0s 2019-12-08T12:17:14.601 INFO:teuthology.orchestra.run.smithi079.stderr: 61250K .......... .......... .......... .......... .......... 83% 223M 0s 2019-12-08T12:17:14.601 INFO:teuthology.orchestra.run.smithi079.stderr: 61300K .......... .......... .......... .......... .......... 83% 214M 0s 2019-12-08T12:17:14.601 INFO:teuthology.orchestra.run.smithi079.stderr: 61350K .......... .......... .......... .......... .......... 83% 214M 0s 2019-12-08T12:17:14.601 INFO:teuthology.orchestra.run.smithi079.stderr: 61400K .......... .......... .......... .......... .......... 83% 226M 0s 2019-12-08T12:17:14.601 INFO:teuthology.orchestra.run.smithi079.stderr: 61450K .......... .......... .......... .......... .......... 83% 287M 0s 2019-12-08T12:17:14.601 INFO:teuthology.orchestra.run.smithi079.stderr: 61500K .......... .......... .......... .......... .......... 83% 284M 0s 2019-12-08T12:17:14.601 INFO:teuthology.orchestra.run.smithi079.stderr: 61550K .......... .......... .......... .......... .......... 83% 228M 0s 2019-12-08T12:17:14.601 INFO:teuthology.orchestra.run.smithi079.stderr: 61600K .......... .......... .......... .......... .......... 83% 284M 0s 2019-12-08T12:17:14.602 INFO:teuthology.orchestra.run.smithi079.stderr: 61650K .......... .......... .......... .......... .......... 83% 287M 0s 2019-12-08T12:17:14.602 INFO:teuthology.orchestra.run.smithi079.stderr: 61700K .......... .......... .......... .......... .......... 83% 283M 0s 2019-12-08T12:17:14.602 INFO:teuthology.orchestra.run.smithi079.stderr: 61750K .......... .......... .......... .......... .......... 84% 238M 0s 2019-12-08T12:17:14.602 INFO:teuthology.orchestra.run.smithi079.stderr: 61800K .......... .......... .......... .......... .......... 84% 268M 0s 2019-12-08T12:17:14.602 INFO:teuthology.orchestra.run.smithi079.stderr: 61850K .......... .......... .......... .......... .......... 84% 262M 0s 2019-12-08T12:17:14.602 INFO:teuthology.orchestra.run.smithi079.stderr: 61900K .......... .......... .......... .......... .......... 84% 277M 0s 2019-12-08T12:17:14.602 INFO:teuthology.orchestra.run.smithi079.stderr: 61950K .......... .......... .......... .......... .......... 84% 216M 0s 2019-12-08T12:17:14.603 INFO:teuthology.orchestra.run.smithi079.stderr: 62000K .......... .......... .......... .......... .......... 84% 265M 0s 2019-12-08T12:17:14.603 INFO:teuthology.orchestra.run.smithi079.stderr: 62050K .......... .......... .......... .......... .......... 84% 264M 0s 2019-12-08T12:17:14.603 INFO:teuthology.orchestra.run.smithi079.stderr: 62100K .......... .......... .......... .......... .......... 84% 232M 0s 2019-12-08T12:17:14.603 INFO:teuthology.orchestra.run.smithi079.stderr: 62150K .......... .......... .......... .......... .......... 84% 230M 0s 2019-12-08T12:17:14.603 INFO:teuthology.orchestra.run.smithi079.stderr: 62200K .......... .......... .......... .......... .......... 84% 244M 0s 2019-12-08T12:17:14.603 INFO:teuthology.orchestra.run.smithi079.stderr: 62250K .......... .......... .......... .......... .......... 84% 267M 0s 2019-12-08T12:17:14.603 INFO:teuthology.orchestra.run.smithi079.stderr: 62300K .......... .......... .......... .......... .......... 84% 271M 0s 2019-12-08T12:17:14.603 INFO:teuthology.orchestra.run.smithi079.stderr: 62350K .......... .......... .......... .......... .......... 84% 205M 0s 2019-12-08T12:17:14.604 INFO:teuthology.orchestra.run.smithi079.stderr: 62400K .......... .......... .......... .......... .......... 84% 263M 0s 2019-12-08T12:17:14.604 INFO:teuthology.orchestra.run.smithi079.stderr: 62450K .......... .......... .......... .......... .......... 84% 288M 0s 2019-12-08T12:17:14.604 INFO:teuthology.orchestra.run.smithi079.stderr: 62500K .......... .......... .......... .......... .......... 85% 271M 0s 2019-12-08T12:17:14.604 INFO:teuthology.orchestra.run.smithi079.stderr: 62550K .......... .......... .......... .......... .......... 85% 240M 0s 2019-12-08T12:17:14.604 INFO:teuthology.orchestra.run.smithi079.stderr: 62600K .......... .......... .......... .......... .......... 85% 282M 0s 2019-12-08T12:17:14.604 INFO:teuthology.orchestra.run.smithi079.stderr: 62650K .......... .......... .......... .......... .......... 85% 263M 0s 2019-12-08T12:17:14.604 INFO:teuthology.orchestra.run.smithi079.stderr: 62700K .......... .......... .......... .......... .......... 85% 264M 0s 2019-12-08T12:17:14.605 INFO:teuthology.orchestra.run.smithi079.stderr: 62750K .......... .......... .......... .......... .......... 85% 243M 0s 2019-12-08T12:17:14.605 INFO:teuthology.orchestra.run.smithi079.stderr: 62800K .......... .......... .......... .......... .......... 85% 250M 0s 2019-12-08T12:17:14.605 INFO:teuthology.orchestra.run.smithi079.stderr: 62850K .......... .......... .......... .......... .......... 85% 263M 0s 2019-12-08T12:17:14.605 INFO:teuthology.orchestra.run.smithi079.stderr: 62900K .......... .......... .......... .......... .......... 85% 259M 0s 2019-12-08T12:17:14.605 INFO:teuthology.orchestra.run.smithi079.stderr: 62950K .......... .......... .......... .......... .......... 85% 245M 0s 2019-12-08T12:17:14.605 INFO:teuthology.orchestra.run.smithi079.stderr: 63000K .......... .......... .......... .......... .......... 85% 285M 0s 2019-12-08T12:17:14.605 INFO:teuthology.orchestra.run.smithi079.stderr: 63050K .......... .......... .......... .......... .......... 85% 277M 0s 2019-12-08T12:17:14.606 INFO:teuthology.orchestra.run.smithi079.stderr: 63100K .......... .......... .......... .......... .......... 85% 277M 0s 2019-12-08T12:17:14.606 INFO:teuthology.orchestra.run.smithi079.stderr: 63150K .......... .......... .......... .......... .......... 85% 232M 0s 2019-12-08T12:17:14.606 INFO:teuthology.orchestra.run.smithi079.stderr: 63200K .......... .......... .......... .......... .......... 85% 289M 0s 2019-12-08T12:17:14.606 INFO:teuthology.orchestra.run.smithi079.stderr: 63250K .......... .......... .......... .......... .......... 86% 278M 0s 2019-12-08T12:17:14.606 INFO:teuthology.orchestra.run.smithi079.stderr: 63300K .......... .......... .......... .......... .......... 86% 282M 0s 2019-12-08T12:17:14.606 INFO:teuthology.orchestra.run.smithi079.stderr: 63350K .......... .......... .......... .......... .......... 86% 261M 0s 2019-12-08T12:17:14.607 INFO:teuthology.orchestra.run.smithi079.stderr: 63400K .......... .......... .......... .......... .......... 86% 298M 0s 2019-12-08T12:17:14.607 INFO:teuthology.orchestra.run.smithi079.stderr: 63450K .......... .......... .......... .......... .......... 86% 272M 0s 2019-12-08T12:17:14.607 INFO:teuthology.orchestra.run.smithi079.stderr: 63500K .......... .......... .......... .......... .......... 86% 279M 0s 2019-12-08T12:17:14.607 INFO:teuthology.orchestra.run.smithi079.stderr: 63550K .......... .......... .......... .......... .......... 86% 224M 0s 2019-12-08T12:17:14.607 INFO:teuthology.orchestra.run.smithi079.stderr: 63600K .......... .......... .......... .......... .......... 86% 259M 0s 2019-12-08T12:17:14.607 INFO:teuthology.orchestra.run.smithi079.stderr: 63650K .......... .......... .......... .......... .......... 86% 267M 0s 2019-12-08T12:17:14.607 INFO:teuthology.orchestra.run.smithi079.stderr: 63700K .......... .......... .......... .......... .......... 86% 246M 0s 2019-12-08T12:17:14.608 INFO:teuthology.orchestra.run.smithi079.stderr: 63750K .......... .......... .......... .......... .......... 86% 244M 0s 2019-12-08T12:17:14.608 INFO:teuthology.orchestra.run.smithi079.stderr: 63800K .......... .......... .......... .......... .......... 86% 291M 0s 2019-12-08T12:17:14.608 INFO:teuthology.orchestra.run.smithi079.stderr: 63850K .......... .......... .......... .......... .......... 86% 288M 0s 2019-12-08T12:17:14.608 INFO:teuthology.orchestra.run.smithi079.stderr: 63900K .......... .......... .......... .......... .......... 86% 283M 0s 2019-12-08T12:17:14.608 INFO:teuthology.orchestra.run.smithi079.stderr: 63950K .......... .......... .......... .......... .......... 87% 233M 0s 2019-12-08T12:17:14.608 INFO:teuthology.orchestra.run.smithi079.stderr: 64000K .......... .......... .......... .......... .......... 87% 275M 0s 2019-12-08T12:17:14.608 INFO:teuthology.orchestra.run.smithi079.stderr: 64050K .......... .......... .......... .......... .......... 87% 283M 0s 2019-12-08T12:17:14.609 INFO:teuthology.orchestra.run.smithi079.stderr: 64100K .......... .......... .......... .......... .......... 87% 302M 0s 2019-12-08T12:17:14.609 INFO:teuthology.orchestra.run.smithi079.stderr: 64150K .......... .......... .......... .......... .......... 87% 250M 0s 2019-12-08T12:17:14.609 INFO:teuthology.orchestra.run.smithi079.stderr: 64200K .......... .......... .......... .......... .......... 87% 286M 0s 2019-12-08T12:17:14.609 INFO:teuthology.orchestra.run.smithi079.stderr: 64250K .......... .......... .......... .......... .......... 87% 286M 0s 2019-12-08T12:17:14.609 INFO:teuthology.orchestra.run.smithi079.stderr: 64300K .......... .......... .......... .......... .......... 87% 288M 0s 2019-12-08T12:17:14.609 INFO:teuthology.orchestra.run.smithi079.stderr: 64350K .......... .......... .......... .......... .......... 87% 222M 0s 2019-12-08T12:17:14.609 INFO:teuthology.orchestra.run.smithi079.stderr: 64400K .......... .......... .......... .......... .......... 87% 265M 0s 2019-12-08T12:17:14.609 INFO:teuthology.orchestra.run.smithi079.stderr: 64450K .......... .......... .......... .......... .......... 87% 265M 0s 2019-12-08T12:17:14.610 INFO:teuthology.orchestra.run.smithi079.stderr: 64500K .......... .......... .......... .......... .......... 87% 281M 0s 2019-12-08T12:17:14.610 INFO:teuthology.orchestra.run.smithi079.stderr: 64550K .......... .......... .......... .......... .......... 87% 220M 0s 2019-12-08T12:17:14.610 INFO:teuthology.orchestra.run.smithi079.stderr: 64600K .......... .......... .......... .......... .......... 87% 262M 0s 2019-12-08T12:17:14.610 INFO:teuthology.orchestra.run.smithi079.stderr: 64650K .......... .......... .......... .......... .......... 87% 247M 0s 2019-12-08T12:17:14.610 INFO:teuthology.orchestra.run.smithi079.stderr: 64700K .......... .......... .......... .......... .......... 88% 275M 0s 2019-12-08T12:17:14.610 INFO:teuthology.orchestra.run.smithi079.stderr: 64750K .......... .......... .......... .......... .......... 88% 226M 0s 2019-12-08T12:17:14.610 INFO:teuthology.orchestra.run.smithi079.stderr: 64800K .......... .......... .......... .......... .......... 88% 255M 0s 2019-12-08T12:17:14.611 INFO:teuthology.orchestra.run.smithi079.stderr: 64850K .......... .......... .......... .......... .......... 88% 264M 0s 2019-12-08T12:17:14.611 INFO:teuthology.orchestra.run.smithi079.stderr: 64900K .......... .......... .......... .......... .......... 88% 273M 0s 2019-12-08T12:17:14.611 INFO:teuthology.orchestra.run.smithi079.stderr: 64950K .......... .......... .......... .......... .......... 88% 252M 0s 2019-12-08T12:17:14.611 INFO:teuthology.orchestra.run.smithi079.stderr: 65000K .......... .......... .......... .......... .......... 88% 245M 0s 2019-12-08T12:17:14.611 INFO:teuthology.orchestra.run.smithi079.stderr: 65050K .......... .......... .......... .......... .......... 88% 269M 0s 2019-12-08T12:17:14.611 INFO:teuthology.orchestra.run.smithi079.stderr: 65100K .......... .......... .......... .......... .......... 88% 283M 0s 2019-12-08T12:17:14.611 INFO:teuthology.orchestra.run.smithi079.stderr: 65150K .......... .......... .......... .......... .......... 88% 233M 0s 2019-12-08T12:17:14.612 INFO:teuthology.orchestra.run.smithi079.stderr: 65200K .......... .......... .......... .......... .......... 88% 278M 0s 2019-12-08T12:17:14.612 INFO:teuthology.orchestra.run.smithi079.stderr: 65250K .......... .......... .......... .......... .......... 88% 285M 0s 2019-12-08T12:17:14.612 INFO:teuthology.orchestra.run.smithi079.stderr: 65300K .......... .......... .......... .......... .......... 88% 279M 0s 2019-12-08T12:17:14.612 INFO:teuthology.orchestra.run.smithi079.stderr: 65350K .......... .......... .......... .......... .......... 88% 254M 0s 2019-12-08T12:17:14.612 INFO:teuthology.orchestra.run.smithi079.stderr: 65400K .......... .......... .......... .......... .......... 88% 279M 0s 2019-12-08T12:17:14.613 INFO:teuthology.orchestra.run.smithi079.stderr: 65450K .......... .......... .......... .......... .......... 89% 276M 0s 2019-12-08T12:17:14.613 INFO:teuthology.orchestra.run.smithi079.stderr: 65500K .......... .......... .......... .......... .......... 89% 290M 0s 2019-12-08T12:17:14.613 INFO:teuthology.orchestra.run.smithi079.stderr: 65550K .......... .......... .......... .......... .......... 89% 235M 0s 2019-12-08T12:17:14.613 INFO:teuthology.orchestra.run.smithi079.stderr: 65600K .......... .......... .......... .......... .......... 89% 277M 0s 2019-12-08T12:17:14.613 INFO:teuthology.orchestra.run.smithi079.stderr: 65650K .......... .......... .......... .......... .......... 89% 289M 0s 2019-12-08T12:17:14.613 INFO:teuthology.orchestra.run.smithi079.stderr: 65700K .......... .......... .......... .......... .......... 89% 280M 0s 2019-12-08T12:17:14.613 INFO:teuthology.orchestra.run.smithi079.stderr: 65750K .......... .......... .......... .......... .......... 89% 242M 0s 2019-12-08T12:17:14.614 INFO:teuthology.orchestra.run.smithi079.stderr: 65800K .......... .......... .......... .......... .......... 89% 276M 0s 2019-12-08T12:17:14.614 INFO:teuthology.orchestra.run.smithi079.stderr: 65850K .......... .......... .......... .......... .......... 89% 257M 0s 2019-12-08T12:17:14.614 INFO:teuthology.orchestra.run.smithi079.stderr: 65900K .......... .......... .......... .......... .......... 89% 258M 0s 2019-12-08T12:17:14.614 INFO:teuthology.orchestra.run.smithi079.stderr: 65950K .......... .......... .......... .......... .......... 89% 244M 0s 2019-12-08T12:17:14.614 INFO:teuthology.orchestra.run.smithi079.stderr: 66000K .......... .......... .......... .......... .......... 89% 280M 0s 2019-12-08T12:17:14.614 INFO:teuthology.orchestra.run.smithi079.stderr: 66050K .......... .......... .......... .......... .......... 89% 294M 0s 2019-12-08T12:17:14.614 INFO:teuthology.orchestra.run.smithi079.stderr: 66100K .......... .......... .......... .......... .......... 89% 289M 0s 2019-12-08T12:17:14.614 INFO:teuthology.orchestra.run.smithi079.stderr: 66150K .......... .......... .......... .......... .......... 89% 239M 0s 2019-12-08T12:17:14.615 INFO:teuthology.orchestra.run.smithi079.stderr: 66200K .......... .......... .......... .......... .......... 90% 294M 0s 2019-12-08T12:17:14.615 INFO:teuthology.orchestra.run.smithi079.stderr: 66250K .......... .......... .......... .......... .......... 90% 289M 0s 2019-12-08T12:17:14.615 INFO:teuthology.orchestra.run.smithi079.stderr: 66300K .......... .......... .......... .......... .......... 90% 252M 0s 2019-12-08T12:17:14.615 INFO:teuthology.orchestra.run.smithi079.stderr: 66350K .......... .......... .......... .......... .......... 90% 229M 0s 2019-12-08T12:17:14.615 INFO:teuthology.orchestra.run.smithi079.stderr: 66400K .......... .......... .......... .......... .......... 90% 249M 0s 2019-12-08T12:17:14.615 INFO:teuthology.orchestra.run.smithi079.stderr: 66450K .......... .......... .......... .......... .......... 90% 272M 0s 2019-12-08T12:17:14.615 INFO:teuthology.orchestra.run.smithi079.stderr: 66500K .......... .......... .......... .......... .......... 90% 258M 0s 2019-12-08T12:17:14.616 INFO:teuthology.orchestra.run.smithi079.stderr: 66550K .......... .......... .......... .......... .......... 90% 201M 0s 2019-12-08T12:17:14.616 INFO:teuthology.orchestra.run.smithi079.stderr: 66600K .......... .......... .......... .......... .......... 90% 197M 0s 2019-12-08T12:17:14.616 INFO:teuthology.orchestra.run.smithi079.stderr: 66650K .......... .......... .......... .......... .......... 90% 273M 0s 2019-12-08T12:17:14.616 INFO:teuthology.orchestra.run.smithi079.stderr: 66700K .......... .......... .......... .......... .......... 90% 258M 0s 2019-12-08T12:17:14.616 INFO:teuthology.orchestra.run.smithi079.stderr: 66750K .......... .......... .......... .......... .......... 90% 225M 0s 2019-12-08T12:17:14.616 INFO:teuthology.orchestra.run.smithi079.stderr: 66800K .......... .......... .......... .......... .......... 90% 255M 0s 2019-12-08T12:17:14.616 INFO:teuthology.orchestra.run.smithi079.stderr: 66850K .......... .......... .......... .......... .......... 90% 257M 0s 2019-12-08T12:17:14.617 INFO:teuthology.orchestra.run.smithi079.stderr: 66900K .......... .......... .......... .......... .......... 91% 265M 0s 2019-12-08T12:17:14.617 INFO:teuthology.orchestra.run.smithi079.stderr: 66950K .......... .......... .......... .......... .......... 91% 257M 0s 2019-12-08T12:17:14.617 INFO:teuthology.orchestra.run.smithi079.stderr: 67000K .......... .......... .......... .......... .......... 91% 275M 0s 2019-12-08T12:17:14.617 INFO:teuthology.orchestra.run.smithi079.stderr: 67050K .......... .......... .......... .......... .......... 91% 275M 0s 2019-12-08T12:17:14.617 INFO:teuthology.orchestra.run.smithi079.stderr: 67100K .......... .......... .......... .......... .......... 91% 263M 0s 2019-12-08T12:17:14.617 INFO:teuthology.orchestra.run.smithi079.stderr: 67150K .......... .......... .......... .......... .......... 91% 238M 0s 2019-12-08T12:17:14.617 INFO:teuthology.orchestra.run.smithi079.stderr: 67200K .......... .......... .......... .......... .......... 91% 276M 0s 2019-12-08T12:17:14.617 INFO:teuthology.orchestra.run.smithi079.stderr: 67250K .......... .......... .......... .......... .......... 91% 290M 0s 2019-12-08T12:17:14.618 INFO:teuthology.orchestra.run.smithi079.stderr: 67300K .......... .......... .......... .......... .......... 91% 298M 0s 2019-12-08T12:17:14.618 INFO:teuthology.orchestra.run.smithi079.stderr: 67350K .......... .......... .......... .......... .......... 91% 232M 0s 2019-12-08T12:17:14.618 INFO:teuthology.orchestra.run.smithi079.stderr: 67400K .......... .......... .......... .......... .......... 91% 269M 0s 2019-12-08T12:17:14.618 INFO:teuthology.orchestra.run.smithi079.stderr: 67450K .......... .......... .......... .......... .......... 91% 248M 0s 2019-12-08T12:17:14.618 INFO:teuthology.orchestra.run.smithi079.stderr: 67500K .......... .......... .......... .......... .......... 91% 267M 0s 2019-12-08T12:17:14.618 INFO:teuthology.orchestra.run.smithi079.stderr: 67550K .......... .......... .......... .......... .......... 91% 228M 0s 2019-12-08T12:17:14.618 INFO:teuthology.orchestra.run.smithi079.stderr: 67600K .......... .......... .......... .......... .......... 91% 279M 0s 2019-12-08T12:17:14.619 INFO:teuthology.orchestra.run.smithi079.stderr: 67650K .......... .......... .......... .......... .......... 92% 280M 0s 2019-12-08T12:17:14.619 INFO:teuthology.orchestra.run.smithi079.stderr: 67700K .......... .......... .......... .......... .......... 92% 239M 0s 2019-12-08T12:17:14.619 INFO:teuthology.orchestra.run.smithi079.stderr: 67750K .......... .......... .......... .......... .......... 92% 212M 0s 2019-12-08T12:17:14.619 INFO:teuthology.orchestra.run.smithi079.stderr: 67800K .......... .......... .......... .......... .......... 92% 362M 0s 2019-12-08T12:17:14.619 INFO:teuthology.orchestra.run.smithi079.stderr: 67850K .......... .......... .......... .......... .......... 92% 384M 0s 2019-12-08T12:17:14.619 INFO:teuthology.orchestra.run.smithi079.stderr: 67900K .......... .......... .......... .......... .......... 92% 409M 0s 2019-12-08T12:17:14.619 INFO:teuthology.orchestra.run.smithi079.stderr: 67950K .......... .......... .......... .......... .......... 92% 302M 0s 2019-12-08T12:17:14.620 INFO:teuthology.orchestra.run.smithi079.stderr: 68000K .......... .......... .......... .......... .......... 92% 275M 0s 2019-12-08T12:17:14.620 INFO:teuthology.orchestra.run.smithi079.stderr: 68050K .......... .......... .......... .......... .......... 92% 250M 0s 2019-12-08T12:17:14.620 INFO:teuthology.orchestra.run.smithi079.stderr: 68100K .......... .......... .......... .......... .......... 92% 251M 0s 2019-12-08T12:17:14.620 INFO:teuthology.orchestra.run.smithi079.stderr: 68150K .......... .......... .......... .......... .......... 92% 220M 0s 2019-12-08T12:17:14.620 INFO:teuthology.orchestra.run.smithi079.stderr: 68200K .......... .......... .......... .......... .......... 92% 262M 0s 2019-12-08T12:17:14.620 INFO:teuthology.orchestra.run.smithi079.stderr: 68250K .......... .......... .......... .......... .......... 92% 294M 0s 2019-12-08T12:17:14.620 INFO:teuthology.orchestra.run.smithi079.stderr: 68300K .......... .......... .......... .......... .......... 92% 251M 0s 2019-12-08T12:17:14.621 INFO:teuthology.orchestra.run.smithi079.stderr: 68350K .......... .......... .......... .......... .......... 92% 244M 0s 2019-12-08T12:17:14.621 INFO:teuthology.orchestra.run.smithi079.stderr: 68400K .......... .......... .......... .......... .......... 93% 282M 0s 2019-12-08T12:17:14.621 INFO:teuthology.orchestra.run.smithi079.stderr: 68450K .......... .......... .......... .......... .......... 93% 251M 0s 2019-12-08T12:17:14.621 INFO:teuthology.orchestra.run.smithi079.stderr: 68500K .......... .......... .......... .......... .......... 93% 253M 0s 2019-12-08T12:17:14.621 INFO:teuthology.orchestra.run.smithi079.stderr: 68550K .......... .......... .......... .......... .......... 93% 218M 0s 2019-12-08T12:17:14.621 INFO:teuthology.orchestra.run.smithi079.stderr: 68600K .......... .......... .......... .......... .......... 93% 272M 0s 2019-12-08T12:17:14.621 INFO:teuthology.orchestra.run.smithi079.stderr: 68650K .......... .......... .......... .......... .......... 93% 280M 0s 2019-12-08T12:17:14.621 INFO:teuthology.orchestra.run.smithi079.stderr: 68700K .......... .......... .......... .......... .......... 93% 274M 0s 2019-12-08T12:17:14.622 INFO:teuthology.orchestra.run.smithi079.stderr: 68750K .......... .......... .......... .......... .......... 93% 251M 0s 2019-12-08T12:17:14.622 INFO:teuthology.orchestra.run.smithi079.stderr: 68800K .......... .......... .......... .......... .......... 93% 274M 0s 2019-12-08T12:17:14.622 INFO:teuthology.orchestra.run.smithi079.stderr: 68850K .......... .......... .......... .......... .......... 93% 275M 0s 2019-12-08T12:17:14.622 INFO:teuthology.orchestra.run.smithi079.stderr: 68900K .......... .......... .......... .......... .......... 93% 282M 0s 2019-12-08T12:17:14.622 INFO:teuthology.orchestra.run.smithi079.stderr: 68950K .......... .......... .......... .......... .......... 93% 245M 0s 2019-12-08T12:17:14.622 INFO:teuthology.orchestra.run.smithi079.stderr: 69000K .......... .......... .......... .......... .......... 93% 287M 0s 2019-12-08T12:17:14.622 INFO:teuthology.orchestra.run.smithi079.stderr: 69050K .......... .......... .......... .......... .......... 93% 273M 0s 2019-12-08T12:17:14.623 INFO:teuthology.orchestra.run.smithi079.stderr: 69100K .......... .......... .......... .......... .......... 94% 271M 0s 2019-12-08T12:17:14.623 INFO:teuthology.orchestra.run.smithi079.stderr: 69150K .......... .......... .......... .......... .......... 94% 234M 0s 2019-12-08T12:17:14.623 INFO:teuthology.orchestra.run.smithi079.stderr: 69200K .......... .......... .......... .......... .......... 94% 270M 0s 2019-12-08T12:17:14.623 INFO:teuthology.orchestra.run.smithi079.stderr: 69250K .......... .......... .......... .......... .......... 94% 282M 0s 2019-12-08T12:17:14.623 INFO:teuthology.orchestra.run.smithi079.stderr: 69300K .......... .......... .......... .......... .......... 94% 279M 0s 2019-12-08T12:17:14.623 INFO:teuthology.orchestra.run.smithi079.stderr: 69350K .......... .......... .......... .......... .......... 94% 239M 0s 2019-12-08T12:17:14.623 INFO:teuthology.orchestra.run.smithi079.stderr: 69400K .......... .......... .......... .......... .......... 94% 275M 0s 2019-12-08T12:17:14.623 INFO:teuthology.orchestra.run.smithi079.stderr: 69450K .......... .......... .......... .......... .......... 94% 276M 0s 2019-12-08T12:17:14.624 INFO:teuthology.orchestra.run.smithi079.stderr: 69500K .......... .......... .......... .......... .......... 94% 267M 0s 2019-12-08T12:17:14.624 INFO:teuthology.orchestra.run.smithi079.stderr: 69550K .......... .......... .......... .......... .......... 94% 231M 0s 2019-12-08T12:17:14.624 INFO:teuthology.orchestra.run.smithi079.stderr: 69600K .......... .......... .......... .......... .......... 94% 290M 0s 2019-12-08T12:17:14.624 INFO:teuthology.orchestra.run.smithi079.stderr: 69650K .......... .......... .......... .......... .......... 94% 270M 0s 2019-12-08T12:17:14.624 INFO:teuthology.orchestra.run.smithi079.stderr: 69700K .......... .......... .......... .......... .......... 94% 265M 0s 2019-12-08T12:17:14.624 INFO:teuthology.orchestra.run.smithi079.stderr: 69750K .......... .......... .......... .......... .......... 94% 227M 0s 2019-12-08T12:17:14.624 INFO:teuthology.orchestra.run.smithi079.stderr: 69800K .......... .......... .......... .......... .......... 94% 287M 0s 2019-12-08T12:17:14.625 INFO:teuthology.orchestra.run.smithi079.stderr: 69850K .......... .......... .......... .......... .......... 95% 275M 0s 2019-12-08T12:17:14.625 INFO:teuthology.orchestra.run.smithi079.stderr: 69900K .......... .......... .......... .......... .......... 95% 270M 0s 2019-12-08T12:17:14.625 INFO:teuthology.orchestra.run.smithi079.stderr: 69950K .......... .......... .......... .......... .......... 95% 232M 0s 2019-12-08T12:17:14.625 INFO:teuthology.orchestra.run.smithi079.stderr: 70000K .......... .......... .......... .......... .......... 95% 287M 0s 2019-12-08T12:17:14.625 INFO:teuthology.orchestra.run.smithi079.stderr: 70050K .......... .......... .......... .......... .......... 95% 277M 0s 2019-12-08T12:17:14.625 INFO:teuthology.orchestra.run.smithi079.stderr: 70100K .......... .......... .......... .......... .......... 95% 272M 0s 2019-12-08T12:17:14.626 INFO:teuthology.orchestra.run.smithi079.stderr: 70150K .......... .......... .......... .......... .......... 95% 235M 0s 2019-12-08T12:17:14.626 INFO:teuthology.orchestra.run.smithi079.stderr: 70200K .......... .......... .......... .......... .......... 95% 246M 0s 2019-12-08T12:17:14.626 INFO:teuthology.orchestra.run.smithi079.stderr: 70250K .......... .......... .......... .......... .......... 95% 263M 0s 2019-12-08T12:17:14.626 INFO:teuthology.orchestra.run.smithi079.stderr: 70300K .......... .......... .......... .......... .......... 95% 264M 0s 2019-12-08T12:17:14.626 INFO:teuthology.orchestra.run.smithi079.stderr: 70350K .......... .......... .......... .......... .......... 95% 232M 0s 2019-12-08T12:17:14.626 INFO:teuthology.orchestra.run.smithi079.stderr: 70400K .......... .......... .......... .......... .......... 95% 269M 0s 2019-12-08T12:17:14.626 INFO:teuthology.orchestra.run.smithi079.stderr: 70450K .......... .......... .......... .......... .......... 95% 228M 0s 2019-12-08T12:17:14.627 INFO:teuthology.orchestra.run.smithi079.stderr: 70500K .......... .......... .......... .......... .......... 95% 260M 0s 2019-12-08T12:17:14.627 INFO:teuthology.orchestra.run.smithi079.stderr: 70550K .......... .......... .......... .......... .......... 95% 244M 0s 2019-12-08T12:17:14.627 INFO:teuthology.orchestra.run.smithi079.stderr: 70600K .......... .......... .......... .......... .......... 96% 276M 0s 2019-12-08T12:17:14.627 INFO:teuthology.orchestra.run.smithi079.stderr: 70650K .......... .......... .......... .......... .......... 96% 288M 0s 2019-12-08T12:17:14.627 INFO:teuthology.orchestra.run.smithi079.stderr: 70700K .......... .......... .......... .......... .......... 96% 257M 0s 2019-12-08T12:17:14.627 INFO:teuthology.orchestra.run.smithi079.stderr: 70750K .......... .......... .......... .......... .......... 96% 224M 0s 2019-12-08T12:17:14.628 INFO:teuthology.orchestra.run.smithi079.stderr: 70800K .......... .......... .......... .......... .......... 96% 282M 0s 2019-12-08T12:17:14.628 INFO:teuthology.orchestra.run.smithi079.stderr: 70850K .......... .......... .......... .......... .......... 96% 294M 0s 2019-12-08T12:17:14.628 INFO:teuthology.orchestra.run.smithi079.stderr: 70900K .......... .......... .......... .......... .......... 96% 259M 0s 2019-12-08T12:17:14.628 INFO:teuthology.orchestra.run.smithi079.stderr: 70950K .......... .......... .......... .......... .......... 96% 249M 0s 2019-12-08T12:17:14.628 INFO:teuthology.orchestra.run.smithi079.stderr: 71000K .......... .......... .......... .......... .......... 96% 288M 0s 2019-12-08T12:17:14.628 INFO:teuthology.orchestra.run.smithi079.stderr: 71050K .......... .......... .......... .......... .......... 96% 262M 0s 2019-12-08T12:17:14.628 INFO:teuthology.orchestra.run.smithi079.stderr: 71100K .......... .......... .......... .......... .......... 96% 273M 0s 2019-12-08T12:17:14.629 INFO:teuthology.orchestra.run.smithi079.stderr: 71150K .......... .......... .......... .......... .......... 96% 229M 0s 2019-12-08T12:17:14.629 INFO:teuthology.orchestra.run.smithi079.stderr: 71200K .......... .......... .......... .......... .......... 96% 278M 0s 2019-12-08T12:17:14.629 INFO:teuthology.orchestra.run.smithi079.stderr: 71250K .......... .......... .......... .......... .......... 96% 255M 0s 2019-12-08T12:17:14.629 INFO:teuthology.orchestra.run.smithi079.stderr: 71300K .......... .......... .......... .......... .......... 96% 281M 0s 2019-12-08T12:17:14.629 INFO:teuthology.orchestra.run.smithi079.stderr: 71350K .......... .......... .......... .......... .......... 97% 220M 0s 2019-12-08T12:17:14.629 INFO:teuthology.orchestra.run.smithi079.stderr: 71400K .......... .......... .......... .......... .......... 97% 255M 0s 2019-12-08T12:17:14.629 INFO:teuthology.orchestra.run.smithi079.stderr: 71450K .......... .......... .......... .......... .......... 97% 292M 0s 2019-12-08T12:17:14.630 INFO:teuthology.orchestra.run.smithi079.stderr: 71500K .......... .......... .......... .......... .......... 97% 267M 0s 2019-12-08T12:17:14.630 INFO:teuthology.orchestra.run.smithi079.stderr: 71550K .......... .......... .......... .......... .......... 97% 238M 0s 2019-12-08T12:17:14.630 INFO:teuthology.orchestra.run.smithi079.stderr: 71600K .......... .......... .......... .......... .......... 97% 267M 0s 2019-12-08T12:17:14.630 INFO:teuthology.orchestra.run.smithi079.stderr: 71650K .......... .......... .......... .......... .......... 97% 277M 0s 2019-12-08T12:17:14.630 INFO:teuthology.orchestra.run.smithi079.stderr: 71700K .......... .......... .......... .......... .......... 97% 266M 0s 2019-12-08T12:17:14.630 INFO:teuthology.orchestra.run.smithi079.stderr: 71750K .......... .......... .......... .......... .......... 97% 219M 0s 2019-12-08T12:17:14.630 INFO:teuthology.orchestra.run.smithi079.stderr: 71800K .......... .......... .......... .......... .......... 97% 378M 0s 2019-12-08T12:17:14.631 INFO:teuthology.orchestra.run.smithi079.stderr: 71850K .......... .......... .......... .......... .......... 97% 355M 0s 2019-12-08T12:17:14.631 INFO:teuthology.orchestra.run.smithi079.stderr: 71900K .......... .......... .......... .......... .......... 97% 341M 0s 2019-12-08T12:17:14.631 INFO:teuthology.orchestra.run.smithi079.stderr: 71950K .......... .......... .......... .......... .......... 97% 307M 0s 2019-12-08T12:17:14.631 INFO:teuthology.orchestra.run.smithi079.stderr: 72000K .......... .......... .......... .......... .......... 97% 357M 0s 2019-12-08T12:17:14.631 INFO:teuthology.orchestra.run.smithi079.stderr: 72050K .......... .......... .......... .......... .......... 98% 398M 0s 2019-12-08T12:17:14.631 INFO:teuthology.orchestra.run.smithi079.stderr: 72100K .......... .......... .......... .......... .......... 98% 387M 0s 2019-12-08T12:17:14.631 INFO:teuthology.orchestra.run.smithi079.stderr: 72150K .......... .......... .......... .......... .......... 98% 333M 0s 2019-12-08T12:17:14.632 INFO:teuthology.orchestra.run.smithi079.stderr: 72200K .......... .......... .......... .......... .......... 98% 416M 0s 2019-12-08T12:17:14.632 INFO:teuthology.orchestra.run.smithi079.stderr: 72250K .......... .......... .......... .......... .......... 98% 402M 0s 2019-12-08T12:17:14.632 INFO:teuthology.orchestra.run.smithi079.stderr: 72300K .......... .......... .......... .......... .......... 98% 387M 0s 2019-12-08T12:17:14.632 INFO:teuthology.orchestra.run.smithi079.stderr: 72350K .......... .......... .......... .......... .......... 98% 322M 0s 2019-12-08T12:17:14.632 INFO:teuthology.orchestra.run.smithi079.stderr: 72400K .......... .......... .......... .......... .......... 98% 410M 0s 2019-12-08T12:17:14.632 INFO:teuthology.orchestra.run.smithi079.stderr: 72450K .......... .......... .......... .......... .......... 98% 391M 0s 2019-12-08T12:17:14.632 INFO:teuthology.orchestra.run.smithi079.stderr: 72500K .......... .......... .......... .......... .......... 98% 393M 0s 2019-12-08T12:17:14.632 INFO:teuthology.orchestra.run.smithi079.stderr: 72550K .......... .......... .......... .......... .......... 98% 352M 0s 2019-12-08T12:17:14.633 INFO:teuthology.orchestra.run.smithi079.stderr: 72600K .......... .......... .......... .......... .......... 98% 393M 0s 2019-12-08T12:17:14.633 INFO:teuthology.orchestra.run.smithi079.stderr: 72650K .......... .......... .......... .......... .......... 98% 409M 0s 2019-12-08T12:17:14.633 INFO:teuthology.orchestra.run.smithi079.stderr: 72700K .......... .......... .......... .......... .......... 98% 412M 0s 2019-12-08T12:17:14.633 INFO:teuthology.orchestra.run.smithi079.stderr: 72750K .......... .......... .......... .......... .......... 98% 344M 0s 2019-12-08T12:17:14.633 INFO:teuthology.orchestra.run.smithi079.stderr: 72800K .......... .......... .......... .......... .......... 99% 413M 0s 2019-12-08T12:17:14.633 INFO:teuthology.orchestra.run.smithi079.stderr: 72850K .......... .......... .......... .......... .......... 99% 416M 0s 2019-12-08T12:17:14.633 INFO:teuthology.orchestra.run.smithi079.stderr: 72900K .......... .......... .......... .......... .......... 99% 393M 0s 2019-12-08T12:17:14.634 INFO:teuthology.orchestra.run.smithi079.stderr: 72950K .......... .......... .......... .......... .......... 99% 369M 0s 2019-12-08T12:17:14.634 INFO:teuthology.orchestra.run.smithi079.stderr: 73000K .......... .......... .......... .......... .......... 99% 394M 0s 2019-12-08T12:17:14.634 INFO:teuthology.orchestra.run.smithi079.stderr: 73050K .......... .......... .......... .......... .......... 99% 393M 0s 2019-12-08T12:17:14.634 INFO:teuthology.orchestra.run.smithi079.stderr: 73100K .......... .......... .......... .......... .......... 99% 407M 0s 2019-12-08T12:17:14.634 INFO:teuthology.orchestra.run.smithi079.stderr: 73150K .......... .......... .......... .......... .......... 99% 308M 0s 2019-12-08T12:17:14.634 INFO:teuthology.orchestra.run.smithi079.stderr: 73200K .......... .......... .......... .......... .......... 99% 393M 0s 2019-12-08T12:17:14.634 INFO:teuthology.orchestra.run.smithi079.stderr: 73250K .......... .......... .......... .......... .......... 99% 397M 0s 2019-12-08T12:17:14.635 INFO:teuthology.orchestra.run.smithi079.stderr: 73300K .......... .......... .......... .......... .......... 99% 407M 0s 2019-12-08T12:17:14.635 INFO:teuthology.orchestra.run.smithi079.stderr: 73350K .......... .......... .......... .......... .......... 99% 343M 0s 2019-12-08T12:17:14.635 INFO:teuthology.orchestra.run.smithi079.stderr: 73400K .......... .......... .......... .......... .......... 99% 390M 0s 2019-12-08T12:17:14.635 INFO:teuthology.orchestra.run.smithi079.stderr: 73450K .......... .......... .......... .......... .......... 99% 388M 0s 2019-12-08T12:17:14.635 INFO:teuthology.orchestra.run.smithi079.stderr: 73500K .......... .......... .......... .......... .......... 99% 397M 0s 2019-12-08T12:17:14.635 INFO:teuthology.orchestra.run.smithi079.stderr: 73550K ........ 100% 448M=0.3s 2019-12-08T12:17:14.635 INFO:teuthology.orchestra.run.smithi079.stderr: 2019-12-08T12:17:14.636 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08 12:17:13 (241 MB/s) - ‘gradle-4.7-bin.zip’ saved [75323957/75323957] 2019-12-08T12:17:14.636 INFO:teuthology.orchestra.run.smithi079.stderr: 2019-12-08T12:17:14.636 INFO:teuthology.orchestra.run.smithi079.stdout:Archive: gradle-4.7-bin.zip 2019-12-08T12:17:14.636 INFO:teuthology.orchestra.run.smithi079.stdout: creating: /opt/gradle/gradle-4.7/ 2019-12-08T12:17:14.636 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/getting-started.html 2019-12-08T12:17:14.637 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/LICENSE 2019-12-08T12:17:14.637 INFO:teuthology.orchestra.run.smithi079.stdout: creating: /opt/gradle/gradle-4.7/media/ 2019-12-08T12:17:14.637 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle-icon-64x64.png 2019-12-08T12:17:14.637 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle-icon-48x48.png 2019-12-08T12:17:14.637 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle.icns 2019-12-08T12:17:14.638 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle-icon-24x24.png 2019-12-08T12:17:14.638 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle-icon-256x256.png 2019-12-08T12:17:14.638 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle-icon-512x512.png 2019-12-08T12:17:14.638 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle-icon-16x16.png 2019-12-08T12:17:14.638 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle-icon-32x32.png 2019-12-08T12:17:14.638 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/media/gradle-icon-128x128.png 2019-12-08T12:17:14.638 INFO:teuthology.orchestra.run.smithi079.stdout: creating: /opt/gradle/gradle-4.7/init.d/ 2019-12-08T12:17:14.638 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/init.d/readme.txt 2019-12-08T12:17:14.639 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/NOTICE 2019-12-08T12:17:14.639 INFO:teuthology.orchestra.run.smithi079.stdout: creating: /opt/gradle/gradle-4.7/bin/ 2019-12-08T12:17:14.639 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/bin/gradle.bat 2019-12-08T12:17:14.639 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/bin/gradle 2019-12-08T12:17:14.639 INFO:teuthology.orchestra.run.smithi079.stdout: creating: /opt/gradle/gradle-4.7/lib/ 2019-12-08T12:17:14.639 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/annotations-13.0.jar 2019-12-08T12:17:14.640 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-kotlin-dsl-0.16.3.jar 2019-12-08T12:17:14.640 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-kotlin-dsl-tooling-builders-0.16.3.jar 2019-12-08T12:17:14.640 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-kotlin-dsl-tooling-models-0.16.3.jar 2019-12-08T12:17:14.640 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/kotlin-compiler-embeddable-1.2.31.jar 2019-12-08T12:17:14.640 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/kotlin-reflect-1.2.31.jar 2019-12-08T12:17:14.640 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/kotlin-sam-with-receiver-compiler-plugin-1.2.31.jar 2019-12-08T12:17:14.640 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/kotlin-script-runtime-1.2.31.jar 2019-12-08T12:17:14.641 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/kotlin-stdlib-1.2.31.jar 2019-12-08T12:17:14.641 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/kotlin-stdlib-jdk7-1.2.31.jar 2019-12-08T12:17:14.641 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/kotlin-stdlib-jdk8-1.2.31.jar 2019-12-08T12:17:14.641 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-launcher-4.7.jar 2019-12-08T12:17:14.641 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-runtime-api-info-4.7.jar 2019-12-08T12:17:14.641 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-tooling-api-4.7.jar 2019-12-08T12:17:14.641 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-wrapper-4.7.jar 2019-12-08T12:17:14.642 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-installation-beacon-4.7.jar 2019-12-08T12:17:14.642 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-core-4.7.jar 2019-12-08T12:17:14.642 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-jvm-services-4.7.jar 2019-12-08T12:17:14.642 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-core-api-4.7.jar 2019-12-08T12:17:14.642 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-build-cache-4.7.jar 2019-12-08T12:17:14.642 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-logging-4.7.jar 2019-12-08T12:17:14.642 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-process-services-4.7.jar 2019-12-08T12:17:14.642 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-resources-4.7.jar 2019-12-08T12:17:14.643 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-persistent-cache-4.7.jar 2019-12-08T12:17:14.643 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-native-4.7.jar 2019-12-08T12:17:14.643 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-model-groovy-4.7.jar 2019-12-08T12:17:14.643 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-model-core-4.7.jar 2019-12-08T12:17:14.643 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-base-services-groovy-4.7.jar 2019-12-08T12:17:14.643 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-messaging-4.7.jar 2019-12-08T12:17:14.643 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-base-services-4.7.jar 2019-12-08T12:17:14.644 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-build-option-4.7.jar 2019-12-08T12:17:14.644 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-cli-4.7.jar 2019-12-08T12:17:14.644 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/gradle-docs-4.7.jar 2019-12-08T12:17:14.644 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/asm-commons-6.1.1.jar 2019-12-08T12:17:14.644 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/asm-analysis-6.1.1.jar 2019-12-08T12:17:14.644 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/asm-tree-6.1.1.jar 2019-12-08T12:17:14.644 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/kryo-2.20.jar 2019-12-08T12:17:14.645 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/reflectasm-1.07-shaded.jar 2019-12-08T12:17:14.645 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/asm-6.1.1.jar 2019-12-08T12:17:14.645 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/commons-io-2.4.jar 2019-12-08T12:17:14.645 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/jcl-over-slf4j-1.7.16.jar 2019-12-08T12:17:14.645 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/jul-to-slf4j-1.7.16.jar 2019-12-08T12:17:14.645 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/log4j-over-slf4j-1.7.16.jar 2019-12-08T12:17:14.645 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/slf4j-api-1.7.16.jar 2019-12-08T12:17:14.646 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/guava-jdk5-17.0.jar 2019-12-08T12:17:14.646 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/jsr305-2.0.1.jar 2019-12-08T12:17:14.646 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/fastutil-7.2.1-min.jar 2019-12-08T12:17:14.646 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/commons-lang-2.6.jar 2019-12-08T12:17:14.646 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/jcip-annotations-1.0.jar 2019-12-08T12:17:14.646 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/groovy-all-2.4.12.jar 2019-12-08T12:17:14.646 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/ant-1.9.9.jar 2019-12-08T12:17:14.646 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/javax.inject-1.jar 2019-12-08T12:17:14.647 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/commons-collections-3.2.2.jar 2019-12-08T12:17:14.647 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-0.14.jar 2019-12-08T12:17:14.647 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/commons-compress-1.14.jar 2019-12-08T12:17:14.647 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/xml-apis-1.4.01.jar 2019-12-08T12:17:14.647 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/jansi-1.14.jar 2019-12-08T12:17:14.647 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/ant-launcher-1.9.9.jar 2019-12-08T12:17:14.647 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-freebsd-amd64-libcpp-0.14.jar 2019-12-08T12:17:14.648 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-freebsd-amd64-libstdcpp-0.14.jar 2019-12-08T12:17:14.648 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-freebsd-i386-libcpp-0.14.jar 2019-12-08T12:17:14.648 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-freebsd-i386-libstdcpp-0.14.jar 2019-12-08T12:17:14.648 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-linux-amd64-0.14.jar 2019-12-08T12:17:14.648 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-linux-i386-0.14.jar 2019-12-08T12:17:14.648 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-osx-amd64-0.14.jar 2019-12-08T12:17:14.648 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-osx-i386-0.14.jar 2019-12-08T12:17:14.649 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-windows-amd64-0.14.jar 2019-12-08T12:17:14.649 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-windows-i386-0.14.jar 2019-12-08T12:17:14.649 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-linux-amd64-ncurses5-0.14.jar 2019-12-08T12:17:14.649 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-linux-amd64-ncurses6-0.14.jar 2019-12-08T12:17:14.649 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-linux-i386-ncurses5-0.14.jar 2019-12-08T12:17:14.649 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/native-platform-linux-i386-ncurses6-0.14.jar 2019-12-08T12:17:14.649 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/minlog-1.2.jar 2019-12-08T12:17:14.650 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/objenesis-1.2.jar 2019-12-08T12:17:14.650 INFO:teuthology.orchestra.run.smithi079.stdout: creating: /opt/gradle/gradle-4.7/lib/plugins/ 2019-12-08T12:17:14.650 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-announce-4.7.jar 2019-12-08T12:17:14.650 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-antlr-4.7.jar 2019-12-08T12:17:14.650 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-code-quality-4.7.jar 2019-12-08T12:17:14.650 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-osgi-4.7.jar 2019-12-08T12:17:14.650 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-signing-4.7.jar 2019-12-08T12:17:14.650 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-ide-native-4.7.jar 2019-12-08T12:17:14.651 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-testing-native-4.7.jar 2019-12-08T12:17:14.651 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-language-native-4.7.jar 2019-12-08T12:17:14.651 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-plugin-development-4.7.jar 2019-12-08T12:17:14.651 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-maven-4.7.jar 2019-12-08T12:17:14.651 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-ide-play-4.7.jar 2019-12-08T12:17:14.651 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-ide-4.7.jar 2019-12-08T12:17:14.651 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-scala-4.7.jar 2019-12-08T12:17:14.652 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-build-comparison-4.7.jar 2019-12-08T12:17:14.652 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-ear-4.7.jar 2019-12-08T12:17:14.652 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-platform-play-4.7.jar 2019-12-08T12:17:14.652 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-javascript-4.7.jar 2019-12-08T12:17:14.652 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-ivy-4.7.jar 2019-12-08T12:17:14.652 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-jacoco-4.7.jar 2019-12-08T12:17:14.652 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-build-init-4.7.jar 2019-12-08T12:17:14.653 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-plugins-4.7.jar 2019-12-08T12:17:14.653 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-tooling-api-builders-4.7.jar 2019-12-08T12:17:14.653 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-test-kit-4.7.jar 2019-12-08T12:17:14.653 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-composite-builds-4.7.jar 2019-12-08T12:17:14.653 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-language-groovy-4.7.jar 2019-12-08T12:17:14.653 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-language-scala-4.7.jar 2019-12-08T12:17:14.653 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-testing-junit-platform-4.7.jar 2019-12-08T12:17:14.654 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-testing-jvm-4.7.jar 2019-12-08T12:17:14.654 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-language-java-4.7.jar 2019-12-08T12:17:14.654 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-language-jvm-4.7.jar 2019-12-08T12:17:14.654 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-platform-jvm-4.7.jar 2019-12-08T12:17:14.654 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-platform-native-4.7.jar 2019-12-08T12:17:14.654 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-diagnostics-4.7.jar 2019-12-08T12:17:14.654 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-testing-base-4.7.jar 2019-12-08T12:17:14.655 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-reporting-4.7.jar 2019-12-08T12:17:14.655 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-publish-4.7.jar 2019-12-08T12:17:14.655 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-platform-base-4.7.jar 2019-12-08T12:17:14.655 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-plugin-use-4.7.jar 2019-12-08T12:17:14.655 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-resources-s3-4.7.jar 2019-12-08T12:17:14.656 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-resources-gcs-4.7.jar 2019-12-08T12:17:14.656 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-build-cache-http-4.7.jar 2019-12-08T12:17:14.656 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-dependency-management-4.7.jar 2019-12-08T12:17:14.656 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-resources-http-4.7.jar 2019-12-08T12:17:14.656 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-resources-sftp-4.7.jar 2019-12-08T12:17:14.656 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-workers-4.7.jar 2019-12-08T12:17:14.657 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gradle-version-control-4.7.jar 2019-12-08T12:17:14.657 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/aws-java-sdk-s3-1.11.267.jar 2019-12-08T12:17:14.657 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/aws-java-sdk-kms-1.11.267.jar 2019-12-08T12:17:14.657 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/aws-java-sdk-core-1.11.267.jar 2019-12-08T12:17:14.657 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/org.eclipse.jgit-4.5.3.201708160445-r.jar 2019-12-08T12:17:14.657 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/wagon-http-2.4.jar 2019-12-08T12:17:14.657 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/wagon-http-shared4-2.4.jar 2019-12-08T12:17:14.658 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/google-api-services-storage-v1-rev116-1.23.0.jar 2019-12-08T12:17:14.658 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/google-api-client-1.23.0.jar 2019-12-08T12:17:14.658 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/google-oauth-client-1.23.0.jar 2019-12-08T12:17:14.658 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/google-http-client-jackson2-1.23.0.jar 2019-12-08T12:17:14.658 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/google-http-client-1.23.0.jar 2019-12-08T12:17:14.658 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/httpclient-4.5.5.jar 2019-12-08T12:17:14.658 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/commons-codec-1.10.jar 2019-12-08T12:17:14.658 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/plexus-container-default-1.5.5.jar 2019-12-08T12:17:14.659 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/xbean-reflect-3.4.jar 2019-12-08T12:17:14.659 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/asm-util-6.1.1.jar 2019-12-08T12:17:14.659 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/jatl-0.2.2.jar 2019-12-08T12:17:14.659 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/commons-cli-1.2.jar 2019-12-08T12:17:14.659 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/biz.aQute.bndlib-3.4.0.jar 2019-12-08T12:17:14.659 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/ivy-2.2.0.jar 2019-12-08T12:17:14.659 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-compat-3.0.4.jar 2019-12-08T12:17:14.660 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-core-3.0.4.jar 2019-12-08T12:17:14.660 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/pmaven-common-0.8-20100325.jar 2019-12-08T12:17:14.660 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/pmaven-groovy-0.8-20100325.jar 2019-12-08T12:17:14.660 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/wagon-file-2.4.jar 2019-12-08T12:17:14.660 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/aether-connector-wagon-1.13.1.jar 2019-12-08T12:17:14.660 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/bcpg-jdk15on-1.58.jar 2019-12-08T12:17:14.660 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/rhino-1.7R3.jar 2019-12-08T12:17:14.661 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/gson-2.7.jar 2019-12-08T12:17:14.661 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/simple-4.1.21.jar 2019-12-08T12:17:14.661 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-plugin-api-3.0.4.jar 2019-12-08T12:17:14.661 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/testng-6.3.1.jar 2019-12-08T12:17:14.661 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/snakeyaml-1.6.jar 2019-12-08T12:17:14.661 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/dd-plist-1.20.jar 2019-12-08T12:17:14.661 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/junit-4.12.jar 2019-12-08T12:17:14.662 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/bsh-2.0b6.jar 2019-12-08T12:17:14.662 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/junit-platform-launcher-1.0.3.jar 2019-12-08T12:17:14.662 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/jcifs-1.3.17.jar 2019-12-08T12:17:14.662 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/nekohtml-1.9.20.jar 2019-12-08T12:17:14.662 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/xercesImpl-2.11.0.jar 2019-12-08T12:17:14.662 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/jsch-0.1.54.jar 2019-12-08T12:17:14.662 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/jmespath-java-1.11.267.jar 2019-12-08T12:17:14.662 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/jackson-databind-2.8.11.jar 2019-12-08T12:17:14.663 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/jackson-core-2.8.11.jar 2019-12-08T12:17:14.663 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/jackson-annotations-2.8.11.jar 2019-12-08T12:17:14.663 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/joda-time-2.8.2.jar 2019-12-08T12:17:14.663 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/bcprov-jdk15on-1.58.jar 2019-12-08T12:17:14.663 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-aether-provider-3.0.4.jar 2019-12-08T12:17:14.663 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/aether-impl-1.13.1.jar 2019-12-08T12:17:14.663 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/aether-spi-1.13.1.jar 2019-12-08T12:17:14.664 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/aether-util-1.13.1.jar 2019-12-08T12:17:14.664 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/aether-api-1.13.1.jar 2019-12-08T12:17:14.664 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/wagon-provider-api-2.4.jar 2019-12-08T12:17:14.664 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/plexus-classworlds-2.4.jar 2019-12-08T12:17:14.664 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-model-builder-3.0.4.jar 2019-12-08T12:17:14.664 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-model-3.0.4.jar 2019-12-08T12:17:14.664 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-settings-builder-3.0.4.jar 2019-12-08T12:17:14.665 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-artifact-3.0.4.jar 2019-12-08T12:17:14.665 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-settings-3.0.4.jar 2019-12-08T12:17:14.665 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/plexus-sec-dispatcher-1.3.jar 2019-12-08T12:17:14.665 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/maven-repository-metadata-3.0.4.jar 2019-12-08T12:17:14.665 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/plexus-utils-3.0.8.jar 2019-12-08T12:17:14.665 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/ion-java-1.0.2.jar 2019-12-08T12:17:14.665 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/httpcore-4.4.9.jar 2019-12-08T12:17:14.666 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/hamcrest-core-1.3.jar 2019-12-08T12:17:14.666 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/junit-platform-engine-1.0.3.jar 2019-12-08T12:17:14.666 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/junit-platform-commons-1.0.3.jar 2019-12-08T12:17:14.666 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/apiguardian-api-1.0.0.jar 2019-12-08T12:17:14.666 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/jcommander-1.47.jar 2019-12-08T12:17:14.666 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/plexus-interpolation-1.14.jar 2019-12-08T12:17:14.666 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/plexus-component-annotations-1.5.5.jar 2019-12-08T12:17:14.666 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/opentest4j-1.0.0.jar 2019-12-08T12:17:14.667 INFO:teuthology.orchestra.run.smithi079.stdout: inflating: /opt/gradle/gradle-4.7/lib/plugins/plexus-cipher-1.7.jar 2019-12-08T12:17:14.667 INFO:teuthology.orchestra.run.smithi079.stdout:export PATH=/opt/gradle/gradle-4.7/bin:/usr/lib64/qt-3.3/bin:/usr/local/bin:/usr/bin 2019-12-08T12:17:15.172 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:17:15.173 INFO:teuthology.orchestra.run.smithi079.stdout:Welcome to Gradle 4.7! 2019-12-08T12:17:15.173 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:17:15.173 INFO:teuthology.orchestra.run.smithi079.stdout:Here are the highlights of this release: 2019-12-08T12:17:15.173 INFO:teuthology.orchestra.run.smithi079.stdout: - Incremental annotation processing 2019-12-08T12:17:15.173 INFO:teuthology.orchestra.run.smithi079.stdout: - JDK 10 support 2019-12-08T12:17:15.174 INFO:teuthology.orchestra.run.smithi079.stdout: - Grouped non-interactive console logs 2019-12-08T12:17:15.174 INFO:teuthology.orchestra.run.smithi079.stdout: - Failed tests are re-run first for quicker feedback 2019-12-08T12:17:15.174 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:17:15.174 INFO:teuthology.orchestra.run.smithi079.stdout:For more details see https://docs.gradle.org/4.7/release-notes.html 2019-12-08T12:17:15.174 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:17:15.439 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:17:15.440 INFO:teuthology.orchestra.run.smithi079.stdout:------------------------------------------------------------ 2019-12-08T12:17:15.440 INFO:teuthology.orchestra.run.smithi079.stdout:Gradle 4.7 2019-12-08T12:17:15.440 INFO:teuthology.orchestra.run.smithi079.stdout:------------------------------------------------------------ 2019-12-08T12:17:15.440 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:17:15.440 INFO:teuthology.orchestra.run.smithi079.stdout:Build time: 2018-04-18 09:09:12 UTC 2019-12-08T12:17:15.440 INFO:teuthology.orchestra.run.smithi079.stdout:Revision: b9a962bf70638332300e7f810689cb2febbd4a6c 2019-12-08T12:17:15.441 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:17:15.441 INFO:teuthology.orchestra.run.smithi079.stdout:Groovy: 2.4.12 2019-12-08T12:17:15.441 INFO:teuthology.orchestra.run.smithi079.stdout:Ant: Apache Ant(TM) version 1.9.9 compiled on February 2 2017 2019-12-08T12:17:15.441 INFO:teuthology.orchestra.run.smithi079.stdout:JVM: 1.8.0_232 (Oracle Corporation 25.232-b09) 2019-12-08T12:17:15.441 INFO:teuthology.orchestra.run.smithi079.stdout:OS: Linux 3.10.0-1062.9.1.el7.x86_64 amd64 2019-12-08T12:17:15.441 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:17:15.446 DEBUG:tasks.s3tests_java:S3 Tests Java: BEGIN 2019-12-08T12:17:15.446 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1'] 2019-12-08T12:17:15.446 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi013.front.sepia.ceph.com 2019-12-08T12:17:15.446 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2019-12-08T12:17:15.447 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi079.front.sepia.ceph.com 2019-12-08T12:17:15.447 INFO:tasks.s3tests_java:S3 Tests Java: Creating S3 users... 2019-12-08T12:17:15.864 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf is {'bucket_prefix': 'test-', 's3main': {'access_key': None, 's3dir': 'folder', 'endpoint': None, 'display_name': None, 'region': 'mexico', 'port': None, 'access_secret': None, 'SSE': 'AES256', 'is_secure': None, 'email': None, 'dir': '../data'}} 2019-12-08T12:17:15.865 DEBUG:tasks.s3tests_java:S3 Tests Java: Creating user tester.client.0 2019-12-08T12:17:15.865 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf[s3main] is {'access_key': 'FVNKJSHJVKHBHYFWLLXU', 's3dir': 'folder', 'endpoint': 'smithi079.front.sepia.ceph.com:80', 'display_name': 'Ms. tester.client.0', 'user_id': 'tester.client.0', 'region': 'mexico', 'port': 80, 'access_secret': 'ttt3/vN74Ggtuyz7w4m5BreJAE2s5gDR/fFmWhIyL9zUkhKx2E7N7g==', 'host': 'smithi079.front.sepia.ceph.com', 'SSE': 'AES256', 'is_secure': False, 'email': 'tester.client.0_test@test.test', 'dir': '../data'} 2019-12-08T12:17:15.865 DEBUG:tasks.s3tests_java:S3 Tests Java: Setion, User = s3main, tester.client.0 2019-12-08T12:17:15.865 INFO:tasks.s3tests_java:['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '-n', 'client.0', 'user', 'create', '--uid', 'tester.client.0', '--display-name', 'Ms. tester.client.0', '--access-key', 'FVNKJSHJVKHBHYFWLLXU', '--secret', 'ttt3/vN74Ggtuyz7w4m5BreJAE2s5gDR/fFmWhIyL9zUkhKx2E7N7g==', '--email', 'tester.client.0_test@test.test', '--cluster', 'ceph'] 2019-12-08T12:17:15.866 INFO:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid tester.client.0 --display-name 'Ms. tester.client.0' --access-key FVNKJSHJVKHBHYFWLLXU --secret ttt3/vN74Ggtuyz7w4m5BreJAE2s5gDR/fFmWhIyL9zUkhKx2E7N7g== --email tester.client.0_test@test.test --cluster ceph 2019-12-08T12:17:16.018 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:15.952+0000 7fc213d27ec0 20 rados->read ofs=0 len=0 2019-12-08T12:17:16.056 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:15.990+0000 7fc213d27ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:17:16.056 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:15.990+0000 7fc213d27ec0 20 rados->read ofs=0 len=0 2019-12-08T12:17:16.067 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:16.001+0000 7fc213d27ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:17:16.067 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:16.001+0000 7fc213d27ec0 20 rados->read ofs=0 len=0 2019-12-08T12:17:16.074 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:16.008+0000 7fc213d27ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:17:16.074 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:16.008+0000 7fc213d27ec0 20 rados->read ofs=0 len=0 2019-12-08T12:17:16.097 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:16.032+0000 7fc213d27ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:17:16.333 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:16.267+0000 7fc213d27ec0 20 RGWRados::pool_iterate: got zonegroup_info.fee0148b-7ae2-4cf0-a79e-86045a29cb7c 2019-12-08T12:17:16.334 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:16.267+0000 7fc213d27ec0 20 RGWRados::pool_iterate: got zone_info.f8ab349b-4577-410d-b524-4ecaf50bb1bd 2019-12-08T12:17:16.334 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:16.267+0000 7fc213d27ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-08T12:17:16.334 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:16.267+0000 7fc213d27ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-08T12:17:16.334 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:16.267+0000 7fc213d27ec0 20 rados->read ofs=0 len=0 2019-12-08T12:17:16.353 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:16.287+0000 7fc213d27ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:17:16.353 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:16.287+0000 7fc213d27ec0 20 rados->read ofs=0 len=0 2019-12-08T12:17:16.372 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:16.306+0000 7fc213d27ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-08T12:17:16.372 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:16.306+0000 7fc213d27ec0 20 rados->read ofs=0 len=0 2019-12-08T12:17:16.390 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:16.322+0000 7fc213d27ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:17:16.390 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:16.322+0000 7fc213d27ec0 20 rados->read ofs=0 len=0 2019-12-08T12:17:16.406 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:16.339+0000 7fc213d27ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-08T12:17:16.406 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:16.339+0000 7fc213d27ec0 20 rados->read ofs=0 len=0 2019-12-08T12:17:16.415 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:16.349+0000 7fc213d27ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:17:16.415 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:16.349+0000 7fc213d27ec0 10 cannot find current period zonegroup using local zonegroup 2019-12-08T12:17:16.415 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:16.349+0000 7fc213d27ec0 20 rados->read ofs=0 len=0 2019-12-08T12:17:16.424 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:16.358+0000 7fc213d27ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:17:16.425 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:16.358+0000 7fc213d27ec0 20 rados->read ofs=0 len=0 2019-12-08T12:17:16.442 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:16.376+0000 7fc213d27ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:17:16.443 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:16.376+0000 7fc213d27ec0 20 rados->read ofs=0 len=0 2019-12-08T12:17:16.460 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:16.394+0000 7fc213d27ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-08T12:17:16.460 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:16.394+0000 7fc213d27ec0 20 zonegroup default 2019-12-08T12:17:16.460 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:16.394+0000 7fc213d27ec0 20 rados->read ofs=0 len=0 2019-12-08T12:17:16.472 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:16.406+0000 7fc213d27ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:17:16.473 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:16.407+0000 7fc213d27ec0 10 Cannot find current period zone using local zone 2019-12-08T12:17:16.473 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:16.407+0000 7fc213d27ec0 20 rados->read ofs=0 len=0 2019-12-08T12:17:16.482 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:16.417+0000 7fc213d27ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:17:16.483 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:16.417+0000 7fc213d27ec0 20 rados->read ofs=0 len=0 2019-12-08T12:17:16.497 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:16.431+0000 7fc213d27ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:17:16.498 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:16.431+0000 7fc213d27ec0 20 rados->read ofs=0 len=0 2019-12-08T12:17:16.518 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:16.452+0000 7fc213d27ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-08T12:17:16.518 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:16.452+0000 7fc213d27ec0 20 zone default found 2019-12-08T12:17:16.518 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:16.452+0000 7fc213d27ec0 20 started sync module instance, tier type = 2019-12-08T12:17:16.518 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:16.452+0000 7fc213d27ec0 20 started zone id=f8ab349b-4577-410d-b524-4ecaf50bb1bd (name=default) with tier type = 2019-12-08T12:17:16.946 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:16.880+0000 7fc213d27ec0 20 add_watcher() i=0 2019-12-08T12:17:16.947 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:16.880+0000 7fc213d27ec0 20 add_watcher() i=1 2019-12-08T12:17:16.947 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:16.880+0000 7fc213d27ec0 20 add_watcher() i=2 2019-12-08T12:17:16.947 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:16.880+0000 7fc213d27ec0 20 add_watcher() i=3 2019-12-08T12:17:16.947 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:16.880+0000 7fc213d27ec0 20 add_watcher() i=4 2019-12-08T12:17:16.947 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:16.880+0000 7fc213d27ec0 20 add_watcher() i=5 2019-12-08T12:17:16.949 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:16.882+0000 7fc213d27ec0 20 add_watcher() i=6 2019-12-08T12:17:16.976 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:16.910+0000 7fc213d27ec0 20 add_watcher() i=7 2019-12-08T12:17:16.976 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:16.910+0000 7fc213d27ec0 2 all 8 watchers are set, enabling cache 2019-12-08T12:17:16.977 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:16.910+0000 7fc1d17e2700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-08T12:17:16.981 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:16.916+0000 7fc200f51700 0 -- 172.21.15.79:0/890391785 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55d8fc0fbed0 msgr2=0x55d8fc0fe330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-12-08T12:17:17.189 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:17.119+0000 7fc200f51700 0 --2- 172.21.15.79:0/890391785 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55d8fc0fbed0 0x55d8fc0fe330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2019-12-08T12:17:17.238 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:17.172+0000 7fc200f51700 0 -- 172.21.15.79:0/2255284783 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55d8fc102360 msgr2=0x55d8fc104780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-12-08T12:17:18.863 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:18.796+0000 7fc1437fe700 20 reqs_thread_entry: start 2019-12-08T12:17:18.863 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:18.797+0000 7fc1417fa700 20 reqs_thread_entry: start 2019-12-08T12:17:18.863 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:18.797+0000 7fc213d27ec0 20 init_complete bucket index max shards: 0 2019-12-08T12:17:18.863 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:18.797+0000 7fc12f7fe700 20 reqs_thread_entry: start 2019-12-08T12:17:18.864 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:18.797+0000 7fc213d27ec0 20 get_system_obj_state: rctx=0x7ffc5c01a068 obj=default.rgw.meta:users.uid:tester.client.0 state=0x55d8fc17a710 s->prefetch_data=0 2019-12-08T12:17:18.864 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:18.797+0000 7fc213d27ec0 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2019-12-08T12:17:18.874 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:18.808+0000 7fc213d27ec0 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x0 2019-12-08T12:17:18.874 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:18.808+0000 7fc213d27ec0 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2019-12-08T12:17:18.874 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:18.808+0000 7fc213d27ec0 20 get_system_obj_state: rctx=0x7ffc5c01a078 obj=default.rgw.meta:users.email:tester.client.0_test@test.test state=0x55d8fc17c4a0 s->prefetch_data=0 2019-12-08T12:17:18.874 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:18.808+0000 7fc213d27ec0 10 cache get: name=default.rgw.meta+users.email+tester.client.0_test@test.test : miss 2019-12-08T12:17:18.892 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:18.826+0000 7fc213d27ec0 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x0 2019-12-08T12:17:18.892 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:18.826+0000 7fc213d27ec0 10 adding default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2019-12-08T12:17:18.893 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:18.826+0000 7fc213d27ec0 20 get_system_obj_state: rctx=0x7ffc5c01a078 obj=default.rgw.meta:users.keys:FVNKJSHJVKHBHYFWLLXU state=0x55d8fc17c4a0 s->prefetch_data=0 2019-12-08T12:17:18.893 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:18.826+0000 7fc213d27ec0 10 cache get: name=default.rgw.meta+users.keys+FVNKJSHJVKHBHYFWLLXU : miss 2019-12-08T12:17:18.914 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:18.848+0000 7fc213d27ec0 10 cache put: name=default.rgw.meta+users.keys+FVNKJSHJVKHBHYFWLLXU info.flags=0x0 2019-12-08T12:17:18.914 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:18.848+0000 7fc213d27ec0 10 adding default.rgw.meta+users.keys+FVNKJSHJVKHBHYFWLLXU to cache LRU end 2019-12-08T12:17:18.914 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:18.848+0000 7fc213d27ec0 20 get_system_obj_state: rctx=0x7ffc5c019c88 obj=default.rgw.meta:users.keys:FVNKJSHJVKHBHYFWLLXU state=0x55d8fc17c4a0 s->prefetch_data=0 2019-12-08T12:17:18.914 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:18.848+0000 7fc213d27ec0 10 cache get: name=default.rgw.meta+users.keys+FVNKJSHJVKHBHYFWLLXU : type miss (requested=0x6, cached=0x0) 2019-12-08T12:17:18.921 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:18.855+0000 7fc213d27ec0 10 cache put: name=default.rgw.meta+users.keys+FVNKJSHJVKHBHYFWLLXU info.flags=0x0 2019-12-08T12:17:18.922 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:18.855+0000 7fc213d27ec0 10 moving default.rgw.meta+users.keys+FVNKJSHJVKHBHYFWLLXU to cache LRU end 2019-12-08T12:17:18.922 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:18.855+0000 7fc213d27ec0 20 get_system_obj_state: rctx=0x7ffc5c019e08 obj=default.rgw.meta:users.keys:FVNKJSHJVKHBHYFWLLXU state=0x55d8fc17c4a0 s->prefetch_data=0 2019-12-08T12:17:18.922 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:18.855+0000 7fc213d27ec0 10 cache get: name=default.rgw.meta+users.keys+FVNKJSHJVKHBHYFWLLXU : type miss (requested=0x6, cached=0x0) 2019-12-08T12:17:18.928 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:18.862+0000 7fc213d27ec0 10 cache put: name=default.rgw.meta+users.keys+FVNKJSHJVKHBHYFWLLXU info.flags=0x0 2019-12-08T12:17:18.929 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:18.862+0000 7fc213d27ec0 10 moving default.rgw.meta+users.keys+FVNKJSHJVKHBHYFWLLXU to cache LRU end 2019-12-08T12:17:18.987 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:18.921+0000 7fc213d27ec0 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2019-12-08T12:17:18.987 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:18.921+0000 7fc213d27ec0 10 moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2019-12-08T12:17:18.988 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:18.921+0000 7fc213d27ec0 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=632 2019-12-08T12:17:19.003 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:18.936+0000 7fc1e67fc700 10 RGWWatcher::handle_notify() notify_id 571230650369 cookie 94390430121904 notifier 4469 bl.length()=632 2019-12-08T12:17:19.003 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:18.936+0000 7fc1e67fc700 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2019-12-08T12:17:19.003 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:18.936+0000 7fc1e67fc700 10 moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2019-12-08T12:17:19.193 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:19.126+0000 7fc213d27ec0 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2019-12-08T12:17:19.193 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:19.126+0000 7fc213d27ec0 10 moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2019-12-08T12:17:19.193 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:19.126+0000 7fc213d27ec0 10 distributing notification oid=default.rgw.control:notify.3 bl.length()=200 2019-12-08T12:17:19.206 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:19.140+0000 7fc1e67fc700 10 RGWWatcher::handle_notify() notify_id 571230650374 cookie 94390430113808 notifier 4469 bl.length()=200 2019-12-08T12:17:19.207 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:19.140+0000 7fc1e67fc700 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2019-12-08T12:17:19.207 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:19.140+0000 7fc1e67fc700 10 moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2019-12-08T12:17:19.383 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:19.317+0000 7fc213d27ec0 10 cache put: name=default.rgw.meta+users.keys+FVNKJSHJVKHBHYFWLLXU info.flags=0x7 2019-12-08T12:17:19.383 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:19.317+0000 7fc213d27ec0 10 moving default.rgw.meta+users.keys+FVNKJSHJVKHBHYFWLLXU to cache LRU end 2019-12-08T12:17:19.384 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:19.317+0000 7fc213d27ec0 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=189 2019-12-08T12:17:19.392 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:19.325+0000 7fc1e67fc700 10 RGWWatcher::handle_notify() notify_id 571230650370 cookie 94390430121904 notifier 4469 bl.length()=189 2019-12-08T12:17:19.392 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:19.325+0000 7fc1e67fc700 10 cache put: name=default.rgw.meta+users.keys+FVNKJSHJVKHBHYFWLLXU info.flags=0x7 2019-12-08T12:17:19.392 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:19.325+0000 7fc1e67fc700 10 moving default.rgw.meta+users.keys+FVNKJSHJVKHBHYFWLLXU to cache LRU end 2019-12-08T12:17:19.736 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2019-12-08T12:17:19.737 INFO:teuthology.orchestra.run.smithi079.stdout: "user_id": "tester.client.0", 2019-12-08T12:17:19.737 INFO:teuthology.orchestra.run.smithi079.stdout: "display_name": "Ms. tester.client.0", 2019-12-08T12:17:19.737 INFO:teuthology.orchestra.run.smithi079.stdout: "email": "tester.client.0_test@test.test", 2019-12-08T12:17:19.737 INFO:teuthology.orchestra.run.smithi079.stdout: "suspended": 0, 2019-12-08T12:17:19.738 INFO:teuthology.orchestra.run.smithi079.stdout: "max_buckets": 1000, 2019-12-08T12:17:19.738 INFO:teuthology.orchestra.run.smithi079.stdout: "subusers": [], 2019-12-08T12:17:19.738 INFO:teuthology.orchestra.run.smithi079.stdout: "keys": [ 2019-12-08T12:17:19.738 INFO:teuthology.orchestra.run.smithi079.stdout: { 2019-12-08T12:17:19.738 INFO:teuthology.orchestra.run.smithi079.stdout: "user": "tester.client.0", 2019-12-08T12:17:19.738 INFO:teuthology.orchestra.run.smithi079.stdout: "access_key": "FVNKJSHJVKHBHYFWLLXU", 2019-12-08T12:17:19.738 INFO:teuthology.orchestra.run.smithi079.stdout: "secret_key": "ttt3/vN74Ggtuyz7w4m5BreJAE2s5gDR/fFmWhIyL9zUkhKx2E7N7g==" 2019-12-08T12:17:19.739 INFO:teuthology.orchestra.run.smithi079.stdout: } 2019-12-08T12:17:19.739 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2019-12-08T12:17:19.739 INFO:teuthology.orchestra.run.smithi079.stdout: "swift_keys": [], 2019-12-08T12:17:19.739 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": [], 2019-12-08T12:17:19.739 INFO:teuthology.orchestra.run.smithi079.stdout: "op_mask": "read, write, delete", 2019-12-08T12:17:19.739 INFO:teuthology.orchestra.run.smithi079.stdout: "default_placement": "", 2019-12-08T12:17:19.739 INFO:teuthology.orchestra.run.smithi079.stdout: "default_storage_class": "", 2019-12-08T12:17:19.740 INFO:teuthology.orchestra.run.smithi079.stdout: "placement_tags": [], 2019-12-08T12:17:19.740 INFO:teuthology.orchestra.run.smithi079.stdout: "bucket_quota": { 2019-12-08T12:17:19.740 INFO:teuthology.orchestra.run.smithi079.stdout: "enabled": false, 2019-12-08T12:17:19.740 INFO:teuthology.orchestra.run.smithi079.stdout: "check_on_raw": false, 2019-12-08T12:17:19.740 INFO:teuthology.orchestra.run.smithi079.stdout: "max_size": -1, 2019-12-08T12:17:19.741 INFO:teuthology.orchestra.run.smithi079.stdout: "max_size_kb": 0, 2019-12-08T12:17:19.741 INFO:teuthology.orchestra.run.smithi079.stdout: "max_objects": -1 2019-12-08T12:17:19.741 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2019-12-08T12:17:19.741 INFO:teuthology.orchestra.run.smithi079.stdout: "user_quota": { 2019-12-08T12:17:19.741 INFO:teuthology.orchestra.run.smithi079.stdout: "enabled": false, 2019-12-08T12:17:19.741 INFO:teuthology.orchestra.run.smithi079.stdout: "check_on_raw": false, 2019-12-08T12:17:19.742 INFO:teuthology.orchestra.run.smithi079.stdout: "max_size": -1, 2019-12-08T12:17:19.742 INFO:teuthology.orchestra.run.smithi079.stdout: "max_size_kb": 0, 2019-12-08T12:17:19.742 INFO:teuthology.orchestra.run.smithi079.stdout: "max_objects": -1 2019-12-08T12:17:19.742 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2019-12-08T12:17:19.742 INFO:teuthology.orchestra.run.smithi079.stdout: "temp_url_keys": [], 2019-12-08T12:17:19.742 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "rgw", 2019-12-08T12:17:19.742 INFO:teuthology.orchestra.run.smithi079.stdout: "mfa_ids": [] 2019-12-08T12:17:19.743 INFO:teuthology.orchestra.run.smithi079.stdout:} 2019-12-08T12:17:19.743 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:17:19.775 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:19.708+0000 7fc213d27ec0 20 remove_watcher() i=0 2019-12-08T12:17:19.775 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:19.708+0000 7fc213d27ec0 2 removed watcher, disabling cache 2019-12-08T12:17:19.837 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:19.771+0000 7fc213d27ec0 20 remove_watcher() i=1 2019-12-08T12:17:19.902 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:19.836+0000 7fc213d27ec0 20 remove_watcher() i=2 2019-12-08T12:17:19.970 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:19.904+0000 7fc213d27ec0 20 remove_watcher() i=3 2019-12-08T12:17:20.064 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:19.997+0000 7fc213d27ec0 20 remove_watcher() i=4 2019-12-08T12:17:20.128 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:20.062+0000 7fc213d27ec0 20 remove_watcher() i=5 2019-12-08T12:17:20.179 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:20.113+0000 7fc213d27ec0 20 remove_watcher() i=6 2019-12-08T12:17:20.219 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:20.153+0000 7fc213d27ec0 20 remove_watcher() i=7 2019-12-08T12:17:20.230 INFO:teuthology.orchestra.run.smithi079:> cat > /home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf 2019-12-08T12:17:20.287 INFO:tasks.s3tests_java:S3 Tests Java: Running tests... 2019-12-08T12:17:20.288 INFO:teuthology.orchestra.run.smithi079:> cp /home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf /home/ubuntu/cephtest/s3-tests-java/config.properties 2019-12-08T12:17:20.387 INFO:teuthology.orchestra.run.smithi079:> radosgw-admin gc process --include-all 2019-12-08T12:17:20.510 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:20.444+0000 7f9530871ec0 20 rados->read ofs=0 len=0 2019-12-08T12:17:20.544 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:20.478+0000 7f9530871ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:17:20.545 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:20.478+0000 7f9530871ec0 20 rados->read ofs=0 len=0 2019-12-08T12:17:20.555 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:20.489+0000 7f9530871ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:17:20.555 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:20.489+0000 7f9530871ec0 20 rados->read ofs=0 len=0 2019-12-08T12:17:20.565 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:20.498+0000 7f9530871ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:17:20.565 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:20.498+0000 7f9530871ec0 20 rados->read ofs=0 len=0 2019-12-08T12:17:20.587 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:20.521+0000 7f9530871ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:17:20.805 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:20.739+0000 7f9530871ec0 20 RGWRados::pool_iterate: got zonegroup_info.fee0148b-7ae2-4cf0-a79e-86045a29cb7c 2019-12-08T12:17:20.805 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:20.739+0000 7f9530871ec0 20 RGWRados::pool_iterate: got zone_info.f8ab349b-4577-410d-b524-4ecaf50bb1bd 2019-12-08T12:17:20.806 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:20.739+0000 7f9530871ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-08T12:17:20.806 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:20.739+0000 7f9530871ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-08T12:17:20.806 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:20.739+0000 7f9530871ec0 20 rados->read ofs=0 len=0 2019-12-08T12:17:20.820 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:20.754+0000 7f9530871ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:17:20.820 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:20.754+0000 7f9530871ec0 20 rados->read ofs=0 len=0 2019-12-08T12:17:20.833 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:20.767+0000 7f9530871ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-08T12:17:20.834 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:20.767+0000 7f9530871ec0 20 rados->read ofs=0 len=0 2019-12-08T12:17:20.847 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:20.781+0000 7f9530871ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:17:20.847 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:20.781+0000 7f9530871ec0 20 rados->read ofs=0 len=0 2019-12-08T12:17:20.858 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:20.792+0000 7f9530871ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-08T12:17:20.858 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:20.792+0000 7f9530871ec0 20 rados->read ofs=0 len=0 2019-12-08T12:17:20.863 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:20.797+0000 7f9530871ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:17:20.863 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:20.797+0000 7f9530871ec0 10 cannot find current period zonegroup using local zonegroup 2019-12-08T12:17:20.863 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:20.797+0000 7f9530871ec0 20 rados->read ofs=0 len=0 2019-12-08T12:17:20.872 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:20.806+0000 7f9530871ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:17:20.872 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:20.806+0000 7f9530871ec0 20 rados->read ofs=0 len=0 2019-12-08T12:17:20.885 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:20.819+0000 7f9530871ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:17:20.885 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:20.819+0000 7f9530871ec0 20 rados->read ofs=0 len=0 2019-12-08T12:17:20.898 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:20.832+0000 7f9530871ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-08T12:17:20.899 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:20.832+0000 7f9530871ec0 20 zonegroup default 2019-12-08T12:17:20.899 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:20.832+0000 7f9530871ec0 20 rados->read ofs=0 len=0 2019-12-08T12:17:20.905 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:20.839+0000 7f9530871ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:17:20.906 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:20.839+0000 7f9530871ec0 10 Cannot find current period zone using local zone 2019-12-08T12:17:20.906 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:20.839+0000 7f9530871ec0 20 rados->read ofs=0 len=0 2019-12-08T12:17:20.912 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:20.846+0000 7f9530871ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:17:20.912 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:20.846+0000 7f9530871ec0 20 rados->read ofs=0 len=0 2019-12-08T12:17:20.924 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:20.858+0000 7f9530871ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:17:20.924 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:20.858+0000 7f9530871ec0 20 rados->read ofs=0 len=0 2019-12-08T12:17:20.939 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:20.873+0000 7f9530871ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-08T12:17:20.940 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:20.873+0000 7f9530871ec0 20 zone default found 2019-12-08T12:17:20.940 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:20.873+0000 7f9530871ec0 20 started sync module instance, tier type = 2019-12-08T12:17:20.940 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:20.873+0000 7f9530871ec0 20 started zone id=f8ab349b-4577-410d-b524-4ecaf50bb1bd (name=default) with tier type = 2019-12-08T12:17:21.331 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:21.264+0000 7f9530871ec0 20 add_watcher() i=0 2019-12-08T12:17:21.331 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:21.264+0000 7f9530871ec0 20 add_watcher() i=1 2019-12-08T12:17:21.332 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:21.264+0000 7f9530871ec0 20 add_watcher() i=2 2019-12-08T12:17:21.332 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:21.264+0000 7f9530871ec0 20 add_watcher() i=3 2019-12-08T12:17:21.332 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:21.264+0000 7f9530871ec0 20 add_watcher() i=4 2019-12-08T12:17:21.332 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:21.264+0000 7f9530871ec0 20 add_watcher() i=5 2019-12-08T12:17:21.333 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:21.264+0000 7f9530871ec0 20 add_watcher() i=6 2019-12-08T12:17:21.374 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:21.307+0000 7f9530871ec0 20 add_watcher() i=7 2019-12-08T12:17:21.374 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:21.307+0000 7f9530871ec0 2 all 8 watchers are set, enabling cache 2019-12-08T12:17:21.374 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:21.307+0000 7f94ee7dc700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-08T12:17:21.377 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:21.310+0000 7f951e29c700 0 -- 172.21.15.79:0/2258622853 >> v2:172.21.15.13:3300/0 conn(0x55fe75e18140 msgr2=0x55fe75e174d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-12-08T12:17:21.400 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:21.333+0000 7f951d29a700 0 -- 172.21.15.79:0/52609565 >> v2:172.21.15.79:3300/0 conn(0x55fe75e2a770 msgr2=0x55fe75e18b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-08T12:17:23.297 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:23.231+0000 7f9464ff9700 20 reqs_thread_entry: start 2019-12-08T12:17:23.298 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:23.231+0000 7f945e7fc700 20 reqs_thread_entry: start 2019-12-08T12:17:23.298 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:23.231+0000 7f9530871ec0 20 init_complete bucket index max shards: 0 2019-12-08T12:17:23.298 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:23.231+0000 7f945cff9700 20 reqs_thread_entry: start 2019-12-08T12:17:23.298 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:23.231+0000 7f9530871ec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-12-08T12:17:23.350 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:23.284+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:23.369 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:23.303+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:17:23.380 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:23.314+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:23.416 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:23.349+0000 7f9530871ec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-12-08T12:17:23.460 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:23.393+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:23.480 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:23.413+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:17:23.511 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:23.444+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-08T12:17:23.511 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:23.444+0000 7f9530871ec0 20 garbage collection: RGWGC::process iterating over entry tag='f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.233', time=2019-12-08T14:16:53.324688+0000, chain.objs.size()=5 2019-12-08T12:17:23.511 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:23.444+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.9__multipart_foo-LUKEWARM.2~0jMBe4FmMoKpYlVkOM2c3Dqnc6gAskn.1 2019-12-08T12:17:23.511 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:23.444+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.9__shadow_foo-LUKEWARM.2~0jMBe4FmMoKpYlVkOM2c3Dqnc6gAskn.1_1 2019-12-08T12:17:23.511 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:23.444+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.9__multipart_foo-LUKEWARM.2~0jMBe4FmMoKpYlVkOM2c3Dqnc6gAskn.2 2019-12-08T12:17:23.511 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:23.444+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.9__shadow_foo-LUKEWARM.2~0jMBe4FmMoKpYlVkOM2c3Dqnc6gAskn.2_1 2019-12-08T12:17:23.512 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:23.444+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.9__multipart_foo-LUKEWARM.2~0jMBe4FmMoKpYlVkOM2c3Dqnc6gAskn.3 2019-12-08T12:17:23.612 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:23.545+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-08T12:17:23.715 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:23.648+0000 7f9530871ec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-12-08T12:17:23.775 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:23.709+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:23.802 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:23.735+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:17:23.839 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:23.772+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-12-08T12:17:23.840 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:23.772+0000 7f9530871ec0 20 garbage collection: RGWGC::process iterating over entry tag='f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.55', time=2019-12-08T14:16:45.978802+0000, chain.objs.size()=4 2019-12-08T12:17:23.840 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:23.772+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.4__multipart_foo.2~sSNFC7obVjNFKJEXMuBa62GxO9-x8w7.1 2019-12-08T12:17:23.840 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:23.772+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.4__multipart_foo.2~sSNFC7obVjNFKJEXMuBa62GxO9-x8w7.2 2019-12-08T12:17:23.840 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:23.772+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.4__multipart_foo.2~sSNFC7obVjNFKJEXMuBa62GxO9-x8w7.3 2019-12-08T12:17:23.840 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:23.772+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.4__multipart_foo.2~sSNFC7obVjNFKJEXMuBa62GxO9-x8w7.4 2019-12-08T12:17:23.840 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:23.772+0000 7f9530871ec0 20 garbage collection: RGWGC::process iterating over entry tag='f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.245', time=2019-12-08T14:16:54.851099+0000, chain.objs.size()=5 2019-12-08T12:17:23.840 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:23.772+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.9__multipart_foo-STANDARD.2~cP0qIj401LARVW6Unk3_W178talsGQT.1 2019-12-08T12:17:23.841 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:23.772+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.9__shadow_foo-STANDARD.2~cP0qIj401LARVW6Unk3_W178talsGQT.1_1 2019-12-08T12:17:23.841 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:23.772+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.9__multipart_foo-STANDARD.2~cP0qIj401LARVW6Unk3_W178talsGQT.2 2019-12-08T12:17:23.841 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:23.772+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.9__shadow_foo-STANDARD.2~cP0qIj401LARVW6Unk3_W178talsGQT.2_1 2019-12-08T12:17:23.841 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:23.772+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.9__multipart_foo-STANDARD.2~cP0qIj401LARVW6Unk3_W178talsGQT.3 2019-12-08T12:17:24.087 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:24.020+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-08T12:17:24.199 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:24.132+0000 7f9530871ec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-12-08T12:17:24.233 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:24.166+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:24.268 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:24.202+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:17:24.299 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:24.231+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-08T12:17:24.300 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:24.231+0000 7f9530871ec0 20 garbage collection: RGWGC::process iterating over entry tag='_fciwpBm_fJiyIHtICdBXB6LpNyIFzOw', time=2019-12-08T14:16:50.931835+0000, chain.objs.size()=1 2019-12-08T12:17:24.300 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:24.231+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.7__shadow_.kHmwnQh61rhzzfsaRergIqROJ0gKDeg_0 2019-12-08T12:17:24.358 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:24.291+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-08T12:17:24.476 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:24.409+0000 7f9530871ec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-12-08T12:17:24.580 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:24.513+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:24.621 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:24.555+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:17:24.673 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:24.606+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-08T12:17:24.673 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:24.606+0000 7f9530871ec0 20 garbage collection: RGWGC::process iterating over entry tag='_QySozO70fBTEJZ8yb3OHWisU27clau8', time=2019-12-08T14:16:52.826154+0000, chain.objs.size()=3 2019-12-08T12:17:24.673 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:24.606+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.9__shadow_.mzJ7IJLb3nz-aJr9hQZnFLzNNeoDsOH_0 2019-12-08T12:17:24.673 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:24.606+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.9__shadow_.mzJ7IJLb3nz-aJr9hQZnFLzNNeoDsOH_1 2019-12-08T12:17:24.674 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:24.606+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.9__shadow_.mzJ7IJLb3nz-aJr9hQZnFLzNNeoDsOH_2 2019-12-08T12:17:24.738 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:24.671+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-08T12:17:24.838 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:24.771+0000 7f9530871ec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-12-08T12:17:24.888 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:24.821+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:24.910 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:24.843+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:17:24.947 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:24.880+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-12-08T12:17:24.947 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:24.880+0000 7f9530871ec0 20 garbage collection: RGWGC::process iterating over entry tag='f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.108', time=2019-12-08T14:16:48.913026+0000, chain.objs.size()=2 2019-12-08T12:17:24.947 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:24.880+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.7__shadow_.Zr54HxdQZRmB0XN1fHNm_RarvLeoaq9_0 2019-12-08T12:17:24.947 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:24.880+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.7__shadow_.Zr54HxdQZRmB0XN1fHNm_RarvLeoaq9_1 2019-12-08T12:17:24.947 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:24.880+0000 7f9530871ec0 20 garbage collection: RGWGC::process iterating over entry tag='_wE5xn43oadRIh4EXe9n8IUF4_KHFgjo', time=2019-12-08T14:16:49.892753+0000, chain.objs.size()=2 2019-12-08T12:17:24.947 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:24.880+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.7__shadow_.db_5d7BmSC-3n6dTDbjUjIeTsYXj_U2_0 2019-12-08T12:17:24.948 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:24.880+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.7__shadow_.db_5d7BmSC-3n6dTDbjUjIeTsYXj_U2_1 2019-12-08T12:17:25.017 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:24.950+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-08T12:17:25.125 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:25.058+0000 7f9530871ec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-12-08T12:17:25.201 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:25.134+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:25.225 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:25.158+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:17:25.270 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:25.204+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:25.329 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:25.262+0000 7f9530871ec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-12-08T12:17:25.372 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:25.305+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:25.389 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:25.322+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:17:25.403 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:25.336+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-12-08T12:17:25.404 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:25.336+0000 7f9530871ec0 20 garbage collection: RGWGC::process iterating over entry tag='_sPiS_1330ZyetB82Xm4ZuC_HBLwYeNV', time=2019-12-08T14:16:50.401509+0000, chain.objs.size()=1 2019-12-08T12:17:25.404 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:25.336+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.7__shadow_.kjNBa6gNABYpL5pcUZqPaxVv0NMF7s6_1 2019-12-08T12:17:25.404 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:25.336+0000 7f9530871ec0 20 garbage collection: RGWGC::process iterating over entry tag='_PlVQEH9yKkfxagizazK4xgaYeWswPGA', time=2019-12-08T14:16:53.493500+0000, chain.objs.size()=3 2019-12-08T12:17:25.404 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:25.337+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.9__shadow_.4NP3QwCcZ0bQjVpCoIU0ETwUYo_dSDO_0 2019-12-08T12:17:25.404 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:25.337+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.9__shadow_.4NP3QwCcZ0bQjVpCoIU0ETwUYo_dSDO_1 2019-12-08T12:17:25.404 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:25.337+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.9__shadow_.4NP3QwCcZ0bQjVpCoIU0ETwUYo_dSDO_2 2019-12-08T12:17:25.503 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:25.431+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-08T12:17:25.575 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:25.509+0000 7f9530871ec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-12-08T12:17:25.622 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:25.556+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:25.645 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:25.577+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:17:25.654 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:25.586+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:25.691 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:25.623+0000 7f9530871ec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-12-08T12:17:25.736 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:25.668+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:25.754 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:25.687+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:17:25.763 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:25.696+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:25.798 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:25.730+0000 7f9530871ec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-12-08T12:17:25.856 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:25.788+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:25.878 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:25.810+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:17:25.892 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:25.825+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-08T12:17:25.893 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:25.825+0000 7f9530871ec0 20 garbage collection: RGWGC::process iterating over entry tag='f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.85', time=2019-12-08T14:16:57.819143+0000, chain.objs.size()=3 2019-12-08T12:17:25.893 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:25.825+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.6__shadow_.cjNCQ5oG6vHai1aU1XM2l-DrudXfnnH_0 2019-12-08T12:17:25.893 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:25.825+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.6__shadow_.cjNCQ5oG6vHai1aU1XM2l-DrudXfnnH_1 2019-12-08T12:17:25.893 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:25.825+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.6__shadow_.cjNCQ5oG6vHai1aU1XM2l-DrudXfnnH_2 2019-12-08T12:17:25.975 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:25.907+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-08T12:17:26.065 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:25.997+0000 7f9530871ec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-12-08T12:17:26.116 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:26.048+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:26.143 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:26.076+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:17:26.195 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:26.128+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-12-08T12:17:26.195 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:26.128+0000 7f9530871ec0 20 garbage collection: RGWGC::process iterating over entry tag='_LsKu0t6JputAICfPkVzVL1EOenCfs8b', time=2019-12-08T14:16:49.484614+0000, chain.objs.size()=1 2019-12-08T12:17:26.195 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:26.128+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.7__shadow_.6mx-8d7_cwT73IHZTAntguwbnum-4Zt_1 2019-12-08T12:17:26.196 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:26.128+0000 7f9530871ec0 20 garbage collection: RGWGC::process iterating over entry tag='f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.224', time=2019-12-08T14:16:52.386760+0000, chain.objs.size()=5 2019-12-08T12:17:26.196 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:26.128+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.9__multipart_foo-FROZEN.2~BLmTxpapviv4KhOSPnOP6ahyUfAKhbn.1 2019-12-08T12:17:26.196 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:26.128+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.9__shadow_foo-FROZEN.2~BLmTxpapviv4KhOSPnOP6ahyUfAKhbn.1_1 2019-12-08T12:17:26.196 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:26.128+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.9__multipart_foo-FROZEN.2~BLmTxpapviv4KhOSPnOP6ahyUfAKhbn.2 2019-12-08T12:17:26.196 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:26.128+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.9__shadow_foo-FROZEN.2~BLmTxpapviv4KhOSPnOP6ahyUfAKhbn.2_1 2019-12-08T12:17:26.196 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:26.128+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.9__multipart_foo-FROZEN.2~BLmTxpapviv4KhOSPnOP6ahyUfAKhbn.3 2019-12-08T12:17:26.377 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:26.310+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-08T12:17:26.492 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:26.426+0000 7f9530871ec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-12-08T12:17:26.555 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:26.488+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:26.583 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:26.516+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:17:26.599 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:26.532+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:26.644 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:26.576+0000 7f9530871ec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-12-08T12:17:26.695 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:26.628+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:26.714 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:26.647+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:17:26.728 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:26.661+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:26.770 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:26.703+0000 7f9530871ec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-12-08T12:17:26.812 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:26.745+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:26.828 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:26.761+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:17:26.842 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:26.775+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-08T12:17:26.843 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:26.775+0000 7f9530871ec0 20 garbage collection: RGWGC::process iterating over entry tag='f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.71', time=2019-12-08T14:16:47.726856+0000, chain.objs.size()=4 2019-12-08T12:17:26.843 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:26.775+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.5__multipart_foo.2~p02dWvDgIXsTSVsWDHXPQm1vFZ77nMb.1 2019-12-08T12:17:26.843 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:26.775+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.5__multipart_foo.2~p02dWvDgIXsTSVsWDHXPQm1vFZ77nMb.2 2019-12-08T12:17:26.843 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:26.775+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.5__multipart_foo.2~p02dWvDgIXsTSVsWDHXPQm1vFZ77nMb.3 2019-12-08T12:17:26.843 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:26.775+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.5__multipart_foo.2~p02dWvDgIXsTSVsWDHXPQm1vFZ77nMb.4 2019-12-08T12:17:26.971 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:26.904+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-08T12:17:27.039 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:26.972+0000 7f9530871ec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-12-08T12:17:27.085 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:27.018+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:27.108 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:27.041+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:17:27.123 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:27.056+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-08T12:17:27.123 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:27.056+0000 7f9530871ec0 20 garbage collection: RGWGC::process iterating over entry tag='f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.210', time=2019-12-08T14:16:56.355717+0000, chain.objs.size()=3 2019-12-08T12:17:27.123 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:27.056+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.8__multipart_foo-STANDARD.2~ludvaRPqTB9V0PGlI-KuZd1-gc5YRuI.1 2019-12-08T12:17:27.124 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:27.056+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.8__multipart_foo-STANDARD.2~ludvaRPqTB9V0PGlI-KuZd1-gc5YRuI.2 2019-12-08T12:17:27.124 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:27.056+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.8__multipart_foo-STANDARD.2~ludvaRPqTB9V0PGlI-KuZd1-gc5YRuI.3 2019-12-08T12:17:27.215 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:27.143+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-08T12:17:27.336 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:27.269+0000 7f9530871ec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-12-08T12:17:27.398 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:27.331+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:27.423 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:27.356+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:17:27.447 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:27.380+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-12-08T12:17:27.447 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:27.380+0000 7f9530871ec0 20 garbage collection: RGWGC::process iterating over entry tag='f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.112', time=2019-12-08T14:16:49.671723+0000, chain.objs.size()=2 2019-12-08T12:17:27.447 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:27.380+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.7__shadow_.BOXAKs3q4Rk8nPQrVMvXpMeMapmT1P2_0 2019-12-08T12:17:27.448 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:27.380+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.7__shadow_.BOXAKs3q4Rk8nPQrVMvXpMeMapmT1P2_1 2019-12-08T12:17:27.448 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:27.380+0000 7f9530871ec0 20 garbage collection: RGWGC::process iterating over entry tag='f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.114', time=2019-12-08T14:16:50.135851+0000, chain.objs.size()=2 2019-12-08T12:17:27.448 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:27.380+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.7__shadow_.BOXAKs3q4Rk8nPQrVMvXpMeMapmT1P2_0 2019-12-08T12:17:27.448 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:27.380+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.7__shadow_.BOXAKs3q4Rk8nPQrVMvXpMeMapmT1P2_1 2019-12-08T12:17:27.547 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:27.480+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-08T12:17:27.638 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:27.571+0000 7f9530871ec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-12-08T12:17:27.705 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:27.638+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:27.727 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:27.661+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:17:27.741 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:27.674+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-08T12:17:27.741 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:27.674+0000 7f9530871ec0 20 garbage collection: RGWGC::process iterating over entry tag='_AOwG5COhLW-c3rAYtmr0lNQeIUA_OmZ', time=2019-12-08T14:16:49.356219+0000, chain.objs.size()=2 2019-12-08T12:17:27.741 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:27.674+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.7__shadow_.XK6NQjCJcwsLcVJltS9J5UcJqawe3E4_0 2019-12-08T12:17:27.741 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:27.674+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.7__shadow_.XK6NQjCJcwsLcVJltS9J5UcJqawe3E4_1 2019-12-08T12:17:27.792 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:27.725+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-08T12:17:27.879 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:27.812+0000 7f9530871ec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-12-08T12:17:27.935 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:27.868+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:27.965 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:27.898+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:17:27.985 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:27.918+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-08T12:17:27.985 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:27.918+0000 7f9530871ec0 20 garbage collection: RGWGC::process iterating over entry tag='f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.242', time=2019-12-08T14:16:54.122215+0000, chain.objs.size()=5 2019-12-08T12:17:27.985 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:27.918+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.9__multipart_foo-STANDARD.2~cP0qIj401LARVW6Unk3_W178talsGQT.1 2019-12-08T12:17:27.986 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:27.918+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.9__shadow_foo-STANDARD.2~cP0qIj401LARVW6Unk3_W178talsGQT.1_1 2019-12-08T12:17:27.986 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:27.918+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.9__multipart_foo-STANDARD.2~cP0qIj401LARVW6Unk3_W178talsGQT.2 2019-12-08T12:17:27.986 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:27.918+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.9__shadow_foo-STANDARD.2~cP0qIj401LARVW6Unk3_W178talsGQT.2_1 2019-12-08T12:17:27.986 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:27.918+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.9__multipart_foo-STANDARD.2~cP0qIj401LARVW6Unk3_W178talsGQT.3 2019-12-08T12:17:28.213 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:28.146+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-08T12:17:28.280 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:28.213+0000 7f9530871ec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-12-08T12:17:28.340 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:28.273+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:28.361 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:28.294+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:17:28.379 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:28.311+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2019-12-08T12:17:28.379 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:28.311+0000 7f9530871ec0 20 garbage collection: RGWGC::process iterating over entry tag='_gV3UPYsUXFWORUQ3e0gU15ehNCU1NjC', time=2019-12-08T14:16:50.826391+0000, chain.objs.size()=1 2019-12-08T12:17:28.379 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:28.311+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.7__shadow_.dDcUFf7JmiaWMwFzJvP9Jbd9MvGxQHg_0 2019-12-08T12:17:28.379 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:28.312+0000 7f9530871ec0 20 garbage collection: RGWGC::process iterating over entry tag='_xijSZbNDcO80SFXP1bPiL1_wXC0QTAV', time=2019-12-08T14:16:53.053772+0000, chain.objs.size()=2 2019-12-08T12:17:28.379 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:28.312+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.9__shadow_.fVD1BJD5gQttC7ftAHgS4-4NgQxFsKr_1 2019-12-08T12:17:28.379 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:28.312+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.9__shadow_.fVD1BJD5gQttC7ftAHgS4-4NgQxFsKr_2 2019-12-08T12:17:28.380 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:28.312+0000 7f9530871ec0 20 garbage collection: RGWGC::process iterating over entry tag='_6k4ePL6AXwOsF_6ZKZy6k0qGZqXwsqA', time=2019-12-08T14:16:54.588696+0000, chain.objs.size()=3 2019-12-08T12:17:28.380 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:28.312+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.9__shadow_.FIDJ7Us-upzfA4OvjaPQeKdSWXsHQqV_0 2019-12-08T12:17:28.380 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:28.312+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.9__shadow_.FIDJ7Us-upzfA4OvjaPQeKdSWXsHQqV_1 2019-12-08T12:17:28.380 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:28.312+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.9__shadow_.FIDJ7Us-upzfA4OvjaPQeKdSWXsHQqV_2 2019-12-08T12:17:28.513 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:28.446+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-08T12:17:28.592 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:28.525+0000 7f9530871ec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-12-08T12:17:28.636 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:28.569+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:28.655 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:28.588+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:17:28.686 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:28.619+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-08T12:17:28.686 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:28.619+0000 7f9530871ec0 20 garbage collection: RGWGC::process iterating over entry tag='f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.20', time=2019-12-08T14:16:43.101342+0000, chain.objs.size()=4 2019-12-08T12:17:28.686 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:28.619+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.2__multipart_foo.2~GFbohPeD2RkIL2XT5tzRjohbsAdUdIY.1 2019-12-08T12:17:28.686 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:28.619+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.2__multipart_foo.2~GFbohPeD2RkIL2XT5tzRjohbsAdUdIY.2 2019-12-08T12:17:28.686 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:28.619+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.2__multipart_foo.2~GFbohPeD2RkIL2XT5tzRjohbsAdUdIY.3 2019-12-08T12:17:28.687 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:28.619+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.2__multipart_foo.2~GFbohPeD2RkIL2XT5tzRjohbsAdUdIY.4 2019-12-08T12:17:28.847 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:28.780+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-08T12:17:28.965 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:28.898+0000 7f9530871ec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-12-08T12:17:29.008 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:28.941+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:29.025 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:28.958+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:17:29.038 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:28.970+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-12-08T12:17:29.038 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:28.970+0000 7f9530871ec0 20 garbage collection: RGWGC::process iterating over entry tag='f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.109', time=2019-12-08T14:16:49.156319+0000, chain.objs.size()=2 2019-12-08T12:17:29.038 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:28.970+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.7__shadow_.Zr54HxdQZRmB0XN1fHNm_RarvLeoaq9_0 2019-12-08T12:17:29.038 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:28.970+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.7__shadow_.Zr54HxdQZRmB0XN1fHNm_RarvLeoaq9_1 2019-12-08T12:17:29.038 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:28.970+0000 7f9530871ec0 20 garbage collection: RGWGC::process iterating over entry tag='_SRCYVvR42yzN_tR3y9pC1TMDxcQsuLD', time=2019-12-08T14:16:53.994645+0000, chain.objs.size()=2 2019-12-08T12:17:29.039 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:28.970+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.9__shadow_.A6_93_orgtUxMiWcq44W0OB37syg4T-_1 2019-12-08T12:17:29.039 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:28.970+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.9__shadow_.A6_93_orgtUxMiWcq44W0OB37syg4T-_2 2019-12-08T12:17:29.175 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:29.108+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-08T12:17:29.265 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:29.198+0000 7f9530871ec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-12-08T12:17:29.310 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:29.241+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:30.112 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:29.258+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:17:30.112 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:29.268+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-08T12:17:30.112 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:29.268+0000 7f9530871ec0 20 garbage collection: RGWGC::process iterating over entry tag='f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.40', time=2019-12-08T14:16:44.398085+0000, chain.objs.size()=4 2019-12-08T12:17:30.112 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:29.268+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.3__multipart_foo.2~af_ZZ1xxWVnhq4KsI2gzhaSdMCLEYbl.1 2019-12-08T12:17:30.112 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:29.268+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.3__multipart_foo.2~af_ZZ1xxWVnhq4KsI2gzhaSdMCLEYbl.2 2019-12-08T12:17:30.112 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:29.268+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.3__multipart_foo.2~af_ZZ1xxWVnhq4KsI2gzhaSdMCLEYbl.3 2019-12-08T12:17:30.113 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:29.268+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.3__multipart_foo.2~af_ZZ1xxWVnhq4KsI2gzhaSdMCLEYbl.4 2019-12-08T12:17:30.113 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:29.443+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-08T12:17:30.113 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:29.555+0000 7f9530871ec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-12-08T12:17:30.113 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:29.599+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:30.113 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:29.621+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:17:30.113 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:29.633+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:30.113 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:29.664+0000 7f9530871ec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-12-08T12:17:30.114 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:29.703+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:30.114 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:29.718+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:17:30.114 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:29.726+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:30.114 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:29.768+0000 7f9530871ec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-12-08T12:17:30.114 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:29.822+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:30.114 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:29.840+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:17:30.114 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:29.853+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-08T12:17:30.115 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:29.853+0000 7f9530871ec0 20 garbage collection: RGWGC::process iterating over entry tag='f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.203', time=2019-12-08T14:16:56.118488+0000, chain.objs.size()=5 2019-12-08T12:17:30.115 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:29.853+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.8__multipart_foo-LUKEWARM.2~pas3wQ5yR5trqbde33X-MzUZhJ-GbyR.1 2019-12-08T12:17:30.115 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:29.853+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.8__shadow_foo-LUKEWARM.2~pas3wQ5yR5trqbde33X-MzUZhJ-GbyR.1_1 2019-12-08T12:17:30.115 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:29.853+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.8__multipart_foo-LUKEWARM.2~pas3wQ5yR5trqbde33X-MzUZhJ-GbyR.2 2019-12-08T12:17:30.115 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:29.853+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.8__shadow_foo-LUKEWARM.2~pas3wQ5yR5trqbde33X-MzUZhJ-GbyR.2_1 2019-12-08T12:17:30.115 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:29.853+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.8__multipart_foo-LUKEWARM.2~pas3wQ5yR5trqbde33X-MzUZhJ-GbyR.3 2019-12-08T12:17:30.115 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:29.965+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-08T12:17:30.140 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:30.073+0000 7f9530871ec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-12-08T12:17:30.190 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:30.123+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:30.210 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:30.144+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:17:30.223 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:30.155+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-08T12:17:30.223 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:30.155+0000 7f9530871ec0 20 garbage collection: RGWGC::process iterating over entry tag='_Z8qjDI0SDlXrqpMB1IdER0zy1hCJe5W', time=2019-12-08T14:16:54.274668+0000, chain.objs.size()=3 2019-12-08T12:17:30.223 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:30.155+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.9__shadow_.yeFQ3ojJtCBfkNXw0la61b1vZt2G24q_0 2019-12-08T12:17:30.223 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:30.156+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.9__shadow_.yeFQ3ojJtCBfkNXw0la61b1vZt2G24q_1 2019-12-08T12:17:30.223 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:30.156+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.9__shadow_.yeFQ3ojJtCBfkNXw0la61b1vZt2G24q_2 2019-12-08T12:17:30.319 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:30.251+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-08T12:17:30.418 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:30.351+0000 7f9530871ec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-12-08T12:17:30.497 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:30.430+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:30.522 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:30.455+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:17:30.575 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:30.508+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-08T12:17:30.576 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:30.508+0000 7f9530871ec0 20 garbage collection: RGWGC::process iterating over entry tag='f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.225', time=2019-12-08T14:16:52.627641+0000, chain.objs.size()=5 2019-12-08T12:17:30.576 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:30.508+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.9__multipart_foo-FROZEN.2~BLmTxpapviv4KhOSPnOP6ahyUfAKhbn.1 2019-12-08T12:17:30.576 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:30.508+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.9__shadow_foo-FROZEN.2~BLmTxpapviv4KhOSPnOP6ahyUfAKhbn.1_1 2019-12-08T12:17:30.576 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:30.508+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.9__multipart_foo-FROZEN.2~BLmTxpapviv4KhOSPnOP6ahyUfAKhbn.2 2019-12-08T12:17:30.576 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:30.508+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.9__shadow_foo-FROZEN.2~BLmTxpapviv4KhOSPnOP6ahyUfAKhbn.2_1 2019-12-08T12:17:30.576 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:30.508+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.9__multipart_foo-FROZEN.2~BLmTxpapviv4KhOSPnOP6ahyUfAKhbn.3 2019-12-08T12:17:30.690 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:30.623+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-08T12:17:30.764 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:30.697+0000 7f9530871ec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-12-08T12:17:30.811 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:30.744+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:30.834 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:30.767+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:17:30.849 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:30.782+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-08T12:17:30.849 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:30.782+0000 7f9530871ec0 20 garbage collection: RGWGC::process iterating over entry tag='f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.235', time=2019-12-08T14:16:53.719687+0000, chain.objs.size()=5 2019-12-08T12:17:30.849 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:30.782+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.9__multipart_foo-LUKEWARM.2~0jMBe4FmMoKpYlVkOM2c3Dqnc6gAskn.1 2019-12-08T12:17:30.849 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:30.782+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.9__shadow_foo-LUKEWARM.2~0jMBe4FmMoKpYlVkOM2c3Dqnc6gAskn.1_1 2019-12-08T12:17:30.849 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:30.782+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.9__multipart_foo-LUKEWARM.2~0jMBe4FmMoKpYlVkOM2c3Dqnc6gAskn.2 2019-12-08T12:17:30.849 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:30.782+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.9__shadow_foo-LUKEWARM.2~0jMBe4FmMoKpYlVkOM2c3Dqnc6gAskn.2_1 2019-12-08T12:17:30.850 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:30.782+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.9__multipart_foo-LUKEWARM.2~0jMBe4FmMoKpYlVkOM2c3Dqnc6gAskn.3 2019-12-08T12:17:30.918 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:30.851+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-08T12:17:31.075 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:31.008+0000 7f9530871ec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-12-08T12:17:31.124 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:31.057+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:31.142 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:31.074+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:17:31.154 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:31.087+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-08T12:17:31.155 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:31.087+0000 7f9530871ec0 20 garbage collection: RGWGC::process iterating over entry tag='f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.196', time=2019-12-08T14:16:56.008743+0000, chain.objs.size()=5 2019-12-08T12:17:31.155 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:31.087+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.8__multipart_foo-FROZEN.2~V7F0hpB0xQ4tpfZmx_aAeS7vkG-o9pz.1 2019-12-08T12:17:31.155 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:31.087+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.8__shadow_foo-FROZEN.2~V7F0hpB0xQ4tpfZmx_aAeS7vkG-o9pz.1_1 2019-12-08T12:17:31.155 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:31.087+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.8__multipart_foo-FROZEN.2~V7F0hpB0xQ4tpfZmx_aAeS7vkG-o9pz.2 2019-12-08T12:17:31.155 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:31.087+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.8__shadow_foo-FROZEN.2~V7F0hpB0xQ4tpfZmx_aAeS7vkG-o9pz.2_1 2019-12-08T12:17:31.155 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:31.087+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.8__multipart_foo-FROZEN.2~V7F0hpB0xQ4tpfZmx_aAeS7vkG-o9pz.3 2019-12-08T12:17:31.242 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:31.175+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-08T12:17:31.342 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:31.274+0000 7f9530871ec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-12-08T12:17:31.407 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:31.340+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:31.436 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:31.369+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:17:31.455 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:31.388+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:31.506 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:31.439+0000 7f9530871ec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-12-08T12:17:31.579 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:31.512+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:31.610 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:31.542+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:17:31.634 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:31.567+0000 7f9530871ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-08T12:17:31.634 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:31.567+0000 7f9530871ec0 20 garbage collection: RGWGC::process iterating over entry tag='f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.84', time=2019-12-08T14:16:57.631325+0000, chain.objs.size()=3 2019-12-08T12:17:31.634 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:31.567+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.6__shadow_.La4IgkFnLAV79ubYCqANmEZzmjePLSb_0 2019-12-08T12:17:31.634 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:31.567+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.6__shadow_.La4IgkFnLAV79ubYCqANmEZzmjePLSb_1 2019-12-08T12:17:31.635 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:31.567+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.6__shadow_.La4IgkFnLAV79ubYCqANmEZzmjePLSb_2 2019-12-08T12:17:31.699 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:31.632+0000 7f9530871ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-08T12:17:31.822 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:31.755+0000 7f9530871ec0 20 remove_watcher() i=0 2019-12-08T12:17:31.823 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:31.755+0000 7f9530871ec0 2 removed watcher, disabling cache 2019-12-08T12:17:31.859 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:31.792+0000 7f9530871ec0 20 remove_watcher() i=1 2019-12-08T12:17:31.908 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:31.841+0000 7f9530871ec0 20 remove_watcher() i=2 2019-12-08T12:17:31.957 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:31.889+0000 7f9530871ec0 20 remove_watcher() i=3 2019-12-08T12:17:31.997 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:31.930+0000 7f9530871ec0 20 remove_watcher() i=4 2019-12-08T12:17:32.036 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:31.969+0000 7f9530871ec0 20 remove_watcher() i=5 2019-12-08T12:17:32.075 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:32.008+0000 7f9530871ec0 20 remove_watcher() i=6 2019-12-08T12:17:32.129 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:32.062+0000 7f9530871ec0 20 remove_watcher() i=7 2019-12-08T12:17:32.141 INFO:teuthology.orchestra.run.smithi079:> radosgw-admin gc process --include-all 2019-12-08T12:17:32.244 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:32.177+0000 7f7f6bac9ec0 20 rados->read ofs=0 len=0 2019-12-08T12:17:32.270 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:32.203+0000 7f7f6bac9ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:17:32.270 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:32.203+0000 7f7f6bac9ec0 20 rados->read ofs=0 len=0 2019-12-08T12:17:32.276 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:32.209+0000 7f7f6bac9ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:17:32.276 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:32.209+0000 7f7f6bac9ec0 20 rados->read ofs=0 len=0 2019-12-08T12:17:32.285 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:32.218+0000 7f7f6bac9ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:17:32.286 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:32.218+0000 7f7f6bac9ec0 20 rados->read ofs=0 len=0 2019-12-08T12:17:32.308 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:32.241+0000 7f7f6bac9ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:17:32.526 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:32.458+0000 7f7f6bac9ec0 20 RGWRados::pool_iterate: got zonegroup_info.fee0148b-7ae2-4cf0-a79e-86045a29cb7c 2019-12-08T12:17:32.526 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:32.458+0000 7f7f6bac9ec0 20 RGWRados::pool_iterate: got zone_info.f8ab349b-4577-410d-b524-4ecaf50bb1bd 2019-12-08T12:17:32.526 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:32.458+0000 7f7f6bac9ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-08T12:17:32.527 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:32.458+0000 7f7f6bac9ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-08T12:17:32.527 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:32.459+0000 7f7f6bac9ec0 20 rados->read ofs=0 len=0 2019-12-08T12:17:32.544 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:32.476+0000 7f7f6bac9ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:17:32.544 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:32.477+0000 7f7f6bac9ec0 20 rados->read ofs=0 len=0 2019-12-08T12:17:32.561 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:32.494+0000 7f7f6bac9ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-08T12:17:32.562 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:32.494+0000 7f7f6bac9ec0 20 rados->read ofs=0 len=0 2019-12-08T12:17:32.575 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:32.508+0000 7f7f6bac9ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:17:32.575 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:32.508+0000 7f7f6bac9ec0 20 rados->read ofs=0 len=0 2019-12-08T12:17:32.595 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:32.525+0000 7f7f6bac9ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-08T12:17:32.596 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:32.525+0000 7f7f6bac9ec0 20 rados->read ofs=0 len=0 2019-12-08T12:17:32.602 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:32.535+0000 7f7f6bac9ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:17:32.602 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:32.535+0000 7f7f6bac9ec0 10 cannot find current period zonegroup using local zonegroup 2019-12-08T12:17:32.602 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:32.535+0000 7f7f6bac9ec0 20 rados->read ofs=0 len=0 2019-12-08T12:17:32.614 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:32.547+0000 7f7f6bac9ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:17:32.614 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:32.547+0000 7f7f6bac9ec0 20 rados->read ofs=0 len=0 2019-12-08T12:17:32.631 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:32.563+0000 7f7f6bac9ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:17:32.631 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:32.563+0000 7f7f6bac9ec0 20 rados->read ofs=0 len=0 2019-12-08T12:17:32.646 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:32.579+0000 7f7f6bac9ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-08T12:17:32.646 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:32.579+0000 7f7f6bac9ec0 20 zonegroup default 2019-12-08T12:17:32.646 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:32.579+0000 7f7f6bac9ec0 20 rados->read ofs=0 len=0 2019-12-08T12:17:32.654 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:32.587+0000 7f7f6bac9ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:17:32.654 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:32.587+0000 7f7f6bac9ec0 10 Cannot find current period zone using local zone 2019-12-08T12:17:32.655 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:32.587+0000 7f7f6bac9ec0 20 rados->read ofs=0 len=0 2019-12-08T12:17:32.666 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:32.598+0000 7f7f6bac9ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:17:32.666 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:32.598+0000 7f7f6bac9ec0 20 rados->read ofs=0 len=0 2019-12-08T12:17:32.686 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:32.617+0000 7f7f6bac9ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:17:32.686 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:32.617+0000 7f7f6bac9ec0 20 rados->read ofs=0 len=0 2019-12-08T12:17:32.698 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:32.630+0000 7f7f6bac9ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-08T12:17:32.698 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:32.630+0000 7f7f6bac9ec0 20 zone default found 2019-12-08T12:17:32.698 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:32.630+0000 7f7f6bac9ec0 20 started sync module instance, tier type = 2019-12-08T12:17:32.698 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:32.630+0000 7f7f6bac9ec0 20 started zone id=f8ab349b-4577-410d-b524-4ecaf50bb1bd (name=default) with tier type = 2019-12-08T12:17:33.115 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:33.048+0000 7f7f6bac9ec0 20 add_watcher() i=0 2019-12-08T12:17:33.116 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:33.048+0000 7f7f6bac9ec0 20 add_watcher() i=1 2019-12-08T12:17:33.116 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:33.048+0000 7f7f6bac9ec0 20 add_watcher() i=2 2019-12-08T12:17:33.116 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:33.048+0000 7f7f6bac9ec0 20 add_watcher() i=3 2019-12-08T12:17:33.116 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:33.048+0000 7f7f6bac9ec0 20 add_watcher() i=4 2019-12-08T12:17:33.116 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:33.048+0000 7f7f6bac9ec0 20 add_watcher() i=5 2019-12-08T12:17:33.116 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:33.048+0000 7f7f6bac9ec0 20 add_watcher() i=6 2019-12-08T12:17:33.145 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:33.078+0000 7f7f6bac9ec0 20 add_watcher() i=7 2019-12-08T12:17:33.145 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:33.078+0000 7f7f6bac9ec0 2 all 8 watchers are set, enabling cache 2019-12-08T12:17:33.145 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:33.078+0000 7f7f297e2700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-08T12:17:33.150 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:33.083+0000 7f7f58cf3700 0 -- 172.21.15.79:0/1893392913 >> v2:172.21.15.79:3300/0 conn(0x558131524010 msgr2=0x558131524420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-12-08T12:17:33.354 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:33.287+0000 7f7f58cf3700 0 --2- 172.21.15.79:0/1893392913 >> v2:172.21.15.79:3300/0 conn(0x558131524010 0x558131524420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2019-12-08T12:17:33.416 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:33.349+0000 7f7f594f4700 0 -- 172.21.15.79:0/1626716670 >> [v2:172.21.15.79:6800/9057,v1:172.21.15.79:6801/9057] conn(0x7f7e9c022470 msgr2=0x7f7e9c024960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-08T12:17:35.166 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:35.098+0000 7f7e9b7fe700 20 reqs_thread_entry: start 2019-12-08T12:17:35.166 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:35.099+0000 7f7e997fa700 20 reqs_thread_entry: start 2019-12-08T12:17:35.166 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:35.099+0000 7f7f6bac9ec0 20 init_complete bucket index max shards: 0 2019-12-08T12:17:35.167 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:35.099+0000 7f7e877fe700 20 reqs_thread_entry: start 2019-12-08T12:17:35.167 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:35.099+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-12-08T12:17:35.221 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:35.154+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:35.246 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:35.179+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:17:35.262 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:35.194+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:35.302 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:35.235+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-12-08T12:17:35.370 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:35.302+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:35.393 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:35.325+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:17:35.405 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:35.336+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:35.447 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:35.380+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-12-08T12:17:35.502 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:35.434+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:35.524 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:35.457+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:17:35.537 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:35.469+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:35.585 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:35.517+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-12-08T12:17:35.638 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:35.571+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:35.665 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:35.598+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:17:35.687 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:35.620+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:35.732 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:35.664+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-12-08T12:17:35.790 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:35.722+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:35.813 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:35.746+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:17:35.823 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:35.756+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:35.858 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:35.790+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-12-08T12:17:35.907 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:35.840+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:35.927 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:35.860+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:17:35.935 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:35.867+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:35.970 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:35.903+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-12-08T12:17:36.017 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:35.950+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:36.041 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:35.974+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:17:36.055 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:35.987+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:36.099 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:36.031+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-12-08T12:17:36.171 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:36.103+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:36.196 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:36.127+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:17:36.224 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:36.155+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:36.274 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:36.205+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-12-08T12:17:36.332 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:36.263+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:36.352 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:36.283+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:17:36.361 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:36.292+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:36.407 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:36.339+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-12-08T12:17:36.468 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:36.400+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:36.495 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:36.427+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:17:36.508 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:36.440+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:36.560 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:36.491+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-12-08T12:17:36.638 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:36.569+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:36.666 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:36.597+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:17:36.683 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:36.615+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:36.722 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:36.654+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-12-08T12:17:36.780 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:36.712+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:36.798 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:36.731+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:17:36.809 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:36.742+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:36.843 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:36.775+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-12-08T12:17:36.895 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:36.828+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:36.914 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:36.847+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:17:36.924 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:36.856+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:36.976 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:36.909+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-12-08T12:17:37.017 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:36.949+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:37.034 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:36.967+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:17:37.043 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:36.976+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:37.078 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:37.010+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-12-08T12:17:37.118 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:37.050+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:37.134 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:37.066+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:17:37.142 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:37.074+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:37.181 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:37.113+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-12-08T12:17:37.235 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:37.167+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:37.255 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:37.188+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:17:37.265 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:37.198+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:37.299 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:37.232+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-12-08T12:17:37.338 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:37.270+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:37.359 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:37.291+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:17:37.370 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:37.302+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:37.403 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:37.336+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-12-08T12:17:37.451 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:37.383+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:37.468 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:37.400+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:17:37.481 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:37.414+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:37.522 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:37.455+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-12-08T12:17:37.589 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:37.522+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:37.619 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:37.551+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:17:37.631 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:37.563+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:37.674 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:37.607+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-12-08T12:17:37.760 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:37.692+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:37.796 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:37.729+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:17:37.821 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:37.754+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:37.874 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:37.806+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-12-08T12:17:37.959 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:37.892+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:37.995 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:37.927+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:17:38.011 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:37.943+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:38.069 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:38.002+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-12-08T12:17:38.148 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:38.081+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:38.181 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:38.113+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:17:38.196 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:38.128+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:38.256 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:38.189+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-12-08T12:17:38.308 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:38.240+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:38.332 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:38.264+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:17:38.346 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:38.278+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:38.396 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:38.328+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-12-08T12:17:38.464 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:38.396+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:38.496 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:38.429+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:17:38.511 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:38.443+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:38.567 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:38.500+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-12-08T12:17:38.630 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:38.562+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:38.669 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:38.601+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:17:38.685 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:38.617+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:38.734 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:38.666+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-12-08T12:17:38.935 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:38.868+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:38.954 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:38.886+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:17:38.966 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:38.898+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:39.010 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:38.943+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-12-08T12:17:39.074 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:39.007+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:39.097 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:39.029+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:17:39.109 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:39.041+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:39.159 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:39.091+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-12-08T12:17:39.231 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:39.164+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:39.264 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:39.196+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:17:39.274 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:39.207+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:39.336 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:39.268+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-12-08T12:17:39.420 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:39.352+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:39.455 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:39.387+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:17:39.470 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:39.403+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:39.524 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:39.456+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-12-08T12:17:39.604 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:39.536+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:39.623 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:39.555+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:17:39.635 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:39.567+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:39.694 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:39.626+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-12-08T12:17:39.795 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:39.728+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:39.832 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:39.764+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:17:39.849 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:39.782+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:39.918 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:39.850+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-12-08T12:17:39.986 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:39.918+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:40.011 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:39.944+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:17:40.022 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:39.954+0000 7f7f6bac9ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:17:40.090 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:40.022+0000 7f7f6bac9ec0 20 remove_watcher() i=0 2019-12-08T12:17:40.090 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:40.022+0000 7f7f6bac9ec0 2 removed watcher, disabling cache 2019-12-08T12:17:40.139 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:40.072+0000 7f7f6bac9ec0 20 remove_watcher() i=1 2019-12-08T12:17:40.211 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:40.144+0000 7f7f6bac9ec0 20 remove_watcher() i=2 2019-12-08T12:17:40.250 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:40.183+0000 7f7f6bac9ec0 20 remove_watcher() i=3 2019-12-08T12:17:40.287 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:40.220+0000 7f7f6bac9ec0 20 remove_watcher() i=4 2019-12-08T12:17:40.337 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:40.266+0000 7f7f6bac9ec0 20 remove_watcher() i=5 2019-12-08T12:17:40.398 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:40.331+0000 7f7f6bac9ec0 20 remove_watcher() i=6 2019-12-08T12:17:40.451 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:17:40.384+0000 7f7f6bac9ec0 20 remove_watcher() i=7 2019-12-08T12:17:40.461 INFO:teuthology.orchestra.run.smithi079:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle-4.7/bin/gradle clean test --rerun-tasks --no-build-cache --tests AWS4Test 2019-12-08T12:17:41.071 INFO:teuthology.orchestra.run.smithi079.stdout:Starting a Gradle Daemon (subsequent builds will be faster) 2019-12-08T12:17:44.170 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/io/spring/gradle/dependency-management-plugin/1.0.3.RELEASE/dependency-management-plugin-1.0.3.RELEASE.pom 2019-12-08T12:17:44.271 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/io/spring/gradle/dependency-management-plugin/1.0.3.RELEASE/dependency-management-plugin-1.0.3.RELEASE.jar 2019-12-08T12:17:45.372 INFO:teuthology.orchestra.run.smithi079.stdout:> Task :clean UP-TO-DATE 2019-12-08T12:17:45.471 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-bom/1.11.549/aws-java-sdk-bom-1.11.549.pom 2019-12-08T12:17:45.471 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pom/1.11.549/aws-java-sdk-pom-1.11.549.pom 2019-12-08T12:17:45.671 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/log4j/log4j/1.2.17/log4j-1.2.17.pom 2019-12-08T12:17:45.671 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-server/2.44.0/selenium-server-2.44.0.pom 2019-12-08T12:17:45.671 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-s3/1.11.549/aws-java-sdk-s3-1.11.549.pom 2019-12-08T12:17:45.672 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk/1.11.549/aws-java-sdk-1.11.549.pom 2019-12-08T12:17:45.672 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/org/testng/testng/6.1.1/testng-6.1.1.pom 2019-12-08T12:17:45.672 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sqs/1.11.549/aws-java-sdk-sqs-1.11.549.pom 2019-12-08T12:17:45.672 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-core/1.11.549/aws-java-sdk-core-1.11.549.pom 2019-12-08T12:17:45.672 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/3/oss-parent-3.pom 2019-12-08T12:17:45.672 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-parent/2.44.0/selenium-parent-2.44.0.pom 2019-12-08T12:17:45.772 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/commons-logging/commons-logging/1.1.3/commons-logging-1.1.3.pom 2019-12-08T12:17:45.772 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.5/httpclient-4.5.5.pom 2019-12-08T12:17:45.772 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/software/amazon/ion/ion-java/1.0.2/ion-java-1.0.2.pom 2019-12-08T12:17:45.773 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/core/jackson-databind/2.6.7.2/jackson-databind-2.6.7.2.pom 2019-12-08T12:17:45.773 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/joda-time/joda-time/2.8.1/joda-time-2.8.1.pom 2019-12-08T12:17:45.773 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/dataformat/jackson-dataformat-cbor/2.6.7/jackson-dataformat-cbor-2.6.7.pom 2019-12-08T12:17:45.773 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/jackson-parent/2.6.2/jackson-parent-2.6.2.pom 2019-12-08T12:17:45.773 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/28/commons-parent-28.pom 2019-12-08T12:17:45.773 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.5/httpcomponents-client-4.5.5.pom 2019-12-08T12:17:45.773 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/oss-parent/24/oss-parent-24.pom 2019-12-08T12:17:45.774 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/10/httpcomponents-parent-10.pom 2019-12-08T12:17:45.774 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom 2019-12-08T12:17:45.873 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom 2019-12-08T12:17:45.873 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-docdb/1.11.549/aws-java-sdk-docdb-1.11.549.pom 2019-12-08T12:17:45.874 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-backup/1.11.549/aws-java-sdk-backup-1.11.549.pom 2019-12-08T12:17:45.874 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-managedblockchain/1.11.549/aws-java-sdk-managedblockchain-1.11.549.pom 2019-12-08T12:17:45.874 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-apigatewaymanagementapi/1.11.549/aws-java-sdk-apigatewaymanagementapi-1.11.549.pom 2019-12-08T12:17:45.874 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-apigatewayv2/1.11.549/aws-java-sdk-apigatewayv2-1.11.549.pom 2019-12-08T12:17:45.874 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-worklink/1.11.549/aws-java-sdk-worklink-1.11.549.pom 2019-12-08T12:17:45.874 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-textract/1.11.549/aws-java-sdk-textract-1.11.549.pom 2019-12-08T12:17:45.874 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-licensemanager/1.11.549/aws-java-sdk-licensemanager-1.11.549.pom 2019-12-08T12:17:45.875 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kafka/1.11.549/aws-java-sdk-kafka-1.11.549.pom 2019-12-08T12:17:45.875 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-fsx/1.11.549/aws-java-sdk-fsx-1.11.549.pom 2019-12-08T12:17:45.875 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediaconnect/1.11.549/aws-java-sdk-mediaconnect-1.11.549.pom 2019-12-08T12:17:45.875 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-securityhub/1.11.549/aws-java-sdk-securityhub-1.11.549.pom 2019-12-08T12:17:45.880 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kinesisanalyticsv2/1.11.549/aws-java-sdk-kinesisanalyticsv2-1.11.549.pom 2019-12-08T12:17:45.881 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-transfer/1.11.549/aws-java-sdk-transfer-1.11.549.pom 2019-12-08T12:17:45.881 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-comprehendmedical/1.11.549/aws-java-sdk-comprehendmedical-1.11.549.pom 2019-12-08T12:17:45.973 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-datasync/1.11.549/aws-java-sdk-datasync-1.11.549.pom 2019-12-08T12:17:45.974 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-robomaker/1.11.549/aws-java-sdk-robomaker-1.11.549.pom 2019-12-08T12:17:45.974 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-quicksight/1.11.549/aws-java-sdk-quicksight-1.11.549.pom 2019-12-08T12:17:45.974 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-globalaccelerator/1.11.549/aws-java-sdk-globalaccelerator-1.11.549.pom 2019-12-08T12:17:45.974 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-route53resolver/1.11.549/aws-java-sdk-route53resolver-1.11.549.pom 2019-12-08T12:17:45.974 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ram/1.11.549/aws-java-sdk-ram-1.11.549.pom 2019-12-08T12:17:45.974 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-amplify/1.11.549/aws-java-sdk-amplify-1.11.549.pom 2019-12-08T12:17:45.975 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-rdsdata/1.11.549/aws-java-sdk-rdsdata-1.11.549.pom 2019-12-08T12:17:45.975 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-s3control/1.11.549/aws-java-sdk-s3control-1.11.549.pom 2019-12-08T12:17:45.975 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pinpointsmsvoice/1.11.549/aws-java-sdk-pinpointsmsvoice-1.11.549.pom 2019-12-08T12:17:45.975 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pinpointemail/1.11.549/aws-java-sdk-pinpointemail-1.11.549.pom 2019-12-08T12:17:45.975 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-chime/1.11.549/aws-java-sdk-chime-1.11.549.pom 2019-12-08T12:17:45.975 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-signer/1.11.549/aws-java-sdk-signer-1.11.549.pom 2019-12-08T12:17:45.975 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-eks/1.11.549/aws-java-sdk-eks-1.11.549.pom 2019-12-08T12:17:45.976 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-neptune/1.11.549/aws-java-sdk-neptune-1.11.549.pom 2019-12-08T12:17:45.976 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediatailor/1.11.549/aws-java-sdk-mediatailor-1.11.549.pom 2019-12-08T12:17:45.976 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-dlm/1.11.549/aws-java-sdk-dlm-1.11.549.pom 2019-12-08T12:17:45.981 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-macie/1.11.549/aws-java-sdk-macie-1.11.549.pom 2019-12-08T12:17:45.982 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iot1clickdevices/1.11.549/aws-java-sdk-iot1clickdevices-1.11.549.pom 2019-12-08T12:17:45.982 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pi/1.11.549/aws-java-sdk-pi-1.11.549.pom 2019-12-08T12:17:45.982 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iot1clickprojects/1.11.549/aws-java-sdk-iot1clickprojects-1.11.549.pom 2019-12-08T12:17:45.982 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iotanalytics/1.11.549/aws-java-sdk-iotanalytics-1.11.549.pom 2019-12-08T12:17:45.982 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-secretsmanager/1.11.549/aws-java-sdk-secretsmanager-1.11.549.pom 2019-12-08T12:17:45.982 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-acmpca/1.11.549/aws-java-sdk-acmpca-1.11.549.pom 2019-12-08T12:17:45.983 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-connect/1.11.549/aws-java-sdk-connect-1.11.549.pom 2019-12-08T12:17:45.983 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-fms/1.11.549/aws-java-sdk-fms-1.11.549.pom 2019-12-08T12:17:45.983 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-autoscalingplans/1.11.549/aws-java-sdk-autoscalingplans-1.11.549.pom 2019-12-08T12:17:45.983 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloud9/1.11.549/aws-java-sdk-cloud9-1.11.549.pom 2019-12-08T12:17:45.983 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-workmail/1.11.549/aws-java-sdk-workmail-1.11.549.pom 2019-12-08T12:17:45.983 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-transcribe/1.11.549/aws-java-sdk-transcribe-1.11.549.pom 2019-12-08T12:17:45.984 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-serverlessapplicationrepository/1.11.549/aws-java-sdk-serverlessapplicationrepository-1.11.549.pom 2019-12-08T12:17:45.984 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-servicediscovery/1.11.549/aws-java-sdk-servicediscovery-1.11.549.pom 2019-12-08T12:17:45.984 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-alexaforbusiness/1.11.549/aws-java-sdk-alexaforbusiness-1.11.549.pom 2019-12-08T12:17:45.984 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-comprehend/1.11.549/aws-java-sdk-comprehend-1.11.549.pom 2019-12-08T12:17:45.984 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-translate/1.11.549/aws-java-sdk-translate-1.11.549.pom 2019-12-08T12:17:45.984 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-resourcegroups/1.11.549/aws-java-sdk-resourcegroups-1.11.549.pom 2019-12-08T12:17:45.985 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sagemaker/1.11.549/aws-java-sdk-sagemaker-1.11.549.pom 2019-12-08T12:17:45.985 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sagemakerruntime/1.11.549/aws-java-sdk-sagemakerruntime-1.11.549.pom 2019-12-08T12:17:45.985 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iotjobsdataplane/1.11.549/aws-java-sdk-iotjobsdataplane-1.11.549.pom 2019-12-08T12:17:46.071 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-guardduty/1.11.549/aws-java-sdk-guardduty-1.11.549.pom 2019-12-08T12:17:46.071 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mq/1.11.549/aws-java-sdk-mq-1.11.549.pom 2019-12-08T12:17:46.071 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-appsync/1.11.549/aws-java-sdk-appsync-1.11.549.pom 2019-12-08T12:17:46.071 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kinesisvideo/1.11.549/aws-java-sdk-kinesisvideo-1.11.549.pom 2019-12-08T12:17:46.073 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediastore/1.11.549/aws-java-sdk-mediastore-1.11.549.pom 2019-12-08T12:17:46.073 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediaconvert/1.11.549/aws-java-sdk-mediaconvert-1.11.549.pom 2019-12-08T12:17:46.073 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-medialive/1.11.549/aws-java-sdk-medialive-1.11.549.pom 2019-12-08T12:17:46.073 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediastoredata/1.11.549/aws-java-sdk-mediastoredata-1.11.549.pom 2019-12-08T12:17:46.073 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pricing/1.11.549/aws-java-sdk-pricing-1.11.549.pom 2019-12-08T12:17:46.073 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediapackage/1.11.549/aws-java-sdk-mediapackage-1.11.549.pom 2019-12-08T12:17:46.074 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-costexplorer/1.11.549/aws-java-sdk-costexplorer-1.11.549.pom 2019-12-08T12:17:46.074 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudhsmv2/1.11.549/aws-java-sdk-cloudhsmv2-1.11.549.pom 2019-12-08T12:17:46.074 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-glue/1.11.549/aws-java-sdk-glue-1.11.549.pom 2019-12-08T12:17:46.074 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-migrationhub/1.11.549/aws-java-sdk-migrationhub-1.11.549.pom 2019-12-08T12:17:46.074 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-dax/1.11.549/aws-java-sdk-dax-1.11.549.pom 2019-12-08T12:17:46.074 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-athena/1.11.549/aws-java-sdk-athena-1.11.549.pom 2019-12-08T12:17:46.074 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-greengrass/1.11.549/aws-java-sdk-greengrass-1.11.549.pom 2019-12-08T12:17:46.075 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-lexmodelbuilding/1.11.549/aws-java-sdk-lexmodelbuilding-1.11.549.pom 2019-12-08T12:17:46.075 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-marketplaceentitlement/1.11.549/aws-java-sdk-marketplaceentitlement-1.11.549.pom 2019-12-08T12:17:46.075 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codestar/1.11.549/aws-java-sdk-codestar-1.11.549.pom 2019-12-08T12:17:46.075 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-resourcegroupstaggingapi/1.11.549/aws-java-sdk-resourcegroupstaggingapi-1.11.549.pom 2019-12-08T12:17:46.075 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pinpoint/1.11.549/aws-java-sdk-pinpoint-1.11.549.pom 2019-12-08T12:17:46.075 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-xray/1.11.549/aws-java-sdk-xray-1.11.549.pom 2019-12-08T12:17:46.075 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-opsworkscm/1.11.549/aws-java-sdk-opsworkscm-1.11.549.pom 2019-12-08T12:17:46.076 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-support/1.11.549/aws-java-sdk-support-1.11.549.pom 2019-12-08T12:17:46.076 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-simpledb/1.11.549/aws-java-sdk-simpledb-1.11.549.pom 2019-12-08T12:17:46.076 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-servicecatalog/1.11.549/aws-java-sdk-servicecatalog-1.11.549.pom 2019-12-08T12:17:46.076 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-simpleworkflow/1.11.549/aws-java-sdk-simpleworkflow-1.11.549.pom 2019-12-08T12:17:46.076 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-servermigration/1.11.549/aws-java-sdk-servermigration-1.11.549.pom 2019-12-08T12:17:46.076 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-storagegateway/1.11.549/aws-java-sdk-storagegateway-1.11.549.pom 2019-12-08T12:17:46.076 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-route53/1.11.549/aws-java-sdk-route53-1.11.549.pom 2019-12-08T12:17:46.171 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sts/1.11.549/aws-java-sdk-sts-1.11.549.pom 2019-12-08T12:17:46.172 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mobile/1.11.549/aws-java-sdk-mobile-1.11.549.pom 2019-12-08T12:17:46.172 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-rds/1.11.549/aws-java-sdk-rds-1.11.549.pom 2019-12-08T12:17:46.172 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iam/1.11.549/aws-java-sdk-iam-1.11.549.pom 2019-12-08T12:17:46.172 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-redshift/1.11.549/aws-java-sdk-redshift-1.11.549.pom 2019-12-08T12:17:46.172 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-datapipeline/1.11.549/aws-java-sdk-datapipeline-1.11.549.pom 2019-12-08T12:17:46.172 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-glacier/1.11.549/aws-java-sdk-glacier-1.11.549.pom 2019-12-08T12:17:46.173 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticloadbalancing/1.11.549/aws-java-sdk-elasticloadbalancing-1.11.549.pom 2019-12-08T12:17:46.173 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-importexport/1.11.549/aws-java-sdk-importexport-1.11.549.pom 2019-12-08T12:17:46.173 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticbeanstalk/1.11.549/aws-java-sdk-elasticbeanstalk-1.11.549.pom 2019-12-08T12:17:46.173 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticloadbalancingv2/1.11.549/aws-java-sdk-elasticloadbalancingv2-1.11.549.pom 2019-12-08T12:17:46.173 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-emr/1.11.549/aws-java-sdk-emr-1.11.549.pom 2019-12-08T12:17:46.173 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticache/1.11.549/aws-java-sdk-elasticache-1.11.549.pom 2019-12-08T12:17:46.174 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elastictranscoder/1.11.549/aws-java-sdk-elastictranscoder-1.11.549.pom 2019-12-08T12:17:46.174 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ec2/1.11.549/aws-java-sdk-ec2-1.11.549.pom 2019-12-08T12:17:46.174 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-dynamodb/1.11.549/aws-java-sdk-dynamodb-1.11.549.pom 2019-12-08T12:17:46.174 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sns/1.11.549/aws-java-sdk-sns-1.11.549.pom 2019-12-08T12:17:46.174 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudwatch/1.11.549/aws-java-sdk-cloudwatch-1.11.549.pom 2019-12-08T12:17:46.174 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudtrail/1.11.549/aws-java-sdk-cloudtrail-1.11.549.pom 2019-12-08T12:17:46.175 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-logs/1.11.549/aws-java-sdk-logs-1.11.549.pom 2019-12-08T12:17:46.175 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-events/1.11.549/aws-java-sdk-events-1.11.549.pom 2019-12-08T12:17:46.175 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-budgets/1.11.549/aws-java-sdk-budgets-1.11.549.pom 2019-12-08T12:17:46.175 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cognitoidentity/1.11.549/aws-java-sdk-cognitoidentity-1.11.549.pom 2019-12-08T12:17:46.175 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cognitosync/1.11.549/aws-java-sdk-cognitosync-1.11.549.pom 2019-12-08T12:17:46.176 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudformation/1.11.549/aws-java-sdk-cloudformation-1.11.549.pom 2019-12-08T12:17:46.176 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-directconnect/1.11.549/aws-java-sdk-directconnect-1.11.549.pom 2019-12-08T12:17:46.176 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudfront/1.11.549/aws-java-sdk-cloudfront-1.11.549.pom 2019-12-08T12:17:46.176 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-clouddirectory/1.11.549/aws-java-sdk-clouddirectory-1.11.549.pom 2019-12-08T12:17:46.176 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kinesis/1.11.549/aws-java-sdk-kinesis-1.11.549.pom 2019-12-08T12:17:46.176 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-opsworks/1.11.549/aws-java-sdk-opsworks-1.11.549.pom 2019-12-08T12:17:46.176 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ses/1.11.549/aws-java-sdk-ses-1.11.549.pom 2019-12-08T12:17:46.177 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-autoscaling/1.11.549/aws-java-sdk-autoscaling-1.11.549.pom 2019-12-08T12:17:46.177 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudwatchmetrics/1.11.549/aws-java-sdk-cloudwatchmetrics-1.11.549.pom 2019-12-08T12:17:46.177 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codepipeline/1.11.549/aws-java-sdk-codepipeline-1.11.549.pom 2019-12-08T12:17:46.177 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kms/1.11.549/aws-java-sdk-kms-1.11.549.pom 2019-12-08T12:17:46.177 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-config/1.11.549/aws-java-sdk-config-1.11.549.pom 2019-12-08T12:17:46.177 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codedeploy/1.11.549/aws-java-sdk-codedeploy-1.11.549.pom 2019-12-08T12:17:46.178 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudsearch/1.11.549/aws-java-sdk-cloudsearch-1.11.549.pom 2019-12-08T12:17:46.178 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ecs/1.11.549/aws-java-sdk-ecs-1.11.549.pom 2019-12-08T12:17:46.178 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-lambda/1.11.549/aws-java-sdk-lambda-1.11.549.pom 2019-12-08T12:17:46.178 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ecr/1.11.549/aws-java-sdk-ecr-1.11.549.pom 2019-12-08T12:17:46.178 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ssm/1.11.549/aws-java-sdk-ssm-1.11.549.pom 2019-12-08T12:17:46.178 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudhsm/1.11.549/aws-java-sdk-cloudhsm-1.11.549.pom 2019-12-08T12:17:46.178 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-machinelearning/1.11.549/aws-java-sdk-machinelearning-1.11.549.pom 2019-12-08T12:17:46.271 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-directory/1.11.549/aws-java-sdk-directory-1.11.549.pom 2019-12-08T12:17:46.271 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codecommit/1.11.549/aws-java-sdk-codecommit-1.11.549.pom 2019-12-08T12:17:46.271 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-efs/1.11.549/aws-java-sdk-efs-1.11.549.pom 2019-12-08T12:17:46.272 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-workspaces/1.11.549/aws-java-sdk-workspaces-1.11.549.pom 2019-12-08T12:17:46.272 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-devicefarm/1.11.549/aws-java-sdk-devicefarm-1.11.549.pom 2019-12-08T12:17:46.272 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-waf/1.11.549/aws-java-sdk-waf-1.11.549.pom 2019-12-08T12:17:46.272 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iot/1.11.549/aws-java-sdk-iot-1.11.549.pom 2019-12-08T12:17:46.272 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-marketplacecommerceanalytics/1.11.549/aws-java-sdk-marketplacecommerceanalytics-1.11.549.pom 2019-12-08T12:17:46.272 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-api-gateway/1.11.549/aws-java-sdk-api-gateway-1.11.549.pom 2019-12-08T12:17:46.273 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-acm/1.11.549/aws-java-sdk-acm-1.11.549.pom 2019-12-08T12:17:46.273 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticsearch/1.11.549/aws-java-sdk-elasticsearch-1.11.549.pom 2019-12-08T12:17:46.273 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-inspector/1.11.549/aws-java-sdk-inspector-1.11.549.pom 2019-12-08T12:17:46.273 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-gamelift/1.11.549/aws-java-sdk-gamelift-1.11.549.pom 2019-12-08T12:17:46.273 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-dms/1.11.549/aws-java-sdk-dms-1.11.549.pom 2019-12-08T12:17:46.273 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-discovery/1.11.549/aws-java-sdk-discovery-1.11.549.pom 2019-12-08T12:17:46.273 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-marketplacemeteringservice/1.11.549/aws-java-sdk-marketplacemeteringservice-1.11.549.pom 2019-12-08T12:17:46.274 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cognitoidp/1.11.549/aws-java-sdk-cognitoidp-1.11.549.pom 2019-12-08T12:17:46.274 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-snowball/1.11.549/aws-java-sdk-snowball-1.11.549.pom 2019-12-08T12:17:46.274 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-rekognition/1.11.549/aws-java-sdk-rekognition-1.11.549.pom 2019-12-08T12:17:46.274 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-applicationautoscaling/1.11.549/aws-java-sdk-applicationautoscaling-1.11.549.pom 2019-12-08T12:17:46.274 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-lightsail/1.11.549/aws-java-sdk-lightsail-1.11.549.pom 2019-12-08T12:17:46.274 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-polly/1.11.549/aws-java-sdk-polly-1.11.549.pom 2019-12-08T12:17:46.274 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-stepfunctions/1.11.549/aws-java-sdk-stepfunctions-1.11.549.pom 2019-12-08T12:17:46.275 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-costandusagereport/1.11.549/aws-java-sdk-costandusagereport-1.11.549.pom 2019-12-08T12:17:46.275 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-health/1.11.549/aws-java-sdk-health-1.11.549.pom 2019-12-08T12:17:46.275 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-appstream/1.11.549/aws-java-sdk-appstream-1.11.549.pom 2019-12-08T12:17:46.275 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codebuild/1.11.549/aws-java-sdk-codebuild-1.11.549.pom 2019-12-08T12:17:46.275 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-shield/1.11.549/aws-java-sdk-shield-1.11.549.pom 2019-12-08T12:17:46.276 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-batch/1.11.549/aws-java-sdk-batch-1.11.549.pom 2019-12-08T12:17:46.276 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-lex/1.11.549/aws-java-sdk-lex-1.11.549.pom 2019-12-08T12:17:46.276 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-organizations/1.11.549/aws-java-sdk-organizations-1.11.549.pom 2019-12-08T12:17:46.276 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-workdocs/1.11.549/aws-java-sdk-workdocs-1.11.549.pom 2019-12-08T12:17:46.276 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-models/1.11.549/aws-java-sdk-models-1.11.549.pom 2019-12-08T12:17:46.276 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mechanicalturkrequester/1.11.549/aws-java-sdk-mechanicalturkrequester-1.11.549.pom 2019-12-08T12:17:46.276 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-appmesh/1.11.549/aws-java-sdk-appmesh-1.11.549.pom 2019-12-08T12:17:46.277 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-swf-libraries/1.11.22/aws-java-sdk-swf-libraries-1.11.22.pom 2019-12-08T12:17:46.371 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pom/1.11.22/aws-java-sdk-pom-1.11.22.pom 2019-12-08T12:17:46.371 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/jmespath-java/1.11.549/jmespath-java-1.11.549.pom 2019-12-08T12:17:46.371 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/mx4j/mx4j-tools/3.0.1/mx4j-tools-3.0.1.pom 2019-12-08T12:17:46.372 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/net/jcip/jcip-annotations/1.0/jcip-annotations-1.0.pom 2019-12-08T12:17:46.372 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/jetty-repacked/7.6.1/jetty-repacked-7.6.1.pom 2019-12-08T12:17:46.372 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/org/mortbay/jetty/servlet-api-2.5/6.1.9/servlet-api-2.5-6.1.9.pom 2019-12-08T12:17:46.372 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/jetty-rc-repacked/5/jetty-rc-repacked-5.pom 2019-12-08T12:17:46.372 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/org/bouncycastle/bcpkix-jdk15on/1.48/bcpkix-jdk15on-1.48.pom 2019-12-08T12:17:46.372 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-java/2.44.0/selenium-java-2.44.0.pom 2019-12-08T12:17:46.372 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/org/bouncycastle/bcprov-jdk15on/1.48/bcprov-jdk15on-1.48.pom 2019-12-08T12:17:46.373 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.9/commons-codec-1.9.pom 2019-12-08T12:17:46.373 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/org/yaml/snakeyaml/1.8/snakeyaml-1.8.pom 2019-12-08T12:17:46.373 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/org/mortbay/jetty/project/6.1.9/project-6.1.9.pom 2019-12-08T12:17:46.474 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/32/commons-parent-32.pom 2019-12-08T12:17:46.474 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/junit/junit/3.8.1/junit-3.8.1.pom 2019-12-08T12:17:46.474 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/org/beanshell/bsh/2.0b4/bsh-2.0b4.pom 2019-12-08T12:17:46.474 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/beust/jcommander/1.12/jcommander-1.12.pom 2019-12-08T12:17:46.475 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/org/beanshell/beanshell/2.0b4/beanshell-2.0b4.pom 2019-12-08T12:17:46.571 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/commons-logging/commons-logging/1.2/commons-logging-1.2.pom 2019-12-08T12:17:46.571 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/34/commons-parent-34.pom 2019-12-08T12:17:46.571 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.10/commons-codec-1.10.pom 2019-12-08T12:17:46.572 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/35/commons-parent-35.pom 2019-12-08T12:17:46.572 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom 2019-12-08T12:17:46.572 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.9/httpcore-4.4.9.pom 2019-12-08T12:17:46.671 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.9/httpcomponents-core-4.4.9.pom 2019-12-08T12:17:46.672 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/9/httpcomponents-parent-9.pom 2019-12-08T12:17:46.672 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/core/jackson-core/2.6.7/jackson-core-2.6.7.pom 2019-12-08T12:17:46.672 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/core/jackson-annotations/2.6.0/jackson-annotations-2.6.0.pom 2019-12-08T12:17:46.672 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/jackson-parent/2.6.1/jackson-parent-2.6.1.pom 2019-12-08T12:17:46.672 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/oss-parent/23/oss-parent-23.pom 2019-12-08T12:17:46.673 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-codec-http/4.1.17.Final/netty-codec-http-4.1.17.Final.pom 2019-12-08T12:17:46.673 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-handler/4.1.17.Final/netty-handler-4.1.17.Final.pom 2019-12-08T12:17:46.673 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-parent/4.1.17.Final/netty-parent-4.1.17.Final.pom 2019-12-08T12:17:46.771 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom 2019-12-08T12:17:46.771 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-chrome-driver/2.44.0/selenium-chrome-driver-2.44.0.pom 2019-12-08T12:17:46.771 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-firefox-driver/2.44.0/selenium-firefox-driver-2.44.0.pom 2019-12-08T12:17:46.771 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-safari-driver/2.44.0/selenium-safari-driver-2.44.0.pom 2019-12-08T12:17:46.771 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/org/webbitserver/webbit/0.4.14/webbit-0.4.14.pom 2019-12-08T12:17:46.771 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-support/2.44.0/selenium-support-2.44.0.pom 2019-12-08T12:17:46.772 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-htmlunit-driver/2.44.0/selenium-htmlunit-driver-2.44.0.pom 2019-12-08T12:17:46.772 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-ie-driver/2.44.0/selenium-ie-driver-2.44.0.pom 2019-12-08T12:17:46.772 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/6/oss-parent-6.pom 2019-12-08T12:17:46.772 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-codec/4.1.17.Final/netty-codec-4.1.17.Final.pom 2019-12-08T12:17:46.772 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-transport/4.1.17.Final/netty-transport-4.1.17.Final.pom 2019-12-08T12:17:46.772 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-buffer/4.1.17.Final/netty-buffer-4.1.17.Final.pom 2019-12-08T12:17:46.871 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-remote-driver/2.44.0/selenium-remote-driver-2.44.0.pom 2019-12-08T12:17:46.871 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/net/sourceforge/htmlunit/htmlunit/2.15/htmlunit-2.15.pom 2019-12-08T12:17:46.871 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/commons-io/commons-io/2.4/commons-io-2.4.pom 2019-12-08T12:17:46.871 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-exec/1.1/commons-exec-1.1.pom 2019-12-08T12:17:46.873 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/25/commons-parent-25.pom 2019-12-08T12:17:46.873 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/17/commons-parent-17.pom 2019-12-08T12:17:46.873 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/org/apache/apache/7/apache-7.pom 2019-12-08T12:17:46.873 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/org/apache/apache/9/apache-9.pom 2019-12-08T12:17:46.873 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/net/java/dev/jna/platform/3.4.0/platform-3.4.0.pom 2019-12-08T12:17:46.873 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/net/java/dev/jna/jna/3.4.0/jna-3.4.0.pom 2019-12-08T12:17:46.971 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty/3.5.2.Final/netty-3.5.2.Final.pom 2019-12-08T12:17:46.971 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom 2019-12-08T12:17:46.971 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-common/4.1.17.Final/netty-common-4.1.17.Final.pom 2019-12-08T12:17:46.971 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-resolver/4.1.17.Final/netty-resolver-4.1.17.Final.pom 2019-12-08T12:17:46.972 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/cglib/cglib-nodep/2.1_3/cglib-nodep-2.1_3.pom 2019-12-08T12:17:46.972 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/google/guava/guava/18.0/guava-18.0.pom 2019-12-08T12:17:46.972 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/google/code/gson/gson/2.3/gson-2.3.pom 2019-12-08T12:17:46.974 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-api/2.44.0/selenium-api-2.44.0.pom 2019-12-08T12:17:46.974 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/18.0/guava-parent-18.0.pom 2019-12-08T12:17:46.974 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/commons-collections/commons-collections/3.2.1/commons-collections-3.2.1.pom 2019-12-08T12:17:46.974 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/net/sourceforge/nekohtml/nekohtml/1.9.21/nekohtml-1.9.21.pom 2019-12-08T12:17:46.974 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpmime/4.3.3/httpmime-4.3.3.pom 2019-12-08T12:17:46.975 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/xerces/xercesImpl/2.11.0/xercesImpl-2.11.0.pom 2019-12-08T12:17:46.975 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/net/sourceforge/htmlunit/htmlunit-core-js/2.15/htmlunit-core-js-2.15.pom 2019-12-08T12:17:46.975 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-websocket/8.1.15.v20140411/jetty-websocket-8.1.15.v20140411.pom 2019-12-08T12:17:46.975 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/net/sourceforge/cssparser/cssparser/0.9.14/cssparser-0.9.14.pom 2019-12-08T12:17:46.975 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/xalan/xalan/2.7.1/xalan-2.7.1.pom 2019-12-08T12:17:47.071 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/org/apache/apache/4/apache-4.pom 2019-12-08T12:17:47.071 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-project/8.1.15.v20140411/jetty-project-8.1.15.v20140411.pom 2019-12-08T12:17:47.071 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.3.3/httpcomponents-client-4.3.3.pom 2019-12-08T12:17:47.072 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.3.2/commons-lang3-3.3.2.pom 2019-12-08T12:17:47.072 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/9/commons-parent-9.pom 2019-12-08T12:17:47.072 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/33/commons-parent-33.pom 2019-12-08T12:17:47.072 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-parent/20/jetty-parent-20.pom 2019-12-08T12:17:47.072 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/project/7/project-7.pom 2019-12-08T12:17:47.073 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/xalan/serializer/2.7.1/serializer-2.7.1.pom 2019-12-08T12:17:47.073 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/xml-apis/xml-apis/1.4.01/xml-apis-1.4.01.pom 2019-12-08T12:17:47.074 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/org/w3c/css/sac/1.3/sac-1.3.pom 2019-12-08T12:17:47.074 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-util/8.1.15.v20140411/jetty-util-8.1.15.v20140411.pom 2019-12-08T12:17:47.074 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-http/8.1.15.v20140411/jetty-http-8.1.15.v20140411.pom 2019-12-08T12:17:47.074 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-io/8.1.15.v20140411/jetty-io-8.1.15.v20140411.pom 2019-12-08T12:17:47.872 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk/1.11.549/aws-java-sdk-1.11.549.jar 2019-12-08T12:17:47.872 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-glacier/1.11.549/aws-java-sdk-glacier-1.11.549.jar 2019-12-08T12:17:47.872 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudwatchmetrics/1.11.549/aws-java-sdk-cloudwatchmetrics-1.11.549.jar 2019-12-08T12:17:47.872 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sqs/1.11.549/aws-java-sdk-sqs-1.11.549.jar 2019-12-08T12:17:47.872 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-dynamodb/1.11.549/aws-java-sdk-dynamodb-1.11.549.jar 2019-12-08T12:17:47.873 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sns/1.11.549/aws-java-sdk-sns-1.11.549.jar 2019-12-08T12:17:47.873 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-s3/1.11.549/aws-java-sdk-s3-1.11.549.jar 2019-12-08T12:17:47.873 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-s3control/1.11.549/aws-java-sdk-s3control-1.11.549.jar 2019-12-08T12:17:47.873 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-managedblockchain/1.11.549/aws-java-sdk-managedblockchain-1.11.549.jar 2019-12-08T12:17:47.873 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-textract/1.11.549/aws-java-sdk-textract-1.11.549.jar 2019-12-08T12:17:47.971 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-backup/1.11.549/aws-java-sdk-backup-1.11.549.jar 2019-12-08T12:17:47.972 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-worklink/1.11.549/aws-java-sdk-worklink-1.11.549.jar 2019-12-08T12:17:47.972 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-docdb/1.11.549/aws-java-sdk-docdb-1.11.549.jar 2019-12-08T12:17:47.972 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kafka/1.11.549/aws-java-sdk-kafka-1.11.549.jar 2019-12-08T12:17:47.972 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-apigatewaymanagementapi/1.11.549/aws-java-sdk-apigatewaymanagementapi-1.11.549.jar 2019-12-08T12:17:47.972 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-apigatewayv2/1.11.549/aws-java-sdk-apigatewayv2-1.11.549.jar 2019-12-08T12:17:47.972 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-licensemanager/1.11.549/aws-java-sdk-licensemanager-1.11.549.jar 2019-12-08T12:17:47.972 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-appmesh/1.11.549/aws-java-sdk-appmesh-1.11.549.jar 2019-12-08T12:17:47.973 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-securityhub/1.11.549/aws-java-sdk-securityhub-1.11.549.jar 2019-12-08T12:17:47.974 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-fsx/1.11.549/aws-java-sdk-fsx-1.11.549.jar 2019-12-08T12:17:47.974 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediaconnect/1.11.549/aws-java-sdk-mediaconnect-1.11.549.jar 2019-12-08T12:17:47.975 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kinesisanalyticsv2/1.11.549/aws-java-sdk-kinesisanalyticsv2-1.11.549.jar 2019-12-08T12:17:47.975 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-comprehendmedical/1.11.549/aws-java-sdk-comprehendmedical-1.11.549.jar 2019-12-08T12:17:47.975 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-globalaccelerator/1.11.549/aws-java-sdk-globalaccelerator-1.11.549.jar 2019-12-08T12:17:47.975 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-transfer/1.11.549/aws-java-sdk-transfer-1.11.549.jar 2019-12-08T12:17:47.975 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-datasync/1.11.549/aws-java-sdk-datasync-1.11.549.jar 2019-12-08T12:17:47.975 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-quicksight/1.11.549/aws-java-sdk-quicksight-1.11.549.jar 2019-12-08T12:17:47.976 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-route53resolver/1.11.549/aws-java-sdk-route53resolver-1.11.549.jar 2019-12-08T12:17:47.976 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-amplify/1.11.549/aws-java-sdk-amplify-1.11.549.jar 2019-12-08T12:17:47.976 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ram/1.11.549/aws-java-sdk-ram-1.11.549.jar 2019-12-08T12:17:48.071 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-rdsdata/1.11.549/aws-java-sdk-rdsdata-1.11.549.jar 2019-12-08T12:17:48.071 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pinpointsmsvoice/1.11.549/aws-java-sdk-pinpointsmsvoice-1.11.549.jar 2019-12-08T12:17:48.071 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-robomaker/1.11.549/aws-java-sdk-robomaker-1.11.549.jar 2019-12-08T12:17:48.071 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pinpointemail/1.11.549/aws-java-sdk-pinpointemail-1.11.549.jar 2019-12-08T12:17:48.071 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-chime/1.11.549/aws-java-sdk-chime-1.11.549.jar 2019-12-08T12:17:48.072 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-dlm/1.11.549/aws-java-sdk-dlm-1.11.549.jar 2019-12-08T12:17:48.072 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-signer/1.11.549/aws-java-sdk-signer-1.11.549.jar 2019-12-08T12:17:48.072 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-eks/1.11.549/aws-java-sdk-eks-1.11.549.jar 2019-12-08T12:17:48.072 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-macie/1.11.549/aws-java-sdk-macie-1.11.549.jar 2019-12-08T12:17:48.072 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediatailor/1.11.549/aws-java-sdk-mediatailor-1.11.549.jar 2019-12-08T12:17:48.073 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-neptune/1.11.549/aws-java-sdk-neptune-1.11.549.jar 2019-12-08T12:17:48.073 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pi/1.11.549/aws-java-sdk-pi-1.11.549.jar 2019-12-08T12:17:48.073 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iot1clickprojects/1.11.549/aws-java-sdk-iot1clickprojects-1.11.549.jar 2019-12-08T12:17:48.073 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-acmpca/1.11.549/aws-java-sdk-acmpca-1.11.549.jar 2019-12-08T12:17:48.073 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iot1clickdevices/1.11.549/aws-java-sdk-iot1clickdevices-1.11.549.jar 2019-12-08T12:17:48.073 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-fms/1.11.549/aws-java-sdk-fms-1.11.549.jar 2019-12-08T12:17:48.074 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-connect/1.11.549/aws-java-sdk-connect-1.11.549.jar 2019-12-08T12:17:48.074 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-secretsmanager/1.11.549/aws-java-sdk-secretsmanager-1.11.549.jar 2019-12-08T12:17:48.074 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iotanalytics/1.11.549/aws-java-sdk-iotanalytics-1.11.549.jar 2019-12-08T12:17:48.074 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-transcribe/1.11.549/aws-java-sdk-transcribe-1.11.549.jar 2019-12-08T12:17:48.074 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-autoscalingplans/1.11.549/aws-java-sdk-autoscalingplans-1.11.549.jar 2019-12-08T12:17:48.074 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-workmail/1.11.549/aws-java-sdk-workmail-1.11.549.jar 2019-12-08T12:17:48.074 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloud9/1.11.549/aws-java-sdk-cloud9-1.11.549.jar 2019-12-08T12:17:48.075 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-alexaforbusiness/1.11.549/aws-java-sdk-alexaforbusiness-1.11.549.jar 2019-12-08T12:17:48.075 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-serverlessapplicationrepository/1.11.549/aws-java-sdk-serverlessapplicationrepository-1.11.549.jar 2019-12-08T12:17:48.075 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-resourcegroups/1.11.549/aws-java-sdk-resourcegroups-1.11.549.jar 2019-12-08T12:17:48.075 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-translate/1.11.549/aws-java-sdk-translate-1.11.549.jar 2019-12-08T12:17:48.075 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-comprehend/1.11.549/aws-java-sdk-comprehend-1.11.549.jar 2019-12-08T12:17:48.075 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-servicediscovery/1.11.549/aws-java-sdk-servicediscovery-1.11.549.jar 2019-12-08T12:17:48.075 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sagemaker/1.11.549/aws-java-sdk-sagemaker-1.11.549.jar 2019-12-08T12:17:48.171 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iotjobsdataplane/1.11.549/aws-java-sdk-iotjobsdataplane-1.11.549.jar 2019-12-08T12:17:48.171 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sagemakerruntime/1.11.549/aws-java-sdk-sagemakerruntime-1.11.549.jar 2019-12-08T12:17:48.171 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-appsync/1.11.549/aws-java-sdk-appsync-1.11.549.jar 2019-12-08T12:17:48.172 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kinesisvideo/1.11.549/aws-java-sdk-kinesisvideo-1.11.549.jar 2019-12-08T12:17:48.172 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mq/1.11.549/aws-java-sdk-mq-1.11.549.jar 2019-12-08T12:17:48.172 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-guardduty/1.11.549/aws-java-sdk-guardduty-1.11.549.jar 2019-12-08T12:17:48.172 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediaconvert/1.11.549/aws-java-sdk-mediaconvert-1.11.549.jar 2019-12-08T12:17:48.173 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediastoredata/1.11.549/aws-java-sdk-mediastoredata-1.11.549.jar 2019-12-08T12:17:48.173 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediastore/1.11.549/aws-java-sdk-mediastore-1.11.549.jar 2019-12-08T12:17:48.174 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mediapackage/1.11.549/aws-java-sdk-mediapackage-1.11.549.jar 2019-12-08T12:17:48.174 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-medialive/1.11.549/aws-java-sdk-medialive-1.11.549.jar 2019-12-08T12:17:48.174 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-costexplorer/1.11.549/aws-java-sdk-costexplorer-1.11.549.jar 2019-12-08T12:17:48.174 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pricing/1.11.549/aws-java-sdk-pricing-1.11.549.jar 2019-12-08T12:17:48.174 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mobile/1.11.549/aws-java-sdk-mobile-1.11.549.jar 2019-12-08T12:17:48.174 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudhsmv2/1.11.549/aws-java-sdk-cloudhsmv2-1.11.549.jar 2019-12-08T12:17:48.273 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-glue/1.11.549/aws-java-sdk-glue-1.11.549.jar 2019-12-08T12:17:48.273 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-dax/1.11.549/aws-java-sdk-dax-1.11.549.jar 2019-12-08T12:17:48.273 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-athena/1.11.549/aws-java-sdk-athena-1.11.549.jar 2019-12-08T12:17:48.273 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codestar/1.11.549/aws-java-sdk-codestar-1.11.549.jar 2019-12-08T12:17:48.274 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-greengrass/1.11.549/aws-java-sdk-greengrass-1.11.549.jar 2019-12-08T12:17:48.274 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-migrationhub/1.11.549/aws-java-sdk-migrationhub-1.11.549.jar 2019-12-08T12:17:48.274 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-marketplaceentitlement/1.11.549/aws-java-sdk-marketplaceentitlement-1.11.549.jar 2019-12-08T12:17:48.274 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-lexmodelbuilding/1.11.549/aws-java-sdk-lexmodelbuilding-1.11.549.jar 2019-12-08T12:17:48.275 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-resourcegroupstaggingapi/1.11.549/aws-java-sdk-resourcegroupstaggingapi-1.11.549.jar 2019-12-08T12:17:48.275 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-xray/1.11.549/aws-java-sdk-xray-1.11.549.jar 2019-12-08T12:17:48.275 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-pinpoint/1.11.549/aws-java-sdk-pinpoint-1.11.549.jar 2019-12-08T12:17:48.275 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-opsworkscm/1.11.549/aws-java-sdk-opsworkscm-1.11.549.jar 2019-12-08T12:17:48.275 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-support/1.11.549/aws-java-sdk-support-1.11.549.jar 2019-12-08T12:17:48.276 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-simpledb/1.11.549/aws-java-sdk-simpledb-1.11.549.jar 2019-12-08T12:17:48.276 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-servicecatalog/1.11.549/aws-java-sdk-servicecatalog-1.11.549.jar 2019-12-08T12:17:48.276 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-simpleworkflow/1.11.549/aws-java-sdk-simpleworkflow-1.11.549.jar 2019-12-08T12:17:48.276 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-storagegateway/1.11.549/aws-java-sdk-storagegateway-1.11.549.jar 2019-12-08T12:17:48.372 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-swf-libraries/1.11.22/aws-java-sdk-swf-libraries-1.11.22.jar 2019-12-08T12:17:48.372 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-servermigration/1.11.549/aws-java-sdk-servermigration-1.11.549.jar 2019-12-08T12:17:48.372 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-route53/1.11.549/aws-java-sdk-route53-1.11.549.jar 2019-12-08T12:17:48.372 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-importexport/1.11.549/aws-java-sdk-importexport-1.11.549.jar 2019-12-08T12:17:48.372 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-sts/1.11.549/aws-java-sdk-sts-1.11.549.jar 2019-12-08T12:17:48.373 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-rds/1.11.549/aws-java-sdk-rds-1.11.549.jar 2019-12-08T12:17:48.373 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticbeanstalk/1.11.549/aws-java-sdk-elasticbeanstalk-1.11.549.jar 2019-12-08T12:17:48.373 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-redshift/1.11.549/aws-java-sdk-redshift-1.11.549.jar 2019-12-08T12:17:48.373 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iam/1.11.549/aws-java-sdk-iam-1.11.549.jar 2019-12-08T12:17:48.373 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticloadbalancingv2/1.11.549/aws-java-sdk-elasticloadbalancingv2-1.11.549.jar 2019-12-08T12:17:48.373 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticloadbalancing/1.11.549/aws-java-sdk-elasticloadbalancing-1.11.549.jar 2019-12-08T12:17:48.374 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-datapipeline/1.11.549/aws-java-sdk-datapipeline-1.11.549.jar 2019-12-08T12:17:48.374 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elastictranscoder/1.11.549/aws-java-sdk-elastictranscoder-1.11.549.jar 2019-12-08T12:17:48.374 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticache/1.11.549/aws-java-sdk-elasticache-1.11.549.jar 2019-12-08T12:17:48.471 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-emr/1.11.549/aws-java-sdk-emr-1.11.549.jar 2019-12-08T12:17:48.471 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudwatch/1.11.549/aws-java-sdk-cloudwatch-1.11.549.jar 2019-12-08T12:17:48.472 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudtrail/1.11.549/aws-java-sdk-cloudtrail-1.11.549.jar 2019-12-08T12:17:48.472 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ec2/1.11.549/aws-java-sdk-ec2-1.11.549.jar 2019-12-08T12:17:48.472 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-budgets/1.11.549/aws-java-sdk-budgets-1.11.549.jar 2019-12-08T12:17:48.472 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-events/1.11.549/aws-java-sdk-events-1.11.549.jar 2019-12-08T12:17:48.472 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-logs/1.11.549/aws-java-sdk-logs-1.11.549.jar 2019-12-08T12:17:48.472 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cognitoidentity/1.11.549/aws-java-sdk-cognitoidentity-1.11.549.jar 2019-12-08T12:17:48.473 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cognitosync/1.11.549/aws-java-sdk-cognitosync-1.11.549.jar 2019-12-08T12:17:48.571 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-directconnect/1.11.549/aws-java-sdk-directconnect-1.11.549.jar 2019-12-08T12:17:48.571 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudfront/1.11.549/aws-java-sdk-cloudfront-1.11.549.jar 2019-12-08T12:17:48.571 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-clouddirectory/1.11.549/aws-java-sdk-clouddirectory-1.11.549.jar 2019-12-08T12:17:48.572 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-opsworks/1.11.549/aws-java-sdk-opsworks-1.11.549.jar 2019-12-08T12:17:48.572 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kinesis/1.11.549/aws-java-sdk-kinesis-1.11.549.jar 2019-12-08T12:17:48.572 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudformation/1.11.549/aws-java-sdk-cloudformation-1.11.549.jar 2019-12-08T12:17:48.572 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ses/1.11.549/aws-java-sdk-ses-1.11.549.jar 2019-12-08T12:17:48.671 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-autoscaling/1.11.549/aws-java-sdk-autoscaling-1.11.549.jar 2019-12-08T12:17:48.672 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-lambda/1.11.549/aws-java-sdk-lambda-1.11.549.jar 2019-12-08T12:17:48.672 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-kms/1.11.549/aws-java-sdk-kms-1.11.549.jar 2019-12-08T12:17:48.672 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudsearch/1.11.549/aws-java-sdk-cloudsearch-1.11.549.jar 2019-12-08T12:17:48.672 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ecs/1.11.549/aws-java-sdk-ecs-1.11.549.jar 2019-12-08T12:17:48.672 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codedeploy/1.11.549/aws-java-sdk-codedeploy-1.11.549.jar 2019-12-08T12:17:48.672 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codepipeline/1.11.549/aws-java-sdk-codepipeline-1.11.549.jar 2019-12-08T12:17:48.673 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-config/1.11.549/aws-java-sdk-config-1.11.549.jar 2019-12-08T12:17:48.673 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ecr/1.11.549/aws-java-sdk-ecr-1.11.549.jar 2019-12-08T12:17:48.673 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-workspaces/1.11.549/aws-java-sdk-workspaces-1.11.549.jar 2019-12-08T12:17:48.673 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-ssm/1.11.549/aws-java-sdk-ssm-1.11.549.jar 2019-12-08T12:17:48.771 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-machinelearning/1.11.549/aws-java-sdk-machinelearning-1.11.549.jar 2019-12-08T12:17:48.772 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cloudhsm/1.11.549/aws-java-sdk-cloudhsm-1.11.549.jar 2019-12-08T12:17:48.772 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-efs/1.11.549/aws-java-sdk-efs-1.11.549.jar 2019-12-08T12:17:48.772 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-directory/1.11.549/aws-java-sdk-directory-1.11.549.jar 2019-12-08T12:17:48.773 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codecommit/1.11.549/aws-java-sdk-codecommit-1.11.549.jar 2019-12-08T12:17:48.773 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-devicefarm/1.11.549/aws-java-sdk-devicefarm-1.11.549.jar 2019-12-08T12:17:48.773 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-elasticsearch/1.11.549/aws-java-sdk-elasticsearch-1.11.549.jar 2019-12-08T12:17:48.773 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-waf/1.11.549/aws-java-sdk-waf-1.11.549.jar 2019-12-08T12:17:48.774 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-marketplacecommerceanalytics/1.11.549/aws-java-sdk-marketplacecommerceanalytics-1.11.549.jar 2019-12-08T12:17:48.774 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-inspector/1.11.549/aws-java-sdk-inspector-1.11.549.jar 2019-12-08T12:17:48.774 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-iot/1.11.549/aws-java-sdk-iot-1.11.549.jar 2019-12-08T12:17:48.774 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-api-gateway/1.11.549/aws-java-sdk-api-gateway-1.11.549.jar 2019-12-08T12:17:48.774 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-acm/1.11.549/aws-java-sdk-acm-1.11.549.jar 2019-12-08T12:17:48.775 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-gamelift/1.11.549/aws-java-sdk-gamelift-1.11.549.jar 2019-12-08T12:17:48.775 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-dms/1.11.549/aws-java-sdk-dms-1.11.549.jar 2019-12-08T12:17:48.775 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-marketplacemeteringservice/1.11.549/aws-java-sdk-marketplacemeteringservice-1.11.549.jar 2019-12-08T12:17:48.775 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-cognitoidp/1.11.549/aws-java-sdk-cognitoidp-1.11.549.jar 2019-12-08T12:17:48.776 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-discovery/1.11.549/aws-java-sdk-discovery-1.11.549.jar 2019-12-08T12:17:48.872 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-applicationautoscaling/1.11.549/aws-java-sdk-applicationautoscaling-1.11.549.jar 2019-12-08T12:17:48.872 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-snowball/1.11.549/aws-java-sdk-snowball-1.11.549.jar 2019-12-08T12:17:48.872 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-polly/1.11.549/aws-java-sdk-polly-1.11.549.jar 2019-12-08T12:17:48.872 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-rekognition/1.11.549/aws-java-sdk-rekognition-1.11.549.jar 2019-12-08T12:17:48.872 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-stepfunctions/1.11.549/aws-java-sdk-stepfunctions-1.11.549.jar 2019-12-08T12:17:48.872 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-lightsail/1.11.549/aws-java-sdk-lightsail-1.11.549.jar 2019-12-08T12:17:48.873 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-codebuild/1.11.549/aws-java-sdk-codebuild-1.11.549.jar 2019-12-08T12:17:48.873 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-costandusagereport/1.11.549/aws-java-sdk-costandusagereport-1.11.549.jar 2019-12-08T12:17:48.873 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-shield/1.11.549/aws-java-sdk-shield-1.11.549.jar 2019-12-08T12:17:48.873 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-batch/1.11.549/aws-java-sdk-batch-1.11.549.jar 2019-12-08T12:17:48.873 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-appstream/1.11.549/aws-java-sdk-appstream-1.11.549.jar 2019-12-08T12:17:48.873 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-health/1.11.549/aws-java-sdk-health-1.11.549.jar 2019-12-08T12:17:48.873 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-lex/1.11.549/aws-java-sdk-lex-1.11.549.jar 2019-12-08T12:17:48.874 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-mechanicalturkrequester/1.11.549/aws-java-sdk-mechanicalturkrequester-1.11.549.jar 2019-12-08T12:17:48.972 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-organizations/1.11.549/aws-java-sdk-organizations-1.11.549.jar 2019-12-08T12:17:48.973 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-server/2.44.0/selenium-server-2.44.0.jar 2019-12-08T12:17:48.973 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-core/1.11.549/aws-java-sdk-core-1.11.549.jar 2019-12-08T12:17:48.973 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-workdocs/1.11.549/aws-java-sdk-workdocs-1.11.549.jar 2019-12-08T12:17:48.973 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/org/testng/testng/6.1.1/testng-6.1.1.jar 2019-12-08T12:17:48.973 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/log4j/log4j/1.2.17/log4j-1.2.17.jar 2019-12-08T12:17:48.974 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-java/2.44.0/selenium-java-2.44.0.jar 2019-12-08T12:17:48.974 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-htmlunit-driver/2.44.0/selenium-htmlunit-driver-2.44.0.jar 2019-12-08T12:17:48.974 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-chrome-driver/2.44.0/selenium-chrome-driver-2.44.0.jar 2019-12-08T12:17:48.974 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-safari-driver/2.44.0/selenium-safari-driver-2.44.0.jar 2019-12-08T12:17:48.974 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-firefox-driver/2.44.0/selenium-firefox-driver-2.44.0.jar 2019-12-08T12:17:48.974 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-support/2.44.0/selenium-support-2.44.0.jar 2019-12-08T12:17:48.975 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-ie-driver/2.44.0/selenium-ie-driver-2.44.0.jar 2019-12-08T12:17:48.975 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/net/sourceforge/htmlunit/htmlunit/2.15/htmlunit-2.15.jar 2019-12-08T12:17:48.975 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-remote-driver/2.44.0/selenium-remote-driver-2.44.0.jar 2019-12-08T12:17:48.975 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpmime/4.3.3/httpmime-4.3.3.jar 2019-12-08T12:17:48.975 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.5/httpclient-4.5.5.jar 2019-12-08T12:17:48.975 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/commons-logging/commons-logging/1.2/commons-logging-1.2.jar 2019-12-08T12:17:48.976 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/jmespath-java/1.11.549/jmespath-java-1.11.549.jar 2019-12-08T12:17:48.976 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/dataformat/jackson-dataformat-cbor/2.6.7/jackson-dataformat-cbor-2.6.7.jar 2019-12-08T12:17:48.976 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/software/amazon/ion/ion-java/1.0.2/ion-java-1.0.2.jar 2019-12-08T12:17:48.976 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/core/jackson-databind/2.6.7.2/jackson-databind-2.6.7.2.jar 2019-12-08T12:17:48.976 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/joda-time/joda-time/2.8.1/joda-time-2.8.1.jar 2019-12-08T12:17:48.977 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/org/bouncycastle/bcpkix-jdk15on/1.48/bcpkix-jdk15on-1.48.jar 2019-12-08T12:17:49.071 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/mx4j/mx4j-tools/3.0.1/mx4j-tools-3.0.1.jar 2019-12-08T12:17:49.072 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/amazonaws/aws-java-sdk-models/1.11.549/aws-java-sdk-models-1.11.549.jar 2019-12-08T12:17:49.072 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/org/bouncycastle/bcprov-jdk15on/1.48/bcprov-jdk15on-1.48.jar 2019-12-08T12:17:49.072 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/org/mortbay/jetty/servlet-api-2.5/6.1.9/servlet-api-2.5-6.1.9.jar 2019-12-08T12:17:49.072 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/jetty-repacked/7.6.1/jetty-repacked-7.6.1.jar 2019-12-08T12:17:49.072 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/jetty-rc-repacked/5/jetty-rc-repacked-5.jar 2019-12-08T12:17:49.073 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/junit/junit/3.8.1/junit-3.8.1.jar 2019-12-08T12:17:49.073 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/net/jcip/jcip-annotations/1.0/jcip-annotations-1.0.jar 2019-12-08T12:17:49.073 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/org/yaml/snakeyaml/1.8/snakeyaml-1.8.jar 2019-12-08T12:17:49.073 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.10/commons-codec-1.10.jar 2019-12-08T12:17:49.073 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/org/beanshell/bsh/2.0b4/bsh-2.0b4.jar 2019-12-08T12:17:49.172 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.9/httpcore-4.4.9.jar 2019-12-08T12:17:49.172 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/core/jackson-annotations/2.6.0/jackson-annotations-2.6.0.jar 2019-12-08T12:17:49.172 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/fasterxml/jackson/core/jackson-core/2.6.7/jackson-core-2.6.7.jar 2019-12-08T12:17:49.173 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/beust/jcommander/1.12/jcommander-1.12.jar 2019-12-08T12:17:49.173 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-codec-http/4.1.17.Final/netty-codec-http-4.1.17.Final.jar 2019-12-08T12:17:49.173 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-handler/4.1.17.Final/netty-handler-4.1.17.Final.jar 2019-12-08T12:17:49.173 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-codec/4.1.17.Final/netty-codec-4.1.17.Final.jar 2019-12-08T12:17:49.173 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-buffer/4.1.17.Final/netty-buffer-4.1.17.Final.jar 2019-12-08T12:17:49.173 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/org/webbitserver/webbit/0.4.14/webbit-0.4.14.jar 2019-12-08T12:17:49.173 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/commons-io/commons-io/2.4/commons-io-2.4.jar 2019-12-08T12:17:49.174 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-transport/4.1.17.Final/netty-transport-4.1.17.Final.jar 2019-12-08T12:17:49.174 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-exec/1.1/commons-exec-1.1.jar 2019-12-08T12:17:49.174 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/net/java/dev/jna/jna/3.4.0/jna-3.4.0.jar 2019-12-08T12:17:49.174 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty/3.5.2.Final/netty-3.5.2.Final.jar 2019-12-08T12:17:49.174 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/net/java/dev/jna/platform/3.4.0/platform-3.4.0.jar 2019-12-08T12:17:49.174 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-common/4.1.17.Final/netty-common-4.1.17.Final.jar 2019-12-08T12:17:49.174 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/io/netty/netty-resolver/4.1.17.Final/netty-resolver-4.1.17.Final.jar 2019-12-08T12:17:49.175 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/org/seleniumhq/selenium/selenium-api/2.44.0/selenium-api-2.44.0.jar 2019-12-08T12:17:49.175 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/cglib/cglib-nodep/2.1_3/cglib-nodep-2.1_3.jar 2019-12-08T12:17:49.175 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/google/guava/guava/18.0/guava-18.0.jar 2019-12-08T12:17:49.176 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/com/google/code/gson/gson/2.3/gson-2.3.jar 2019-12-08T12:17:49.176 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/xalan/xalan/2.7.1/xalan-2.7.1.jar 2019-12-08T12:17:49.271 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/net/sourceforge/htmlunit/htmlunit-core-js/2.15/htmlunit-core-js-2.15.jar 2019-12-08T12:17:49.271 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/net/sourceforge/nekohtml/nekohtml/1.9.21/nekohtml-1.9.21.jar 2019-12-08T12:17:49.271 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/commons-collections/commons-collections/3.2.1/commons-collections-3.2.1.jar 2019-12-08T12:17:49.271 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.3.2/commons-lang3-3.3.2.jar 2019-12-08T12:17:49.272 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/xerces/xercesImpl/2.11.0/xercesImpl-2.11.0.jar 2019-12-08T12:17:49.272 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/net/sourceforge/cssparser/cssparser/0.9.14/cssparser-0.9.14.jar 2019-12-08T12:17:49.272 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-websocket/8.1.15.v20140411/jetty-websocket-8.1.15.v20140411.jar 2019-12-08T12:17:49.272 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/xalan/serializer/2.7.1/serializer-2.7.1.jar 2019-12-08T12:17:49.272 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/org/w3c/css/sac/1.3/sac-1.3.jar 2019-12-08T12:17:49.272 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/xml-apis/xml-apis/1.4.01/xml-apis-1.4.01.jar 2019-12-08T12:17:49.272 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-http/8.1.15.v20140411/jetty-http-8.1.15.v20140411.jar 2019-12-08T12:17:49.273 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-io/8.1.15.v20140411/jetty-io-8.1.15.v20140411.jar 2019-12-08T12:17:49.273 INFO:teuthology.orchestra.run.smithi079.stdout:Download https://repo.maven.apache.org/maven2/org/eclipse/jetty/jetty-util/8.1.15.v20140411/jetty-util-8.1.15.v20140411.jar 2019-12-08T12:17:57.671 INFO:teuthology.orchestra.run.smithi079.stdout:> Task :compileJava 2019-12-08T12:17:57.771 INFO:teuthology.orchestra.run.smithi079.stdout:> Task :processResources 2019-12-08T12:17:57.772 INFO:teuthology.orchestra.run.smithi079.stdout:> Task :classes 2019-12-08T12:17:58.172 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:17:58.172 INFO:teuthology.orchestra.run.smithi079.stdout:> Task :compileTestJava 2019-12-08T12:17:58.172 INFO:teuthology.orchestra.run.smithi079.stdout:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2019-12-08T12:17:58.172 INFO:teuthology.orchestra.run.smithi079.stdout:Note: Recompile with -Xlint:deprecation for details. 2019-12-08T12:17:58.173 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:17:58.173 INFO:teuthology.orchestra.run.smithi079.stdout:> Task :processTestResources NO-SOURCE 2019-12-08T12:17:58.173 INFO:teuthology.orchestra.run.smithi079.stdout:> Task :testClasses 2019-12-08T12:18:05.072 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:18:05.072 INFO:teuthology.orchestra.run.smithi079.stdout:> Task :test 2019-12-08T12:18:05.072 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:18:05.072 INFO:teuthology.orchestra.run.smithi079.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 STARTED 2019-12-08T12:18:54.275 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:18:54.275 INFO:teuthology.orchestra.run.smithi079.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 PASSED 2019-12-08T12:19:00.876 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:19:00.876 INFO:teuthology.orchestra.run.smithi079.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 STARTED 2019-12-08T12:19:02.676 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:19:02.676 INFO:teuthology.orchestra.run.smithi079.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 PASSED 2019-12-08T12:19:06.296 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:00:16:31.010 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T12:19:06.307 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:00:16:31.021 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T12:19:06.362 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:00:16:31.022 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T12:19:06.374 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:00:16:31.034 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T12:19:06.396 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:00:16:31.056 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T12:19:06.396 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:00:16:31.056 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T12:19:06.550 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:00:16:31.264 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T12:19:06.577 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:00:16:31.236 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T12:19:06.683 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:00:16:31.343 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T12:19:09.076 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:19:09.077 INFO:teuthology.orchestra.run.smithi079.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 STARTED 2019-12-08T12:19:47.579 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:19:47.579 INFO:teuthology.orchestra.run.smithi079.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 PASSED 2019-12-08T12:19:54.080 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:19:54.080 INFO:teuthology.orchestra.run.smithi079.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 STARTED 2019-12-08T12:19:54.280 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:19:54.280 INFO:teuthology.orchestra.run.smithi079.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 PASSED 2019-12-08T12:19:55.580 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:19:55.580 INFO:teuthology.orchestra.run.smithi079.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 STARTED 2019-12-08T12:19:59.280 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:19:59.280 INFO:teuthology.orchestra.run.smithi079.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 PASSED 2019-12-08T12:20:05.465 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:00:17:30.120 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T12:20:05.466 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:00:17:30.180 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T12:20:05.467 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:00:17:30.123 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T12:20:05.476 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:00:17:30.190 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T12:20:05.480 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:00:17:30.135 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T12:20:05.482 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:00:17:30.138 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T12:20:05.520 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:00:17:30.175 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T12:20:05.526 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:00:17:30.181 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T12:20:05.545 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:00:17:30.260 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T12:20:05.581 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:20:05.581 INFO:teuthology.orchestra.run.smithi079.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 STARTED 2019-12-08T12:20:28.082 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:20:28.082 INFO:teuthology.orchestra.run.smithi079.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 PASSED 2019-12-08T12:20:40.983 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:20:40.983 INFO:teuthology.orchestra.run.smithi079.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STARTED 2019-12-08T12:24:17.755 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:00:21:42.468 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T12:24:17.763 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:00:21:42.476 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T12:24:17.806 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:00:21:42.449 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T12:24:17.831 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:00:21:42.474 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T12:24:17.835 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:00:21:42.477 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T12:24:17.836 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:00:21:42.479 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T12:24:17.973 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:00:21:42.616 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T12:24:17.985 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:00:21:42.628 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T12:24:17.988 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:00:21:42.701 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T12:25:01.294 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:25:01.294 INFO:teuthology.orchestra.run.smithi079.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 PASSED 2019-12-08T12:25:18.994 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:25:18.994 INFO:teuthology.orchestra.run.smithi079.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 STARTED 2019-12-08T12:25:21.494 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:25:21.494 INFO:teuthology.orchestra.run.smithi079.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 PASSED 2019-12-08T12:25:26.794 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:25:26.794 INFO:teuthology.orchestra.run.smithi079.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 STARTED 2019-12-08T12:25:31.194 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:25:31.194 INFO:teuthology.orchestra.run.smithi079.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 PASSED 2019-12-08T12:25:41.594 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:25:41.594 INFO:teuthology.orchestra.run.smithi079.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 STARTED 2019-12-08T12:25:58.694 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:25:58.695 INFO:teuthology.orchestra.run.smithi079.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 PASSED 2019-12-08T12:26:06.503 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:26:06.503 INFO:teuthology.orchestra.run.smithi079.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 STARTED 2019-12-08T12:26:07.094 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:26:07.095 INFO:teuthology.orchestra.run.smithi079.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 PASSED 2019-12-08T12:26:08.494 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:26:08.495 INFO:teuthology.orchestra.run.smithi079.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 STARTED 2019-12-08T12:26:31.641 INFO:tasks.rgw.client.0.smithi079.stdout:2019-12-08T12:26:31.588+0000 3fa61700 -1 handle_data failed with exit code -5 2019-12-08T12:26:31.795 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:26:31.795 INFO:teuthology.orchestra.run.smithi079.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 PASSED 2019-12-08T12:26:40.895 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:26:40.895 INFO:teuthology.orchestra.run.smithi079.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 STARTED 2019-12-08T12:27:05.095 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:27:05.095 INFO:teuthology.orchestra.run.smithi079.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 PASSED 2019-12-08T12:27:19.995 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:27:19.996 INFO:teuthology.orchestra.run.smithi079.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 STARTED 2019-12-08T12:27:41.096 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:27:41.096 INFO:teuthology.orchestra.run.smithi079.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 PASSED 2019-12-08T12:27:49.496 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:27:49.496 INFO:teuthology.orchestra.run.smithi079.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 STARTED 2019-12-08T12:28:27.564 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:00:25:52.271 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T12:28:27.568 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:00:25:52.274 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T12:28:27.582 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:00:25:52.221 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T12:28:27.620 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:00:25:52.260 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T12:28:27.627 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:00:25:52.267 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T12:28:27.642 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:00:25:52.282 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T12:28:27.841 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:00:25:52.548 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T12:28:27.847 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:00:25:52.487 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T12:28:27.860 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:00:25:52.500 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T12:34:42.167 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:00:32:06.868 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T12:34:42.175 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:00:32:06.878 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T12:34:42.177 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:00:32:06.812 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T12:34:42.178 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:00:32:06.814 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T12:34:42.184 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:00:32:06.820 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T12:34:42.185 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:00:32:06.821 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T12:34:42.446 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:00:32:07.081 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T12:34:42.450 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:00:32:07.085 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T12:34:42.452 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:00:32:07.156 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T12:35:00.001 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:35:00.001 INFO:teuthology.orchestra.run.smithi079.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 PASSED 2019-12-08T12:35:05.201 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:35:05.201 INFO:teuthology.orchestra.run.smithi079.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 STARTED 2019-12-08T12:35:43.101 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:35:43.102 INFO:teuthology.orchestra.run.smithi079.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 PASSED 2019-12-08T12:35:49.402 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:35:49.402 INFO:teuthology.orchestra.run.smithi079.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 STARTED 2019-12-08T12:36:47.702 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:36:47.703 INFO:teuthology.orchestra.run.smithi079.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 PASSED 2019-12-08T12:36:54.602 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:36:54.603 INFO:teuthology.orchestra.run.smithi079.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 STARTED 2019-12-08T12:37:02.902 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:37:02.903 INFO:teuthology.orchestra.run.smithi079.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 PASSED 2019-12-08T12:37:15.603 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:37:15.603 INFO:teuthology.orchestra.run.smithi079.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 STARTED 2019-12-08T12:37:17.903 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:37:17.903 INFO:teuthology.orchestra.run.smithi079.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 PASSED 2019-12-08T12:37:23.404 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:37:23.404 INFO:teuthology.orchestra.run.smithi079.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 STARTED 2019-12-08T12:37:26.603 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:37:26.603 INFO:teuthology.orchestra.run.smithi079.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 PASSED 2019-12-08T12:37:36.303 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:37:36.303 INFO:teuthology.orchestra.run.smithi079.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 STARTED 2019-12-08T12:37:40.103 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:37:40.103 INFO:teuthology.orchestra.run.smithi079.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 PASSED 2019-12-08T12:37:46.803 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:37:46.803 INFO:teuthology.orchestra.run.smithi079.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 STARTED 2019-12-08T12:37:51.203 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:37:51.203 INFO:teuthology.orchestra.run.smithi079.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 PASSED 2019-12-08T12:37:57.903 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:37:57.903 INFO:teuthology.orchestra.run.smithi079.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 STARTED 2019-12-08T12:37:59.903 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:37:59.904 INFO:teuthology.orchestra.run.smithi079.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 PASSED 2019-12-08T12:38:09.703 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:38:09.703 INFO:teuthology.orchestra.run.smithi079.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 STARTED 2019-12-08T12:38:13.303 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:38:13.304 INFO:teuthology.orchestra.run.smithi079.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 PASSED 2019-12-08T12:38:20.203 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:38:20.204 INFO:teuthology.orchestra.run.smithi079.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 STARTED 2019-12-08T12:38:22.303 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:38:22.304 INFO:teuthology.orchestra.run.smithi079.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 PASSED 2019-12-08T12:38:28.103 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:38:28.103 INFO:teuthology.orchestra.run.smithi079.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 STARTED 2019-12-08T12:38:52.903 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:38:52.903 INFO:teuthology.orchestra.run.smithi079.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 PASSED 2019-12-08T12:39:01.703 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:39:01.703 INFO:teuthology.orchestra.run.smithi079.stdout:---------------------------------------------------------------------- 2019-12-08T12:39:01.703 INFO:teuthology.orchestra.run.smithi079.stdout:| Results: SUCCESS (26 tests, 26 successes, 0 failures, 0 skipped) | 2019-12-08T12:39:01.704 INFO:teuthology.orchestra.run.smithi079.stdout:---------------------------------------------------------------------- 2019-12-08T12:39:01.761 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:39:01.761 INFO:teuthology.orchestra.run.smithi079.stdout:BUILD SUCCESSFUL in 21m 21s 2019-12-08T12:39:01.761 INFO:teuthology.orchestra.run.smithi079.stdout:5 actionable tasks: 4 executed, 1 up-to-date 2019-12-08T12:39:02.080 INFO:teuthology.orchestra.run.smithi079:> radosgw-admin gc process --include-all 2019-12-08T12:39:02.268 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:02.266+0000 7fc6dd5e4ec0 20 rados->read ofs=0 len=0 2019-12-08T12:39:02.306 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:02.304+0000 7fc6dd5e4ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:39:02.306 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:02.304+0000 7fc6dd5e4ec0 20 rados->read ofs=0 len=0 2019-12-08T12:39:02.315 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:02.314+0000 7fc6dd5e4ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:39:02.315 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:02.314+0000 7fc6dd5e4ec0 20 rados->read ofs=0 len=0 2019-12-08T12:39:02.320 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:02.319+0000 7fc6dd5e4ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:39:02.320 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:02.319+0000 7fc6dd5e4ec0 20 rados->read ofs=0 len=0 2019-12-08T12:39:02.341 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:02.340+0000 7fc6dd5e4ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:39:02.594 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:02.593+0000 7fc6dd5e4ec0 20 RGWRados::pool_iterate: got zonegroup_info.fee0148b-7ae2-4cf0-a79e-86045a29cb7c 2019-12-08T12:39:02.595 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:02.593+0000 7fc6dd5e4ec0 20 RGWRados::pool_iterate: got zone_info.f8ab349b-4577-410d-b524-4ecaf50bb1bd 2019-12-08T12:39:02.595 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:02.593+0000 7fc6dd5e4ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-08T12:39:02.595 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:02.593+0000 7fc6dd5e4ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-08T12:39:02.595 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:02.593+0000 7fc6dd5e4ec0 20 rados->read ofs=0 len=0 2019-12-08T12:39:02.607 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:02.606+0000 7fc6dd5e4ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:39:02.608 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:02.606+0000 7fc6dd5e4ec0 20 rados->read ofs=0 len=0 2019-12-08T12:39:02.626 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:02.624+0000 7fc6dd5e4ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-08T12:39:02.626 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:02.624+0000 7fc6dd5e4ec0 20 rados->read ofs=0 len=0 2019-12-08T12:39:02.637 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:02.635+0000 7fc6dd5e4ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:39:02.637 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:02.635+0000 7fc6dd5e4ec0 20 rados->read ofs=0 len=0 2019-12-08T12:39:02.650 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:02.649+0000 7fc6dd5e4ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-08T12:39:02.650 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:02.649+0000 7fc6dd5e4ec0 20 rados->read ofs=0 len=0 2019-12-08T12:39:02.659 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:02.657+0000 7fc6dd5e4ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:39:02.659 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:02.657+0000 7fc6dd5e4ec0 10 cannot find current period zonegroup using local zonegroup 2019-12-08T12:39:02.659 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:02.657+0000 7fc6dd5e4ec0 20 rados->read ofs=0 len=0 2019-12-08T12:39:02.667 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:02.665+0000 7fc6dd5e4ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:39:02.667 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:02.665+0000 7fc6dd5e4ec0 20 rados->read ofs=0 len=0 2019-12-08T12:39:02.680 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:02.678+0000 7fc6dd5e4ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:39:02.680 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:02.678+0000 7fc6dd5e4ec0 20 rados->read ofs=0 len=0 2019-12-08T12:39:02.694 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:02.692+0000 7fc6dd5e4ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-08T12:39:02.694 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:02.692+0000 7fc6dd5e4ec0 20 zonegroup default 2019-12-08T12:39:02.694 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:02.692+0000 7fc6dd5e4ec0 20 rados->read ofs=0 len=0 2019-12-08T12:39:02.705 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:02.703+0000 7fc6dd5e4ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:39:02.705 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:02.703+0000 7fc6dd5e4ec0 10 Cannot find current period zone using local zone 2019-12-08T12:39:02.705 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:02.703+0000 7fc6dd5e4ec0 20 rados->read ofs=0 len=0 2019-12-08T12:39:02.712 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:02.710+0000 7fc6dd5e4ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:39:02.712 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:02.710+0000 7fc6dd5e4ec0 20 rados->read ofs=0 len=0 2019-12-08T12:39:02.724 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:02.722+0000 7fc6dd5e4ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:39:02.724 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:02.722+0000 7fc6dd5e4ec0 20 rados->read ofs=0 len=0 2019-12-08T12:39:02.744 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:02.743+0000 7fc6dd5e4ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-08T12:39:02.744 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:02.743+0000 7fc6dd5e4ec0 20 zone default found 2019-12-08T12:39:02.745 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:02.743+0000 7fc6dd5e4ec0 20 started sync module instance, tier type = 2019-12-08T12:39:02.745 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:02.743+0000 7fc6dd5e4ec0 20 started zone id=f8ab349b-4577-410d-b524-4ecaf50bb1bd (name=default) with tier type = 2019-12-08T12:39:03.208 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:03.206+0000 7fc6dd5e4ec0 20 add_watcher() i=0 2019-12-08T12:39:03.208 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:03.206+0000 7fc6dd5e4ec0 20 add_watcher() i=1 2019-12-08T12:39:03.208 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:03.206+0000 7fc6dd5e4ec0 20 add_watcher() i=2 2019-12-08T12:39:03.208 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:03.206+0000 7fc6dd5e4ec0 20 add_watcher() i=3 2019-12-08T12:39:03.208 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:03.206+0000 7fc6dd5e4ec0 20 add_watcher() i=4 2019-12-08T12:39:03.209 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:03.206+0000 7fc6dd5e4ec0 20 add_watcher() i=5 2019-12-08T12:39:03.209 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:03.206+0000 7fc6dd5e4ec0 20 add_watcher() i=6 2019-12-08T12:39:03.237 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:03.235+0000 7fc6dd5e4ec0 20 add_watcher() i=7 2019-12-08T12:39:03.237 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:03.235+0000 7fc6dd5e4ec0 2 all 8 watchers are set, enabling cache 2019-12-08T12:39:03.237 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:03.235+0000 7fc69b7de700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-08T12:39:03.257 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:03.255+0000 7fc6ca80e700 0 -- 172.21.15.79:0/339821284 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x56300f9803b0 msgr2=0x56300f99bad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-08T12:39:03.418 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:03.416+0000 7fc6cb00f700 0 -- 172.21.15.79:0/339821284 >> [v2:172.21.15.13:6824/9328,v1:172.21.15.13:6825/9328] conn(0x56300f9a86e0 msgr2=0x56300f9aab00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-08T12:39:04.925 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:04.923+0000 7fc609ffb700 20 reqs_thread_entry: start 2019-12-08T12:39:04.925 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:04.923+0000 7fc6037fe700 20 reqs_thread_entry: start 2019-12-08T12:39:04.925 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:04.923+0000 7fc6dd5e4ec0 20 init_complete bucket index max shards: 0 2019-12-08T12:39:04.925 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:04.923+0000 7fc601ffb700 20 reqs_thread_entry: start 2019-12-08T12:39:04.926 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:04.924+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-12-08T12:39:04.967 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:04.965+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:04.986 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:04.984+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:05.002 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:05.000+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-08T12:39:05.002 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:05.000+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process iterating over entry tag='2~rFJEDL2OI8dh2WTo2MF2U_Cc3jOGm4a', time=2019-12-08T14:18:53.042080+0000, chain.objs.size()=9 2019-12-08T12:39:05.002 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:05.000+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.13__multipart_key1.2~rFJEDL2OI8dh2WTo2MF2U_Cc3jOGm4a.1 2019-12-08T12:39:05.003 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:05.000+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.13__shadow_key1.2~rFJEDL2OI8dh2WTo2MF2U_Cc3jOGm4a.1_1 2019-12-08T12:39:05.003 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:05.000+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.13__multipart_key1.2~rFJEDL2OI8dh2WTo2MF2U_Cc3jOGm4a.2 2019-12-08T12:39:05.003 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:05.000+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.13__shadow_key1.2~rFJEDL2OI8dh2WTo2MF2U_Cc3jOGm4a.2_1 2019-12-08T12:39:05.003 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:05.000+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.13__multipart_key1.2~rFJEDL2OI8dh2WTo2MF2U_Cc3jOGm4a.3 2019-12-08T12:39:05.003 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:05.000+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.13__shadow_key1.2~rFJEDL2OI8dh2WTo2MF2U_Cc3jOGm4a.3_1 2019-12-08T12:39:05.003 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:05.000+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.13__multipart_key1.2~rFJEDL2OI8dh2WTo2MF2U_Cc3jOGm4a.4 2019-12-08T12:39:05.003 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:05.000+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.13__shadow_key1.2~rFJEDL2OI8dh2WTo2MF2U_Cc3jOGm4a.4_1 2019-12-08T12:39:05.004 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:05.000+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.13__multipart_key1.2~rFJEDL2OI8dh2WTo2MF2U_Cc3jOGm4a.5 2019-12-08T12:39:05.214 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:05.212+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-08T12:39:05.350 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:05.348+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-12-08T12:39:05.391 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:05.390+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:05.411 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:05.410+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:05.422 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:05.420+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:05.453 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:05.452+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-12-08T12:39:05.497 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:05.495+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:05.515 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:05.513+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:05.544 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:05.542+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-12-08T12:39:05.545 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:05.542+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process iterating over entry tag='f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.528', time=2019-12-08T14:26:33.536612+0000, chain.objs.size()=9 2019-12-08T12:39:05.545 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:05.542+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.25__multipart_key1.2~1wej7L3jI12Jqwm4hOChR2P9cAuW5jx.1 2019-12-08T12:39:05.545 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:05.543+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.25__shadow_key1.2~1wej7L3jI12Jqwm4hOChR2P9cAuW5jx.1_1 2019-12-08T12:39:05.545 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:05.543+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.25__multipart_key1.2~1wej7L3jI12Jqwm4hOChR2P9cAuW5jx.2 2019-12-08T12:39:05.545 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:05.543+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.25__shadow_key1.2~1wej7L3jI12Jqwm4hOChR2P9cAuW5jx.2_1 2019-12-08T12:39:05.545 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:05.543+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.25__multipart_key1.2~1wej7L3jI12Jqwm4hOChR2P9cAuW5jx.3 2019-12-08T12:39:05.546 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:05.543+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.25__shadow_key1.2~1wej7L3jI12Jqwm4hOChR2P9cAuW5jx.3_1 2019-12-08T12:39:05.546 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:05.543+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.25__multipart_key1.2~1wej7L3jI12Jqwm4hOChR2P9cAuW5jx.4 2019-12-08T12:39:05.546 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:05.543+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.25__shadow_key1.2~1wej7L3jI12Jqwm4hOChR2P9cAuW5jx.4_1 2019-12-08T12:39:05.546 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:05.543+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.25__multipart_key1.2~1wej7L3jI12Jqwm4hOChR2P9cAuW5jx.5 2019-12-08T12:39:05.547 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:05.543+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process iterating over entry tag='f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.636', time=2019-12-08T14:34:59.175803+0000, chain.objs.size()=16 2019-12-08T12:39:05.547 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:05.543+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__multipart_key1.2~II7c9RdBq7Uz4gedNOxc1WNS5851cf4.1 2019-12-08T12:39:05.547 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:05.543+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__shadow_key1.2~II7c9RdBq7Uz4gedNOxc1WNS5851cf4.1_1 2019-12-08T12:39:05.547 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:05.543+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__shadow_key1.2~II7c9RdBq7Uz4gedNOxc1WNS5851cf4.1_2 2019-12-08T12:39:05.669 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:05.667+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__multipart_key1.2~II7c9RdBq7Uz4gedNOxc1WNS5851cf4.2 2019-12-08T12:39:05.734 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:05.733+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__shadow_key1.2~II7c9RdBq7Uz4gedNOxc1WNS5851cf4.2_1 2019-12-08T12:39:05.804 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:05.802+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__shadow_key1.2~II7c9RdBq7Uz4gedNOxc1WNS5851cf4.2_2 2019-12-08T12:39:05.804 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:05.802+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__multipart_key1.2~II7c9RdBq7Uz4gedNOxc1WNS5851cf4.3 2019-12-08T12:39:05.860 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:05.858+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__shadow_key1.2~II7c9RdBq7Uz4gedNOxc1WNS5851cf4.3_1 2019-12-08T12:39:05.860 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:05.858+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__shadow_key1.2~II7c9RdBq7Uz4gedNOxc1WNS5851cf4.3_2 2019-12-08T12:39:05.860 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:05.858+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__multipart_key1.2~II7c9RdBq7Uz4gedNOxc1WNS5851cf4.4 2019-12-08T12:39:05.860 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:05.858+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__shadow_key1.2~II7c9RdBq7Uz4gedNOxc1WNS5851cf4.4_1 2019-12-08T12:39:05.860 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:05.858+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__shadow_key1.2~II7c9RdBq7Uz4gedNOxc1WNS5851cf4.4_2 2019-12-08T12:39:05.861 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:05.858+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__multipart_key1.2~II7c9RdBq7Uz4gedNOxc1WNS5851cf4.5 2019-12-08T12:39:05.861 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:05.858+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__shadow_key1.2~II7c9RdBq7Uz4gedNOxc1WNS5851cf4.5_1 2019-12-08T12:39:05.922 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:05.920+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__shadow_key1.2~II7c9RdBq7Uz4gedNOxc1WNS5851cf4.5_2 2019-12-08T12:39:05.922 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:05.920+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__multipart_key1.2~II7c9RdBq7Uz4gedNOxc1WNS5851cf4.6 2019-12-08T12:39:06.269 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:06.268+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-08T12:39:06.363 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:06.361+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-12-08T12:39:06.401 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:06.400+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:06.417 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:06.416+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:06.425 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:06.424+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:06.460 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:06.456+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-12-08T12:39:06.529 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:06.528+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:06.547 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:06.546+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:06.560 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:06.559+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-08T12:39:06.560 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:06.559+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process iterating over entry tag='2~XQ_BxN4oldZFqjz14tal7LmPfKqJdxc', time=2019-12-08T14:27:44.618325+0000, chain.objs.size()=5 2019-12-08T12:39:06.561 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:06.559+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.27__multipart_key1.2~XQ_BxN4oldZFqjz14tal7LmPfKqJdxc.7 2019-12-08T12:39:06.561 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:06.559+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.27__shadow_key1.2~XQ_BxN4oldZFqjz14tal7LmPfKqJdxc.7_1 2019-12-08T12:39:06.561 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:06.559+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.27__multipart_key1.2~XQ_BxN4oldZFqjz14tal7LmPfKqJdxc.10 2019-12-08T12:39:06.561 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:06.559+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.27__shadow_key1.2~XQ_BxN4oldZFqjz14tal7LmPfKqJdxc.10_1 2019-12-08T12:39:06.561 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:06.559+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.27__multipart_key1.2~XQ_BxN4oldZFqjz14tal7LmPfKqJdxc.13 2019-12-08T12:39:06.698 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:06.696+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-08T12:39:06.785 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:06.783+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-12-08T12:39:06.823 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:06.821+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:06.838 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:06.837+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:06.847 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:06.845+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:06.874 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:06.873+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-12-08T12:39:06.921 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:06.919+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:06.937 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:06.936+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:06.954 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:06.953+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-08T12:39:06.954 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:06.953+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process iterating over entry tag='f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.620', time=2019-12-08T14:32:54.725512+0000, chain.objs.size()=19 2019-12-08T12:39:06.955 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:06.953+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__multipart_key1.2~hx-CG6v4MtLXqyABiIYJvVZuS0ysuiB.1 2019-12-08T12:39:06.955 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:06.953+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__shadow_key1.2~hx-CG6v4MtLXqyABiIYJvVZuS0ysuiB.1_1 2019-12-08T12:39:06.955 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:06.953+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__multipart_key1.2~hx-CG6v4MtLXqyABiIYJvVZuS0ysuiB.2 2019-12-08T12:39:06.956 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:06.953+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__shadow_key1.2~hx-CG6v4MtLXqyABiIYJvVZuS0ysuiB.2_1 2019-12-08T12:39:06.956 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:06.953+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__multipart_key1.2~hx-CG6v4MtLXqyABiIYJvVZuS0ysuiB.3 2019-12-08T12:39:06.956 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:06.953+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__shadow_key1.2~hx-CG6v4MtLXqyABiIYJvVZuS0ysuiB.3_1 2019-12-08T12:39:06.956 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:06.953+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__multipart_key1.2~hx-CG6v4MtLXqyABiIYJvVZuS0ysuiB.4 2019-12-08T12:39:06.956 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:06.953+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__shadow_key1.2~hx-CG6v4MtLXqyABiIYJvVZuS0ysuiB.4_1 2019-12-08T12:39:06.956 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:06.953+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__multipart_key1.2~hx-CG6v4MtLXqyABiIYJvVZuS0ysuiB.5 2019-12-08T12:39:06.957 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:06.953+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__shadow_key1.2~hx-CG6v4MtLXqyABiIYJvVZuS0ysuiB.5_1 2019-12-08T12:39:06.957 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:06.953+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__multipart_key1.2~hx-CG6v4MtLXqyABiIYJvVZuS0ysuiB.6 2019-12-08T12:39:06.957 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:06.953+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__shadow_key1.2~hx-CG6v4MtLXqyABiIYJvVZuS0ysuiB.6_1 2019-12-08T12:39:07.234 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:07.232+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__multipart_key1.2~hx-CG6v4MtLXqyABiIYJvVZuS0ysuiB.7 2019-12-08T12:39:07.234 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:07.232+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__shadow_key1.2~hx-CG6v4MtLXqyABiIYJvVZuS0ysuiB.7_1 2019-12-08T12:39:07.235 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:07.232+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__multipart_key1.2~hx-CG6v4MtLXqyABiIYJvVZuS0ysuiB.8 2019-12-08T12:39:07.235 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:07.232+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__shadow_key1.2~hx-CG6v4MtLXqyABiIYJvVZuS0ysuiB.8_1 2019-12-08T12:39:07.235 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:07.232+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__multipart_key1.2~hx-CG6v4MtLXqyABiIYJvVZuS0ysuiB.9 2019-12-08T12:39:07.313 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:07.311+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__shadow_key1.2~hx-CG6v4MtLXqyABiIYJvVZuS0ysuiB.9_1 2019-12-08T12:39:07.313 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:07.311+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__multipart_key1.2~hx-CG6v4MtLXqyABiIYJvVZuS0ysuiB.10 2019-12-08T12:39:07.523 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:07.521+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-08T12:39:07.611 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:07.609+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-12-08T12:39:07.656 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:07.654+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:07.676 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:07.674+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:07.693 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:07.692+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:07.735 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:07.733+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-12-08T12:39:07.818 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:07.817+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:07.845 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:07.844+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:07.877 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:07.875+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-12-08T12:39:07.877 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:07.875+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process iterating over entry tag='f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.595', time=2019-12-08T14:30:23.281032+0000, chain.objs.size()=21 2019-12-08T12:39:07.877 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:07.875+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__multipart_key1.2~BBpomY7Vs4eXOsxKVERaTt6iIC0omyM.1 2019-12-08T12:39:07.878 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:07.875+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__shadow_key1.2~BBpomY7Vs4eXOsxKVERaTt6iIC0omyM.1_1 2019-12-08T12:39:07.878 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:07.875+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__multipart_key1.2~BBpomY7Vs4eXOsxKVERaTt6iIC0omyM.2 2019-12-08T12:39:07.878 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:07.875+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__shadow_key1.2~BBpomY7Vs4eXOsxKVERaTt6iIC0omyM.2_1 2019-12-08T12:39:07.878 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:07.875+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__multipart_key1.2~BBpomY7Vs4eXOsxKVERaTt6iIC0omyM.3 2019-12-08T12:39:07.878 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:07.875+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__shadow_key1.2~BBpomY7Vs4eXOsxKVERaTt6iIC0omyM.3_1 2019-12-08T12:39:07.879 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:07.875+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__multipart_key1.2~BBpomY7Vs4eXOsxKVERaTt6iIC0omyM.4 2019-12-08T12:39:07.879 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:07.875+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__shadow_key1.2~BBpomY7Vs4eXOsxKVERaTt6iIC0omyM.4_1 2019-12-08T12:39:07.879 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:07.875+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__multipart_key1.2~BBpomY7Vs4eXOsxKVERaTt6iIC0omyM.5 2019-12-08T12:39:07.879 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:07.875+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__shadow_key1.2~BBpomY7Vs4eXOsxKVERaTt6iIC0omyM.5_1 2019-12-08T12:39:07.879 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:07.875+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__multipart_key1.2~BBpomY7Vs4eXOsxKVERaTt6iIC0omyM.6 2019-12-08T12:39:07.879 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:07.875+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__shadow_key1.2~BBpomY7Vs4eXOsxKVERaTt6iIC0omyM.6_1 2019-12-08T12:39:08.032 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:08.030+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__multipart_key1.2~BBpomY7Vs4eXOsxKVERaTt6iIC0omyM.7 2019-12-08T12:39:08.035 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:08.033+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__shadow_key1.2~BBpomY7Vs4eXOsxKVERaTt6iIC0omyM.7_1 2019-12-08T12:39:08.035 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:08.033+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__multipart_key1.2~BBpomY7Vs4eXOsxKVERaTt6iIC0omyM.8 2019-12-08T12:39:08.048 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:08.046+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__shadow_key1.2~BBpomY7Vs4eXOsxKVERaTt6iIC0omyM.8_1 2019-12-08T12:39:08.104 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:08.102+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__multipart_key1.2~BBpomY7Vs4eXOsxKVERaTt6iIC0omyM.9 2019-12-08T12:39:08.196 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:08.194+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__shadow_key1.2~BBpomY7Vs4eXOsxKVERaTt6iIC0omyM.9_1 2019-12-08T12:39:08.196 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:08.194+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__multipart_key1.2~BBpomY7Vs4eXOsxKVERaTt6iIC0omyM.10 2019-12-08T12:39:08.196 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:08.194+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__shadow_key1.2~BBpomY7Vs4eXOsxKVERaTt6iIC0omyM.10_1 2019-12-08T12:39:08.196 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:08.194+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__multipart_key1.2~BBpomY7Vs4eXOsxKVERaTt6iIC0omyM.11 2019-12-08T12:39:08.197 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:08.194+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process iterating over entry tag='f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.644', time=2019-12-08T14:35:01.806958+0000, chain.objs.size()=16 2019-12-08T12:39:08.197 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:08.194+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__multipart_key1.2~obwjg5O03vfZfFDiI7qQ2r_Ro_op5uT.1 2019-12-08T12:39:08.197 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:08.194+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__shadow_key1.2~obwjg5O03vfZfFDiI7qQ2r_Ro_op5uT.1_1 2019-12-08T12:39:08.273 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:08.271+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__shadow_key1.2~obwjg5O03vfZfFDiI7qQ2r_Ro_op5uT.1_2 2019-12-08T12:39:08.273 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:08.271+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__multipart_key1.2~obwjg5O03vfZfFDiI7qQ2r_Ro_op5uT.2 2019-12-08T12:39:08.292 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:08.290+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__shadow_key1.2~obwjg5O03vfZfFDiI7qQ2r_Ro_op5uT.2_1 2019-12-08T12:39:08.329 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:08.327+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__shadow_key1.2~obwjg5O03vfZfFDiI7qQ2r_Ro_op5uT.2_2 2019-12-08T12:39:08.357 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:08.356+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__multipart_key1.2~obwjg5O03vfZfFDiI7qQ2r_Ro_op5uT.3 2019-12-08T12:39:08.550 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:08.548+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__shadow_key1.2~obwjg5O03vfZfFDiI7qQ2r_Ro_op5uT.3_1 2019-12-08T12:39:08.550 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:08.548+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__shadow_key1.2~obwjg5O03vfZfFDiI7qQ2r_Ro_op5uT.3_2 2019-12-08T12:39:08.550 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:08.548+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__multipart_key1.2~obwjg5O03vfZfFDiI7qQ2r_Ro_op5uT.4 2019-12-08T12:39:08.551 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:08.548+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__shadow_key1.2~obwjg5O03vfZfFDiI7qQ2r_Ro_op5uT.4_1 2019-12-08T12:39:08.551 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:08.548+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__shadow_key1.2~obwjg5O03vfZfFDiI7qQ2r_Ro_op5uT.4_2 2019-12-08T12:39:08.551 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:08.548+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__multipart_key1.2~obwjg5O03vfZfFDiI7qQ2r_Ro_op5uT.5 2019-12-08T12:39:08.551 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:08.548+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__shadow_key1.2~obwjg5O03vfZfFDiI7qQ2r_Ro_op5uT.5_1 2019-12-08T12:39:08.552 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:08.548+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__shadow_key1.2~obwjg5O03vfZfFDiI7qQ2r_Ro_op5uT.5_2 2019-12-08T12:39:08.552 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:08.548+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__multipart_key1.2~obwjg5O03vfZfFDiI7qQ2r_Ro_op5uT.6 2019-12-08T12:39:08.893 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:08.891+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-08T12:39:08.995 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:08.994+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-12-08T12:39:09.045 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:09.044+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:09.062 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:09.061+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:09.076 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:09.074+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-08T12:39:09.077 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:09.074+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process iterating over entry tag='f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.438', time=2019-12-08T14:22:29.543357+0000, chain.objs.size()=9 2019-12-08T12:39:09.077 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:09.074+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.20__multipart_key1.2~L1HbHRaMjxGcoIaPF5NWSSB2LZQE5J2.1 2019-12-08T12:39:09.077 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:09.074+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.20__shadow_key1.2~L1HbHRaMjxGcoIaPF5NWSSB2LZQE5J2.1_1 2019-12-08T12:39:09.077 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:09.074+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.20__multipart_key1.2~L1HbHRaMjxGcoIaPF5NWSSB2LZQE5J2.2 2019-12-08T12:39:09.078 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:09.074+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.20__shadow_key1.2~L1HbHRaMjxGcoIaPF5NWSSB2LZQE5J2.2_1 2019-12-08T12:39:09.078 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:09.074+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.20__multipart_key1.2~L1HbHRaMjxGcoIaPF5NWSSB2LZQE5J2.3 2019-12-08T12:39:09.078 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:09.074+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.20__shadow_key1.2~L1HbHRaMjxGcoIaPF5NWSSB2LZQE5J2.3_1 2019-12-08T12:39:09.078 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:09.074+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.20__multipart_key1.2~L1HbHRaMjxGcoIaPF5NWSSB2LZQE5J2.4 2019-12-08T12:39:09.079 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:09.074+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.20__shadow_key1.2~L1HbHRaMjxGcoIaPF5NWSSB2LZQE5J2.4_1 2019-12-08T12:39:09.079 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:09.074+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.20__multipart_key1.2~L1HbHRaMjxGcoIaPF5NWSSB2LZQE5J2.5 2019-12-08T12:39:09.330 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:09.329+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-08T12:39:09.419 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:09.418+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-12-08T12:39:09.464 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:09.463+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:09.480 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:09.479+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:09.489 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:09.488+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:09.520 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:09.519+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-12-08T12:39:09.566 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:09.562+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:09.580 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:09.578+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:09.593 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:09.592+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-08T12:39:09.594 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:09.592+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process iterating over entry tag='f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.509', time=2019-12-08T14:26:00.339622+0000, chain.objs.size()=9 2019-12-08T12:39:09.594 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:09.592+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.24__multipart_key1.2~2wRcwnqPLGM6J_6u6sjWS96T6_c6ZNw.1 2019-12-08T12:39:09.594 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:09.592+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.24__shadow_key1.2~2wRcwnqPLGM6J_6u6sjWS96T6_c6ZNw.1_1 2019-12-08T12:39:09.594 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:09.592+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.24__multipart_key1.2~2wRcwnqPLGM6J_6u6sjWS96T6_c6ZNw.2 2019-12-08T12:39:09.594 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:09.592+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.24__shadow_key1.2~2wRcwnqPLGM6J_6u6sjWS96T6_c6ZNw.2_1 2019-12-08T12:39:09.594 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:09.592+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.24__multipart_key1.2~2wRcwnqPLGM6J_6u6sjWS96T6_c6ZNw.3 2019-12-08T12:39:09.595 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:09.592+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.24__shadow_key1.2~2wRcwnqPLGM6J_6u6sjWS96T6_c6ZNw.3_1 2019-12-08T12:39:09.595 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:09.592+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.24__multipart_key1.2~2wRcwnqPLGM6J_6u6sjWS96T6_c6ZNw.4 2019-12-08T12:39:09.595 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:09.592+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.24__shadow_key1.2~2wRcwnqPLGM6J_6u6sjWS96T6_c6ZNw.4_1 2019-12-08T12:39:09.595 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:09.592+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.24__multipart_key1.2~2wRcwnqPLGM6J_6u6sjWS96T6_c6ZNw.5 2019-12-08T12:39:09.968 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:09.965+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-08T12:39:10.045 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:10.043+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-12-08T12:39:10.107 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:10.106+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:10.125 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:10.123+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:10.133 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:10.132+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:10.180 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:10.178+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-12-08T12:39:10.236 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:10.235+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:10.262 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:10.260+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:10.271 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:10.270+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:10.325 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:10.323+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-12-08T12:39:10.403 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:10.402+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:10.432 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:10.430+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:10.444 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:10.442+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:10.503 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:10.502+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-12-08T12:39:10.589 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:10.588+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:10.632 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:10.630+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:10.657 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:10.655+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-08T12:39:10.657 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:10.655+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process iterating over entry tag='f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.446', time=2019-12-08T14:23:04.489321+0000, chain.objs.size()=9 2019-12-08T12:39:10.657 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:10.655+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.20__multipart_key1.2~mSGtqPmirVOGfcyMNNY9WY-1UpybLBI.1 2019-12-08T12:39:10.657 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:10.655+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.20__shadow_key1.2~mSGtqPmirVOGfcyMNNY9WY-1UpybLBI.1_1 2019-12-08T12:39:10.658 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:10.655+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.20__multipart_key1.2~mSGtqPmirVOGfcyMNNY9WY-1UpybLBI.2 2019-12-08T12:39:10.658 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:10.655+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.20__shadow_key1.2~mSGtqPmirVOGfcyMNNY9WY-1UpybLBI.2_1 2019-12-08T12:39:10.658 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:10.655+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.20__multipart_key1.2~mSGtqPmirVOGfcyMNNY9WY-1UpybLBI.3 2019-12-08T12:39:10.658 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:10.655+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.20__shadow_key1.2~mSGtqPmirVOGfcyMNNY9WY-1UpybLBI.3_1 2019-12-08T12:39:10.658 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:10.655+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.20__multipart_key1.2~mSGtqPmirVOGfcyMNNY9WY-1UpybLBI.4 2019-12-08T12:39:10.658 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:10.655+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.20__shadow_key1.2~mSGtqPmirVOGfcyMNNY9WY-1UpybLBI.4_1 2019-12-08T12:39:10.658 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:10.655+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.20__multipart_key1.2~mSGtqPmirVOGfcyMNNY9WY-1UpybLBI.5 2019-12-08T12:39:10.956 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:10.955+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-08T12:39:11.047 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:11.046+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-12-08T12:39:11.095 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:11.093+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:11.111 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:11.110+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:11.127 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:11.125+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-08T12:39:11.127 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:11.125+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process iterating over entry tag='f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.674', time=2019-12-08T14:36:49.506139+0000, chain.objs.size()=9 2019-12-08T12:39:11.127 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:11.125+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.30__multipart_key1.2~igxdAdd9RcVvJZlBffAaEUs7I_i0kTl.1 2019-12-08T12:39:11.127 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:11.125+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.30__shadow_key1.2~igxdAdd9RcVvJZlBffAaEUs7I_i0kTl.1_1 2019-12-08T12:39:11.128 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:11.125+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.30__multipart_key1.2~igxdAdd9RcVvJZlBffAaEUs7I_i0kTl.2 2019-12-08T12:39:11.128 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:11.125+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.30__shadow_key1.2~igxdAdd9RcVvJZlBffAaEUs7I_i0kTl.2_1 2019-12-08T12:39:11.128 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:11.125+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.30__multipart_key1.2~igxdAdd9RcVvJZlBffAaEUs7I_i0kTl.3 2019-12-08T12:39:11.128 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:11.125+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.30__shadow_key1.2~igxdAdd9RcVvJZlBffAaEUs7I_i0kTl.3_1 2019-12-08T12:39:11.128 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:11.125+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.30__multipart_key1.2~igxdAdd9RcVvJZlBffAaEUs7I_i0kTl.4 2019-12-08T12:39:11.128 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:11.125+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.30__shadow_key1.2~igxdAdd9RcVvJZlBffAaEUs7I_i0kTl.4_1 2019-12-08T12:39:11.129 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:11.125+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.30__multipart_key1.2~igxdAdd9RcVvJZlBffAaEUs7I_i0kTl.5 2019-12-08T12:39:11.422 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:11.420+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-08T12:39:11.502 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:11.501+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-12-08T12:39:11.548 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:11.546+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:11.563 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:11.562+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:11.575 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:11.573+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-08T12:39:11.575 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:11.573+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process iterating over entry tag='f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.466', time=2019-12-08T14:24:59.687154+0000, chain.objs.size()=7 2019-12-08T12:39:11.575 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:11.573+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.20__multipart_key1.2~7ZR4NUsaMVRYh8y3a8dPQcmt0RbGCCb.1 2019-12-08T12:39:11.575 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:11.573+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.20__shadow_key1.2~7ZR4NUsaMVRYh8y3a8dPQcmt0RbGCCb.1_1 2019-12-08T12:39:11.576 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:11.573+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.20__shadow_key1.2~7ZR4NUsaMVRYh8y3a8dPQcmt0RbGCCb.1_2 2019-12-08T12:39:11.576 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:11.573+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.20__multipart_key1.2~7ZR4NUsaMVRYh8y3a8dPQcmt0RbGCCb.2 2019-12-08T12:39:11.576 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:11.573+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.20__shadow_key1.2~7ZR4NUsaMVRYh8y3a8dPQcmt0RbGCCb.2_1 2019-12-08T12:39:11.576 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:11.573+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.20__shadow_key1.2~7ZR4NUsaMVRYh8y3a8dPQcmt0RbGCCb.2_2 2019-12-08T12:39:11.576 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:11.573+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.20__multipart_key1.2~7ZR4NUsaMVRYh8y3a8dPQcmt0RbGCCb.3 2019-12-08T12:39:11.770 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:11.769+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-08T12:39:11.854 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:11.852+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-12-08T12:39:11.890 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:11.888+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:11.904 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:11.903+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:11.913 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:11.912+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:11.962 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:11.961+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-12-08T12:39:12.057 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:12.055+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:12.088 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:12.087+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:12.105 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:12.104+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-08T12:39:12.105 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:12.104+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process iterating over entry tag='f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.430', time=2019-12-08T14:25:04.625144+0000, chain.objs.size()=5 2019-12-08T12:39:12.105 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:12.104+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.19__shadow_.eGyXYb6VkZB8w6NQtaIjloWrY5t64yz_1 2019-12-08T12:39:12.106 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:12.104+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.19__shadow_.eGyXYb6VkZB8w6NQtaIjloWrY5t64yz_2 2019-12-08T12:39:12.106 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:12.104+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.19__shadow_.eGyXYb6VkZB8w6NQtaIjloWrY5t64yz_3 2019-12-08T12:39:12.106 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:12.104+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.19__shadow_.eGyXYb6VkZB8w6NQtaIjloWrY5t64yz_4 2019-12-08T12:39:12.106 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:12.104+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.19__shadow_.eGyXYb6VkZB8w6NQtaIjloWrY5t64yz_5 2019-12-08T12:39:12.260 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:12.259+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-08T12:39:12.377 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:12.375+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-12-08T12:39:12.425 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:12.423+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:12.448 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:12.447+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:12.490 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:12.488+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-12-08T12:39:12.490 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:12.488+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process iterating over entry tag='f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.659', time=2019-12-08T14:35:44.594210+0000, chain.objs.size()=9 2019-12-08T12:39:12.490 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:12.488+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.29__multipart_key1.2~OkFMWDWulOfM-FkX64158rIck8RHcS0.1 2019-12-08T12:39:12.490 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:12.488+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.29__shadow_key1.2~OkFMWDWulOfM-FkX64158rIck8RHcS0.1_1 2019-12-08T12:39:12.491 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:12.488+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.29__multipart_key1.2~OkFMWDWulOfM-FkX64158rIck8RHcS0.2 2019-12-08T12:39:12.491 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:12.488+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.29__shadow_key1.2~OkFMWDWulOfM-FkX64158rIck8RHcS0.2_1 2019-12-08T12:39:12.491 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:12.488+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.29__multipart_key1.2~OkFMWDWulOfM-FkX64158rIck8RHcS0.3 2019-12-08T12:39:12.491 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:12.488+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.29__shadow_key1.2~OkFMWDWulOfM-FkX64158rIck8RHcS0.3_1 2019-12-08T12:39:12.491 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:12.488+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.29__multipart_key1.2~OkFMWDWulOfM-FkX64158rIck8RHcS0.4 2019-12-08T12:39:12.491 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:12.488+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.29__shadow_key1.2~OkFMWDWulOfM-FkX64158rIck8RHcS0.4_1 2019-12-08T12:39:12.491 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:12.488+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.29__multipart_key1.2~OkFMWDWulOfM-FkX64158rIck8RHcS0.5 2019-12-08T12:39:12.492 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:12.488+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process iterating over entry tag='2~L6jtZagYouWR2CeAmWNBzewhINuwIFG', time=2019-12-08T14:37:12.399438+0000, chain.objs.size()=40 2019-12-08T12:39:12.492 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:12.488+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.31__multipart_key1.2~L6jtZagYouWR2CeAmWNBzewhINuwIFG.1 2019-12-08T12:39:12.492 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:12.488+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.31__multipart_key1.2~L6jtZagYouWR2CeAmWNBzewhINuwIFG.2 2019-12-08T12:39:12.492 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:12.488+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.31__multipart_key1.2~L6jtZagYouWR2CeAmWNBzewhINuwIFG.3 2019-12-08T12:39:12.625 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:12.624+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.31__multipart_key1.2~L6jtZagYouWR2CeAmWNBzewhINuwIFG.4 2019-12-08T12:39:12.688 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:12.687+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.31__multipart_key1.2~L6jtZagYouWR2CeAmWNBzewhINuwIFG.5 2019-12-08T12:39:12.740 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:12.739+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.31__multipart_key1.2~L6jtZagYouWR2CeAmWNBzewhINuwIFG.6 2019-12-08T12:39:12.740 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:12.739+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.31__multipart_key1.2~L6jtZagYouWR2CeAmWNBzewhINuwIFG.7 2019-12-08T12:39:12.794 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:12.793+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.31__multipart_key1.2~L6jtZagYouWR2CeAmWNBzewhINuwIFG.8 2019-12-08T12:39:12.794 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:12.793+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.31__multipart_key1.2~L6jtZagYouWR2CeAmWNBzewhINuwIFG.9 2019-12-08T12:39:12.794 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:12.793+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.31__multipart_key1.2~L6jtZagYouWR2CeAmWNBzewhINuwIFG.10 2019-12-08T12:39:12.907 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:12.906+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.31__multipart_key1.2~L6jtZagYouWR2CeAmWNBzewhINuwIFG.11 2019-12-08T12:39:12.935 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:12.934+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.31__multipart_key1.2~L6jtZagYouWR2CeAmWNBzewhINuwIFG.12 2019-12-08T12:39:12.936 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:12.934+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.31__multipart_key1.2~L6jtZagYouWR2CeAmWNBzewhINuwIFG.13 2019-12-08T12:39:12.936 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:12.934+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.31__multipart_key1.2~L6jtZagYouWR2CeAmWNBzewhINuwIFG.14 2019-12-08T12:39:12.936 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:12.934+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.31__multipart_key1.2~L6jtZagYouWR2CeAmWNBzewhINuwIFG.15 2019-12-08T12:39:13.017 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:13.015+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.31__multipart_key1.2~L6jtZagYouWR2CeAmWNBzewhINuwIFG.16 2019-12-08T12:39:13.067 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:13.065+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.31__multipart_key1.2~L6jtZagYouWR2CeAmWNBzewhINuwIFG.17 2019-12-08T12:39:13.067 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:13.065+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.31__multipart_key1.2~L6jtZagYouWR2CeAmWNBzewhINuwIFG.18 2019-12-08T12:39:13.067 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:13.065+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.31__multipart_key1.QnhaaGnqNF4Tv5-TXWwsiHYpcE9s-nU.19 2019-12-08T12:39:13.067 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:13.065+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.31__multipart_key1.I-P6vcbOjVxFVaze4KODrBpEVO1ESwc.20 2019-12-08T12:39:13.067 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:13.065+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.31__multipart_key1.2~L6jtZagYouWR2CeAmWNBzewhINuwIFG.21 2019-12-08T12:39:13.071 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:13.070+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.31__multipart_key1.2~L6jtZagYouWR2CeAmWNBzewhINuwIFG.22 2019-12-08T12:39:13.110 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:13.108+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.31__multipart_key1.2~L6jtZagYouWR2CeAmWNBzewhINuwIFG.23 2019-12-08T12:39:13.110 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:13.108+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.31__multipart_key1.2~L6jtZagYouWR2CeAmWNBzewhINuwIFG.24 2019-12-08T12:39:13.110 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:13.108+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.31__multipart_key1.2~L6jtZagYouWR2CeAmWNBzewhINuwIFG.25 2019-12-08T12:39:13.110 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:13.108+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.31__multipart_key1.2~L6jtZagYouWR2CeAmWNBzewhINuwIFG.26 2019-12-08T12:39:13.110 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:13.108+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.31__multipart_key1.2~L6jtZagYouWR2CeAmWNBzewhINuwIFG.27 2019-12-08T12:39:13.286 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:13.285+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.31__multipart_key1.2~L6jtZagYouWR2CeAmWNBzewhINuwIFG.28 2019-12-08T12:39:13.381 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:13.380+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.31__multipart_key1.2~L6jtZagYouWR2CeAmWNBzewhINuwIFG.29 2019-12-08T12:39:13.382 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:13.380+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.31__multipart_key1.2~L6jtZagYouWR2CeAmWNBzewhINuwIFG.30 2019-12-08T12:39:13.400 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:13.398+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.31__multipart_key1.2~L6jtZagYouWR2CeAmWNBzewhINuwIFG.31 2019-12-08T12:39:13.400 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:13.399+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.31__multipart_key1.2~L6jtZagYouWR2CeAmWNBzewhINuwIFG.32 2019-12-08T12:39:13.400 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:13.399+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.31__multipart_key1.2~L6jtZagYouWR2CeAmWNBzewhINuwIFG.33 2019-12-08T12:39:13.400 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:13.399+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.31__multipart_key1.2~L6jtZagYouWR2CeAmWNBzewhINuwIFG.34 2019-12-08T12:39:13.401 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:13.399+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.31__multipart_key1.2~L6jtZagYouWR2CeAmWNBzewhINuwIFG.35 2019-12-08T12:39:13.669 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:13.667+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.31__multipart_key1.2~L6jtZagYouWR2CeAmWNBzewhINuwIFG.36 2019-12-08T12:39:13.669 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:13.667+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.31__multipart_key1.2~L6jtZagYouWR2CeAmWNBzewhINuwIFG.37 2019-12-08T12:39:13.669 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:13.667+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.31__multipart_key1.2~L6jtZagYouWR2CeAmWNBzewhINuwIFG.38 2019-12-08T12:39:13.669 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:13.667+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.31__multipart_key1.2~L6jtZagYouWR2CeAmWNBzewhINuwIFG.39 2019-12-08T12:39:13.759 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:13.757+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.31__multipart_key1.2~L6jtZagYouWR2CeAmWNBzewhINuwIFG.40 2019-12-08T12:39:13.921 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:13.920+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-08T12:39:14.043 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:14.042+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-12-08T12:39:14.106 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:14.105+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:14.136 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:14.135+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:14.168 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:14.166+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-12-08T12:39:14.168 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:14.166+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process iterating over entry tag='f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.454', time=2019-12-08T14:23:30.534944+0000, chain.objs.size()=9 2019-12-08T12:39:14.168 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:14.166+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.20__multipart_key1.2~-79GomyYnXyf4350vr8eh1kh-imRMq7.1 2019-12-08T12:39:14.168 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:14.166+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.20__shadow_key1.2~-79GomyYnXyf4350vr8eh1kh-imRMq7.1_1 2019-12-08T12:39:14.168 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:14.166+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.20__multipart_key1.2~-79GomyYnXyf4350vr8eh1kh-imRMq7.2 2019-12-08T12:39:14.168 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:14.166+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.20__shadow_key1.2~-79GomyYnXyf4350vr8eh1kh-imRMq7.2_1 2019-12-08T12:39:14.169 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:14.166+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.20__multipart_key1.2~-79GomyYnXyf4350vr8eh1kh-imRMq7.3 2019-12-08T12:39:14.169 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:14.166+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.20__shadow_key1.2~-79GomyYnXyf4350vr8eh1kh-imRMq7.3_1 2019-12-08T12:39:14.169 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:14.166+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.20__multipart_key1.2~-79GomyYnXyf4350vr8eh1kh-imRMq7.4 2019-12-08T12:39:14.169 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:14.166+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.20__shadow_key1.2~-79GomyYnXyf4350vr8eh1kh-imRMq7.4_1 2019-12-08T12:39:14.169 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:14.166+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.20__multipart_key1.2~-79GomyYnXyf4350vr8eh1kh-imRMq7.5 2019-12-08T12:39:14.169 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:14.166+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process iterating over entry tag='f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.560', time=2019-12-08T14:27:07.741396+0000, chain.objs.size()=9 2019-12-08T12:39:14.169 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:14.166+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.26__multipart_file.mpg.2~dRfjKJbOLlKaPP5mdpgnUunkeE2217A.1 2019-12-08T12:39:14.170 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:14.166+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.26__shadow_file.mpg.2~dRfjKJbOLlKaPP5mdpgnUunkeE2217A.1_1 2019-12-08T12:39:14.170 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:14.166+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.26__multipart_file.mpg.2~dRfjKJbOLlKaPP5mdpgnUunkeE2217A.2 2019-12-08T12:39:14.419 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:14.418+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.26__shadow_file.mpg.2~dRfjKJbOLlKaPP5mdpgnUunkeE2217A.2_1 2019-12-08T12:39:14.429 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:14.427+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.26__multipart_file.mpg.2~dRfjKJbOLlKaPP5mdpgnUunkeE2217A.3 2019-12-08T12:39:14.488 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:14.487+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.26__shadow_file.mpg.2~dRfjKJbOLlKaPP5mdpgnUunkeE2217A.3_1 2019-12-08T12:39:14.488 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:14.487+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.26__multipart_file.mpg.2~dRfjKJbOLlKaPP5mdpgnUunkeE2217A.4 2019-12-08T12:39:14.488 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:14.487+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.26__shadow_file.mpg.2~dRfjKJbOLlKaPP5mdpgnUunkeE2217A.4_1 2019-12-08T12:39:14.520 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:14.519+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.26__multipart_file.mpg.2~dRfjKJbOLlKaPP5mdpgnUunkeE2217A.5 2019-12-08T12:39:14.732 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:14.731+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-08T12:39:14.836 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:14.835+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-12-08T12:39:14.881 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:14.880+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:14.899 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:14.898+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:14.910 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:14.908+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:14.962 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:14.961+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-12-08T12:39:15.022 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:15.020+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:15.049 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:15.047+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:15.079 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:15.078+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-12-08T12:39:15.080 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:15.078+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process iterating over entry tag='f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.415', time=2019-12-08T14:20:30.710122+0000, chain.objs.size()=9 2019-12-08T12:39:15.080 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:15.078+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.17__multipart_key1.2~LDua7PJDcD38JTgrtx_NGL1GQINYg7c.1 2019-12-08T12:39:15.080 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:15.078+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.17__shadow_key1.2~LDua7PJDcD38JTgrtx_NGL1GQINYg7c.1_1 2019-12-08T12:39:15.080 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:15.078+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.17__multipart_key1.2~LDua7PJDcD38JTgrtx_NGL1GQINYg7c.2 2019-12-08T12:39:15.080 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:15.078+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.17__shadow_key1.2~LDua7PJDcD38JTgrtx_NGL1GQINYg7c.2_1 2019-12-08T12:39:15.081 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:15.078+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.17__multipart_key1.2~LDua7PJDcD38JTgrtx_NGL1GQINYg7c.3 2019-12-08T12:39:15.081 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:15.078+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.17__shadow_key1.2~LDua7PJDcD38JTgrtx_NGL1GQINYg7c.3_1 2019-12-08T12:39:15.081 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:15.078+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.17__multipart_key1.2~LDua7PJDcD38JTgrtx_NGL1GQINYg7c.4 2019-12-08T12:39:15.081 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:15.078+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.17__shadow_key1.2~LDua7PJDcD38JTgrtx_NGL1GQINYg7c.4_1 2019-12-08T12:39:15.083 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:15.078+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.17__multipart_key1.2~LDua7PJDcD38JTgrtx_NGL1GQINYg7c.5 2019-12-08T12:39:15.083 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:15.078+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process iterating over entry tag='f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.417', time=2019-12-08T14:20:36.804643+0000, chain.objs.size()=9 2019-12-08T12:39:15.083 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:15.078+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.17__multipart_key1.2~LDua7PJDcD38JTgrtx_NGL1GQINYg7c.1 2019-12-08T12:39:15.083 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:15.078+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.17__shadow_key1.2~LDua7PJDcD38JTgrtx_NGL1GQINYg7c.1_1 2019-12-08T12:39:15.083 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:15.078+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.17__multipart_key1.2~LDua7PJDcD38JTgrtx_NGL1GQINYg7c.2 2019-12-08T12:39:15.296 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:15.295+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.17__shadow_key1.2~LDua7PJDcD38JTgrtx_NGL1GQINYg7c.2_1 2019-12-08T12:39:15.296 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:15.295+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.17__multipart_key1.2~LDua7PJDcD38JTgrtx_NGL1GQINYg7c.3 2019-12-08T12:39:15.297 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:15.295+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.17__shadow_key1.2~LDua7PJDcD38JTgrtx_NGL1GQINYg7c.3_1 2019-12-08T12:39:15.299 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:15.298+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.17__multipart_key1.2~LDua7PJDcD38JTgrtx_NGL1GQINYg7c.4 2019-12-08T12:39:15.323 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:15.322+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.17__shadow_key1.2~LDua7PJDcD38JTgrtx_NGL1GQINYg7c.4_1 2019-12-08T12:39:15.323 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:15.322+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.17__multipart_key1.2~LDua7PJDcD38JTgrtx_NGL1GQINYg7c.5 2019-12-08T12:39:15.601 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:15.600+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-08T12:39:15.690 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:15.688+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-12-08T12:39:15.733 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:15.731+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:15.751 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:15.749+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:15.760 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:15.759+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:15.805 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:15.799+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-12-08T12:39:15.879 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:15.878+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:15.907 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:15.905+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:15.922 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:15.920+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:15.978 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:15.977+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-12-08T12:39:16.067 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:16.065+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:16.086 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:16.084+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:16.112 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:16.110+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-12-08T12:39:16.112 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:16.110+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process iterating over entry tag='f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.559', time=2019-12-08T14:27:10.326614+0000, chain.objs.size()=9 2019-12-08T12:39:16.112 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:16.110+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.26__multipart_file2.mpg.2~iHroX39Lrihf3UsOsuYNpUWW4bUzU3b.1 2019-12-08T12:39:16.112 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:16.110+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.26__shadow_file2.mpg.2~iHroX39Lrihf3UsOsuYNpUWW4bUzU3b.1_1 2019-12-08T12:39:16.112 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:16.110+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.26__multipart_file2.mpg.2~iHroX39Lrihf3UsOsuYNpUWW4bUzU3b.2 2019-12-08T12:39:16.112 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:16.110+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.26__shadow_file2.mpg.2~iHroX39Lrihf3UsOsuYNpUWW4bUzU3b.2_1 2019-12-08T12:39:16.113 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:16.110+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.26__multipart_file2.mpg.2~iHroX39Lrihf3UsOsuYNpUWW4bUzU3b.3 2019-12-08T12:39:16.113 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:16.110+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.26__shadow_file2.mpg.2~iHroX39Lrihf3UsOsuYNpUWW4bUzU3b.3_1 2019-12-08T12:39:16.115 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:16.110+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.26__multipart_file2.mpg.2~iHroX39Lrihf3UsOsuYNpUWW4bUzU3b.4 2019-12-08T12:39:16.115 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:16.110+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.26__shadow_file2.mpg.2~iHroX39Lrihf3UsOsuYNpUWW4bUzU3b.4_1 2019-12-08T12:39:16.115 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:16.110+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.26__multipart_file2.mpg.2~iHroX39Lrihf3UsOsuYNpUWW4bUzU3b.5 2019-12-08T12:39:16.115 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:16.110+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process iterating over entry tag='f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.608', time=2019-12-08T14:31:39.432444+0000, chain.objs.size()=21 2019-12-08T12:39:16.116 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:16.110+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__multipart_key1.2~56Ywqf7TCcEmT8qH7yn0AWv6DV5M3ra.1 2019-12-08T12:39:16.116 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:16.110+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__shadow_key1.2~56Ywqf7TCcEmT8qH7yn0AWv6DV5M3ra.1_1 2019-12-08T12:39:16.116 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:16.110+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__multipart_key1.2~56Ywqf7TCcEmT8qH7yn0AWv6DV5M3ra.2 2019-12-08T12:39:16.349 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:16.348+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__shadow_key1.2~56Ywqf7TCcEmT8qH7yn0AWv6DV5M3ra.2_1 2019-12-08T12:39:16.349 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:16.348+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__multipart_key1.2~56Ywqf7TCcEmT8qH7yn0AWv6DV5M3ra.3 2019-12-08T12:39:16.378 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:16.376+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__shadow_key1.2~56Ywqf7TCcEmT8qH7yn0AWv6DV5M3ra.3_1 2019-12-08T12:39:16.378 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:16.376+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__multipart_key1.2~56Ywqf7TCcEmT8qH7yn0AWv6DV5M3ra.4 2019-12-08T12:39:16.378 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:16.376+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__shadow_key1.2~56Ywqf7TCcEmT8qH7yn0AWv6DV5M3ra.4_1 2019-12-08T12:39:16.399 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:16.397+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__multipart_key1.2~56Ywqf7TCcEmT8qH7yn0AWv6DV5M3ra.5 2019-12-08T12:39:16.399 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:16.397+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__shadow_key1.2~56Ywqf7TCcEmT8qH7yn0AWv6DV5M3ra.5_1 2019-12-08T12:39:16.477 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:16.476+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__multipart_key1.2~56Ywqf7TCcEmT8qH7yn0AWv6DV5M3ra.6 2019-12-08T12:39:16.478 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:16.476+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__shadow_key1.2~56Ywqf7TCcEmT8qH7yn0AWv6DV5M3ra.6_1 2019-12-08T12:39:16.478 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:16.476+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__multipart_key1.2~56Ywqf7TCcEmT8qH7yn0AWv6DV5M3ra.7 2019-12-08T12:39:16.478 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:16.476+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__shadow_key1.2~56Ywqf7TCcEmT8qH7yn0AWv6DV5M3ra.7_1 2019-12-08T12:39:16.607 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:16.605+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__multipart_key1.2~56Ywqf7TCcEmT8qH7yn0AWv6DV5M3ra.8 2019-12-08T12:39:16.607 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:16.605+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__shadow_key1.2~56Ywqf7TCcEmT8qH7yn0AWv6DV5M3ra.8_1 2019-12-08T12:39:16.607 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:16.605+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__multipart_key1.2~56Ywqf7TCcEmT8qH7yn0AWv6DV5M3ra.9 2019-12-08T12:39:16.607 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:16.605+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__shadow_key1.2~56Ywqf7TCcEmT8qH7yn0AWv6DV5M3ra.9_1 2019-12-08T12:39:16.607 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:16.605+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__multipart_key1.2~56Ywqf7TCcEmT8qH7yn0AWv6DV5M3ra.10 2019-12-08T12:39:16.678 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:16.677+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__shadow_key1.2~56Ywqf7TCcEmT8qH7yn0AWv6DV5M3ra.10_1 2019-12-08T12:39:16.679 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:16.677+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__multipart_key1.2~56Ywqf7TCcEmT8qH7yn0AWv6DV5M3ra.11 2019-12-08T12:39:16.928 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:16.926+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-08T12:39:17.007 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:17.006+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-12-08T12:39:17.056 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:17.054+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:17.078 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:17.076+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:17.101 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:17.099+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-12-08T12:39:17.102 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:17.099+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process iterating over entry tag='f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.460', time=2019-12-08T14:24:16.161288+0000, chain.objs.size()=7 2019-12-08T12:39:17.102 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:17.099+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.20__multipart_key1.2~gDOYGLO2fW8ObPB5YAcSQ00uave476k.1 2019-12-08T12:39:17.102 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:17.099+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.20__shadow_key1.2~gDOYGLO2fW8ObPB5YAcSQ00uave476k.1_1 2019-12-08T12:39:17.102 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:17.099+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.20__shadow_key1.2~gDOYGLO2fW8ObPB5YAcSQ00uave476k.1_2 2019-12-08T12:39:17.102 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:17.099+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.20__multipart_key1.2~gDOYGLO2fW8ObPB5YAcSQ00uave476k.2 2019-12-08T12:39:17.102 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:17.099+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.20__shadow_key1.2~gDOYGLO2fW8ObPB5YAcSQ00uave476k.2_1 2019-12-08T12:39:17.103 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:17.099+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.20__shadow_key1.2~gDOYGLO2fW8ObPB5YAcSQ00uave476k.2_2 2019-12-08T12:39:17.103 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:17.099+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.20__multipart_key1.2~gDOYGLO2fW8ObPB5YAcSQ00uave476k.3 2019-12-08T12:39:17.103 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:17.099+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process iterating over entry tag='f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.834', time=2019-12-08T14:38:55.350610+0000, chain.objs.size()=21 2019-12-08T12:39:17.103 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:17.099+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.39__multipart_key1.2~hQoJF8QOW3wvzu38s13X7ig5xsGnG2E.1 2019-12-08T12:39:17.103 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:17.099+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.39__shadow_key1.2~hQoJF8QOW3wvzu38s13X7ig5xsGnG2E.1_1 2019-12-08T12:39:17.103 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:17.099+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.39__multipart_key1.2~hQoJF8QOW3wvzu38s13X7ig5xsGnG2E.2 2019-12-08T12:39:17.103 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:17.099+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.39__shadow_key1.2~hQoJF8QOW3wvzu38s13X7ig5xsGnG2E.2_1 2019-12-08T12:39:17.104 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:17.099+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.39__multipart_key1.2~hQoJF8QOW3wvzu38s13X7ig5xsGnG2E.3 2019-12-08T12:39:17.411 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:17.409+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.39__shadow_key1.2~hQoJF8QOW3wvzu38s13X7ig5xsGnG2E.3_1 2019-12-08T12:39:17.411 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:17.409+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.39__multipart_key1.2~hQoJF8QOW3wvzu38s13X7ig5xsGnG2E.4 2019-12-08T12:39:17.411 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:17.410+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.39__shadow_key1.2~hQoJF8QOW3wvzu38s13X7ig5xsGnG2E.4_1 2019-12-08T12:39:17.411 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:17.410+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.39__multipart_key1.2~hQoJF8QOW3wvzu38s13X7ig5xsGnG2E.5 2019-12-08T12:39:17.412 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:17.410+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.39__shadow_key1.2~hQoJF8QOW3wvzu38s13X7ig5xsGnG2E.5_1 2019-12-08T12:39:17.412 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:17.410+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.39__multipart_key1.2~hQoJF8QOW3wvzu38s13X7ig5xsGnG2E.6 2019-12-08T12:39:17.416 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:17.415+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.39__shadow_key1.2~hQoJF8QOW3wvzu38s13X7ig5xsGnG2E.6_1 2019-12-08T12:39:17.416 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:17.415+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.39__multipart_key1.2~hQoJF8QOW3wvzu38s13X7ig5xsGnG2E.7 2019-12-08T12:39:17.416 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:17.415+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.39__shadow_key1.2~hQoJF8QOW3wvzu38s13X7ig5xsGnG2E.7_1 2019-12-08T12:39:17.416 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:17.415+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.39__multipart_key1.2~hQoJF8QOW3wvzu38s13X7ig5xsGnG2E.8 2019-12-08T12:39:17.424 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:17.423+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.39__shadow_key1.2~hQoJF8QOW3wvzu38s13X7ig5xsGnG2E.8_1 2019-12-08T12:39:17.907 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:17.905+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.39__multipart_key1.2~hQoJF8QOW3wvzu38s13X7ig5xsGnG2E.9 2019-12-08T12:39:17.907 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:17.905+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.39__shadow_key1.2~hQoJF8QOW3wvzu38s13X7ig5xsGnG2E.9_1 2019-12-08T12:39:17.908 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:17.905+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.39__multipart_key1.2~hQoJF8QOW3wvzu38s13X7ig5xsGnG2E.10 2019-12-08T12:39:17.908 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:17.906+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.39__shadow_key1.2~hQoJF8QOW3wvzu38s13X7ig5xsGnG2E.10_1 2019-12-08T12:39:17.908 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:17.906+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.39__multipart_key1.2~hQoJF8QOW3wvzu38s13X7ig5xsGnG2E.11 2019-12-08T12:39:18.216 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:18.215+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-08T12:39:18.291 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:18.289+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-12-08T12:39:18.342 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:18.340+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:18.367 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:18.365+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:18.391 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:18.389+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-12-08T12:39:18.391 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:18.389+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process iterating over entry tag='f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.472', time=2019-12-08T14:25:13.235220+0000, chain.objs.size()=7 2019-12-08T12:39:18.391 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:18.389+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.20__multipart_key1.2~8KUqtqTtVvyAGuKe13ZHWSbP5wlmQkP.1 2019-12-08T12:39:18.392 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:18.389+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.20__shadow_key1.2~8KUqtqTtVvyAGuKe13ZHWSbP5wlmQkP.1_1 2019-12-08T12:39:18.392 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:18.389+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.20__shadow_key1.2~8KUqtqTtVvyAGuKe13ZHWSbP5wlmQkP.1_2 2019-12-08T12:39:18.392 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:18.389+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.20__multipart_key1.2~8KUqtqTtVvyAGuKe13ZHWSbP5wlmQkP.2 2019-12-08T12:39:18.392 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:18.389+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.20__shadow_key1.2~8KUqtqTtVvyAGuKe13ZHWSbP5wlmQkP.2_1 2019-12-08T12:39:18.393 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:18.389+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.20__shadow_key1.2~8KUqtqTtVvyAGuKe13ZHWSbP5wlmQkP.2_2 2019-12-08T12:39:18.393 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:18.389+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.20__multipart_key1.2~8KUqtqTtVvyAGuKe13ZHWSbP5wlmQkP.3 2019-12-08T12:39:18.393 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:18.389+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process iterating over entry tag='f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.628', time=2019-12-08T14:33:57.815697+0000, chain.objs.size()=16 2019-12-08T12:39:18.393 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:18.389+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__multipart_key1.2~vlufXNWh4r6feDzsiFYoksmX-abnw6Q.1 2019-12-08T12:39:18.394 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:18.389+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__shadow_key1.2~vlufXNWh4r6feDzsiFYoksmX-abnw6Q.1_1 2019-12-08T12:39:18.394 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:18.389+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__shadow_key1.2~vlufXNWh4r6feDzsiFYoksmX-abnw6Q.1_2 2019-12-08T12:39:18.394 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:18.389+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__multipart_key1.2~vlufXNWh4r6feDzsiFYoksmX-abnw6Q.2 2019-12-08T12:39:18.394 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:18.389+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__shadow_key1.2~vlufXNWh4r6feDzsiFYoksmX-abnw6Q.2_1 2019-12-08T12:39:18.601 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:18.600+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__shadow_key1.2~vlufXNWh4r6feDzsiFYoksmX-abnw6Q.2_2 2019-12-08T12:39:18.673 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:18.672+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__multipart_key1.2~vlufXNWh4r6feDzsiFYoksmX-abnw6Q.3 2019-12-08T12:39:18.674 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:18.672+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__shadow_key1.2~vlufXNWh4r6feDzsiFYoksmX-abnw6Q.3_1 2019-12-08T12:39:18.708 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:18.706+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__shadow_key1.2~vlufXNWh4r6feDzsiFYoksmX-abnw6Q.3_2 2019-12-08T12:39:18.708 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:18.706+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__multipart_key1.2~vlufXNWh4r6feDzsiFYoksmX-abnw6Q.4 2019-12-08T12:39:18.708 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:18.706+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__shadow_key1.2~vlufXNWh4r6feDzsiFYoksmX-abnw6Q.4_1 2019-12-08T12:39:18.708 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:18.706+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__shadow_key1.2~vlufXNWh4r6feDzsiFYoksmX-abnw6Q.4_2 2019-12-08T12:39:18.709 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:18.706+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__multipart_key1.2~vlufXNWh4r6feDzsiFYoksmX-abnw6Q.5 2019-12-08T12:39:18.709 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:18.706+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__shadow_key1.2~vlufXNWh4r6feDzsiFYoksmX-abnw6Q.5_1 2019-12-08T12:39:18.761 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:18.760+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__shadow_key1.2~vlufXNWh4r6feDzsiFYoksmX-abnw6Q.5_2 2019-12-08T12:39:18.761 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:18.760+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.28__multipart_key1.2~vlufXNWh4r6feDzsiFYoksmX-abnw6Q.6 2019-12-08T12:39:19.034 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:19.032+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-08T12:39:19.124 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:19.123+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-12-08T12:39:19.188 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:19.187+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:19.206 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:19.205+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:19.215 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:19.214+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:19.259 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:19.258+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-12-08T12:39:19.295 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:19.294+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:19.312 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:19.310+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:19.328 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:19.327+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-08T12:39:19.329 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:19.327+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process iterating over entry tag='f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.386', time=2019-12-08T14:19:49.273210+0000, chain.objs.size()=9 2019-12-08T12:39:19.329 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:19.327+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.15__multipart_key1.2~TGtA2UuOO9NOapMzYxGI25nNfY9KN0k.1 2019-12-08T12:39:19.329 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:19.327+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.15__shadow_key1.2~TGtA2UuOO9NOapMzYxGI25nNfY9KN0k.1_1 2019-12-08T12:39:19.329 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:19.327+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.15__multipart_key1.2~TGtA2UuOO9NOapMzYxGI25nNfY9KN0k.2 2019-12-08T12:39:19.329 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:19.327+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.15__shadow_key1.2~TGtA2UuOO9NOapMzYxGI25nNfY9KN0k.2_1 2019-12-08T12:39:19.329 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:19.327+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.15__multipart_key1.2~TGtA2UuOO9NOapMzYxGI25nNfY9KN0k.3 2019-12-08T12:39:19.329 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:19.327+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.15__shadow_key1.2~TGtA2UuOO9NOapMzYxGI25nNfY9KN0k.3_1 2019-12-08T12:39:19.330 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:19.327+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.15__multipart_key1.2~TGtA2UuOO9NOapMzYxGI25nNfY9KN0k.4 2019-12-08T12:39:19.330 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:19.327+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.15__shadow_key1.2~TGtA2UuOO9NOapMzYxGI25nNfY9KN0k.4_1 2019-12-08T12:39:19.330 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:19.327+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.15__multipart_key1.2~TGtA2UuOO9NOapMzYxGI25nNfY9KN0k.5 2019-12-08T12:39:19.557 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:19.556+0000 7fc6dd5e4ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-08T12:39:19.648 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:19.646+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-12-08T12:39:19.686 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:19.684+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:19.704 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:19.702+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:19.713 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:19.711+0000 7fc6dd5e4ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:19.791 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:19.789+0000 7fc6dd5e4ec0 20 remove_watcher() i=0 2019-12-08T12:39:19.792 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:19.789+0000 7fc6dd5e4ec0 2 removed watcher, disabling cache 2019-12-08T12:39:19.834 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:19.832+0000 7fc6dd5e4ec0 20 remove_watcher() i=1 2019-12-08T12:39:19.882 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:19.881+0000 7fc6dd5e4ec0 20 remove_watcher() i=2 2019-12-08T12:39:19.924 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:19.923+0000 7fc6dd5e4ec0 20 remove_watcher() i=3 2019-12-08T12:39:19.975 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:19.974+0000 7fc6dd5e4ec0 20 remove_watcher() i=4 2019-12-08T12:39:20.007 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:20.005+0000 7fc6dd5e4ec0 20 remove_watcher() i=5 2019-12-08T12:39:20.043 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:20.042+0000 7fc6dd5e4ec0 20 remove_watcher() i=6 2019-12-08T12:39:20.082 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:20.081+0000 7fc6dd5e4ec0 20 remove_watcher() i=7 2019-12-08T12:39:20.088 INFO:teuthology.orchestra.run.smithi079:> radosgw-admin gc process --include-all 2019-12-08T12:39:20.189 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:20.188+0000 7fe0baa6dec0 20 rados->read ofs=0 len=0 2019-12-08T12:39:20.218 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:20.217+0000 7fe0baa6dec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:39:20.218 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:20.217+0000 7fe0baa6dec0 20 rados->read ofs=0 len=0 2019-12-08T12:39:20.228 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:20.226+0000 7fe0baa6dec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:39:20.228 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:20.226+0000 7fe0baa6dec0 20 rados->read ofs=0 len=0 2019-12-08T12:39:20.237 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:20.236+0000 7fe0baa6dec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:39:20.238 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:20.236+0000 7fe0baa6dec0 20 rados->read ofs=0 len=0 2019-12-08T12:39:20.264 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:20.263+0000 7fe0baa6dec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:39:20.486 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:20.484+0000 7fe0baa6dec0 20 RGWRados::pool_iterate: got zonegroup_info.fee0148b-7ae2-4cf0-a79e-86045a29cb7c 2019-12-08T12:39:20.486 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:20.484+0000 7fe0baa6dec0 20 RGWRados::pool_iterate: got zone_info.f8ab349b-4577-410d-b524-4ecaf50bb1bd 2019-12-08T12:39:20.486 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:20.484+0000 7fe0baa6dec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-08T12:39:20.486 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:20.484+0000 7fe0baa6dec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-08T12:39:20.487 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:20.484+0000 7fe0baa6dec0 20 rados->read ofs=0 len=0 2019-12-08T12:39:20.503 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:20.502+0000 7fe0baa6dec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:39:20.503 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:20.502+0000 7fe0baa6dec0 20 rados->read ofs=0 len=0 2019-12-08T12:39:20.515 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:20.514+0000 7fe0baa6dec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-08T12:39:20.516 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:20.514+0000 7fe0baa6dec0 20 rados->read ofs=0 len=0 2019-12-08T12:39:20.526 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:20.524+0000 7fe0baa6dec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:39:20.526 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:20.524+0000 7fe0baa6dec0 20 rados->read ofs=0 len=0 2019-12-08T12:39:20.542 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:20.541+0000 7fe0baa6dec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-08T12:39:20.542 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:20.541+0000 7fe0baa6dec0 20 rados->read ofs=0 len=0 2019-12-08T12:39:20.549 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:20.547+0000 7fe0baa6dec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:39:20.549 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:20.547+0000 7fe0baa6dec0 10 cannot find current period zonegroup using local zonegroup 2019-12-08T12:39:20.549 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:20.547+0000 7fe0baa6dec0 20 rados->read ofs=0 len=0 2019-12-08T12:39:20.554 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:20.552+0000 7fe0baa6dec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:39:20.554 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:20.553+0000 7fe0baa6dec0 20 rados->read ofs=0 len=0 2019-12-08T12:39:20.565 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:20.564+0000 7fe0baa6dec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:39:20.565 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:20.564+0000 7fe0baa6dec0 20 rados->read ofs=0 len=0 2019-12-08T12:39:20.582 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:20.581+0000 7fe0baa6dec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-08T12:39:20.582 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:20.581+0000 7fe0baa6dec0 20 zonegroup default 2019-12-08T12:39:20.582 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:20.581+0000 7fe0baa6dec0 20 rados->read ofs=0 len=0 2019-12-08T12:39:20.588 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:20.587+0000 7fe0baa6dec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:39:20.588 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:20.587+0000 7fe0baa6dec0 10 Cannot find current period zone using local zone 2019-12-08T12:39:20.589 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:20.587+0000 7fe0baa6dec0 20 rados->read ofs=0 len=0 2019-12-08T12:39:20.594 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:20.593+0000 7fe0baa6dec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:39:20.594 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:20.593+0000 7fe0baa6dec0 20 rados->read ofs=0 len=0 2019-12-08T12:39:20.604 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:20.603+0000 7fe0baa6dec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:39:20.604 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:20.603+0000 7fe0baa6dec0 20 rados->read ofs=0 len=0 2019-12-08T12:39:20.613 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:20.611+0000 7fe0baa6dec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-08T12:39:20.613 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:20.611+0000 7fe0baa6dec0 20 zone default found 2019-12-08T12:39:20.613 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:20.611+0000 7fe0baa6dec0 20 started sync module instance, tier type = 2019-12-08T12:39:20.613 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:20.611+0000 7fe0baa6dec0 20 started zone id=f8ab349b-4577-410d-b524-4ecaf50bb1bd (name=default) with tier type = 2019-12-08T12:39:20.908 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:20.906+0000 7fe0baa6dec0 20 add_watcher() i=0 2019-12-08T12:39:20.908 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:20.906+0000 7fe0baa6dec0 20 add_watcher() i=1 2019-12-08T12:39:20.908 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:20.906+0000 7fe0baa6dec0 20 add_watcher() i=2 2019-12-08T12:39:20.908 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:20.906+0000 7fe0baa6dec0 20 add_watcher() i=3 2019-12-08T12:39:20.908 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:20.906+0000 7fe0baa6dec0 20 add_watcher() i=4 2019-12-08T12:39:20.909 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:20.906+0000 7fe0baa6dec0 20 add_watcher() i=5 2019-12-08T12:39:20.909 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:20.906+0000 7fe0baa6dec0 20 add_watcher() i=6 2019-12-08T12:39:20.930 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:20.929+0000 7fe0baa6dec0 20 add_watcher() i=7 2019-12-08T12:39:20.931 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:20.929+0000 7fe0baa6dec0 2 all 8 watchers are set, enabling cache 2019-12-08T12:39:20.931 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:20.929+0000 7fdffbfff700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-08T12:39:20.944 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:20.943+0000 7fe0a7c97700 0 -- >> v2:172.21.15.79:3300/0 conn(0x555d4fbe00c0 msgr2=0x555d4fbe24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-12-08T12:39:20.987 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:20.986+0000 7fe09ffff700 0 -- 172.21.15.79:0/3764338453 >> [v2:172.21.15.13:6800/9325,v1:172.21.15.13:6801/9325] conn(0x555d4fbaf730 msgr2=0x555d4fbe5620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-08T12:39:22.774 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:22.772+0000 7fdfe67fc700 20 reqs_thread_entry: start 2019-12-08T12:39:22.774 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:22.773+0000 7fdfdffff700 20 reqs_thread_entry: start 2019-12-08T12:39:22.774 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:22.773+0000 7fe0baa6dec0 20 init_complete bucket index max shards: 0 2019-12-08T12:39:22.775 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:22.774+0000 7fdfde7fc700 20 reqs_thread_entry: start 2019-12-08T12:39:22.775 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:22.774+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-12-08T12:39:22.857 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:22.856+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:22.895 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:22.893+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:22.913 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:22.912+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:22.975 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:22.974+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-12-08T12:39:23.056 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:23.055+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:23.084 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:23.082+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:23.099 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:23.098+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:23.148 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:23.146+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-12-08T12:39:23.230 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:23.229+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:23.259 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:23.257+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:23.274 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:23.273+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:23.408 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:23.407+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-12-08T12:39:23.471 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:23.470+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:23.510 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:23.509+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:23.526 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:23.525+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:23.586 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:23.585+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-12-08T12:39:23.676 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:23.674+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:23.702 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:23.701+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:23.713 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:23.712+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:23.754 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:23.753+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-12-08T12:39:23.829 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:23.827+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:23.859 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:23.857+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:23.871 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:23.870+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:23.909 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:23.908+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-12-08T12:39:23.964 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:23.962+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:23.982 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:23.980+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:23.993 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:23.992+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:24.032 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:24.031+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-12-08T12:39:24.073 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:24.072+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:24.091 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:24.090+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:24.100 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:24.099+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:24.140 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:24.139+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-12-08T12:39:24.177 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:24.176+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:24.194 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:24.193+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:24.203 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:24.202+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:24.235 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:24.233+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-12-08T12:39:24.282 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:24.281+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:24.301 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:24.300+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:24.311 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:24.310+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:24.353 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:24.352+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-12-08T12:39:24.405 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:24.404+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:24.426 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:24.425+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:24.436 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:24.435+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:24.471 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:24.470+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-12-08T12:39:24.565 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:24.563+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:24.587 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:24.586+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:24.597 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:24.596+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:24.644 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:24.642+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-12-08T12:39:24.727 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:24.726+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:24.757 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:24.755+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:24.771 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:24.769+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:24.832 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:24.831+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-12-08T12:39:24.898 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:24.897+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:24.919 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:24.918+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:24.930 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:24.929+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:24.975 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:24.974+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-12-08T12:39:25.036 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:25.034+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:25.064 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:25.063+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:25.077 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:25.076+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:25.125 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:25.124+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-12-08T12:39:25.168 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:25.166+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:25.185 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:25.184+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:25.196 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:25.195+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:25.230 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:25.229+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-12-08T12:39:25.284 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:25.282+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:25.303 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:25.301+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:25.323 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:25.320+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:25.362 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:25.361+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-12-08T12:39:25.422 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:25.421+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:25.450 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:25.448+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:25.468 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:25.467+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:25.519 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:25.517+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-12-08T12:39:25.579 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:25.578+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:25.619 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:25.618+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:25.630 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:25.629+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:25.676 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:25.674+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-12-08T12:39:25.748 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:25.746+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:25.778 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:25.777+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:25.793 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:25.792+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:25.852 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:25.851+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-12-08T12:39:25.925 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:25.923+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:25.947 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:25.946+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:25.958 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:25.957+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:26.022 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:26.020+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-12-08T12:39:26.072 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:26.070+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:26.093 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:26.092+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:26.106 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:26.105+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:26.142 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:26.141+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-12-08T12:39:26.195 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:26.194+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:26.214 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:26.212+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:26.223 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:26.222+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:26.271 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:26.270+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-12-08T12:39:26.338 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:26.336+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:26.359 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:26.358+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:26.371 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:26.370+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:26.409 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:26.408+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-12-08T12:39:26.495 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:26.493+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:26.522 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:26.521+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:26.535 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:26.534+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:26.581 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:26.580+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-12-08T12:39:26.658 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:26.657+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:26.683 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:26.682+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:26.705 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:26.704+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:26.773 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:26.772+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-12-08T12:39:26.845 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:26.844+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:26.861 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:26.860+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:26.875 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:26.874+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:26.913 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:26.911+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-12-08T12:39:26.998 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:26.997+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:27.033 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:27.031+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:27.048 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:27.047+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:27.125 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:27.124+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-12-08T12:39:27.188 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:27.186+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:27.210 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:27.209+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:27.219 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:27.216+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:27.271 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:27.270+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-12-08T12:39:27.344 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:27.342+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:27.387 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:27.386+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:27.406 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:27.405+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:27.462 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:27.461+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-12-08T12:39:27.518 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:27.517+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:27.543 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:27.541+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:27.558 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:27.557+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:27.609 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:27.607+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-12-08T12:39:27.705 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:27.704+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:27.733 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:27.732+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:27.746 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:27.745+0000 7fe0baa6dec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:27.837 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:27.836+0000 7fe0baa6dec0 20 remove_watcher() i=0 2019-12-08T12:39:27.837 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:27.836+0000 7fe0baa6dec0 2 removed watcher, disabling cache 2019-12-08T12:39:27.895 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:27.893+0000 7fe0baa6dec0 20 remove_watcher() i=1 2019-12-08T12:39:27.956 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:27.954+0000 7fe0baa6dec0 20 remove_watcher() i=2 2019-12-08T12:39:27.997 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:27.996+0000 7fe0baa6dec0 20 remove_watcher() i=3 2019-12-08T12:39:28.045 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:28.044+0000 7fe0baa6dec0 20 remove_watcher() i=4 2019-12-08T12:39:28.078 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:28.077+0000 7fe0baa6dec0 20 remove_watcher() i=5 2019-12-08T12:39:28.135 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:28.134+0000 7fe0baa6dec0 20 remove_watcher() i=6 2019-12-08T12:39:28.164 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:28.163+0000 7fe0baa6dec0 20 remove_watcher() i=7 2019-12-08T12:39:28.172 INFO:teuthology.orchestra.run.smithi079:> radosgw-admin gc process --include-all 2019-12-08T12:39:28.276 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:28.275+0000 7fcb5015fec0 20 rados->read ofs=0 len=0 2019-12-08T12:39:28.311 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:28.310+0000 7fcb5015fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:39:28.311 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:28.310+0000 7fcb5015fec0 20 rados->read ofs=0 len=0 2019-12-08T12:39:28.323 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:28.322+0000 7fcb5015fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:39:28.324 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:28.322+0000 7fcb5015fec0 20 rados->read ofs=0 len=0 2019-12-08T12:39:28.335 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:28.334+0000 7fcb5015fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:39:28.335 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:28.334+0000 7fcb5015fec0 20 rados->read ofs=0 len=0 2019-12-08T12:39:28.361 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:28.359+0000 7fcb5015fec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:39:28.607 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:28.606+0000 7fcb5015fec0 20 RGWRados::pool_iterate: got zonegroup_info.fee0148b-7ae2-4cf0-a79e-86045a29cb7c 2019-12-08T12:39:28.608 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:28.606+0000 7fcb5015fec0 20 RGWRados::pool_iterate: got zone_info.f8ab349b-4577-410d-b524-4ecaf50bb1bd 2019-12-08T12:39:28.608 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:28.606+0000 7fcb5015fec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-08T12:39:28.608 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:28.606+0000 7fcb5015fec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-08T12:39:28.608 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:28.606+0000 7fcb5015fec0 20 rados->read ofs=0 len=0 2019-12-08T12:39:28.625 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:28.624+0000 7fcb5015fec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:39:28.626 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:28.624+0000 7fcb5015fec0 20 rados->read ofs=0 len=0 2019-12-08T12:39:28.640 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:28.639+0000 7fcb5015fec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-08T12:39:28.640 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:28.639+0000 7fcb5015fec0 20 rados->read ofs=0 len=0 2019-12-08T12:39:28.656 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:28.655+0000 7fcb5015fec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:39:28.656 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:28.655+0000 7fcb5015fec0 20 rados->read ofs=0 len=0 2019-12-08T12:39:28.672 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:28.671+0000 7fcb5015fec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-08T12:39:28.673 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:28.671+0000 7fcb5015fec0 20 rados->read ofs=0 len=0 2019-12-08T12:39:28.687 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:28.686+0000 7fcb5015fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:39:28.688 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:28.686+0000 7fcb5015fec0 10 cannot find current period zonegroup using local zonegroup 2019-12-08T12:39:28.688 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:28.686+0000 7fcb5015fec0 20 rados->read ofs=0 len=0 2019-12-08T12:39:28.698 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:28.696+0000 7fcb5015fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:39:28.698 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:28.696+0000 7fcb5015fec0 20 rados->read ofs=0 len=0 2019-12-08T12:39:28.718 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:28.717+0000 7fcb5015fec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:39:28.718 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:28.717+0000 7fcb5015fec0 20 rados->read ofs=0 len=0 2019-12-08T12:39:28.733 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:28.732+0000 7fcb5015fec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-08T12:39:28.734 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:28.732+0000 7fcb5015fec0 20 zonegroup default 2019-12-08T12:39:28.734 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:28.732+0000 7fcb5015fec0 20 rados->read ofs=0 len=0 2019-12-08T12:39:28.745 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:28.744+0000 7fcb5015fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:39:28.745 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:28.744+0000 7fcb5015fec0 10 Cannot find current period zone using local zone 2019-12-08T12:39:28.746 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:28.744+0000 7fcb5015fec0 20 rados->read ofs=0 len=0 2019-12-08T12:39:28.758 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:28.757+0000 7fcb5015fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:39:28.758 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:28.757+0000 7fcb5015fec0 20 rados->read ofs=0 len=0 2019-12-08T12:39:28.767 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:28.766+0000 7fcb5015fec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:39:28.768 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:28.766+0000 7fcb5015fec0 20 rados->read ofs=0 len=0 2019-12-08T12:39:28.781 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:28.780+0000 7fcb5015fec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-08T12:39:28.782 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:28.780+0000 7fcb5015fec0 20 zone default found 2019-12-08T12:39:28.782 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:28.780+0000 7fcb5015fec0 20 started sync module instance, tier type = 2019-12-08T12:39:28.782 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:28.780+0000 7fcb5015fec0 20 started zone id=f8ab349b-4577-410d-b524-4ecaf50bb1bd (name=default) with tier type = 2019-12-08T12:39:29.171 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:29.170+0000 7fcb5015fec0 20 add_watcher() i=0 2019-12-08T12:39:29.172 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:29.170+0000 7fcb5015fec0 20 add_watcher() i=1 2019-12-08T12:39:29.172 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:29.170+0000 7fcb5015fec0 20 add_watcher() i=2 2019-12-08T12:39:29.172 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:29.170+0000 7fcb5015fec0 20 add_watcher() i=3 2019-12-08T12:39:29.172 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:29.170+0000 7fcb5015fec0 20 add_watcher() i=4 2019-12-08T12:39:29.172 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:29.170+0000 7fcb5015fec0 20 add_watcher() i=5 2019-12-08T12:39:29.172 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:29.170+0000 7fcb5015fec0 20 add_watcher() i=6 2019-12-08T12:39:29.208 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:29.207+0000 7fcb5015fec0 20 add_watcher() i=7 2019-12-08T12:39:29.208 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:29.207+0000 7fcb5015fec0 2 all 8 watchers are set, enabling cache 2019-12-08T12:39:29.208 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:29.207+0000 7fcb0dfdb700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-08T12:39:29.217 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:29.216+0000 7fcb3cb88700 0 -- 172.21.15.79:0/1425359281 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x558ae764ed30 msgr2=0x558ae76780c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-12-08T12:39:29.257 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:29.255+0000 7fcb3db8a700 0 -- 172.21.15.79:0/970721363 >> [v2:172.21.15.79:6800/9057,v1:172.21.15.79:6801/9057] conn(0x7fca800224a0 msgr2=0x7fca80024990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-08T12:39:30.911 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:30.909+0000 7fca7ffff700 20 reqs_thread_entry: start 2019-12-08T12:39:30.911 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:30.910+0000 7fca7dffb700 20 reqs_thread_entry: start 2019-12-08T12:39:30.911 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:30.910+0000 7fcb5015fec0 20 init_complete bucket index max shards: 0 2019-12-08T12:39:30.912 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:30.911+0000 7fca6bfff700 20 reqs_thread_entry: start 2019-12-08T12:39:30.912 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:30.911+0000 7fcb5015fec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-12-08T12:39:30.996 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:30.995+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:31.026 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:31.025+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:31.041 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:31.040+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:31.095 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:31.094+0000 7fcb5015fec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-12-08T12:39:31.175 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:31.174+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:31.206 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:31.205+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:31.221 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:31.220+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:31.263 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:31.262+0000 7fcb5015fec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-12-08T12:39:31.329 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:31.327+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:31.364 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:31.363+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:31.378 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:31.377+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:31.431 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:31.430+0000 7fcb5015fec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-12-08T12:39:31.502 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:31.500+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:31.525 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:31.524+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:31.534 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:31.533+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:31.582 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:31.580+0000 7fcb5015fec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-12-08T12:39:31.672 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:31.671+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:31.706 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:31.705+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:31.724 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:31.722+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:31.780 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:31.779+0000 7fcb5015fec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-12-08T12:39:31.870 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:31.869+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:31.898 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:31.897+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:31.911 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:31.910+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:31.963 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:31.962+0000 7fcb5015fec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-12-08T12:39:32.037 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:32.036+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:32.064 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:32.062+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:32.087 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:32.086+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:32.137 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:32.136+0000 7fcb5015fec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-12-08T12:39:32.187 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:32.186+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:32.209 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:32.208+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:32.221 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:32.220+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:32.254 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:32.253+0000 7fcb5015fec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-12-08T12:39:32.326 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:32.325+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:32.368 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:32.367+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:32.387 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:32.386+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:32.437 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:32.436+0000 7fcb5015fec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-12-08T12:39:32.492 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:32.491+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:32.517 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:32.516+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:32.529 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:32.528+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:32.569 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:32.567+0000 7fcb5015fec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-12-08T12:39:32.610 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:32.609+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:32.632 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:32.631+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:32.645 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:32.644+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:32.679 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:32.678+0000 7fcb5015fec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-12-08T12:39:32.720 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:32.719+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:32.737 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:32.736+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:32.746 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:32.745+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:32.779 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:32.778+0000 7fcb5015fec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-12-08T12:39:32.825 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:32.824+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:32.849 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:32.848+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:32.867 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:32.866+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:32.903 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:32.902+0000 7fcb5015fec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-12-08T12:39:32.977 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:32.976+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:33.007 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:33.002+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:33.014 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:33.013+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:33.067 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:33.066+0000 7fcb5015fec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-12-08T12:39:33.128 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:33.127+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:33.149 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:33.148+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:33.159 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:33.158+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:33.234 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:33.233+0000 7fcb5015fec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-12-08T12:39:33.307 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:33.306+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:33.331 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:33.330+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:33.341 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:33.340+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:33.393 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:33.392+0000 7fcb5015fec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-12-08T12:39:33.463 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:33.461+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:33.501 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:33.500+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:33.518 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:33.517+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:33.556 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:33.555+0000 7fcb5015fec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-12-08T12:39:33.646 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:33.645+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:33.667 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:33.666+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:33.677 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:33.676+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:33.766 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:33.765+0000 7fcb5015fec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-12-08T12:39:33.854 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:33.853+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:33.883 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:33.882+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:33.894 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:33.893+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:33.951 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:33.950+0000 7fcb5015fec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-12-08T12:39:34.011 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:34.010+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:34.037 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:34.036+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:34.046 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:34.045+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:34.083 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:34.081+0000 7fcb5015fec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-12-08T12:39:34.127 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:34.126+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:34.145 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:34.143+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:34.156 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:34.155+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:34.199 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:34.198+0000 7fcb5015fec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-12-08T12:39:34.257 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:34.256+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:34.276 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:34.275+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:34.286 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:34.285+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:34.330 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:34.329+0000 7fcb5015fec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-12-08T12:39:34.376 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:34.375+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:34.398 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:34.397+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:34.408 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:34.407+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:34.444 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:34.442+0000 7fcb5015fec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-12-08T12:39:34.493 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:34.492+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:34.510 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:34.509+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:34.519 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:34.518+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:34.558 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:34.557+0000 7fcb5015fec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-12-08T12:39:34.648 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:34.647+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:34.672 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:34.672+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:34.687 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:34.685+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:34.743 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:34.742+0000 7fcb5015fec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-12-08T12:39:34.801 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:34.799+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:34.826 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:34.825+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:34.839 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:34.838+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:34.895 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:34.894+0000 7fcb5015fec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-12-08T12:39:34.976 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:34.975+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:35.006 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:35.005+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:35.017 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:35.016+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:35.067 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:35.066+0000 7fcb5015fec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-12-08T12:39:35.151 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:35.149+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:35.194 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:35.193+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:35.214 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:35.213+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:35.284 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:35.283+0000 7fcb5015fec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-12-08T12:39:35.358 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:35.357+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:35.383 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:35.382+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:35.392 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:35.391+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:35.425 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:35.424+0000 7fcb5015fec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-12-08T12:39:35.485 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:35.484+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:35.504 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:35.503+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:35.513 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:35.511+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:35.555 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:35.553+0000 7fcb5015fec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-12-08T12:39:35.592 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:35.591+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:35.607 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:35.606+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:35.619 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:35.618+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:35.655 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:35.654+0000 7fcb5015fec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-12-08T12:39:35.720 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:35.719+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:35.757 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:35.756+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:35.769 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:35.768+0000 7fcb5015fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:35.848 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:35.847+0000 7fcb5015fec0 20 remove_watcher() i=0 2019-12-08T12:39:35.848 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:35.847+0000 7fcb5015fec0 2 removed watcher, disabling cache 2019-12-08T12:39:35.894 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:35.893+0000 7fcb5015fec0 20 remove_watcher() i=1 2019-12-08T12:39:35.941 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:35.940+0000 7fcb5015fec0 20 remove_watcher() i=2 2019-12-08T12:39:35.987 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:35.986+0000 7fcb5015fec0 20 remove_watcher() i=3 2019-12-08T12:39:36.031 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:36.030+0000 7fcb5015fec0 20 remove_watcher() i=4 2019-12-08T12:39:36.079 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:36.078+0000 7fcb5015fec0 20 remove_watcher() i=5 2019-12-08T12:39:36.136 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:36.135+0000 7fcb5015fec0 20 remove_watcher() i=6 2019-12-08T12:39:36.177 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:36.175+0000 7fcb5015fec0 20 remove_watcher() i=7 2019-12-08T12:39:36.185 INFO:teuthology.orchestra.run.smithi079:> radosgw-admin gc process --include-all 2019-12-08T12:39:36.305 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:36.304+0000 7f63e61bcec0 20 rados->read ofs=0 len=0 2019-12-08T12:39:36.361 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:36.360+0000 7f63e61bcec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:39:36.361 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:36.360+0000 7f63e61bcec0 20 rados->read ofs=0 len=0 2019-12-08T12:39:36.371 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:36.369+0000 7f63e61bcec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:39:36.371 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:36.369+0000 7f63e61bcec0 20 rados->read ofs=0 len=0 2019-12-08T12:39:36.379 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:36.378+0000 7f63e61bcec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:39:36.379 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:36.378+0000 7f63e61bcec0 20 rados->read ofs=0 len=0 2019-12-08T12:39:36.399 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:36.398+0000 7f63e61bcec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:39:36.615 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:36.614+0000 7f63e61bcec0 20 RGWRados::pool_iterate: got zonegroup_info.fee0148b-7ae2-4cf0-a79e-86045a29cb7c 2019-12-08T12:39:36.615 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:36.614+0000 7f63e61bcec0 20 RGWRados::pool_iterate: got zone_info.f8ab349b-4577-410d-b524-4ecaf50bb1bd 2019-12-08T12:39:36.616 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:36.614+0000 7f63e61bcec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-08T12:39:36.616 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:36.614+0000 7f63e61bcec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-08T12:39:36.616 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:36.614+0000 7f63e61bcec0 20 rados->read ofs=0 len=0 2019-12-08T12:39:36.626 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:36.625+0000 7f63e61bcec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:39:36.627 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:36.625+0000 7f63e61bcec0 20 rados->read ofs=0 len=0 2019-12-08T12:39:36.635 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:36.634+0000 7f63e61bcec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-08T12:39:36.635 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:36.634+0000 7f63e61bcec0 20 rados->read ofs=0 len=0 2019-12-08T12:39:36.647 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:36.646+0000 7f63e61bcec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:39:36.647 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:36.646+0000 7f63e61bcec0 20 rados->read ofs=0 len=0 2019-12-08T12:39:36.654 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:36.653+0000 7f63e61bcec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-08T12:39:36.654 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:36.653+0000 7f63e61bcec0 20 rados->read ofs=0 len=0 2019-12-08T12:39:36.664 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:36.663+0000 7f63e61bcec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:39:36.664 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:36.663+0000 7f63e61bcec0 10 cannot find current period zonegroup using local zonegroup 2019-12-08T12:39:36.665 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:36.663+0000 7f63e61bcec0 20 rados->read ofs=0 len=0 2019-12-08T12:39:36.671 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:36.670+0000 7f63e61bcec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:39:36.671 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:36.670+0000 7f63e61bcec0 20 rados->read ofs=0 len=0 2019-12-08T12:39:36.683 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:36.682+0000 7f63e61bcec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:39:36.683 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:36.682+0000 7f63e61bcec0 20 rados->read ofs=0 len=0 2019-12-08T12:39:36.695 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:36.694+0000 7f63e61bcec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-08T12:39:36.696 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:36.694+0000 7f63e61bcec0 20 zonegroup default 2019-12-08T12:39:36.696 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:36.694+0000 7f63e61bcec0 20 rados->read ofs=0 len=0 2019-12-08T12:39:36.706 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:36.705+0000 7f63e61bcec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:39:36.706 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:36.705+0000 7f63e61bcec0 10 Cannot find current period zone using local zone 2019-12-08T12:39:36.706 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:36.705+0000 7f63e61bcec0 20 rados->read ofs=0 len=0 2019-12-08T12:39:36.713 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:36.712+0000 7f63e61bcec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:39:36.713 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:36.712+0000 7f63e61bcec0 20 rados->read ofs=0 len=0 2019-12-08T12:39:36.722 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:36.721+0000 7f63e61bcec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:39:36.722 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:36.721+0000 7f63e61bcec0 20 rados->read ofs=0 len=0 2019-12-08T12:39:36.734 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:36.733+0000 7f63e61bcec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-08T12:39:36.734 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:36.733+0000 7f63e61bcec0 20 zone default found 2019-12-08T12:39:36.734 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:36.733+0000 7f63e61bcec0 20 started sync module instance, tier type = 2019-12-08T12:39:36.734 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:36.733+0000 7f63e61bcec0 20 started zone id=f8ab349b-4577-410d-b524-4ecaf50bb1bd (name=default) with tier type = 2019-12-08T12:39:37.046 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:37.045+0000 7f63e61bcec0 20 add_watcher() i=0 2019-12-08T12:39:37.046 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:37.045+0000 7f63e61bcec0 20 add_watcher() i=1 2019-12-08T12:39:37.046 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:37.045+0000 7f63e61bcec0 20 add_watcher() i=2 2019-12-08T12:39:37.046 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:37.045+0000 7f63e61bcec0 20 add_watcher() i=3 2019-12-08T12:39:37.047 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:37.045+0000 7f63e61bcec0 20 add_watcher() i=4 2019-12-08T12:39:37.047 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:37.045+0000 7f63e61bcec0 20 add_watcher() i=5 2019-12-08T12:39:37.047 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:37.045+0000 7f63e61bcec0 20 add_watcher() i=6 2019-12-08T12:39:37.080 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:37.078+0000 7f63e61bcec0 20 add_watcher() i=7 2019-12-08T12:39:37.080 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:37.078+0000 7f63e61bcec0 2 all 8 watchers are set, enabling cache 2019-12-08T12:39:37.080 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:37.079+0000 7f63a3fdf700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-08T12:39:37.089 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:37.089+0000 7f63d2be5700 0 -- 172.21.15.79:0/3701374787 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55f5ef305960 msgr2=0x55f5ef305d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-08T12:39:37.128 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:37.127+0000 7f63d33e6700 0 -- 172.21.15.79:0/2494576395 >> [v2:172.21.15.79:6800/9057,v1:172.21.15.79:6801/9057] conn(0x7f6314022470 msgr2=0x7f6314024960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-08T12:39:38.639 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:38.637+0000 7f63127fc700 20 reqs_thread_entry: start 2019-12-08T12:39:38.639 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:38.638+0000 7f630bfff700 20 reqs_thread_entry: start 2019-12-08T12:39:38.639 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:38.638+0000 7f63e61bcec0 20 init_complete bucket index max shards: 0 2019-12-08T12:39:38.640 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:38.639+0000 7f630a7fc700 20 reqs_thread_entry: start 2019-12-08T12:39:38.640 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:38.639+0000 7f63e61bcec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-12-08T12:39:38.718 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:38.717+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:38.744 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:38.743+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:38.755 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:38.754+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:38.800 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:38.800+0000 7f63e61bcec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-12-08T12:39:38.867 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:38.866+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:38.886 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:38.885+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:38.895 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:38.894+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:38.932 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:38.931+0000 7f63e61bcec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-12-08T12:39:38.993 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:38.991+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:39.019 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:39.016+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:39.031 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:39.031+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:39.073 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:39.072+0000 7f63e61bcec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-12-08T12:39:39.129 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:39.128+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:39.150 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:39.149+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:39.162 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:39.161+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:39.208 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:39.207+0000 7f63e61bcec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-12-08T12:39:39.294 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:39.293+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:39.341 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:39.340+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:39.360 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:39.359+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:39.453 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:39.452+0000 7f63e61bcec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-12-08T12:39:39.533 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:39.532+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:39.566 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:39.565+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:39.579 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:39.579+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:39.629 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:39.628+0000 7f63e61bcec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-12-08T12:39:39.683 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:39.682+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:39.705 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:39.704+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:39.733 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:39.732+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:39.766 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:39.765+0000 7f63e61bcec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-12-08T12:39:39.809 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:39.808+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:39.828 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:39.827+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:39.838 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:39.837+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:39.874 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:39.873+0000 7f63e61bcec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-12-08T12:39:39.914 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:39.913+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:39.931 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:39.930+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:39.942 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:39.941+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:39.974 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:39.973+0000 7f63e61bcec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-12-08T12:39:40.038 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:40.037+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:40.058 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:40.057+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:40.069 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:40.068+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:40.133 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:40.132+0000 7f63e61bcec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-12-08T12:39:40.288 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:40.287+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:40.314 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:40.313+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:40.333 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:40.328+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:40.373 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:40.372+0000 7f63e61bcec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-12-08T12:39:40.462 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:40.454+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:40.494 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:40.493+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:40.510 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:40.509+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:40.566 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:40.565+0000 7f63e61bcec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-12-08T12:39:40.644 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:40.643+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:40.674 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:40.673+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:40.694 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:40.693+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:40.758 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:40.757+0000 7f63e61bcec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-12-08T12:39:40.833 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:40.832+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:40.863 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:40.862+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:40.873 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:40.873+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:40.980 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:40.979+0000 7f63e61bcec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-12-08T12:39:41.037 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:41.036+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:41.061 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:41.060+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:41.076 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:41.076+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:41.115 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:41.114+0000 7f63e61bcec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-12-08T12:39:41.161 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:41.160+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:41.179 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:41.178+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:41.190 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:41.189+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:41.240 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:41.239+0000 7f63e61bcec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-12-08T12:39:41.299 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:41.298+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:41.341 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:41.340+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:41.361 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:41.360+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:41.406 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:41.405+0000 7f63e61bcec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-12-08T12:39:41.463 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:41.462+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:41.483 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:41.482+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:41.492 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:41.491+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:41.547 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:41.546+0000 7f63e61bcec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-12-08T12:39:41.592 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:41.591+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:41.610 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:41.609+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:41.618 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:41.618+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:41.649 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:41.648+0000 7f63e61bcec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-12-08T12:39:41.702 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:41.701+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:41.720 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:41.719+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:41.729 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:41.729+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:41.784 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:41.783+0000 7f63e61bcec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-12-08T12:39:41.832 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:41.831+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:41.851 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:41.850+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:41.861 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:41.860+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:41.907 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:41.906+0000 7f63e61bcec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-12-08T12:39:41.951 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:41.950+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:41.973 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:41.972+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:41.983 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:41.982+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:42.018 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:42.017+0000 7f63e61bcec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-12-08T12:39:42.092 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:42.091+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:42.120 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:42.118+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:42.133 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:42.131+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:42.179 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:42.178+0000 7f63e61bcec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-12-08T12:39:42.256 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:42.255+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:42.285 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:42.284+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:42.299 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:42.298+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:42.355 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:42.354+0000 7f63e61bcec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-12-08T12:39:42.411 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:42.410+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:42.437 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:42.436+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:42.453 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:42.452+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:42.499 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:42.498+0000 7f63e61bcec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-12-08T12:39:42.574 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:42.573+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:42.596 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:42.596+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:42.607 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:42.606+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:42.656 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:42.655+0000 7f63e61bcec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-12-08T12:39:42.722 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:42.721+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:42.750 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:42.750+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:42.767 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:42.766+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:42.819 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:42.818+0000 7f63e61bcec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-12-08T12:39:42.896 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:42.895+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:42.930 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:42.929+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:42.947 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:42.946+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:43.002 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:43.001+0000 7f63e61bcec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-12-08T12:39:43.075 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:43.074+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:43.098 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:43.097+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:43.109 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:43.108+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:43.159 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:43.158+0000 7f63e61bcec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-12-08T12:39:43.235 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:43.234+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:43.268 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:43.267+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:43.282 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:43.281+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:43.335 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:43.334+0000 7f63e61bcec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-12-08T12:39:43.393 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:43.392+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:43.447 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:43.446+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:43.458 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:43.457+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:43.503 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:43.502+0000 7f63e61bcec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-12-08T12:39:43.565 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:43.564+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:43.591 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:43.590+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:39:43.608 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:43.607+0000 7f63e61bcec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:39:43.708 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:43.707+0000 7f63e61bcec0 20 remove_watcher() i=0 2019-12-08T12:39:43.708 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:43.707+0000 7f63e61bcec0 2 removed watcher, disabling cache 2019-12-08T12:39:43.771 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:43.770+0000 7f63e61bcec0 20 remove_watcher() i=1 2019-12-08T12:39:43.839 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:43.838+0000 7f63e61bcec0 20 remove_watcher() i=2 2019-12-08T12:39:43.896 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:43.895+0000 7f63e61bcec0 20 remove_watcher() i=3 2019-12-08T12:39:43.939 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:43.938+0000 7f63e61bcec0 20 remove_watcher() i=4 2019-12-08T12:39:43.980 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:43.979+0000 7f63e61bcec0 20 remove_watcher() i=5 2019-12-08T12:39:44.022 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:44.021+0000 7f63e61bcec0 20 remove_watcher() i=6 2019-12-08T12:39:44.065 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:39:44.064+0000 7f63e61bcec0 20 remove_watcher() i=7 2019-12-08T12:39:44.075 INFO:teuthology.orchestra.run.smithi079:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle-4.7/bin/gradle clean test --rerun-tasks --no-build-cache --tests BucketTest 2019-12-08T12:39:44.800 INFO:teuthology.orchestra.run.smithi079.stdout:> Task :clean 2019-12-08T12:39:45.497 INFO:teuthology.orchestra.run.smithi079.stdout:> Task :compileJava 2019-12-08T12:39:45.497 INFO:teuthology.orchestra.run.smithi079.stdout:> Task :processResources 2019-12-08T12:39:45.498 INFO:teuthology.orchestra.run.smithi079.stdout:> Task :classes 2019-12-08T12:39:45.797 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:39:45.799 INFO:teuthology.orchestra.run.smithi079.stdout:> Task :compileTestJava 2019-12-08T12:39:45.799 INFO:teuthology.orchestra.run.smithi079.stdout:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2019-12-08T12:39:45.799 INFO:teuthology.orchestra.run.smithi079.stdout:Note: Recompile with -Xlint:deprecation for details. 2019-12-08T12:39:45.799 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:39:45.799 INFO:teuthology.orchestra.run.smithi079.stdout:> Task :processTestResources NO-SOURCE 2019-12-08T12:39:45.799 INFO:teuthology.orchestra.run.smithi079.stdout:> Task :testClasses 2019-12-08T12:39:47.797 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:39:47.798 INFO:teuthology.orchestra.run.smithi079.stdout:> Task :test 2019-12-08T12:39:47.798 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:39:47.798 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty STARTED 2019-12-08T12:39:49.797 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:39:49.797 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty PASSED 2019-12-08T12:39:54.177 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:00:37:18.879 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T12:39:54.191 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:00:37:18.893 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T12:39:54.194 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:00:37:18.828 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T12:39:54.197 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:00:37:18.831 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T12:39:54.197 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:00:37:18.831 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T12:39:54.200 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:00:37:18.834 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T12:39:54.351 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:00:37:18.985 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T12:39:54.396 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:00:37:19.099 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T12:39:54.440 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:00:37:19.074 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T12:39:54.497 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:39:54.497 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch STARTED 2019-12-08T12:39:57.297 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:39:57.298 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch PASSED 2019-12-08T12:40:04.296 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:40:04.297 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable STARTED 2019-12-08T12:40:07.197 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:40:07.197 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable PASSED 2019-12-08T12:40:14.196 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:40:14.197 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete STARTED 2019-12-08T12:40:22.696 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:40:22.697 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete PASSED 2019-12-08T12:40:23.801 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:40:23.802 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty STARTED 2019-12-08T12:40:28.097 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:40:28.097 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty PASSED 2019-12-08T12:40:37.096 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:40:37.097 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist STARTED 2019-12-08T12:40:37.396 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:40:37.397 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist PASSED 2019-12-08T12:40:37.896 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:40:37.897 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct STARTED 2019-12-08T12:40:41.596 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:40:41.596 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct PASSED 2019-12-08T12:40:56.096 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:40:56.096 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty STARTED 2019-12-08T12:41:00.096 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:41:00.096 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty PASSED 2019-12-08T12:41:07.196 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:41:07.196 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Bucket tests > BucketTest.testBucketNotExist STARTED 2019-12-08T12:41:07.396 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:41:07.396 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Bucket tests > BucketTest.testBucketNotExist PASSED 2019-12-08T12:41:08.925 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:41:08.926 INFO:teuthology.orchestra.run.smithi079.stdout:-------------------------------------------------------------------- 2019-12-08T12:41:08.926 INFO:teuthology.orchestra.run.smithi079.stdout:| Results: SUCCESS (9 tests, 9 successes, 0 failures, 0 skipped) | 2019-12-08T12:41:08.926 INFO:teuthology.orchestra.run.smithi079.stdout:-------------------------------------------------------------------- 2019-12-08T12:41:08.926 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:41:08.926 INFO:teuthology.orchestra.run.smithi079.stdout:BUILD SUCCESSFUL in 1m 24s 2019-12-08T12:41:08.926 INFO:teuthology.orchestra.run.smithi079.stdout:5 actionable tasks: 5 executed 2019-12-08T12:41:08.944 INFO:teuthology.orchestra.run.smithi079:> radosgw-admin gc process --include-all 2019-12-08T12:41:09.086 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:09.088+0000 7f95d691fec0 20 rados->read ofs=0 len=0 2019-12-08T12:41:09.130 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:09.127+0000 7f95d691fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:41:09.130 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:09.127+0000 7f95d691fec0 20 rados->read ofs=0 len=0 2019-12-08T12:41:09.138 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:09.139+0000 7f95d691fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:41:09.138 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:09.139+0000 7f95d691fec0 20 rados->read ofs=0 len=0 2019-12-08T12:41:09.148 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:09.149+0000 7f95d691fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:41:09.148 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:09.149+0000 7f95d691fec0 20 rados->read ofs=0 len=0 2019-12-08T12:41:09.172 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:09.173+0000 7f95d691fec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:41:09.410 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:09.411+0000 7f95d691fec0 20 RGWRados::pool_iterate: got zonegroup_info.fee0148b-7ae2-4cf0-a79e-86045a29cb7c 2019-12-08T12:41:09.410 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:09.411+0000 7f95d691fec0 20 RGWRados::pool_iterate: got zone_info.f8ab349b-4577-410d-b524-4ecaf50bb1bd 2019-12-08T12:41:09.410 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:09.411+0000 7f95d691fec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-08T12:41:09.410 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:09.411+0000 7f95d691fec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-08T12:41:09.410 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:09.411+0000 7f95d691fec0 20 rados->read ofs=0 len=0 2019-12-08T12:41:09.422 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:09.423+0000 7f95d691fec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:41:09.422 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:09.423+0000 7f95d691fec0 20 rados->read ofs=0 len=0 2019-12-08T12:41:09.436 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:09.438+0000 7f95d691fec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-08T12:41:09.437 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:09.438+0000 7f95d691fec0 20 rados->read ofs=0 len=0 2019-12-08T12:41:09.445 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:09.447+0000 7f95d691fec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:41:09.445 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:09.447+0000 7f95d691fec0 20 rados->read ofs=0 len=0 2019-12-08T12:41:09.465 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:09.466+0000 7f95d691fec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-08T12:41:09.465 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:09.466+0000 7f95d691fec0 20 rados->read ofs=0 len=0 2019-12-08T12:41:09.473 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:09.474+0000 7f95d691fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:41:09.473 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:09.474+0000 7f95d691fec0 10 cannot find current period zonegroup using local zonegroup 2019-12-08T12:41:09.473 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:09.474+0000 7f95d691fec0 20 rados->read ofs=0 len=0 2019-12-08T12:41:09.483 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:09.485+0000 7f95d691fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:41:09.484 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:09.485+0000 7f95d691fec0 20 rados->read ofs=0 len=0 2019-12-08T12:41:09.495 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:09.497+0000 7f95d691fec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:41:09.495 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:09.497+0000 7f95d691fec0 20 rados->read ofs=0 len=0 2019-12-08T12:41:09.511 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:09.512+0000 7f95d691fec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-08T12:41:09.511 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:09.512+0000 7f95d691fec0 20 zonegroup default 2019-12-08T12:41:09.511 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:09.512+0000 7f95d691fec0 20 rados->read ofs=0 len=0 2019-12-08T12:41:09.518 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:09.520+0000 7f95d691fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:41:09.518 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:09.520+0000 7f95d691fec0 10 Cannot find current period zone using local zone 2019-12-08T12:41:09.518 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:09.520+0000 7f95d691fec0 20 rados->read ofs=0 len=0 2019-12-08T12:41:09.523 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:09.525+0000 7f95d691fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:41:09.524 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:09.525+0000 7f95d691fec0 20 rados->read ofs=0 len=0 2019-12-08T12:41:09.540 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:09.542+0000 7f95d691fec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:41:09.540 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:09.542+0000 7f95d691fec0 20 rados->read ofs=0 len=0 2019-12-08T12:41:09.556 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:09.557+0000 7f95d691fec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-08T12:41:09.556 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:09.557+0000 7f95d691fec0 20 zone default found 2019-12-08T12:41:09.556 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:09.557+0000 7f95d691fec0 20 started sync module instance, tier type = 2019-12-08T12:41:09.556 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:09.557+0000 7f95d691fec0 20 started zone id=f8ab349b-4577-410d-b524-4ecaf50bb1bd (name=default) with tier type = 2019-12-08T12:41:09.969 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:09.970+0000 7f95d691fec0 20 add_watcher() i=0 2019-12-08T12:41:09.969 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:09.970+0000 7f95d691fec0 20 add_watcher() i=1 2019-12-08T12:41:09.970 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:09.970+0000 7f95d691fec0 20 add_watcher() i=2 2019-12-08T12:41:09.970 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:09.970+0000 7f95d691fec0 20 add_watcher() i=3 2019-12-08T12:41:09.970 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:09.970+0000 7f95d691fec0 20 add_watcher() i=4 2019-12-08T12:41:09.970 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:09.970+0000 7f95d691fec0 20 add_watcher() i=5 2019-12-08T12:41:09.970 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:09.970+0000 7f95d691fec0 20 add_watcher() i=6 2019-12-08T12:41:10.012 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:10.013+0000 7f95d691fec0 20 add_watcher() i=7 2019-12-08T12:41:10.012 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:10.013+0000 7f95d691fec0 2 all 8 watchers are set, enabling cache 2019-12-08T12:41:10.012 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:10.013+0000 7f9517fff700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-08T12:41:10.037 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:10.038+0000 7f95c3348700 0 -- 172.21.15.79:0/3531337158 >> v2:172.21.15.79:3300/0 conn(0x5646cd1f4af0 msgr2=0x5646cd1f6f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-12-08T12:41:10.239 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:10.239+0000 7f95c3348700 0 --2- 172.21.15.79:0/3531337158 >> v2:172.21.15.79:3300/0 conn(0x5646cd1f4af0 0x5646cd1f6f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2019-12-08T12:41:10.294 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:10.295+0000 7f95c434a700 0 -- 172.21.15.79:0/2158307784 >> [v2:172.21.15.79:6800/9057,v1:172.21.15.79:6801/9057] conn(0x7f9504022490 msgr2=0x7f9504024960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-08T12:41:11.898 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:11.898+0000 7f95027fc700 20 reqs_thread_entry: start 2019-12-08T12:41:11.898 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:11.898+0000 7f94fbfff700 20 reqs_thread_entry: start 2019-12-08T12:41:11.898 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:11.898+0000 7f95d691fec0 20 init_complete bucket index max shards: 0 2019-12-08T12:41:11.899 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:11.899+0000 7f94fa7fc700 20 reqs_thread_entry: start 2019-12-08T12:41:11.899 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:11.899+0000 7f95d691fec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-12-08T12:41:11.961 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:11.961+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:11.979 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:11.980+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:11.991 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:11.992+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:12.038 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:12.039+0000 7f95d691fec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-12-08T12:41:12.095 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:12.095+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:12.112 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:12.112+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:12.126 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:12.127+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:12.171 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:12.171+0000 7f95d691fec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-12-08T12:41:12.253 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:12.253+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:12.279 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:12.279+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:12.294 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:12.295+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:12.335 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:12.336+0000 7f95d691fec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-12-08T12:41:12.413 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:12.413+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:12.440 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:12.441+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:12.453 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:12.454+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:12.490 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:12.491+0000 7f95d691fec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-12-08T12:41:12.538 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:12.538+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:12.558 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:12.558+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:12.565 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:12.566+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:12.612 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:12.613+0000 7f95d691fec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-12-08T12:41:12.663 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:12.664+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:12.681 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:12.681+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:12.691 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:12.691+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:12.722 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:12.722+0000 7f95d691fec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-12-08T12:41:12.767 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:12.767+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:12.793 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:12.794+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:12.809 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:12.809+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:12.848 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:12.849+0000 7f95d691fec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-12-08T12:41:12.894 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:12.894+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:12.913 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:12.913+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:12.927 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:12.927+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:12.984 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:12.985+0000 7f95d691fec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-12-08T12:41:13.029 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:13.029+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:13.045 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:13.045+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:13.055 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:13.056+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:13.094 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:13.094+0000 7f95d691fec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-12-08T12:41:13.161 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:13.161+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:13.189 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:13.189+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:13.201 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:13.201+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:13.268 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:13.269+0000 7f95d691fec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-12-08T12:41:13.332 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:13.332+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:13.352 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:13.352+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:13.364 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:13.365+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:13.426 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:13.427+0000 7f95d691fec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-12-08T12:41:13.503 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:13.504+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:13.537 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:13.538+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:13.549 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:13.550+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:13.583 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:13.583+0000 7f95d691fec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-12-08T12:41:13.650 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:13.651+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:13.674 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:13.674+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:13.686 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:13.686+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:13.731 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:13.731+0000 7f95d691fec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-12-08T12:41:13.806 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:13.806+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:13.839 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:13.840+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:13.855 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:13.856+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:13.917 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:13.918+0000 7f95d691fec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-12-08T12:41:13.978 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:13.978+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:13.999 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:13.999+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:14.017 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:14.017+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:14.067 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:14.067+0000 7f95d691fec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-12-08T12:41:14.140 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:14.141+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:14.163 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:14.163+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:14.173 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:14.174+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:14.220 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:14.221+0000 7f95d691fec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-12-08T12:41:14.281 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:14.281+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:14.299 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:14.299+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:14.309 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:14.309+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:14.348 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:14.349+0000 7f95d691fec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-12-08T12:41:14.429 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:14.429+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:14.458 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:14.459+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:14.476 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:14.476+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:14.527 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:14.527+0000 7f95d691fec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-12-08T12:41:14.595 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:14.595+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:14.624 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:14.625+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:14.636 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:14.636+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:14.678 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:14.678+0000 7f95d691fec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-12-08T12:41:14.769 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:14.770+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:14.810 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:14.810+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:14.827 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:14.828+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:14.897 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:14.898+0000 7f95d691fec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-12-08T12:41:14.964 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:14.965+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:14.994 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:14.995+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:15.012 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:15.013+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:15.063 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:15.064+0000 7f95d691fec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-12-08T12:41:15.135 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:15.136+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:15.156 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:15.157+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:15.168 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:15.168+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:15.214 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:15.215+0000 7f95d691fec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-12-08T12:41:15.306 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:15.307+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:15.343 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:15.344+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:15.366 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:15.366+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:15.441 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:15.442+0000 7f95d691fec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-12-08T12:41:15.511 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:15.511+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:15.529 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:15.529+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:15.538 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:15.539+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:15.581 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:15.581+0000 7f95d691fec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-12-08T12:41:15.669 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:15.669+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:15.698 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:15.699+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:15.713 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:15.713+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:15.772 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:15.773+0000 7f95d691fec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-12-08T12:41:15.830 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:15.831+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:15.856 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:15.856+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:15.870 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:15.871+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:15.907 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:15.908+0000 7f95d691fec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-12-08T12:41:16.042 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:16.042+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:16.072 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:16.073+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:16.084 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:16.085+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:16.135 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:16.136+0000 7f95d691fec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-12-08T12:41:16.194 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:16.194+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:16.214 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:16.215+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:16.225 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:16.226+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:16.270 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:16.270+0000 7f95d691fec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-12-08T12:41:16.346 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:16.346+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:16.372 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:16.373+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:16.386 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:16.387+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:16.430 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:16.431+0000 7f95d691fec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-12-08T12:41:16.516 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:16.516+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:16.544 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:16.545+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:16.560 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:16.561+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:16.601 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:16.601+0000 7f95d691fec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-12-08T12:41:16.657 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:16.657+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:16.679 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:16.680+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:16.698 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:16.698+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:16.736 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:16.737+0000 7f95d691fec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-12-08T12:41:16.816 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:16.816+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:16.840 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:16.841+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:16.852 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:16.853+0000 7f95d691fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:16.928 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:16.928+0000 7f95d691fec0 20 remove_watcher() i=0 2019-12-08T12:41:16.928 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:16.928+0000 7f95d691fec0 2 removed watcher, disabling cache 2019-12-08T12:41:16.988 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:16.989+0000 7f95d691fec0 20 remove_watcher() i=1 2019-12-08T12:41:17.049 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:17.049+0000 7f95d691fec0 20 remove_watcher() i=2 2019-12-08T12:41:17.096 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:17.096+0000 7f95d691fec0 20 remove_watcher() i=3 2019-12-08T12:41:17.157 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:17.157+0000 7f95d691fec0 20 remove_watcher() i=4 2019-12-08T12:41:17.238 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:17.238+0000 7f95d691fec0 20 remove_watcher() i=5 2019-12-08T12:41:17.296 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:17.296+0000 7f95d691fec0 20 remove_watcher() i=6 2019-12-08T12:41:17.347 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:17.348+0000 7f95d691fec0 20 remove_watcher() i=7 2019-12-08T12:41:17.355 INFO:teuthology.orchestra.run.smithi079:> radosgw-admin gc process --include-all 2019-12-08T12:41:17.501 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:17.502+0000 7fdfca49fec0 20 rados->read ofs=0 len=0 2019-12-08T12:41:17.534 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:17.534+0000 7fdfca49fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:41:17.534 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:17.534+0000 7fdfca49fec0 20 rados->read ofs=0 len=0 2019-12-08T12:41:17.543 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:17.544+0000 7fdfca49fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:41:17.543 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:17.544+0000 7fdfca49fec0 20 rados->read ofs=0 len=0 2019-12-08T12:41:17.551 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:17.551+0000 7fdfca49fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:41:17.551 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:17.551+0000 7fdfca49fec0 20 rados->read ofs=0 len=0 2019-12-08T12:41:17.569 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:17.570+0000 7fdfca49fec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:41:17.771 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:17.771+0000 7fdfca49fec0 20 RGWRados::pool_iterate: got zonegroup_info.fee0148b-7ae2-4cf0-a79e-86045a29cb7c 2019-12-08T12:41:17.771 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:17.771+0000 7fdfca49fec0 20 RGWRados::pool_iterate: got zone_info.f8ab349b-4577-410d-b524-4ecaf50bb1bd 2019-12-08T12:41:17.772 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:17.771+0000 7fdfca49fec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-08T12:41:17.772 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:17.771+0000 7fdfca49fec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-08T12:41:17.772 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:17.771+0000 7fdfca49fec0 20 rados->read ofs=0 len=0 2019-12-08T12:41:17.787 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:17.787+0000 7fdfca49fec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:41:17.787 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:17.788+0000 7fdfca49fec0 20 rados->read ofs=0 len=0 2019-12-08T12:41:17.802 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:17.803+0000 7fdfca49fec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-08T12:41:17.802 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:17.803+0000 7fdfca49fec0 20 rados->read ofs=0 len=0 2019-12-08T12:41:17.815 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:17.815+0000 7fdfca49fec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:41:17.815 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:17.815+0000 7fdfca49fec0 20 rados->read ofs=0 len=0 2019-12-08T12:41:17.829 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:17.830+0000 7fdfca49fec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-08T12:41:17.829 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:17.830+0000 7fdfca49fec0 20 rados->read ofs=0 len=0 2019-12-08T12:41:17.840 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:17.841+0000 7fdfca49fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:41:17.840 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:17.841+0000 7fdfca49fec0 10 cannot find current period zonegroup using local zonegroup 2019-12-08T12:41:17.841 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:17.841+0000 7fdfca49fec0 20 rados->read ofs=0 len=0 2019-12-08T12:41:17.848 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:17.848+0000 7fdfca49fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:41:17.848 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:17.848+0000 7fdfca49fec0 20 rados->read ofs=0 len=0 2019-12-08T12:41:17.865 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:17.866+0000 7fdfca49fec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:41:17.865 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:17.866+0000 7fdfca49fec0 20 rados->read ofs=0 len=0 2019-12-08T12:41:17.880 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:17.881+0000 7fdfca49fec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-08T12:41:17.881 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:17.881+0000 7fdfca49fec0 20 zonegroup default 2019-12-08T12:41:17.881 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:17.881+0000 7fdfca49fec0 20 rados->read ofs=0 len=0 2019-12-08T12:41:17.888 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:17.889+0000 7fdfca49fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:41:17.888 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:17.889+0000 7fdfca49fec0 10 Cannot find current period zone using local zone 2019-12-08T12:41:17.889 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:17.889+0000 7fdfca49fec0 20 rados->read ofs=0 len=0 2019-12-08T12:41:17.899 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:17.899+0000 7fdfca49fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:41:17.899 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:17.899+0000 7fdfca49fec0 20 rados->read ofs=0 len=0 2019-12-08T12:41:17.917 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:17.918+0000 7fdfca49fec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:41:17.917 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:17.918+0000 7fdfca49fec0 20 rados->read ofs=0 len=0 2019-12-08T12:41:17.925 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:17.925+0000 7fdfca49fec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-08T12:41:17.925 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:17.925+0000 7fdfca49fec0 20 zone default found 2019-12-08T12:41:17.925 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:17.925+0000 7fdfca49fec0 20 started sync module instance, tier type = 2019-12-08T12:41:17.925 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:17.925+0000 7fdfca49fec0 20 started zone id=f8ab349b-4577-410d-b524-4ecaf50bb1bd (name=default) with tier type = 2019-12-08T12:41:18.291 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:18.291+0000 7fdfca49fec0 20 add_watcher() i=0 2019-12-08T12:41:18.291 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:18.291+0000 7fdfca49fec0 20 add_watcher() i=1 2019-12-08T12:41:18.291 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:18.291+0000 7fdfca49fec0 20 add_watcher() i=2 2019-12-08T12:41:18.292 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:18.291+0000 7fdfca49fec0 20 add_watcher() i=3 2019-12-08T12:41:18.292 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:18.291+0000 7fdfca49fec0 20 add_watcher() i=4 2019-12-08T12:41:18.292 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:18.291+0000 7fdfca49fec0 20 add_watcher() i=5 2019-12-08T12:41:18.292 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:18.291+0000 7fdfca49fec0 20 add_watcher() i=6 2019-12-08T12:41:18.318 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:18.319+0000 7fdfca49fec0 20 add_watcher() i=7 2019-12-08T12:41:18.318 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:18.319+0000 7fdfca49fec0 2 all 8 watchers are set, enabling cache 2019-12-08T12:41:18.318 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:18.319+0000 7fdf87fdf700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-08T12:41:18.326 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:18.326+0000 7fdfb7eca700 0 -- 172.21.15.79:0/546358630 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55dc1c2bdaa0 msgr2=0x55dc1c2bce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-12-08T12:41:18.362 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:18.363+0000 7fdfb7eca700 0 -- 172.21.15.79:0/309186765 >> [v2:172.21.15.79:6800/9057,v1:172.21.15.79:6801/9057] conn(0x7fdef8022470 msgr2=0x7fdef8024960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-08T12:41:19.891 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:19.892+0000 7fdef67fc700 20 reqs_thread_entry: start 2019-12-08T12:41:19.891 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:19.892+0000 7fdeeffff700 20 reqs_thread_entry: start 2019-12-08T12:41:19.892 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:19.892+0000 7fdfca49fec0 20 init_complete bucket index max shards: 0 2019-12-08T12:41:19.892 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:19.893+0000 7fdeee7fc700 20 reqs_thread_entry: start 2019-12-08T12:41:19.892 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:19.893+0000 7fdfca49fec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-12-08T12:41:19.955 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:19.955+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:19.982 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:19.983+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:19.999 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:20.000+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:20.080 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:20.080+0000 7fdfca49fec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-12-08T12:41:20.141 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:20.141+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:20.161 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:20.161+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:20.175 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:20.176+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:20.207 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:20.208+0000 7fdfca49fec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-12-08T12:41:20.248 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:20.248+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:20.265 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:20.266+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:20.275 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:20.274+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:20.311 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:20.312+0000 7fdfca49fec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-12-08T12:41:20.370 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:20.371+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:20.399 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:20.399+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:20.409 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:20.409+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:20.466 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:20.466+0000 7fdfca49fec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-12-08T12:41:20.523 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:20.523+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:20.540 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:20.540+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:20.548 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:20.549+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:20.589 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:20.587+0000 7fdfca49fec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-12-08T12:41:20.630 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:20.630+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:20.647 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:20.647+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:20.656 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:20.656+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:20.698 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:20.698+0000 7fdfca49fec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-12-08T12:41:20.753 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:20.754+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:20.781 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:20.782+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:20.795 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:20.796+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:20.858 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:20.859+0000 7fdfca49fec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-12-08T12:41:20.934 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:20.931+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:20.953 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:20.954+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:20.966 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:20.967+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:21.017 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:21.018+0000 7fdfca49fec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-12-08T12:41:21.101 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:21.101+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:21.133 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:21.134+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:21.150 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:21.150+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:21.208 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:21.208+0000 7fdfca49fec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-12-08T12:41:21.293 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:21.294+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:21.318 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:21.319+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:21.330 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:21.330+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:21.368 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:21.369+0000 7fdfca49fec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-12-08T12:41:21.433 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:21.433+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:21.457 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:21.458+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:21.477 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:21.478+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:21.526 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:21.527+0000 7fdfca49fec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-12-08T12:41:21.569 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:21.570+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:21.589 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:21.589+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:21.599 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:21.599+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:21.637 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:21.638+0000 7fdfca49fec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-12-08T12:41:21.689 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:21.690+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:21.710 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:21.711+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:21.721 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:21.721+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:21.762 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:21.763+0000 7fdfca49fec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-12-08T12:41:21.813 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:21.814+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:21.833 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:21.834+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:21.844 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:21.844+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:21.886 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:21.887+0000 7fdfca49fec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-12-08T12:41:21.949 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:21.950+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:21.975 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:21.976+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:21.983 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:21.983+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:22.025 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:22.026+0000 7fdfca49fec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-12-08T12:41:22.096 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:22.096+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:22.118 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:22.119+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:22.128 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:22.129+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:22.183 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:22.184+0000 7fdfca49fec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-12-08T12:41:22.271 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:22.272+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:22.309 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:22.310+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:22.324 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:22.325+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:22.390 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:22.391+0000 7fdfca49fec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-12-08T12:41:22.479 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:22.480+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:22.509 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:22.509+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:22.529 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:22.530+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:22.570 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:22.570+0000 7fdfca49fec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-12-08T12:41:22.615 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:22.616+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:22.635 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:22.636+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:22.655 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:22.655+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:22.710 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:22.711+0000 7fdfca49fec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-12-08T12:41:22.767 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:22.768+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:22.788 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:22.789+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:22.801 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:22.802+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:22.849 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:22.849+0000 7fdfca49fec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-12-08T12:41:22.911 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:22.912+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:22.940 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:22.941+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:22.950 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:22.951+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:23.001 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:23.002+0000 7fdfca49fec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-12-08T12:41:23.083 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:23.084+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:23.116 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:23.117+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:23.142 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:23.143+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:23.197 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:23.197+0000 7fdfca49fec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-12-08T12:41:23.252 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:23.252+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:23.275 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:23.276+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:23.287 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:23.288+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:23.345 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:23.346+0000 7fdfca49fec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-12-08T12:41:23.437 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:23.437+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:23.473 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:23.474+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:23.492 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:23.493+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:23.549 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:23.546+0000 7fdfca49fec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-12-08T12:41:23.590 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:23.591+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:23.613 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:23.613+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:23.623 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:23.624+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:23.652 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:23.653+0000 7fdfca49fec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-12-08T12:41:23.744 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:23.745+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:23.785 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:23.786+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:23.813 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:23.814+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:23.884 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:23.884+0000 7fdfca49fec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-12-08T12:41:23.968 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:23.969+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:23.995 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:23.996+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:24.011 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:24.012+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:24.059 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:24.060+0000 7fdfca49fec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-12-08T12:41:24.120 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:24.121+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:24.140 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:24.141+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:24.151 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:24.152+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:24.185 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:24.186+0000 7fdfca49fec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-12-08T12:41:24.225 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:24.226+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:24.243 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:24.243+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:24.252 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:24.252+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:24.285 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:24.286+0000 7fdfca49fec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-12-08T12:41:24.378 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:24.379+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:24.395 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:24.396+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:24.403 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:24.403+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:24.441 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:24.442+0000 7fdfca49fec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-12-08T12:41:24.499 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:24.500+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:24.536 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:24.537+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:24.546 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:24.547+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:24.600 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:24.600+0000 7fdfca49fec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-12-08T12:41:24.661 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:24.661+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:24.691 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:24.692+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:24.706 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:24.703+0000 7fdfca49fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:24.781 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:24.782+0000 7fdfca49fec0 20 remove_watcher() i=0 2019-12-08T12:41:24.782 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:24.782+0000 7fdfca49fec0 2 removed watcher, disabling cache 2019-12-08T12:41:24.821 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:24.822+0000 7fdfca49fec0 20 remove_watcher() i=1 2019-12-08T12:41:24.862 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:24.863+0000 7fdfca49fec0 20 remove_watcher() i=2 2019-12-08T12:41:24.921 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:24.922+0000 7fdfca49fec0 20 remove_watcher() i=3 2019-12-08T12:41:24.961 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:24.961+0000 7fdfca49fec0 20 remove_watcher() i=4 2019-12-08T12:41:25.017 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:25.012+0000 7fdfca49fec0 20 remove_watcher() i=5 2019-12-08T12:41:25.063 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:25.063+0000 7fdfca49fec0 20 remove_watcher() i=6 2019-12-08T12:41:25.107 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:25.108+0000 7fdfca49fec0 20 remove_watcher() i=7 2019-12-08T12:41:25.116 INFO:teuthology.orchestra.run.smithi079:> radosgw-admin gc process --include-all 2019-12-08T12:41:25.256 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:25.256+0000 7f8abc263ec0 20 rados->read ofs=0 len=0 2019-12-08T12:41:25.302 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:25.299+0000 7f8abc263ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:41:25.302 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:25.299+0000 7f8abc263ec0 20 rados->read ofs=0 len=0 2019-12-08T12:41:25.311 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:25.311+0000 7f8abc263ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:41:25.311 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:25.311+0000 7f8abc263ec0 20 rados->read ofs=0 len=0 2019-12-08T12:41:25.319 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:25.319+0000 7f8abc263ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:41:25.319 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:25.319+0000 7f8abc263ec0 20 rados->read ofs=0 len=0 2019-12-08T12:41:25.338 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:25.339+0000 7f8abc263ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:41:25.524 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:25.524+0000 7f8abc263ec0 20 RGWRados::pool_iterate: got zonegroup_info.fee0148b-7ae2-4cf0-a79e-86045a29cb7c 2019-12-08T12:41:25.524 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:25.524+0000 7f8abc263ec0 20 RGWRados::pool_iterate: got zone_info.f8ab349b-4577-410d-b524-4ecaf50bb1bd 2019-12-08T12:41:25.524 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:25.524+0000 7f8abc263ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-08T12:41:25.524 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:25.524+0000 7f8abc263ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-08T12:41:25.525 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:25.524+0000 7f8abc263ec0 20 rados->read ofs=0 len=0 2019-12-08T12:41:25.533 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:25.534+0000 7f8abc263ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:41:25.533 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:25.534+0000 7f8abc263ec0 20 rados->read ofs=0 len=0 2019-12-08T12:41:25.543 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:25.544+0000 7f8abc263ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-08T12:41:25.544 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:25.544+0000 7f8abc263ec0 20 rados->read ofs=0 len=0 2019-12-08T12:41:25.555 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:25.556+0000 7f8abc263ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:41:25.555 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:25.556+0000 7f8abc263ec0 20 rados->read ofs=0 len=0 2019-12-08T12:41:25.564 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:25.564+0000 7f8abc263ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-08T12:41:25.564 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:25.564+0000 7f8abc263ec0 20 rados->read ofs=0 len=0 2019-12-08T12:41:25.576 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:25.577+0000 7f8abc263ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:41:25.576 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:25.577+0000 7f8abc263ec0 10 cannot find current period zonegroup using local zonegroup 2019-12-08T12:41:25.576 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:25.577+0000 7f8abc263ec0 20 rados->read ofs=0 len=0 2019-12-08T12:41:25.581 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:25.581+0000 7f8abc263ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:41:25.581 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:25.581+0000 7f8abc263ec0 20 rados->read ofs=0 len=0 2019-12-08T12:41:25.596 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:25.597+0000 7f8abc263ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:41:25.596 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:25.597+0000 7f8abc263ec0 20 rados->read ofs=0 len=0 2019-12-08T12:41:25.606 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:25.607+0000 7f8abc263ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-08T12:41:25.606 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:25.607+0000 7f8abc263ec0 20 zonegroup default 2019-12-08T12:41:25.606 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:25.607+0000 7f8abc263ec0 20 rados->read ofs=0 len=0 2019-12-08T12:41:25.611 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:25.612+0000 7f8abc263ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:41:25.611 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:25.612+0000 7f8abc263ec0 10 Cannot find current period zone using local zone 2019-12-08T12:41:25.612 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:25.612+0000 7f8abc263ec0 20 rados->read ofs=0 len=0 2019-12-08T12:41:25.616 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:25.617+0000 7f8abc263ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:41:25.616 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:25.617+0000 7f8abc263ec0 20 rados->read ofs=0 len=0 2019-12-08T12:41:25.627 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:25.628+0000 7f8abc263ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:41:25.627 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:25.628+0000 7f8abc263ec0 20 rados->read ofs=0 len=0 2019-12-08T12:41:25.647 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:25.642+0000 7f8abc263ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-08T12:41:25.647 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:25.642+0000 7f8abc263ec0 20 zone default found 2019-12-08T12:41:25.647 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:25.642+0000 7f8abc263ec0 20 started sync module instance, tier type = 2019-12-08T12:41:25.647 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:25.642+0000 7f8abc263ec0 20 started zone id=f8ab349b-4577-410d-b524-4ecaf50bb1bd (name=default) with tier type = 2019-12-08T12:41:26.039 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:26.040+0000 7f8abc263ec0 20 add_watcher() i=0 2019-12-08T12:41:26.039 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:26.040+0000 7f8abc263ec0 20 add_watcher() i=1 2019-12-08T12:41:26.040 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:26.040+0000 7f8abc263ec0 20 add_watcher() i=2 2019-12-08T12:41:26.040 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:26.040+0000 7f8abc263ec0 20 add_watcher() i=3 2019-12-08T12:41:26.040 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:26.040+0000 7f8abc263ec0 20 add_watcher() i=4 2019-12-08T12:41:26.040 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:26.040+0000 7f8abc263ec0 20 add_watcher() i=5 2019-12-08T12:41:26.040 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:26.040+0000 7f8abc263ec0 20 add_watcher() i=6 2019-12-08T12:41:26.084 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:26.084+0000 7f8abc263ec0 20 add_watcher() i=7 2019-12-08T12:41:26.084 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:26.084+0000 7f8abc263ec0 2 all 8 watchers are set, enabling cache 2019-12-08T12:41:26.084 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:26.085+0000 7f8a79fdb700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-08T12:41:26.090 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:26.091+0000 7f8aa9c8e700 0 -- 172.21.15.79:0/1114574553 >> v1:172.21.15.79:6789/0 conn(0x55ca673a6550 legacy=0x55ca673ccb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-08T12:41:26.134 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:26.134+0000 7f8aa8c8c700 0 -- 172.21.15.79:0/1447182617 >> [v2:172.21.15.13:6800/9325,v1:172.21.15.13:6801/9325] conn(0x55ca673e4520 msgr2=0x55ca673e6940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-08T12:41:27.944 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:27.941+0000 7f89ebfff700 20 reqs_thread_entry: start 2019-12-08T12:41:27.944 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:27.942+0000 7f89e9ffb700 20 reqs_thread_entry: start 2019-12-08T12:41:27.945 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:27.942+0000 7f8abc263ec0 20 init_complete bucket index max shards: 0 2019-12-08T12:41:27.945 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:27.942+0000 7f89d7fff700 20 reqs_thread_entry: start 2019-12-08T12:41:27.945 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:27.942+0000 7f8abc263ec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-12-08T12:41:28.014 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:28.014+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:28.042 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:28.042+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:28.058 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:28.059+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:28.102 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:28.103+0000 7f8abc263ec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-12-08T12:41:28.162 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:28.163+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:28.189 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:28.185+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:28.198 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:28.199+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:28.266 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:28.266+0000 7f8abc263ec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-12-08T12:41:28.314 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:28.314+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:28.337 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:28.337+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:28.349 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:28.349+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:28.394 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:28.390+0000 7f8abc263ec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-12-08T12:41:28.444 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:28.445+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:28.462 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:28.462+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:28.478 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:28.479+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:28.520 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:28.521+0000 7f8abc263ec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-12-08T12:41:28.588 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:28.589+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:28.614 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:28.614+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:28.625 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:28.626+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:28.665 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:28.664+0000 7f8abc263ec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-12-08T12:41:28.721 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:28.721+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:28.761 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:28.762+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:28.775 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:28.775+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:28.830 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:28.831+0000 7f8abc263ec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-12-08T12:41:28.867 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:28.867+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:28.881 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:28.882+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:28.889 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:28.890+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:28.928 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:28.925+0000 7f8abc263ec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-12-08T12:41:28.975 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:28.976+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:28.994 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:28.995+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:29.006 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:29.005+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:29.036 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:29.037+0000 7f8abc263ec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-12-08T12:41:29.105 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:29.105+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:29.128 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:29.129+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:29.137 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:29.138+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:29.171 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:29.172+0000 7f8abc263ec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-12-08T12:41:29.251 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:29.251+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:29.273 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:29.274+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:29.286 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:29.287+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:29.325 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:29.324+0000 7f8abc263ec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-12-08T12:41:29.371 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:29.372+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:29.396 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:29.397+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:29.412 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:29.413+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:29.448 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:29.448+0000 7f8abc263ec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-12-08T12:41:29.499 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:29.500+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:29.529 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:29.529+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:29.544 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:29.545+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:29.580 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:29.580+0000 7f8abc263ec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-12-08T12:41:29.628 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:29.629+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:29.645 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:29.646+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:29.654 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:29.655+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:29.685 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:29.686+0000 7f8abc263ec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-12-08T12:41:29.726 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:29.727+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:29.742 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:29.743+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:29.753 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:29.754+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:29.790 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:29.791+0000 7f8abc263ec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-12-08T12:41:29.862 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:29.863+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:29.882 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:29.883+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:29.894 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:29.894+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:29.947 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:29.948+0000 7f8abc263ec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-12-08T12:41:29.999 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:29.999+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:30.016 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:30.017+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:30.025 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:30.026+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:30.068 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:30.069+0000 7f8abc263ec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-12-08T12:41:30.119 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:30.119+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:30.138 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:30.135+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:30.147 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:30.148+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:30.188 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:30.188+0000 7f8abc263ec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-12-08T12:41:30.245 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:30.246+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:30.290 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:30.290+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:30.305 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:30.305+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:30.348 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:30.349+0000 7f8abc263ec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-12-08T12:41:30.396 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:30.397+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:30.417 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:30.418+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:30.428 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:30.429+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:30.469 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:30.465+0000 7f8abc263ec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-12-08T12:41:30.516 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:30.517+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:30.537 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:30.537+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:30.548 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:30.549+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:30.585 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:30.586+0000 7f8abc263ec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-12-08T12:41:30.632 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:30.632+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:30.649 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:30.649+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:30.657 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:30.658+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:30.694 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:30.695+0000 7f8abc263ec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-12-08T12:41:30.774 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:30.775+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:30.806 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:30.807+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:30.829 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:30.830+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:30.896 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:30.897+0000 7f8abc263ec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-12-08T12:41:30.985 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:30.985+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:31.019 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:31.020+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:31.038 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:31.039+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:31.111 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:31.112+0000 7f8abc263ec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-12-08T12:41:31.187 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:31.188+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:31.226 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:31.226+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:31.240 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:31.240+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:31.282 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:31.282+0000 7f8abc263ec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-12-08T12:41:31.350 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:31.351+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:31.389 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:31.390+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:31.409 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:31.410+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:31.460 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:31.461+0000 7f8abc263ec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-12-08T12:41:31.538 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:31.538+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:31.557 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:31.557+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:31.568 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:31.569+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:31.609 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:31.610+0000 7f8abc263ec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-12-08T12:41:31.658 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:31.658+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:31.678 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:31.679+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:31.688 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:31.689+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:31.725 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:31.726+0000 7f8abc263ec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-12-08T12:41:31.784 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:31.785+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:31.818 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:31.819+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:31.844 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:31.845+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:31.892 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:31.892+0000 7f8abc263ec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-12-08T12:41:31.949 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:31.950+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:31.975 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:31.976+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:31.990 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:31.991+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:32.054 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:32.055+0000 7f8abc263ec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-12-08T12:41:32.126 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:32.127+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:32.239 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:32.154+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:32.239 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:32.166+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:32.240 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:32.217+0000 7f8abc263ec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-12-08T12:41:32.301 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:32.302+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:32.326 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:32.327+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:32.338 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:32.339+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:32.397 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:32.398+0000 7f8abc263ec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-12-08T12:41:32.470 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:32.471+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:32.502 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:32.503+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:32.517 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:32.517+0000 7f8abc263ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:32.616 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:32.617+0000 7f8abc263ec0 20 remove_watcher() i=0 2019-12-08T12:41:32.617 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:32.617+0000 7f8abc263ec0 2 removed watcher, disabling cache 2019-12-08T12:41:32.652 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:32.652+0000 7f8abc263ec0 20 remove_watcher() i=1 2019-12-08T12:41:32.698 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:32.699+0000 7f8abc263ec0 20 remove_watcher() i=2 2019-12-08T12:41:32.760 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:32.755+0000 7f8abc263ec0 20 remove_watcher() i=3 2019-12-08T12:41:32.816 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:32.817+0000 7f8abc263ec0 20 remove_watcher() i=4 2019-12-08T12:41:32.895 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:32.896+0000 7f8abc263ec0 20 remove_watcher() i=5 2019-12-08T12:41:32.944 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:32.945+0000 7f8abc263ec0 20 remove_watcher() i=6 2019-12-08T12:41:32.986 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:32.986+0000 7f8abc263ec0 20 remove_watcher() i=7 2019-12-08T12:41:32.994 INFO:teuthology.orchestra.run.smithi079:> radosgw-admin gc process --include-all 2019-12-08T12:41:33.113 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:33.114+0000 7f6845f1fec0 20 rados->read ofs=0 len=0 2019-12-08T12:41:33.142 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:33.143+0000 7f6845f1fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:41:33.143 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:33.143+0000 7f6845f1fec0 20 rados->read ofs=0 len=0 2019-12-08T12:41:33.151 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:33.152+0000 7f6845f1fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:41:33.151 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:33.152+0000 7f6845f1fec0 20 rados->read ofs=0 len=0 2019-12-08T12:41:33.159 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:33.160+0000 7f6845f1fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:41:33.160 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:33.160+0000 7f6845f1fec0 20 rados->read ofs=0 len=0 2019-12-08T12:41:33.183 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:33.184+0000 7f6845f1fec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:41:33.358 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:33.358+0000 7f6845f1fec0 20 RGWRados::pool_iterate: got zonegroup_info.fee0148b-7ae2-4cf0-a79e-86045a29cb7c 2019-12-08T12:41:33.358 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:33.358+0000 7f6845f1fec0 20 RGWRados::pool_iterate: got zone_info.f8ab349b-4577-410d-b524-4ecaf50bb1bd 2019-12-08T12:41:33.358 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:33.358+0000 7f6845f1fec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-08T12:41:33.358 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:33.358+0000 7f6845f1fec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-08T12:41:33.358 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:33.358+0000 7f6845f1fec0 20 rados->read ofs=0 len=0 2019-12-08T12:41:33.379 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:33.380+0000 7f6845f1fec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:41:33.379 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:33.380+0000 7f6845f1fec0 20 rados->read ofs=0 len=0 2019-12-08T12:41:33.393 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:33.393+0000 7f6845f1fec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-08T12:41:33.393 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:33.393+0000 7f6845f1fec0 20 rados->read ofs=0 len=0 2019-12-08T12:41:33.411 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:33.411+0000 7f6845f1fec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:41:33.411 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:33.412+0000 7f6845f1fec0 20 rados->read ofs=0 len=0 2019-12-08T12:41:33.429 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:33.430+0000 7f6845f1fec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-08T12:41:33.429 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:33.430+0000 7f6845f1fec0 20 rados->read ofs=0 len=0 2019-12-08T12:41:33.437 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:33.437+0000 7f6845f1fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:41:33.437 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:33.437+0000 7f6845f1fec0 10 cannot find current period zonegroup using local zonegroup 2019-12-08T12:41:33.437 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:33.437+0000 7f6845f1fec0 20 rados->read ofs=0 len=0 2019-12-08T12:41:33.443 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:33.444+0000 7f6845f1fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:41:33.443 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:33.444+0000 7f6845f1fec0 20 rados->read ofs=0 len=0 2019-12-08T12:41:33.462 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:33.462+0000 7f6845f1fec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:41:33.462 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:33.462+0000 7f6845f1fec0 20 rados->read ofs=0 len=0 2019-12-08T12:41:33.483 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:33.483+0000 7f6845f1fec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-08T12:41:33.483 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:33.483+0000 7f6845f1fec0 20 zonegroup default 2019-12-08T12:41:33.483 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:33.483+0000 7f6845f1fec0 20 rados->read ofs=0 len=0 2019-12-08T12:41:33.493 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:33.491+0000 7f6845f1fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:41:33.493 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:33.491+0000 7f6845f1fec0 10 Cannot find current period zone using local zone 2019-12-08T12:41:33.493 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:33.491+0000 7f6845f1fec0 20 rados->read ofs=0 len=0 2019-12-08T12:41:33.498 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:33.499+0000 7f6845f1fec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T12:41:33.498 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:33.499+0000 7f6845f1fec0 20 rados->read ofs=0 len=0 2019-12-08T12:41:33.509 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:33.510+0000 7f6845f1fec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T12:41:33.509 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:33.510+0000 7f6845f1fec0 20 rados->read ofs=0 len=0 2019-12-08T12:41:33.520 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:33.520+0000 7f6845f1fec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-08T12:41:33.520 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:33.520+0000 7f6845f1fec0 20 zone default found 2019-12-08T12:41:33.520 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:33.520+0000 7f6845f1fec0 20 started sync module instance, tier type = 2019-12-08T12:41:33.520 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:33.520+0000 7f6845f1fec0 20 started zone id=f8ab349b-4577-410d-b524-4ecaf50bb1bd (name=default) with tier type = 2019-12-08T12:41:33.892 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:33.893+0000 7f6845f1fec0 20 add_watcher() i=0 2019-12-08T12:41:33.892 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:33.893+0000 7f6845f1fec0 20 add_watcher() i=1 2019-12-08T12:41:33.892 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:33.893+0000 7f6845f1fec0 20 add_watcher() i=2 2019-12-08T12:41:33.892 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:33.893+0000 7f6845f1fec0 20 add_watcher() i=3 2019-12-08T12:41:33.893 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:33.893+0000 7f6845f1fec0 20 add_watcher() i=4 2019-12-08T12:41:33.893 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:33.893+0000 7f6845f1fec0 20 add_watcher() i=5 2019-12-08T12:41:33.893 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:33.893+0000 7f6845f1fec0 20 add_watcher() i=6 2019-12-08T12:41:33.931 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:33.932+0000 7f6845f1fec0 20 add_watcher() i=7 2019-12-08T12:41:33.931 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:33.932+0000 7f6845f1fec0 2 all 8 watchers are set, enabling cache 2019-12-08T12:41:33.931 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:33.932+0000 7f6803fdf700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-08T12:41:33.938 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:33.937+0000 7f683394a700 0 -- 172.21.15.79:0/4009456312 >> v1:172.21.15.13:6789/0 conn(0x56467a0b61d0 legacy=0x56467a0c8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-08T12:41:33.971 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:33.972+0000 7f682bfff700 0 -- 172.21.15.79:0/2933429417 >> [v2:172.21.15.13:6800/9325,v1:172.21.15.13:6801/9325] conn(0x56467a0ff420 msgr2=0x56467a101840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-08T12:41:35.907 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:35.908+0000 7f67727fc700 20 reqs_thread_entry: start 2019-12-08T12:41:35.907 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:35.908+0000 7f676bfff700 20 reqs_thread_entry: start 2019-12-08T12:41:35.908 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:35.908+0000 7f6845f1fec0 20 init_complete bucket index max shards: 0 2019-12-08T12:41:35.908 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:35.909+0000 7f676a7fc700 20 reqs_thread_entry: start 2019-12-08T12:41:35.908 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:35.909+0000 7f6845f1fec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-12-08T12:41:35.982 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:35.983+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:36.008 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:36.009+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:36.021 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:36.021+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:36.075 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:36.075+0000 7f6845f1fec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-12-08T12:41:36.150 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:36.151+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:36.179 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:36.179+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:36.193 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:36.194+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:36.244 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:36.245+0000 7f6845f1fec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-12-08T12:41:36.318 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:36.318+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:36.352 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:36.353+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:36.369 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:36.370+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:36.426 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:36.426+0000 7f6845f1fec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-12-08T12:41:36.507 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:36.508+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:36.538 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:36.539+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:36.565 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:36.566+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:36.632 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:36.633+0000 7f6845f1fec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-12-08T12:41:36.681 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:36.682+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:36.698 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:36.699+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:36.707 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:36.708+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:36.746 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:36.746+0000 7f6845f1fec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-12-08T12:41:36.837 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:36.838+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:36.904 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:36.904+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:36.922 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:36.923+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:36.977 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:36.978+0000 7f6845f1fec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-12-08T12:41:37.041 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:37.042+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:37.070 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:37.071+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:37.085 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:37.086+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:37.131 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:37.131+0000 7f6845f1fec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-12-08T12:41:37.201 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:37.199+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:37.232 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:37.233+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:37.248 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:37.249+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:37.306 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:37.307+0000 7f6845f1fec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-12-08T12:41:37.393 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:37.394+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:37.435 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:37.436+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:37.458 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:37.458+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:37.523 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:37.524+0000 7f6845f1fec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-12-08T12:41:37.584 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:37.585+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:37.609 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:37.609+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:37.618 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:37.619+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:37.672 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:37.673+0000 7f6845f1fec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-12-08T12:41:37.758 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:37.759+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:37.783 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:37.784+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:37.797 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:37.798+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:37.844 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:37.845+0000 7f6845f1fec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-12-08T12:41:37.913 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:37.913+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:37.935 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:37.936+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:37.949 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:37.950+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:38.003 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:38.003+0000 7f6845f1fec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-12-08T12:41:38.079 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:38.080+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:38.105 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:38.106+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:38.117 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:38.117+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:38.152 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:38.152+0000 7f6845f1fec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-12-08T12:41:38.198 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:38.199+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:38.216 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:38.217+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:38.230 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:38.231+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:38.283 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:38.284+0000 7f6845f1fec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-12-08T12:41:38.326 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:38.326+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:38.343 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:38.343+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:38.352 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:38.353+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:38.381 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:38.382+0000 7f6845f1fec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-12-08T12:41:38.425 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:38.426+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:38.442 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:38.442+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:38.458 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:38.452+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:38.480 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:38.480+0000 7f6845f1fec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-12-08T12:41:38.519 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:38.520+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:38.536 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:38.537+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:38.545 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:38.546+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:38.576 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:38.576+0000 7f6845f1fec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-12-08T12:41:38.636 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:38.636+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:38.667 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:38.668+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:38.683 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:38.684+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:38.748 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:38.748+0000 7f6845f1fec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-12-08T12:41:38.819 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:38.820+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:38.857 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:38.855+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:38.871 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:38.872+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:38.932 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:38.933+0000 7f6845f1fec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-12-08T12:41:39.028 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:39.028+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:39.054 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:39.055+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:39.066 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:39.067+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:39.122 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:39.123+0000 7f6845f1fec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-12-08T12:41:39.205 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:39.205+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:39.238 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:39.238+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:39.251 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:39.252+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:39.297 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:39.298+0000 7f6845f1fec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-12-08T12:41:39.353 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:39.353+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:39.371 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:39.372+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:39.380 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:39.381+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:39.433 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:39.434+0000 7f6845f1fec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-12-08T12:41:39.483 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:39.484+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:39.506 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:39.504+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:39.516 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:39.516+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:39.558 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:39.559+0000 7f6845f1fec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-12-08T12:41:39.606 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:39.607+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:39.624 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:39.625+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:39.636 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:39.635+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:39.670 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:39.671+0000 7f6845f1fec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-12-08T12:41:39.746 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:39.747+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:39.773 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:39.773+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:39.790 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:39.791+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:39.840 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:39.841+0000 7f6845f1fec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-12-08T12:41:39.921 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:39.922+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:39.947 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:39.948+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:39.960 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:39.961+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:40.013 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:40.013+0000 7f6845f1fec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-12-08T12:41:40.109 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:40.110+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:40.136 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:40.137+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:40.150 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:40.151+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:40.196 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:40.196+0000 7f6845f1fec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-12-08T12:41:40.254 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:40.255+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:40.279 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:40.280+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:40.295 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:40.296+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:40.341 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:40.342+0000 7f6845f1fec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-12-08T12:41:40.412 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:40.413+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:40.443 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:40.444+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:40.455 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:40.456+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:40.518 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:40.519+0000 7f6845f1fec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-12-08T12:41:40.571 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:40.572+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:40.610 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:40.610+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:40.620 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:40.621+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:40.656 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:40.656+0000 7f6845f1fec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-12-08T12:41:40.697 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:40.698+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:40.711 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:40.712+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:40.720 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:40.721+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:40.753 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:40.754+0000 7f6845f1fec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-12-08T12:41:40.795 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:40.796+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:40.815 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:40.815+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T12:41:40.829 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:40.828+0000 7f6845f1fec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T12:41:40.910 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:40.911+0000 7f6845f1fec0 20 remove_watcher() i=0 2019-12-08T12:41:40.910 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:40.911+0000 7f6845f1fec0 2 removed watcher, disabling cache 2019-12-08T12:41:40.957 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:40.958+0000 7f6845f1fec0 20 remove_watcher() i=1 2019-12-08T12:41:41.000 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:41.001+0000 7f6845f1fec0 20 remove_watcher() i=2 2019-12-08T12:41:41.051 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:41.052+0000 7f6845f1fec0 20 remove_watcher() i=3 2019-12-08T12:41:41.147 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:41.147+0000 7f6845f1fec0 20 remove_watcher() i=4 2019-12-08T12:41:41.201 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:41.202+0000 7f6845f1fec0 20 remove_watcher() i=5 2019-12-08T12:41:41.256 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:41.257+0000 7f6845f1fec0 20 remove_watcher() i=6 2019-12-08T12:41:41.309 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T12:41:41.310+0000 7f6845f1fec0 20 remove_watcher() i=7 2019-12-08T12:41:41.319 INFO:teuthology.orchestra.run.smithi079:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle-4.7/bin/gradle clean test --rerun-tasks --no-build-cache --tests ObjectTest 2019-12-08T12:41:41.986 INFO:teuthology.orchestra.run.smithi079.stdout:> Task :clean 2019-12-08T12:41:42.583 INFO:teuthology.orchestra.run.smithi079.stdout:> Task :compileJava 2019-12-08T12:41:42.583 INFO:teuthology.orchestra.run.smithi079.stdout:> Task :processResources 2019-12-08T12:41:42.583 INFO:teuthology.orchestra.run.smithi079.stdout:> Task :classes 2019-12-08T12:41:42.784 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:41:42.785 INFO:teuthology.orchestra.run.smithi079.stdout:> Task :compileTestJava 2019-12-08T12:41:42.785 INFO:teuthology.orchestra.run.smithi079.stdout:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2019-12-08T12:41:42.785 INFO:teuthology.orchestra.run.smithi079.stdout:Note: Recompile with -Xlint:deprecation for details. 2019-12-08T12:41:42.785 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:41:42.785 INFO:teuthology.orchestra.run.smithi079.stdout:> Task :processTestResources NO-SOURCE 2019-12-08T12:41:42.785 INFO:teuthology.orchestra.run.smithi079.stdout:> Task :testClasses 2019-12-08T12:41:44.883 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:41:44.883 INFO:teuthology.orchestra.run.smithi079.stdout:> Task :test 2019-12-08T12:41:44.883 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:41:44.883 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound STARTED 2019-12-08T12:41:50.683 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:41:50.683 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound PASSED 2019-12-08T12:42:00.782 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:42:00.783 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone STARTED 2019-12-08T12:42:03.183 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:42:03.183 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone PASSED 2019-12-08T12:42:12.482 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:42:12.483 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty STARTED 2019-12-08T12:42:14.783 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:42:14.783 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty PASSED 2019-12-08T12:42:20.083 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:42:20.083 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI STARTED 2019-12-08T12:42:44.282 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:42:44.283 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI PASSED 2019-12-08T12:42:48.382 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:42:48.383 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI STARTED 2019-12-08T12:42:50.282 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:42:50.282 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI PASSED 2019-12-08T12:42:56.982 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:42:56.983 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI STARTED 2019-12-08T12:43:01.382 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:43:01.383 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI PASSED 2019-12-08T12:43:08.082 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:43:08.082 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI STARTED 2019-12-08T12:43:08.282 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:43:08.283 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI PASSED 2019-12-08T12:43:09.882 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:43:09.883 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI STARTED 2019-12-08T12:43:12.382 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:43:12.382 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI PASSED 2019-12-08T12:43:19.382 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:43:19.382 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB STARTED 2019-12-08T12:43:25.482 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:43:25.482 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB PASSED 2019-12-08T12:43:33.882 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:43:33.882 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b STARTED 2019-12-08T12:43:36.882 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:43:36.882 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b PASSED 2019-12-08T12:43:43.882 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:43:43.882 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb STARTED 2019-12-08T12:43:48.282 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:43:48.282 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb PASSED 2019-12-08T12:43:55.182 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:43:55.182 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC STARTED 2019-12-08T12:43:58.282 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:43:58.282 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC PASSED 2019-12-08T12:44:03.582 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:44:03.582 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 STARTED 2019-12-08T12:44:05.882 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:44:05.882 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 PASSED 2019-12-08T12:44:11.982 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:44:11.982 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey STARTED 2019-12-08T12:44:14.682 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:44:14.682 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey PASSED 2019-12-08T12:44:20.582 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:44:20.582 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 STARTED 2019-12-08T12:44:21.982 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:44:21.982 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 PASSED 2019-12-08T12:44:26.582 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:44:26.582 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete STARTED 2019-12-08T12:44:32.782 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:44:32.782 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete PASSED 2019-12-08T12:44:38.482 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:44:38.482 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA STARTED 2019-12-08T12:44:53.881 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:44:53.882 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA PASSED 2019-12-08T12:45:06.378 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:00:42:31.080 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T12:45:06.386 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:00:42:31.088 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T12:45:06.408 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:00:42:31.045 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T12:45:06.410 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:00:42:31.047 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T12:45:06.416 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:00:42:31.053 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T12:45:06.424 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:00:42:31.061 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T12:45:06.658 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:00:42:31.295 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T12:45:06.686 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:00:42:31.323 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T12:45:06.689 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:00:42:31.391 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T12:45:06.981 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:45:06.982 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI STARTED 2019-12-08T12:45:11.496 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:00:42:36.198 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T12:45:11.497 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:00:42:36.134 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T12:45:11.501 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:00:42:36.204 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T12:45:11.516 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:00:42:36.153 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T12:45:11.524 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:00:42:36.226 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T12:45:11.529 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:00:42:36.167 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T12:45:11.532 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:00:42:36.169 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T12:45:11.547 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:00:42:36.184 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T12:45:11.571 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:00:42:36.208 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T12:48:14.680 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:48:14.680 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI PASSED 2019-12-08T12:48:32.779 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:48:32.779 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI STARTED 2019-12-08T12:48:35.979 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:48:35.979 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI PASSED 2019-12-08T12:48:41.979 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:48:41.979 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI STARTED 2019-12-08T12:48:46.979 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:48:46.979 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI PASSED 2019-12-08T12:48:59.278 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:48:59.279 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI STARTED 2019-12-08T12:49:12.778 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:49:12.779 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI PASSED 2019-12-08T12:49:21.878 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:49:21.879 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI STARTED 2019-12-08T12:49:22.178 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:49:22.178 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI PASSED 2019-12-08T12:49:24.378 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:49:24.378 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI STARTED 2019-12-08T12:49:37.898 INFO:tasks.rgw.client.0.smithi079.stdout:2019-12-08T12:49:37.881+0000 40a63700 -1 handle_data failed with exit code -5 2019-12-08T12:49:38.378 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:49:38.378 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI PASSED 2019-12-08T12:49:44.678 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:49:44.678 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 STARTED 2019-12-08T12:50:11.478 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:50:11.478 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 PASSED 2019-12-08T12:50:12.753 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:00:47:37.456 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T12:50:12.764 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:00:47:37.405 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T12:50:12.768 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:00:47:37.409 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T12:50:12.769 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:00:47:37.471 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T12:50:12.771 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:00:47:37.412 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T12:50:12.775 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:00:47:37.416 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T12:50:12.966 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:00:47:37.607 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T12:50:12.978 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:00:47:37.680 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T12:50:12.996 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:00:47:37.637 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T12:50:26.977 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:50:26.978 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI STARTED 2019-12-08T12:51:02.678 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:51:02.678 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI PASSED 2019-12-08T12:51:10.778 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:51:10.778 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI STARTED 2019-12-08T12:53:33.575 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:00:50:58.278 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T12:53:33.592 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:00:50:58.295 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T12:53:33.604 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:00:50:58.242 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T12:53:33.609 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:00:50:58.247 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T12:53:33.625 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:00:50:58.263 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T12:53:33.640 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:00:50:58.270 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T12:53:33.731 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:00:50:58.369 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T12:53:33.735 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:00:50:58.374 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T12:53:33.791 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:00:50:58.493 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T12:54:02.080 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:54:02.080 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI PASSED 2019-12-08T12:54:12.680 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:54:12.680 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI STARTED 2019-12-08T12:54:45.080 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:54:45.081 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI PASSED 2019-12-08T12:54:51.181 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:54:51.181 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI STARTED 2019-12-08T12:55:26.622 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:00:52:51.324 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T12:55:26.634 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:00:52:51.337 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T12:55:26.641 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:00:52:51.279 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T12:55:26.646 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:00:52:51.284 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T12:55:26.654 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:00:52:51.292 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T12:55:26.657 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:00:52:51.295 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T12:55:26.737 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:00:52:51.375 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T12:55:26.766 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:00:52:51.468 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T12:55:26.780 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:00:52:51.418 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T12:55:27.881 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:55:27.881 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI PASSED 2019-12-08T12:55:34.381 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:55:34.381 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause STARTED 2019-12-08T12:55:39.581 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:55:39.581 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause PASSED 2019-12-08T12:55:53.681 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:55:53.681 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound STARTED 2019-12-08T12:55:54.081 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:55:54.081 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound PASSED 2019-12-08T12:55:55.081 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:55:55.081 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testObjectCreateBadContentlengthNegative STARTED 2019-12-08T12:55:56.281 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:55:56.281 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testObjectCreateBadContentlengthNegative PASSED 2019-12-08T12:55:59.081 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:55:59.081 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch STARTED 2019-12-08T12:56:00.881 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:56:00.881 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch PASSED 2019-12-08T12:56:05.581 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:56:05.581 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort STARTED 2019-12-08T12:56:06.380 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:56:06.381 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort PASSED 2019-12-08T12:56:09.681 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:56:09.681 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid STARTED 2019-12-08T12:56:10.881 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:56:10.881 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid PASSED 2019-12-08T12:56:14.881 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:56:14.881 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None STARTED 2019-12-08T12:56:16.481 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:56:16.481 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None PASSED 2019-12-08T12:56:20.881 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:56:20.881 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable STARTED 2019-12-08T12:56:22.181 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:56:22.181 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable PASSED 2019-12-08T12:56:26.181 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:56:26.181 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes STARTED 2019-12-08T12:56:30.081 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:56:30.081 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes PASSED 2019-12-08T12:56:38.181 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:56:38.181 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot STARTED 2019-12-08T12:56:43.581 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:56:43.581 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot PASSED 2019-12-08T12:56:55.881 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:56:55.881 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist STARTED 2019-12-08T12:57:05.981 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:57:05.981 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist PASSED 2019-12-08T12:57:18.681 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:57:18.681 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage STARTED 2019-12-08T12:57:26.280 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:57:26.281 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage PASSED 2019-12-08T12:57:36.481 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:57:36.481 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList STARTED 2019-12-08T12:57:44.081 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:57:44.081 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList PASSED 2019-12-08T12:57:55.880 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:57:55.881 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList STARTED 2019-12-08T12:58:02.781 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:58:02.781 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList PASSED 2019-12-08T12:58:14.980 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:58:14.981 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList STARTED 2019-12-08T12:58:22.181 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:58:22.181 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList PASSED 2019-12-08T12:58:32.780 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:58:32.781 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable STARTED 2019-12-08T12:58:38.680 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:58:38.681 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable PASSED 2019-12-08T12:58:48.580 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:58:48.581 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative STARTED 2019-12-08T12:58:55.380 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:58:55.381 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative PASSED 2019-12-08T12:59:03.580 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:59:03.580 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone STARTED 2019-12-08T12:59:08.580 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:59:08.581 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone PASSED 2019-12-08T12:59:18.780 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:59:18.781 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne STARTED 2019-12-08T12:59:25.980 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:59:25.980 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne PASSED 2019-12-08T12:59:36.380 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:59:36.380 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero STARTED 2019-12-08T12:59:41.980 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:59:41.980 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero PASSED 2019-12-08T12:59:52.580 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:59:52.580 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt STARTED 2019-12-08T12:59:58.680 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T12:59:58.680 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt PASSED 2019-12-08T13:00:07.680 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T13:00:07.681 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic STARTED 2019-12-08T13:00:13.980 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T13:00:13.980 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic PASSED 2019-12-08T13:00:23.080 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T13:00:23.080 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt STARTED 2019-12-08T13:00:29.380 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T13:00:29.380 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt PASSED 2019-12-08T13:00:40.080 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T13:00:40.080 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic STARTED 2019-12-08T13:00:40.202 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:00:58:04.903 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T13:00:40.222 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:00:58:04.924 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T13:00:40.228 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:00:58:04.866 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T13:00:40.230 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:00:58:04.869 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T13:00:40.231 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:00:58:04.869 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T13:00:40.237 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:00:58:04.875 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T13:00:40.411 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:00:58:05.049 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T13:00:40.434 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:00:58:05.136 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T13:00:40.450 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:00:58:05.089 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T13:00:45.880 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T13:00:45.880 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic PASSED 2019-12-08T13:00:58.679 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T13:00:58.680 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist STARTED 2019-12-08T13:01:06.779 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T13:01:06.780 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist PASSED 2019-12-08T13:01:14.580 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T13:01:14.580 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist STARTED 2019-12-08T13:01:22.679 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T13:01:22.679 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist PASSED 2019-12-08T13:01:31.179 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T13:01:31.180 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist STARTED 2019-12-08T13:01:38.779 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T13:01:38.780 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist PASSED 2019-12-08T13:01:47.779 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T13:01:47.780 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty STARTED 2019-12-08T13:01:53.479 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T13:01:53.480 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty PASSED 2019-12-08T13:02:00.438 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:00:59:25.140 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T13:02:00.442 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:00:59:25.145 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T13:02:00.469 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:00:59:25.108 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T13:02:00.474 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:00:59:25.113 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T13:02:00.492 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:00:59:25.130 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T13:02:00.499 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:00:59:25.202 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T13:02:00.518 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:00:59:25.156 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T13:02:00.525 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:00:59:25.164 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T13:02:00.562 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:00:59:25.201 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T13:02:00.979 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T13:02:00.980 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone STARTED 2019-12-08T13:02:05.880 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T13:02:05.880 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone PASSED 2019-12-08T13:02:16.079 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T13:02:16.080 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist STARTED 2019-12-08T13:02:22.880 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T13:02:22.880 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist PASSED 2019-12-08T13:02:33.080 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T13:02:33.080 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable STARTED 2019-12-08T13:02:37.680 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T13:02:37.680 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable PASSED 2019-12-08T13:02:48.280 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T13:02:48.280 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket STARTED 2019-12-08T13:02:50.780 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T13:02:50.780 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket PASSED 2019-12-08T13:02:56.880 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T13:02:56.880 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist STARTED 2019-12-08T13:02:58.880 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T13:02:58.880 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist PASSED 2019-12-08T13:03:04.580 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T13:03:04.580 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl STARTED 2019-12-08T13:03:07.480 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T13:03:07.480 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl PASSED 2019-12-08T13:03:14.980 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T13:03:14.980 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag STARTED 2019-12-08T13:03:18.080 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T13:03:18.080 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag PASSED 2019-12-08T13:03:23.780 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T13:03:23.780 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete STARTED 2019-12-08T13:03:30.980 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T13:03:30.980 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete PASSED 2019-12-08T13:03:36.280 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T13:03:36.281 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket STARTED 2019-12-08T13:03:36.780 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T13:03:36.781 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket PASSED 2019-12-08T13:03:37.080 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T13:03:37.080 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode STARTED 2019-12-08T13:03:40.880 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T13:03:40.880 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode PASSED 2019-12-08T13:03:48.880 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T13:03:48.880 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode STARTED 2019-12-08T13:03:52.780 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T13:03:52.780 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode PASSED 2019-12-08T13:04:00.080 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T13:04:00.081 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey STARTED 2019-12-08T13:04:03.680 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T13:04:03.681 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey PASSED 2019-12-08T13:04:09.180 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T13:04:09.181 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared STARTED 2019-12-08T13:04:11.180 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T13:04:11.181 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared PASSED 2019-12-08T13:04:19.580 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T13:04:19.581 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testSSEKMSPresent STARTED 2019-12-08T13:04:22.481 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T13:04:22.481 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testSSEKMSPresent PASSED 2019-12-08T13:04:28.680 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T13:04:28.681 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile STARTED 2019-12-08T13:04:37.880 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T13:04:37.881 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile PASSED 2019-12-08T13:04:41.780 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T13:04:41.781 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testUploadFileListHLAPI STARTED 2019-12-08T13:04:50.881 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T13:04:50.881 INFO:teuthology.orchestra.run.smithi079.stdout:suite > Object tests > ObjectTest.testUploadFileListHLAPI PASSED 2019-12-08T13:04:56.441 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T13:04:56.441 INFO:teuthology.orchestra.run.smithi079.stdout:---------------------------------------------------------------------- 2019-12-08T13:04:56.441 INFO:teuthology.orchestra.run.smithi079.stdout:| Results: SUCCESS (72 tests, 72 successes, 0 failures, 0 skipped) | 2019-12-08T13:04:56.441 INFO:teuthology.orchestra.run.smithi079.stdout:---------------------------------------------------------------------- 2019-12-08T13:04:56.441 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T13:04:56.442 INFO:teuthology.orchestra.run.smithi079.stdout:BUILD SUCCESSFUL in 23m 15s 2019-12-08T13:04:56.442 INFO:teuthology.orchestra.run.smithi079.stdout:5 actionable tasks: 5 executed 2019-12-08T13:04:56.456 INFO:teuthology.orchestra.run.smithi079:> radosgw-admin gc process --include-all 2019-12-08T13:04:56.600 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:04:56.604+0000 7fd4fea74ec0 20 rados->read ofs=0 len=0 2019-12-08T13:04:56.632 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:04:56.636+0000 7fd4fea74ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T13:04:56.632 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:04:56.636+0000 7fd4fea74ec0 20 rados->read ofs=0 len=0 2019-12-08T13:04:56.645 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:04:56.649+0000 7fd4fea74ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T13:04:56.645 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:04:56.649+0000 7fd4fea74ec0 20 rados->read ofs=0 len=0 2019-12-08T13:04:56.653 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:04:56.657+0000 7fd4fea74ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T13:04:56.653 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:04:56.657+0000 7fd4fea74ec0 20 rados->read ofs=0 len=0 2019-12-08T13:04:56.678 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:04:56.682+0000 7fd4fea74ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T13:04:56.908 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:04:56.912+0000 7fd4fea74ec0 20 RGWRados::pool_iterate: got zonegroup_info.fee0148b-7ae2-4cf0-a79e-86045a29cb7c 2019-12-08T13:04:56.908 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:04:56.912+0000 7fd4fea74ec0 20 RGWRados::pool_iterate: got zone_info.f8ab349b-4577-410d-b524-4ecaf50bb1bd 2019-12-08T13:04:56.908 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:04:56.912+0000 7fd4fea74ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-08T13:04:56.909 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:04:56.912+0000 7fd4fea74ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-08T13:04:56.909 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:04:56.912+0000 7fd4fea74ec0 20 rados->read ofs=0 len=0 2019-12-08T13:04:56.922 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:04:56.926+0000 7fd4fea74ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T13:04:56.922 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:04:56.926+0000 7fd4fea74ec0 20 rados->read ofs=0 len=0 2019-12-08T13:04:56.932 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:04:56.936+0000 7fd4fea74ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-08T13:04:56.932 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:04:56.936+0000 7fd4fea74ec0 20 rados->read ofs=0 len=0 2019-12-08T13:04:56.944 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:04:56.948+0000 7fd4fea74ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T13:04:56.944 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:04:56.948+0000 7fd4fea74ec0 20 rados->read ofs=0 len=0 2019-12-08T13:04:56.957 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:04:56.961+0000 7fd4fea74ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-08T13:04:56.957 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:04:56.961+0000 7fd4fea74ec0 20 rados->read ofs=0 len=0 2019-12-08T13:04:56.963 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:04:56.967+0000 7fd4fea74ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T13:04:56.963 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:04:56.967+0000 7fd4fea74ec0 10 cannot find current period zonegroup using local zonegroup 2019-12-08T13:04:56.963 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:04:56.967+0000 7fd4fea74ec0 20 rados->read ofs=0 len=0 2019-12-08T13:04:56.970 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:04:56.974+0000 7fd4fea74ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T13:04:56.970 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:04:56.974+0000 7fd4fea74ec0 20 rados->read ofs=0 len=0 2019-12-08T13:04:56.983 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:04:56.987+0000 7fd4fea74ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T13:04:56.983 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:04:56.987+0000 7fd4fea74ec0 20 rados->read ofs=0 len=0 2019-12-08T13:04:56.991 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:04:56.995+0000 7fd4fea74ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-08T13:04:56.991 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:04:56.995+0000 7fd4fea74ec0 20 zonegroup default 2019-12-08T13:04:56.992 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:04:56.995+0000 7fd4fea74ec0 20 rados->read ofs=0 len=0 2019-12-08T13:04:56.999 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:04:57.003+0000 7fd4fea74ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T13:04:56.999 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:04:57.003+0000 7fd4fea74ec0 10 Cannot find current period zone using local zone 2019-12-08T13:04:56.999 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:04:57.003+0000 7fd4fea74ec0 20 rados->read ofs=0 len=0 2019-12-08T13:04:57.008 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:04:57.012+0000 7fd4fea74ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T13:04:57.008 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:04:57.012+0000 7fd4fea74ec0 20 rados->read ofs=0 len=0 2019-12-08T13:04:57.023 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:04:57.027+0000 7fd4fea74ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T13:04:57.023 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:04:57.027+0000 7fd4fea74ec0 20 rados->read ofs=0 len=0 2019-12-08T13:04:57.042 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:04:57.047+0000 7fd4fea74ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-08T13:04:57.043 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:04:57.047+0000 7fd4fea74ec0 20 zone default found 2019-12-08T13:04:57.043 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:04:57.047+0000 7fd4fea74ec0 20 started sync module instance, tier type = 2019-12-08T13:04:57.043 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:04:57.047+0000 7fd4fea74ec0 20 started zone id=f8ab349b-4577-410d-b524-4ecaf50bb1bd (name=default) with tier type = 2019-12-08T13:04:57.422 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:04:57.426+0000 7fd4fea74ec0 20 add_watcher() i=0 2019-12-08T13:04:57.422 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:04:57.426+0000 7fd4fea74ec0 20 add_watcher() i=1 2019-12-08T13:04:57.422 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:04:57.426+0000 7fd4fea74ec0 20 add_watcher() i=2 2019-12-08T13:04:57.422 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:04:57.426+0000 7fd4fea74ec0 20 add_watcher() i=3 2019-12-08T13:04:57.422 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:04:57.426+0000 7fd4fea74ec0 20 add_watcher() i=4 2019-12-08T13:04:57.423 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:04:57.426+0000 7fd4fea74ec0 20 add_watcher() i=5 2019-12-08T13:04:57.423 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:04:57.426+0000 7fd4fea74ec0 20 add_watcher() i=6 2019-12-08T13:04:57.446 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:04:57.450+0000 7fd4fea74ec0 20 add_watcher() i=7 2019-12-08T13:04:57.447 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:04:57.450+0000 7fd4fea74ec0 2 all 8 watchers are set, enabling cache 2019-12-08T13:04:57.447 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:04:57.451+0000 7fd43ffff700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-08T13:04:57.452 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:04:57.457+0000 7fd4eb49d700 0 -- 172.21.15.79:0/61197279 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55646ae08a60 msgr2=0x55646ae310a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=0)._try_send injecting socket failure 2019-12-08T13:04:57.655 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:04:57.659+0000 7fd4eb49d700 0 --2- 172.21.15.79:0/61197279 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x55646ae08a60 0x55646ae310a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2019-12-08T13:04:57.741 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:04:57.745+0000 7fd4ebc9e700 0 -- 172.21.15.79:0/2023572530 >> [v2:172.21.15.79:6800/9057,v1:172.21.15.79:6801/9057] conn(0x7fd42c0224c0 msgr2=0x7fd42c024990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-08T13:04:59.350 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:04:59.354+0000 7fd42a7fc700 20 reqs_thread_entry: start 2019-12-08T13:04:59.351 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:04:59.354+0000 7fd423fff700 20 reqs_thread_entry: start 2019-12-08T13:04:59.351 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:04:59.354+0000 7fd4fea74ec0 20 init_complete bucket index max shards: 0 2019-12-08T13:04:59.351 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:04:59.355+0000 7fd4227fc700 20 reqs_thread_entry: start 2019-12-08T13:04:59.351 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:04:59.355+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-12-08T13:04:59.401 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:04:59.405+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:04:59.420 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:04:59.424+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T13:04:59.439 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:04:59.442+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-08T13:04:59.439 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:04:59.442+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process iterating over entry tag='2~65FGfOxExxzrT_MYFFcQLUN4HnWm0zv', time=2019-12-08T14:42:43.180030+0000, chain.objs.size()=9 2019-12-08T13:04:59.439 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:04:59.442+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.52__multipart_key1.2~65FGfOxExxzrT_MYFFcQLUN4HnWm0zv.1 2019-12-08T13:04:59.439 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:04:59.442+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.52__shadow_key1.2~65FGfOxExxzrT_MYFFcQLUN4HnWm0zv.1_1 2019-12-08T13:04:59.440 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:04:59.442+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.52__multipart_key1.2~65FGfOxExxzrT_MYFFcQLUN4HnWm0zv.2 2019-12-08T13:04:59.440 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:04:59.443+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.52__shadow_key1.2~65FGfOxExxzrT_MYFFcQLUN4HnWm0zv.2_1 2019-12-08T13:04:59.440 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:04:59.443+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.52__multipart_key1.2~65FGfOxExxzrT_MYFFcQLUN4HnWm0zv.3 2019-12-08T13:04:59.440 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:04:59.443+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.52__shadow_key1.2~65FGfOxExxzrT_MYFFcQLUN4HnWm0zv.3_1 2019-12-08T13:04:59.440 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:04:59.443+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.52__multipart_key1.2~65FGfOxExxzrT_MYFFcQLUN4HnWm0zv.4 2019-12-08T13:04:59.440 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:04:59.443+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.52__shadow_key1.2~65FGfOxExxzrT_MYFFcQLUN4HnWm0zv.4_1 2019-12-08T13:04:59.440 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:04:59.443+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.52__multipart_key1.2~65FGfOxExxzrT_MYFFcQLUN4HnWm0zv.5 2019-12-08T13:04:59.694 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:04:59.698+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-08T13:04:59.803 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:04:59.807+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-12-08T13:04:59.843 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:04:59.847+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:04:59.860 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:04:59.864+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T13:04:59.890 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:04:59.893+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-08T13:04:59.890 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:04:59.893+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process iterating over entry tag='f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.1062', time=2019-12-08T14:46:19.112947+0000, chain.objs.size()=9 2019-12-08T13:04:59.890 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:04:59.893+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.67__multipart_key1.2~q8GXccqGJ53CUWmTAjMAvkIdGPYjPZg.1 2019-12-08T13:04:59.891 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:04:59.893+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.67__shadow_key1.2~q8GXccqGJ53CUWmTAjMAvkIdGPYjPZg.1_1 2019-12-08T13:04:59.891 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:04:59.893+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.67__multipart_key1.2~q8GXccqGJ53CUWmTAjMAvkIdGPYjPZg.2 2019-12-08T13:04:59.891 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:04:59.893+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.67__shadow_key1.2~q8GXccqGJ53CUWmTAjMAvkIdGPYjPZg.2_1 2019-12-08T13:04:59.891 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:04:59.893+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.67__multipart_key1.2~q8GXccqGJ53CUWmTAjMAvkIdGPYjPZg.3 2019-12-08T13:04:59.891 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:04:59.893+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.67__shadow_key1.2~q8GXccqGJ53CUWmTAjMAvkIdGPYjPZg.3_1 2019-12-08T13:04:59.891 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:04:59.893+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.67__multipart_key1.2~q8GXccqGJ53CUWmTAjMAvkIdGPYjPZg.4 2019-12-08T13:04:59.891 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:04:59.893+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.67__shadow_key1.2~q8GXccqGJ53CUWmTAjMAvkIdGPYjPZg.4_1 2019-12-08T13:04:59.892 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:04:59.893+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.67__multipart_key1.2~q8GXccqGJ53CUWmTAjMAvkIdGPYjPZg.5 2019-12-08T13:05:00.216 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:00.220+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-08T13:05:00.311 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:00.315+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-12-08T13:05:00.354 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:00.358+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:00.372 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:00.376+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T13:05:00.385 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:00.389+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-08T13:05:00.385 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:00.389+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process iterating over entry tag='f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.1070', time=2019-12-08T14:46:58.303958+0000, chain.objs.size()=9 2019-12-08T13:05:00.385 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:00.389+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.67__multipart_key1.2~af0Zbq4uunDP1695K1oBtumF1oN8ZMo.1 2019-12-08T13:05:00.385 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:00.389+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.67__shadow_key1.2~af0Zbq4uunDP1695K1oBtumF1oN8ZMo.1_1 2019-12-08T13:05:00.386 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:00.389+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.67__multipart_key1.2~af0Zbq4uunDP1695K1oBtumF1oN8ZMo.2 2019-12-08T13:05:00.386 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:00.389+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.67__shadow_key1.2~af0Zbq4uunDP1695K1oBtumF1oN8ZMo.2_1 2019-12-08T13:05:00.386 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:00.389+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.67__multipart_key1.2~af0Zbq4uunDP1695K1oBtumF1oN8ZMo.3 2019-12-08T13:05:00.386 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:00.389+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.67__shadow_key1.2~af0Zbq4uunDP1695K1oBtumF1oN8ZMo.3_1 2019-12-08T13:05:00.386 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:00.389+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.67__multipart_key1.2~af0Zbq4uunDP1695K1oBtumF1oN8ZMo.4 2019-12-08T13:05:00.387 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:00.389+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.67__shadow_key1.2~af0Zbq4uunDP1695K1oBtumF1oN8ZMo.4_1 2019-12-08T13:05:00.387 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:00.389+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.67__multipart_key1.2~af0Zbq4uunDP1695K1oBtumF1oN8ZMo.5 2019-12-08T13:05:00.612 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:00.616+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-08T13:05:00.711 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:00.715+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-12-08T13:05:00.753 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:00.757+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:00.777 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:00.781+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T13:05:00.796 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:00.799+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-12-08T13:05:00.796 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:00.799+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process iterating over entry tag='f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.1084', time=2019-12-08T14:47:47.733962+0000, chain.objs.size()=7 2019-12-08T13:05:00.796 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:00.799+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.67__multipart_key1.2~heFtfnj8cngwrKXUzqY1QwAgElE0XcQ.1 2019-12-08T13:05:00.796 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:00.799+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.67__shadow_key1.2~heFtfnj8cngwrKXUzqY1QwAgElE0XcQ.1_1 2019-12-08T13:05:00.796 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:00.799+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.67__shadow_key1.2~heFtfnj8cngwrKXUzqY1QwAgElE0XcQ.1_2 2019-12-08T13:05:00.796 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:00.799+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.67__multipart_key1.2~heFtfnj8cngwrKXUzqY1QwAgElE0XcQ.2 2019-12-08T13:05:00.797 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:00.799+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.67__shadow_key1.2~heFtfnj8cngwrKXUzqY1QwAgElE0XcQ.2_1 2019-12-08T13:05:00.797 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:00.799+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.67__shadow_key1.2~heFtfnj8cngwrKXUzqY1QwAgElE0XcQ.2_2 2019-12-08T13:05:00.797 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:00.799+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.67__multipart_key1.2~heFtfnj8cngwrKXUzqY1QwAgElE0XcQ.3 2019-12-08T13:05:00.797 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:00.799+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process iterating over entry tag='f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.1133', time=2019-12-08T14:49:14.781267+0000, chain.objs.size()=9 2019-12-08T13:05:00.797 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:00.799+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.71__multipart_key1.2~dx49QzbdVu8xw2VyCZMifDE2Om2gXI-.1 2019-12-08T13:05:00.797 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:00.799+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.71__shadow_key1.2~dx49QzbdVu8xw2VyCZMifDE2Om2gXI-.1_1 2019-12-08T13:05:00.798 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:00.799+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.71__multipart_key1.2~dx49QzbdVu8xw2VyCZMifDE2Om2gXI-.2 2019-12-08T13:05:00.798 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:00.799+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.71__shadow_key1.2~dx49QzbdVu8xw2VyCZMifDE2Om2gXI-.2_1 2019-12-08T13:05:00.798 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:00.799+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.71__multipart_key1.2~dx49QzbdVu8xw2VyCZMifDE2Om2gXI-.3 2019-12-08T13:05:00.987 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:00.991+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.71__shadow_key1.2~dx49QzbdVu8xw2VyCZMifDE2Om2gXI-.3_1 2019-12-08T13:05:00.987 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:00.991+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.71__multipart_key1.2~dx49QzbdVu8xw2VyCZMifDE2Om2gXI-.4 2019-12-08T13:05:01.015 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:01.019+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.71__shadow_key1.2~dx49QzbdVu8xw2VyCZMifDE2Om2gXI-.4_1 2019-12-08T13:05:01.039 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:01.043+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.71__multipart_key1.2~dx49QzbdVu8xw2VyCZMifDE2Om2gXI-.5 2019-12-08T13:05:01.163 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:01.167+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-08T13:05:01.283 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:01.287+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-12-08T13:05:01.335 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:01.339+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:01.359 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:01.363+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T13:05:01.372 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:01.376+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-08T13:05:01.372 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:01.376+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process iterating over entry tag='f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.1096', time=2019-12-08T14:48:24.614558+0000, chain.objs.size()=7 2019-12-08T13:05:01.372 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:01.376+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.67__multipart_key1.2~cm-iZPkfDWK3HN-sk0F9kaktCVg1aws.1 2019-12-08T13:05:01.372 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:01.376+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.67__shadow_key1.2~cm-iZPkfDWK3HN-sk0F9kaktCVg1aws.1_1 2019-12-08T13:05:01.373 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:01.376+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.67__shadow_key1.2~cm-iZPkfDWK3HN-sk0F9kaktCVg1aws.1_2 2019-12-08T13:05:01.373 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:01.376+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.67__multipart_key1.2~cm-iZPkfDWK3HN-sk0F9kaktCVg1aws.2 2019-12-08T13:05:01.373 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:01.376+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.67__shadow_key1.2~cm-iZPkfDWK3HN-sk0F9kaktCVg1aws.2_1 2019-12-08T13:05:01.373 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:01.376+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.67__shadow_key1.2~cm-iZPkfDWK3HN-sk0F9kaktCVg1aws.2_2 2019-12-08T13:05:01.373 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:01.376+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.67__multipart_key1.2~cm-iZPkfDWK3HN-sk0F9kaktCVg1aws.3 2019-12-08T13:05:01.624 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:01.628+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-08T13:05:01.793 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:01.797+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-12-08T13:05:01.835 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:01.839+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:01.852 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:01.856+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T13:05:01.861 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:01.866+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:01.900 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:01.904+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-12-08T13:05:01.950 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:01.954+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:01.973 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:01.977+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T13:05:01.984 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:01.988+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:02.027 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:02.031+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-12-08T13:05:02.087 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:02.091+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:02.109 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:02.113+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T13:05:02.118 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:02.122+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:02.162 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:02.167+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-12-08T13:05:02.224 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:02.228+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:02.258 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:02.262+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T13:05:02.271 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:02.275+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:02.309 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:02.313+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-12-08T13:05:02.401 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:02.405+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:02.448 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:02.452+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T13:05:02.478 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:02.482+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-08T13:05:02.478 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:02.482+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process iterating over entry tag='f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.1090', time=2019-12-08T14:48:13.637556+0000, chain.objs.size()=7 2019-12-08T13:05:02.478 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:02.482+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.67__multipart_key1.2~_RrXBq2SgWFKNq51Ulgas6-YhqT_uRa.1 2019-12-08T13:05:02.479 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:02.482+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.67__shadow_key1.2~_RrXBq2SgWFKNq51Ulgas6-YhqT_uRa.1_1 2019-12-08T13:05:02.479 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:02.482+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.67__shadow_key1.2~_RrXBq2SgWFKNq51Ulgas6-YhqT_uRa.1_2 2019-12-08T13:05:02.479 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:02.482+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.67__multipart_key1.2~_RrXBq2SgWFKNq51Ulgas6-YhqT_uRa.2 2019-12-08T13:05:02.479 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:02.482+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.67__shadow_key1.2~_RrXBq2SgWFKNq51Ulgas6-YhqT_uRa.2_1 2019-12-08T13:05:02.479 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:02.482+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.67__shadow_key1.2~_RrXBq2SgWFKNq51Ulgas6-YhqT_uRa.2_2 2019-12-08T13:05:02.479 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:02.482+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.67__multipart_key1.2~_RrXBq2SgWFKNq51Ulgas6-YhqT_uRa.3 2019-12-08T13:05:02.747 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:02.751+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-08T13:05:02.844 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:02.848+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-12-08T13:05:02.880 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:02.885+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:02.897 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:02.901+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T13:05:02.911 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:02.914+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-08T13:05:02.911 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:02.914+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process iterating over entry tag='f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.1041', time=2019-12-08T14:45:01.477604+0000, chain.objs.size()=9 2019-12-08T13:05:02.911 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:02.914+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.64__multipart_key1.2~Ae6wCTjf0FbdOka6V0kc3aEvEtY5JU_.1 2019-12-08T13:05:02.911 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:02.914+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.64__shadow_key1.2~Ae6wCTjf0FbdOka6V0kc3aEvEtY5JU_.1_1 2019-12-08T13:05:02.911 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:02.914+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.64__multipart_key1.2~Ae6wCTjf0FbdOka6V0kc3aEvEtY5JU_.2 2019-12-08T13:05:02.911 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:02.914+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.64__shadow_key1.2~Ae6wCTjf0FbdOka6V0kc3aEvEtY5JU_.2_1 2019-12-08T13:05:02.912 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:02.914+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.64__multipart_key1.2~Ae6wCTjf0FbdOka6V0kc3aEvEtY5JU_.3 2019-12-08T13:05:02.912 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:02.914+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.64__shadow_key1.2~Ae6wCTjf0FbdOka6V0kc3aEvEtY5JU_.3_1 2019-12-08T13:05:02.912 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:02.914+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.64__multipart_key1.2~Ae6wCTjf0FbdOka6V0kc3aEvEtY5JU_.4 2019-12-08T13:05:02.912 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:02.914+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.64__shadow_key1.2~Ae6wCTjf0FbdOka6V0kc3aEvEtY5JU_.4_1 2019-12-08T13:05:02.912 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:02.914+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.64__multipart_key1.2~Ae6wCTjf0FbdOka6V0kc3aEvEtY5JU_.5 2019-12-08T13:05:03.185 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:03.189+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-08T13:05:03.295 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:03.299+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-12-08T13:05:03.340 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:03.344+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:03.356 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:03.361+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T13:05:03.380 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:03.384+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:03.434 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:03.438+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-12-08T13:05:03.499 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:03.502+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:03.526 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:03.530+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T13:05:03.551 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:03.554+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-08T13:05:03.551 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:03.554+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process iterating over entry tag='f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.1222', time=2019-12-08T14:52:37.227582+0000, chain.objs.size()=9 2019-12-08T13:05:03.551 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:03.554+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.75__multipart_key1.2~CcGFjfkRuIfoqk9-5d6Gcsv_Sfqvc2P.1 2019-12-08T13:05:03.551 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:03.554+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.75__shadow_key1.2~CcGFjfkRuIfoqk9-5d6Gcsv_Sfqvc2P.1_1 2019-12-08T13:05:03.551 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:03.554+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.75__multipart_key1.2~CcGFjfkRuIfoqk9-5d6Gcsv_Sfqvc2P.2 2019-12-08T13:05:03.551 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:03.554+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.75__shadow_key1.2~CcGFjfkRuIfoqk9-5d6Gcsv_Sfqvc2P.2_1 2019-12-08T13:05:03.552 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:03.554+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.75__multipart_key1.2~CcGFjfkRuIfoqk9-5d6Gcsv_Sfqvc2P.3 2019-12-08T13:05:03.552 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:03.554+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.75__shadow_key1.2~CcGFjfkRuIfoqk9-5d6Gcsv_Sfqvc2P.3_1 2019-12-08T13:05:03.552 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:03.554+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.75__multipart_key1.2~CcGFjfkRuIfoqk9-5d6Gcsv_Sfqvc2P.4 2019-12-08T13:05:03.552 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:03.554+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.75__shadow_key1.2~CcGFjfkRuIfoqk9-5d6Gcsv_Sfqvc2P.4_1 2019-12-08T13:05:03.552 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:03.554+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.75__multipart_key1.2~CcGFjfkRuIfoqk9-5d6Gcsv_Sfqvc2P.5 2019-12-08T13:05:03.836 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:03.840+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-08T13:05:03.919 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:03.923+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-12-08T13:05:03.961 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:03.965+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:03.979 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:03.983+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T13:05:03.998 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:04.001+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-12-08T13:05:03.998 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:04.001+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process iterating over entry tag='f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.1183', time=2019-12-08T14:50:13.797802+0000, chain.objs.size()=9 2019-12-08T13:05:03.998 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:04.001+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.73__multipart_file.mpg.2~O9Pa7S4Qv1Q6rEs7ThWMJFUydSRYwQ8.1 2019-12-08T13:05:03.998 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:04.001+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.73__shadow_file.mpg.2~O9Pa7S4Qv1Q6rEs7ThWMJFUydSRYwQ8.1_1 2019-12-08T13:05:03.999 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:04.001+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.73__multipart_file.mpg.2~O9Pa7S4Qv1Q6rEs7ThWMJFUydSRYwQ8.2 2019-12-08T13:05:03.999 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:04.001+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.73__shadow_file.mpg.2~O9Pa7S4Qv1Q6rEs7ThWMJFUydSRYwQ8.2_1 2019-12-08T13:05:03.999 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:04.001+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.73__multipart_file.mpg.2~O9Pa7S4Qv1Q6rEs7ThWMJFUydSRYwQ8.3 2019-12-08T13:05:03.999 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:04.001+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.73__shadow_file.mpg.2~O9Pa7S4Qv1Q6rEs7ThWMJFUydSRYwQ8.3_1 2019-12-08T13:05:03.999 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:04.001+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.73__multipart_file.mpg.2~O9Pa7S4Qv1Q6rEs7ThWMJFUydSRYwQ8.4 2019-12-08T13:05:03.999 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:04.001+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.73__shadow_file.mpg.2~O9Pa7S4Qv1Q6rEs7ThWMJFUydSRYwQ8.4_1 2019-12-08T13:05:03.999 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:04.001+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.73__multipart_file.mpg.2~O9Pa7S4Qv1Q6rEs7ThWMJFUydSRYwQ8.5 2019-12-08T13:05:04.000 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:04.001+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process iterating over entry tag='f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.1234', time=2019-12-08T14:53:42.305195+0000, chain.objs.size()=7 2019-12-08T13:05:04.000 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:04.001+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.75__multipart_key1.2~UdOrpx3Z_0ELFuoyVf1mx66LY4HNhZ_.1 2019-12-08T13:05:04.000 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:04.001+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.75__shadow_key1.2~UdOrpx3Z_0ELFuoyVf1mx66LY4HNhZ_.1_1 2019-12-08T13:05:04.000 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:04.001+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.75__shadow_key1.2~UdOrpx3Z_0ELFuoyVf1mx66LY4HNhZ_.1_2 2019-12-08T13:05:04.194 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:04.198+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.75__multipart_key1.2~UdOrpx3Z_0ELFuoyVf1mx66LY4HNhZ_.2 2019-12-08T13:05:04.194 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:04.198+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.75__shadow_key1.2~UdOrpx3Z_0ELFuoyVf1mx66LY4HNhZ_.2_1 2019-12-08T13:05:04.214 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:04.218+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.75__shadow_key1.2~UdOrpx3Z_0ELFuoyVf1mx66LY4HNhZ_.2_2 2019-12-08T13:05:04.215 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:04.218+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.75__multipart_key1.2~UdOrpx3Z_0ELFuoyVf1mx66LY4HNhZ_.3 2019-12-08T13:05:04.393 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:04.397+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-08T13:05:04.470 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:04.474+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-12-08T13:05:04.509 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:04.513+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:04.525 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:04.529+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T13:05:04.539 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:04.543+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-08T13:05:04.539 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:04.543+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process iterating over entry tag='f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.1244', time=2019-12-08T14:54:05.261154+0000, chain.objs.size()=7 2019-12-08T13:05:04.539 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:04.543+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.75__multipart_key1.2~xgxiA5RBjvO6e_6xHeLlVdjRTWR42DW.1 2019-12-08T13:05:04.539 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:04.543+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.75__shadow_key1.2~xgxiA5RBjvO6e_6xHeLlVdjRTWR42DW.1_1 2019-12-08T13:05:04.540 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:04.543+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.75__shadow_key1.2~xgxiA5RBjvO6e_6xHeLlVdjRTWR42DW.1_2 2019-12-08T13:05:04.540 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:04.543+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.75__multipart_key1.2~xgxiA5RBjvO6e_6xHeLlVdjRTWR42DW.2 2019-12-08T13:05:04.540 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:04.543+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.75__shadow_key1.2~xgxiA5RBjvO6e_6xHeLlVdjRTWR42DW.2_1 2019-12-08T13:05:04.541 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:04.543+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.75__shadow_key1.2~xgxiA5RBjvO6e_6xHeLlVdjRTWR42DW.2_2 2019-12-08T13:05:04.541 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:04.543+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.75__multipart_key1.2~xgxiA5RBjvO6e_6xHeLlVdjRTWR42DW.3 2019-12-08T13:05:04.689 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:04.693+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-08T13:05:04.780 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:04.784+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-12-08T13:05:04.817 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:04.821+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:04.832 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:04.836+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T13:05:04.840 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:04.844+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:04.894 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:04.899+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-12-08T13:05:04.939 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:04.943+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:04.956 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:04.960+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T13:05:04.963 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:04.967+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:04.998 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:05.002+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-12-08T13:05:05.051 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:05.055+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:05.072 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:05.076+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T13:05:05.079 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:05.084+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:05.129 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:05.133+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-12-08T13:05:05.250 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:05.254+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:05.282 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:05.286+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T13:05:05.303 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:05.307+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-08T13:05:05.303 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:05.307+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process iterating over entry tag='f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.1229', time=2019-12-08T14:53:11.121915+0000, chain.objs.size()=9 2019-12-08T13:05:05.303 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:05.307+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.75__multipart_key1.2~uSgWfEUtknThY_xclHPEjVx_6QvWGe-.1 2019-12-08T13:05:05.303 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:05.307+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.75__shadow_key1.2~uSgWfEUtknThY_xclHPEjVx_6QvWGe-.1_1 2019-12-08T13:05:05.304 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:05.307+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.75__multipart_key1.2~uSgWfEUtknThY_xclHPEjVx_6QvWGe-.2 2019-12-08T13:05:05.304 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:05.307+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.75__shadow_key1.2~uSgWfEUtknThY_xclHPEjVx_6QvWGe-.2_1 2019-12-08T13:05:05.304 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:05.307+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.75__multipart_key1.2~uSgWfEUtknThY_xclHPEjVx_6QvWGe-.3 2019-12-08T13:05:05.304 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:05.307+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.75__shadow_key1.2~uSgWfEUtknThY_xclHPEjVx_6QvWGe-.3_1 2019-12-08T13:05:05.304 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:05.307+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.75__multipart_key1.2~uSgWfEUtknThY_xclHPEjVx_6QvWGe-.4 2019-12-08T13:05:05.305 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:05.307+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.75__shadow_key1.2~uSgWfEUtknThY_xclHPEjVx_6QvWGe-.4_1 2019-12-08T13:05:05.305 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:05.307+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.75__multipart_key1.2~uSgWfEUtknThY_xclHPEjVx_6QvWGe-.5 2019-12-08T13:05:05.570 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:05.574+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-08T13:05:05.651 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:05.655+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-12-08T13:05:05.687 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:05.692+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:05.704 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:05.708+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T13:05:05.713 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:05.717+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:05.754 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:05.758+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-12-08T13:05:05.811 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:05.815+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:05.838 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:05.843+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T13:05:05.851 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:05.855+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:05.900 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:05.904+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-12-08T13:05:05.962 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:05.966+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:05.983 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:05.988+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T13:05:06.003 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:06.007+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-08T13:05:06.004 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:06.007+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process iterating over entry tag='f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.1905', time=2019-12-08T15:04:38.594909+0000, chain.objs.size()=9 2019-12-08T13:05:06.004 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:06.007+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.118__multipart_key1.2~pD1PXvTZPIkHpKGpKlPj5kzDCLGYG_Y.1 2019-12-08T13:05:06.004 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:06.007+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.118__shadow_key1.2~pD1PXvTZPIkHpKGpKlPj5kzDCLGYG_Y.1_1 2019-12-08T13:05:06.004 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:06.007+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.118__multipart_key1.2~pD1PXvTZPIkHpKGpKlPj5kzDCLGYG_Y.2 2019-12-08T13:05:06.004 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:06.007+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.118__shadow_key1.2~pD1PXvTZPIkHpKGpKlPj5kzDCLGYG_Y.2_1 2019-12-08T13:05:06.004 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:06.007+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.118__multipart_key1.2~pD1PXvTZPIkHpKGpKlPj5kzDCLGYG_Y.3 2019-12-08T13:05:06.004 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:06.007+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.118__shadow_key1.2~pD1PXvTZPIkHpKGpKlPj5kzDCLGYG_Y.3_1 2019-12-08T13:05:06.005 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:06.007+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.118__multipart_key1.2~pD1PXvTZPIkHpKGpKlPj5kzDCLGYG_Y.4 2019-12-08T13:05:06.005 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:06.007+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.118__shadow_key1.2~pD1PXvTZPIkHpKGpKlPj5kzDCLGYG_Y.4_1 2019-12-08T13:05:06.005 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:06.007+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.118__multipart_key1.2~pD1PXvTZPIkHpKGpKlPj5kzDCLGYG_Y.5 2019-12-08T13:05:06.308 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:06.312+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-08T13:05:06.391 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:06.395+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-12-08T13:05:06.433 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:06.437+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:06.449 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:06.453+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T13:05:06.468 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:06.471+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-12-08T13:05:06.468 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:06.471+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process iterating over entry tag='f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.1215', time=2019-12-08T14:52:09.739030+0000, chain.objs.size()=9 2019-12-08T13:05:06.468 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:06.471+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.75__multipart_key1.2~CMvd1kz1zrCUQjQuTjFoU_qP1HlCcnU.1 2019-12-08T13:05:06.469 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:06.471+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.75__shadow_key1.2~CMvd1kz1zrCUQjQuTjFoU_qP1HlCcnU.1_1 2019-12-08T13:05:06.469 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:06.471+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.75__multipart_key1.2~CMvd1kz1zrCUQjQuTjFoU_qP1HlCcnU.2 2019-12-08T13:05:06.469 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:06.471+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.75__shadow_key1.2~CMvd1kz1zrCUQjQuTjFoU_qP1HlCcnU.2_1 2019-12-08T13:05:06.469 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:06.471+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.75__multipart_key1.2~CMvd1kz1zrCUQjQuTjFoU_qP1HlCcnU.3 2019-12-08T13:05:06.469 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:06.471+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.75__shadow_key1.2~CMvd1kz1zrCUQjQuTjFoU_qP1HlCcnU.3_1 2019-12-08T13:05:06.469 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:06.472+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.75__multipart_key1.2~CMvd1kz1zrCUQjQuTjFoU_qP1HlCcnU.4 2019-12-08T13:05:06.469 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:06.472+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.75__shadow_key1.2~CMvd1kz1zrCUQjQuTjFoU_qP1HlCcnU.4_1 2019-12-08T13:05:06.470 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:06.472+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.75__multipart_key1.2~CMvd1kz1zrCUQjQuTjFoU_qP1HlCcnU.5 2019-12-08T13:05:06.470 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:06.472+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process iterating over entry tag='f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.1274', time=2019-12-08T14:55:30.299152+0000, chain.objs.size()=9 2019-12-08T13:05:06.470 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:06.472+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.77__multipart_key1.2~BESrdd_PAqCC7k5tGRfQH6NvPJ0qi45.1 2019-12-08T13:05:06.470 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:06.472+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.77__shadow_key1.2~BESrdd_PAqCC7k5tGRfQH6NvPJ0qi45.1_1 2019-12-08T13:05:06.470 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:06.472+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.77__multipart_key1.2~BESrdd_PAqCC7k5tGRfQH6NvPJ0qi45.2 2019-12-08T13:05:06.679 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:06.683+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.77__shadow_key1.2~BESrdd_PAqCC7k5tGRfQH6NvPJ0qi45.2_1 2019-12-08T13:05:06.679 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:06.683+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.77__multipart_key1.2~BESrdd_PAqCC7k5tGRfQH6NvPJ0qi45.3 2019-12-08T13:05:06.704 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:06.708+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.77__shadow_key1.2~BESrdd_PAqCC7k5tGRfQH6NvPJ0qi45.3_1 2019-12-08T13:05:06.751 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:06.755+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.77__multipart_key1.2~BESrdd_PAqCC7k5tGRfQH6NvPJ0qi45.4 2019-12-08T13:05:06.752 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:06.755+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.77__shadow_key1.2~BESrdd_PAqCC7k5tGRfQH6NvPJ0qi45.4_1 2019-12-08T13:05:06.752 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:06.755+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.77__multipart_key1.2~BESrdd_PAqCC7k5tGRfQH6NvPJ0qi45.5 2019-12-08T13:05:06.979 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:06.983+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-08T13:05:07.069 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:07.073+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-12-08T13:05:07.111 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:07.116+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:07.128 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:07.132+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T13:05:07.137 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:07.141+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:07.179 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:07.183+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-12-08T13:05:07.237 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:07.241+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:07.265 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:07.269+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T13:05:07.283 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:07.287+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-12-08T13:05:07.283 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:07.287+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process iterating over entry tag='2~u7oNUiZMwbCEa4p0TEX5ad2xnXoH15F', time=2019-12-08T14:51:06.039890+0000, chain.objs.size()=9 2019-12-08T13:05:07.283 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:07.287+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.74__multipart_key1.2~u7oNUiZMwbCEa4p0TEX5ad2xnXoH15F.7 2019-12-08T13:05:07.283 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:07.287+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.74__shadow_key1.2~u7oNUiZMwbCEa4p0TEX5ad2xnXoH15F.7_1 2019-12-08T13:05:07.284 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:07.287+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.74__multipart_key1.2~u7oNUiZMwbCEa4p0TEX5ad2xnXoH15F.8 2019-12-08T13:05:07.284 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:07.287+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.74__shadow_key1.2~u7oNUiZMwbCEa4p0TEX5ad2xnXoH15F.8_1 2019-12-08T13:05:07.284 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:07.287+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.74__multipart_key1.2~u7oNUiZMwbCEa4p0TEX5ad2xnXoH15F.9 2019-12-08T13:05:07.284 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:07.287+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.74__shadow_key1.2~u7oNUiZMwbCEa4p0TEX5ad2xnXoH15F.9_1 2019-12-08T13:05:07.284 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:07.287+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.74__multipart_key1.2~u7oNUiZMwbCEa4p0TEX5ad2xnXoH15F.10 2019-12-08T13:05:07.284 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:07.287+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.74__shadow_key1.2~u7oNUiZMwbCEa4p0TEX5ad2xnXoH15F.10_1 2019-12-08T13:05:07.284 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:07.287+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.74__multipart_key1.2~u7oNUiZMwbCEa4p0TEX5ad2xnXoH15F.11 2019-12-08T13:05:07.285 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:07.287+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process iterating over entry tag='f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.1239', time=2019-12-08T14:54:00.899085+0000, chain.objs.size()=7 2019-12-08T13:05:07.285 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:07.287+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.75__multipart_key1.2~Jcsnd0vLi1c7jY5eqeJL-qHIsadrABr.1 2019-12-08T13:05:07.285 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:07.287+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.75__shadow_key1.2~Jcsnd0vLi1c7jY5eqeJL-qHIsadrABr.1_1 2019-12-08T13:05:07.285 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:07.287+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.75__shadow_key1.2~Jcsnd0vLi1c7jY5eqeJL-qHIsadrABr.1_2 2019-12-08T13:05:07.429 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:07.433+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.75__multipart_key1.2~Jcsnd0vLi1c7jY5eqeJL-qHIsadrABr.2 2019-12-08T13:05:07.450 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:07.454+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.75__shadow_key1.2~Jcsnd0vLi1c7jY5eqeJL-qHIsadrABr.2_1 2019-12-08T13:05:07.630 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:07.634+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.75__shadow_key1.2~Jcsnd0vLi1c7jY5eqeJL-qHIsadrABr.2_2 2019-12-08T13:05:07.631 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:07.634+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.75__multipart_key1.2~Jcsnd0vLi1c7jY5eqeJL-qHIsadrABr.3 2019-12-08T13:05:07.739 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:07.743+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-08T13:05:07.811 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:07.815+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-12-08T13:05:07.849 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:07.853+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:07.867 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:07.871+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T13:05:07.899 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:07.903+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-12-08T13:05:07.899 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:07.903+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process iterating over entry tag='f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.970', time=2019-12-08T14:43:27.868418+0000, chain.objs.size()=2 2019-12-08T13:05:07.899 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:07.903+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.56__shadow_.TeDhaHRP5eUOJFDbW-ZWIFmZ0Q8U8M8_1 2019-12-08T13:05:07.900 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:07.903+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.56__shadow_.TeDhaHRP5eUOJFDbW-ZWIFmZ0Q8U8M8_2 2019-12-08T13:05:07.900 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:07.903+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process iterating over entry tag='2~FwWTDbVXwIJCxuAILcuW6gB-HJCmhgV', time=2019-12-08T14:55:51.091626+0000, chain.objs.size()=60 2019-12-08T13:05:07.900 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:07.903+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.78__multipart_key1.2~FwWTDbVXwIJCxuAILcuW6gB-HJCmhgV.1 2019-12-08T13:05:07.900 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:07.903+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.78__multipart_key1.2~FwWTDbVXwIJCxuAILcuW6gB-HJCmhgV.2 2019-12-08T13:05:07.900 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:07.903+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.78__multipart_key1.2~FwWTDbVXwIJCxuAILcuW6gB-HJCmhgV.3 2019-12-08T13:05:07.900 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:07.903+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.78__multipart_key1.2~FwWTDbVXwIJCxuAILcuW6gB-HJCmhgV.4 2019-12-08T13:05:07.901 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:07.903+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.78__multipart_key1.2~FwWTDbVXwIJCxuAILcuW6gB-HJCmhgV.5 2019-12-08T13:05:07.901 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:07.903+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.78__multipart_key1.2~FwWTDbVXwIJCxuAILcuW6gB-HJCmhgV.6 2019-12-08T13:05:07.901 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:07.903+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.78__multipart_key1.2~FwWTDbVXwIJCxuAILcuW6gB-HJCmhgV.7 2019-12-08T13:05:07.901 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:07.903+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.78__multipart_key1.2~FwWTDbVXwIJCxuAILcuW6gB-HJCmhgV.8 2019-12-08T13:05:07.901 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:07.903+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.78__multipart_key1.2~FwWTDbVXwIJCxuAILcuW6gB-HJCmhgV.9 2019-12-08T13:05:07.901 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:07.903+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.78__multipart_key1.2~FwWTDbVXwIJCxuAILcuW6gB-HJCmhgV.10 2019-12-08T13:05:08.141 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:08.145+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.78__multipart_key1.2~FwWTDbVXwIJCxuAILcuW6gB-HJCmhgV.11 2019-12-08T13:05:08.141 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:08.145+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.78__multipart_key1.2~FwWTDbVXwIJCxuAILcuW6gB-HJCmhgV.12 2019-12-08T13:05:08.142 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:08.145+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.78__multipart_key1.2~FwWTDbVXwIJCxuAILcuW6gB-HJCmhgV.13 2019-12-08T13:05:08.142 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:08.145+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.78__multipart_key1.2~FwWTDbVXwIJCxuAILcuW6gB-HJCmhgV.14 2019-12-08T13:05:08.142 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:08.145+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.78__multipart_key1.2~FwWTDbVXwIJCxuAILcuW6gB-HJCmhgV.15 2019-12-08T13:05:08.142 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:08.145+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.78__multipart_key1._rBCh0plnufGB6MDOVRdOjJch_6X_Bp.16 2019-12-08T13:05:08.142 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:08.145+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.78__multipart_key1.jdrYdoBxhRSjV9VJE4Y8VG7HavcfH8D.17 2019-12-08T13:05:08.142 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:08.145+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.78__multipart_key1.2~FwWTDbVXwIJCxuAILcuW6gB-HJCmhgV.18 2019-12-08T13:05:08.143 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:08.145+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.78__multipart_key1.6K8S1nOAhgOdsAgUZ_O5nEZVD16Ed77.19 2019-12-08T13:05:08.151 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:08.156+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.78__multipart_key1.G8LbUIau_PRLYodpoCR5pHOcsEofZPm.20 2019-12-08T13:05:08.152 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:08.156+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.78__multipart_key1.2~FwWTDbVXwIJCxuAILcuW6gB-HJCmhgV.21 2019-12-08T13:05:08.386 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:08.389+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.78__multipart_key1.2~FwWTDbVXwIJCxuAILcuW6gB-HJCmhgV.22 2019-12-08T13:05:08.386 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:08.389+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.78__multipart_key1.2~FwWTDbVXwIJCxuAILcuW6gB-HJCmhgV.23 2019-12-08T13:05:08.387 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:08.389+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.78__multipart_key1.2~FwWTDbVXwIJCxuAILcuW6gB-HJCmhgV.24 2019-12-08T13:05:08.431 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:08.435+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.78__multipart_key1.2~FwWTDbVXwIJCxuAILcuW6gB-HJCmhgV.25 2019-12-08T13:05:08.431 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:08.435+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.78__multipart_key1.2~FwWTDbVXwIJCxuAILcuW6gB-HJCmhgV.26 2019-12-08T13:05:08.467 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:08.471+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.78__multipart_key1.2~FwWTDbVXwIJCxuAILcuW6gB-HJCmhgV.27 2019-12-08T13:05:08.467 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:08.471+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.78__multipart_key1.2~FwWTDbVXwIJCxuAILcuW6gB-HJCmhgV.28 2019-12-08T13:05:08.467 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:08.471+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.78__multipart_key1.2~FwWTDbVXwIJCxuAILcuW6gB-HJCmhgV.29 2019-12-08T13:05:08.467 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:08.471+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.78__multipart_key1.2~FwWTDbVXwIJCxuAILcuW6gB-HJCmhgV.30 2019-12-08T13:05:08.467 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:08.471+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.78__multipart_key1.2~FwWTDbVXwIJCxuAILcuW6gB-HJCmhgV.31 2019-12-08T13:05:08.467 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:08.471+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.78__multipart_key1.2~FwWTDbVXwIJCxuAILcuW6gB-HJCmhgV.32 2019-12-08T13:05:08.595 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:08.599+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.78__multipart_key1.2~FwWTDbVXwIJCxuAILcuW6gB-HJCmhgV.33 2019-12-08T13:05:08.699 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:08.703+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.78__multipart_key1.2~FwWTDbVXwIJCxuAILcuW6gB-HJCmhgV.34 2019-12-08T13:05:08.700 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:08.703+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.78__multipart_key1.2~FwWTDbVXwIJCxuAILcuW6gB-HJCmhgV.35 2019-12-08T13:05:08.700 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:08.703+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.78__multipart_key1.2~FwWTDbVXwIJCxuAILcuW6gB-HJCmhgV.36 2019-12-08T13:05:08.700 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:08.703+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.78__multipart_key1.2~FwWTDbVXwIJCxuAILcuW6gB-HJCmhgV.37 2019-12-08T13:05:08.767 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:08.771+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.78__multipart_key1.2~FwWTDbVXwIJCxuAILcuW6gB-HJCmhgV.38 2019-12-08T13:05:08.767 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:08.771+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.78__multipart_key1.2~FwWTDbVXwIJCxuAILcuW6gB-HJCmhgV.39 2019-12-08T13:05:08.767 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:08.771+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.78__multipart_key1.2~FwWTDbVXwIJCxuAILcuW6gB-HJCmhgV.40 2019-12-08T13:05:08.842 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:08.846+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.78__multipart_key1.2~FwWTDbVXwIJCxuAILcuW6gB-HJCmhgV.41 2019-12-08T13:05:08.855 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:08.859+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.78__multipart_key1.2~FwWTDbVXwIJCxuAILcuW6gB-HJCmhgV.42 2019-12-08T13:05:08.855 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:08.859+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.78__multipart_key1.2~FwWTDbVXwIJCxuAILcuW6gB-HJCmhgV.43 2019-12-08T13:05:08.855 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:08.859+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.78__multipart_key1.2~FwWTDbVXwIJCxuAILcuW6gB-HJCmhgV.44 2019-12-08T13:05:08.922 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:08.926+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.78__multipart_key1.2~FwWTDbVXwIJCxuAILcuW6gB-HJCmhgV.45 2019-12-08T13:05:09.030 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:09.034+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.78__multipart_key1.2~FwWTDbVXwIJCxuAILcuW6gB-HJCmhgV.46 2019-12-08T13:05:09.030 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:09.034+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.78__multipart_key1.2~FwWTDbVXwIJCxuAILcuW6gB-HJCmhgV.47 2019-12-08T13:05:09.030 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:09.034+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.78__multipart_key1.2~FwWTDbVXwIJCxuAILcuW6gB-HJCmhgV.48 2019-12-08T13:05:09.030 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:09.034+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.78__multipart_key1.2~FwWTDbVXwIJCxuAILcuW6gB-HJCmhgV.49 2019-12-08T13:05:09.039 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:09.043+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.78__multipart_key1.2~FwWTDbVXwIJCxuAILcuW6gB-HJCmhgV.50 2019-12-08T13:05:09.039 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:09.043+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.78__multipart_key1.2~FwWTDbVXwIJCxuAILcuW6gB-HJCmhgV.51 2019-12-08T13:05:09.039 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:09.043+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.78__multipart_key1.2~FwWTDbVXwIJCxuAILcuW6gB-HJCmhgV.52 2019-12-08T13:05:09.039 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:09.043+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.78__multipart_key1.2~FwWTDbVXwIJCxuAILcuW6gB-HJCmhgV.53 2019-12-08T13:05:09.189 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:09.193+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.78__multipart_key1.2~FwWTDbVXwIJCxuAILcuW6gB-HJCmhgV.54 2019-12-08T13:05:09.189 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:09.193+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.78__multipart_key1.2~FwWTDbVXwIJCxuAILcuW6gB-HJCmhgV.55 2019-12-08T13:05:09.289 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:09.293+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.78__multipart_key1.2~FwWTDbVXwIJCxuAILcuW6gB-HJCmhgV.56 2019-12-08T13:05:09.289 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:09.293+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.78__multipart_key1.2~FwWTDbVXwIJCxuAILcuW6gB-HJCmhgV.57 2019-12-08T13:05:09.289 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:09.293+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.78__multipart_key1.2~FwWTDbVXwIJCxuAILcuW6gB-HJCmhgV.58 2019-12-08T13:05:09.290 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:09.293+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.78__multipart_key1.2~FwWTDbVXwIJCxuAILcuW6gB-HJCmhgV.59 2019-12-08T13:05:09.290 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:09.293+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.78__multipart_key1.2~FwWTDbVXwIJCxuAILcuW6gB-HJCmhgV.60 2019-12-08T13:05:09.620 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:09.624+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-08T13:05:09.724 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:09.728+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-12-08T13:05:09.774 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:09.778+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:09.802 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:09.806+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T13:05:09.832 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:09.836+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-12-08T13:05:09.832 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:09.836+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process iterating over entry tag='f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.1152', time=2019-12-08T14:49:40.391107+0000, chain.objs.size()=9 2019-12-08T13:05:09.833 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:09.836+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.72__multipart_key1.2~tQ-CAPjrYfK35RrqfRElRuvuDcU-2LX.1 2019-12-08T13:05:09.833 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:09.836+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.72__shadow_key1.2~tQ-CAPjrYfK35RrqfRElRuvuDcU-2LX.1_1 2019-12-08T13:05:09.833 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:09.836+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.72__multipart_key1.2~tQ-CAPjrYfK35RrqfRElRuvuDcU-2LX.2 2019-12-08T13:05:09.833 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:09.836+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.72__shadow_key1.2~tQ-CAPjrYfK35RrqfRElRuvuDcU-2LX.2_1 2019-12-08T13:05:09.833 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:09.836+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.72__multipart_key1.2~tQ-CAPjrYfK35RrqfRElRuvuDcU-2LX.3 2019-12-08T13:05:09.833 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:09.836+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.72__shadow_key1.2~tQ-CAPjrYfK35RrqfRElRuvuDcU-2LX.3_1 2019-12-08T13:05:09.833 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:09.836+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.72__multipart_key1.2~tQ-CAPjrYfK35RrqfRElRuvuDcU-2LX.4 2019-12-08T13:05:09.834 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:09.836+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.72__shadow_key1.2~tQ-CAPjrYfK35RrqfRElRuvuDcU-2LX.4_1 2019-12-08T13:05:09.834 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:09.836+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.72__multipart_key1.2~tQ-CAPjrYfK35RrqfRElRuvuDcU-2LX.5 2019-12-08T13:05:09.834 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:09.836+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process iterating over entry tag='f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.1259', time=2019-12-08T14:54:46.297392+0000, chain.objs.size()=9 2019-12-08T13:05:09.834 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:09.836+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.76__multipart_key1.2~I6kGRhcIW91VH3p42t82l_r-lhHqxMq.1 2019-12-08T13:05:09.834 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:09.836+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.76__shadow_key1.2~I6kGRhcIW91VH3p42t82l_r-lhHqxMq.1_1 2019-12-08T13:05:09.834 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:09.836+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.76__multipart_key1.2~I6kGRhcIW91VH3p42t82l_r-lhHqxMq.2 2019-12-08T13:05:10.030 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:10.034+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.76__shadow_key1.2~I6kGRhcIW91VH3p42t82l_r-lhHqxMq.2_1 2019-12-08T13:05:10.031 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:10.034+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.76__multipart_key1.2~I6kGRhcIW91VH3p42t82l_r-lhHqxMq.3 2019-12-08T13:05:10.031 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:10.034+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.76__shadow_key1.2~I6kGRhcIW91VH3p42t82l_r-lhHqxMq.3_1 2019-12-08T13:05:10.031 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:10.034+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.76__multipart_key1.2~I6kGRhcIW91VH3p42t82l_r-lhHqxMq.4 2019-12-08T13:05:10.031 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:10.034+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.76__shadow_key1.2~I6kGRhcIW91VH3p42t82l_r-lhHqxMq.4_1 2019-12-08T13:05:10.037 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:10.042+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.76__multipart_key1.2~I6kGRhcIW91VH3p42t82l_r-lhHqxMq.5 2019-12-08T13:05:10.341 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:10.345+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-08T13:05:10.514 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:10.517+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-12-08T13:05:10.588 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:10.592+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:10.612 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:10.616+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T13:05:10.627 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:10.631+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-08T13:05:10.627 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:10.631+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process iterating over entry tag='f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.1054', time=2019-12-08T14:48:17.386026+0000, chain.objs.size()=5 2019-12-08T13:05:10.628 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:10.631+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.66__shadow_.bGCC2BSDIEqib8vLL1MHpQcgUC6WRkw_1 2019-12-08T13:05:10.628 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:10.631+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.66__shadow_.bGCC2BSDIEqib8vLL1MHpQcgUC6WRkw_2 2019-12-08T13:05:10.628 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:10.631+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.66__shadow_.bGCC2BSDIEqib8vLL1MHpQcgUC6WRkw_3 2019-12-08T13:05:10.628 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:10.631+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.66__shadow_.bGCC2BSDIEqib8vLL1MHpQcgUC6WRkw_4 2019-12-08T13:05:10.628 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:10.631+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.66__shadow_.bGCC2BSDIEqib8vLL1MHpQcgUC6WRkw_5 2019-12-08T13:05:10.749 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:10.753+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-08T13:05:10.840 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:10.844+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-12-08T13:05:10.883 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:10.887+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:10.900 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:10.904+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T13:05:10.913 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:10.917+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-08T13:05:10.913 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:10.917+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process iterating over entry tag='f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.1921', time=2019-12-08T15:04:52.748154+0000, chain.objs.size()=9 2019-12-08T13:05:10.914 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:10.917+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.119__multipart_key1/data/file.mpg.2~N0hrV1OX8DJm_RHHlaEXbN1irl_p74e.1 2019-12-08T13:05:10.914 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:10.917+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.119__shadow_key1/data/file.mpg.2~N0hrV1OX8DJm_RHHlaEXbN1irl_p74e.1_1 2019-12-08T13:05:10.914 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:10.917+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.119__multipart_key1/data/file.mpg.2~N0hrV1OX8DJm_RHHlaEXbN1irl_p74e.2 2019-12-08T13:05:10.914 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:10.917+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.119__shadow_key1/data/file.mpg.2~N0hrV1OX8DJm_RHHlaEXbN1irl_p74e.2_1 2019-12-08T13:05:10.914 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:10.917+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.119__multipart_key1/data/file.mpg.2~N0hrV1OX8DJm_RHHlaEXbN1irl_p74e.3 2019-12-08T13:05:10.914 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:10.917+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.119__shadow_key1/data/file.mpg.2~N0hrV1OX8DJm_RHHlaEXbN1irl_p74e.3_1 2019-12-08T13:05:10.914 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:10.917+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.119__multipart_key1/data/file.mpg.2~N0hrV1OX8DJm_RHHlaEXbN1irl_p74e.4 2019-12-08T13:05:10.915 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:10.917+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.119__shadow_key1/data/file.mpg.2~N0hrV1OX8DJm_RHHlaEXbN1irl_p74e.4_1 2019-12-08T13:05:10.915 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:10.917+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.119__multipart_key1/data/file.mpg.2~N0hrV1OX8DJm_RHHlaEXbN1irl_p74e.5 2019-12-08T13:05:11.128 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:11.132+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-08T13:05:11.240 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:11.244+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-12-08T13:05:11.283 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:11.287+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:11.300 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:11.304+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T13:05:11.318 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:11.321+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2019-12-08T13:05:11.318 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:11.321+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process iterating over entry tag='f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.1078', time=2019-12-08T14:47:21.190781+0000, chain.objs.size()=9 2019-12-08T13:05:11.318 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:11.321+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.67__multipart_key1.2~H5ol69Jq3zZihVr4kxGPUZiV9bfz8D-.1 2019-12-08T13:05:11.318 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:11.322+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.67__shadow_key1.2~H5ol69Jq3zZihVr4kxGPUZiV9bfz8D-.1_1 2019-12-08T13:05:11.318 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:11.322+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.67__multipart_key1.2~H5ol69Jq3zZihVr4kxGPUZiV9bfz8D-.2 2019-12-08T13:05:11.318 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:11.322+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.67__shadow_key1.2~H5ol69Jq3zZihVr4kxGPUZiV9bfz8D-.2_1 2019-12-08T13:05:11.319 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:11.322+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.67__multipart_key1.2~H5ol69Jq3zZihVr4kxGPUZiV9bfz8D-.3 2019-12-08T13:05:11.319 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:11.322+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.67__shadow_key1.2~H5ol69Jq3zZihVr4kxGPUZiV9bfz8D-.3_1 2019-12-08T13:05:11.319 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:11.322+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.67__multipart_key1.2~H5ol69Jq3zZihVr4kxGPUZiV9bfz8D-.4 2019-12-08T13:05:11.319 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:11.322+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.67__shadow_key1.2~H5ol69Jq3zZihVr4kxGPUZiV9bfz8D-.4_1 2019-12-08T13:05:11.319 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:11.322+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.67__multipart_key1.2~H5ol69Jq3zZihVr4kxGPUZiV9bfz8D-.5 2019-12-08T13:05:11.319 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:11.322+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process iterating over entry tag='f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.1184', time=2019-12-08T14:50:16.699774+0000, chain.objs.size()=9 2019-12-08T13:05:11.319 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:11.322+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.73__multipart_file2.mpg.2~9JMXGTlUWXJr-d976N5se3H6jCh-NBM.1 2019-12-08T13:05:11.320 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:11.322+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.73__shadow_file2.mpg.2~9JMXGTlUWXJr-d976N5se3H6jCh-NBM.1_1 2019-12-08T13:05:11.320 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:11.322+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.73__multipart_file2.mpg.2~9JMXGTlUWXJr-d976N5se3H6jCh-NBM.2 2019-12-08T13:05:11.471 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:11.474+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.73__shadow_file2.mpg.2~9JMXGTlUWXJr-d976N5se3H6jCh-NBM.2_1 2019-12-08T13:05:11.471 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:11.474+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.73__multipart_file2.mpg.2~9JMXGTlUWXJr-d976N5se3H6jCh-NBM.3 2019-12-08T13:05:11.488 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:11.492+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.73__shadow_file2.mpg.2~9JMXGTlUWXJr-d976N5se3H6jCh-NBM.3_1 2019-12-08T13:05:11.637 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:11.641+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.73__multipart_file2.mpg.2~9JMXGTlUWXJr-d976N5se3H6jCh-NBM.4 2019-12-08T13:05:11.644 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:11.648+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.73__shadow_file2.mpg.2~9JMXGTlUWXJr-d976N5se3H6jCh-NBM.4_1 2019-12-08T13:05:11.685 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:11.689+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.73__multipart_file2.mpg.2~9JMXGTlUWXJr-d976N5se3H6jCh-NBM.5 2019-12-08T13:05:11.836 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:11.840+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-08T13:05:11.952 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:11.956+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-12-08T13:05:12.009 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:12.013+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:12.032 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:12.036+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T13:05:12.046 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:12.050+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:12.090 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:12.094+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-12-08T13:05:12.159 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:12.163+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:12.201 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:12.205+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T13:05:12.219 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:12.222+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2019-12-08T13:05:12.219 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:12.222+0000 7fd4fea74ec0 20 garbage collection: RGWGC::process iterating over entry tag='f8ab349b-4577-410d-b524-4ecaf50bb1bd.4449.1039', time=2019-12-08T14:44:55.414414+0000, chain.objs.size()=9 2019-12-08T13:05:12.219 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:12.222+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.64__multipart_key1.2~Ae6wCTjf0FbdOka6V0kc3aEvEtY5JU_.1 2019-12-08T13:05:12.219 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:12.222+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.64__shadow_key1.2~Ae6wCTjf0FbdOka6V0kc3aEvEtY5JU_.1_1 2019-12-08T13:05:12.219 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:12.223+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.64__multipart_key1.2~Ae6wCTjf0FbdOka6V0kc3aEvEtY5JU_.2 2019-12-08T13:05:12.219 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:12.223+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.64__shadow_key1.2~Ae6wCTjf0FbdOka6V0kc3aEvEtY5JU_.2_1 2019-12-08T13:05:12.220 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:12.223+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.64__multipart_key1.2~Ae6wCTjf0FbdOka6V0kc3aEvEtY5JU_.3 2019-12-08T13:05:12.220 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:12.223+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.64__shadow_key1.2~Ae6wCTjf0FbdOka6V0kc3aEvEtY5JU_.3_1 2019-12-08T13:05:12.220 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:12.223+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.64__multipart_key1.2~Ae6wCTjf0FbdOka6V0kc3aEvEtY5JU_.4 2019-12-08T13:05:12.220 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:12.223+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.64__shadow_key1.2~Ae6wCTjf0FbdOka6V0kc3aEvEtY5JU_.4_1 2019-12-08T13:05:12.220 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:12.223+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.64__multipart_key1.2~Ae6wCTjf0FbdOka6V0kc3aEvEtY5JU_.5 2019-12-08T13:05:12.484 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:12.488+0000 7fd4fea74ec0 5 garbage collection: RGWGC::process removing entries, marker: 2019-12-08T13:05:12.690 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:12.694+0000 7fd4fea74ec0 20 remove_watcher() i=0 2019-12-08T13:05:12.690 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:12.694+0000 7fd4fea74ec0 2 removed watcher, disabling cache 2019-12-08T13:05:12.730 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:12.734+0000 7fd4fea74ec0 20 remove_watcher() i=1 2019-12-08T13:05:12.762 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:12.766+0000 7fd4fea74ec0 20 remove_watcher() i=2 2019-12-08T13:05:12.801 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:12.805+0000 7fd4fea74ec0 20 remove_watcher() i=3 2019-12-08T13:05:12.846 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:12.850+0000 7fd4fea74ec0 20 remove_watcher() i=4 2019-12-08T13:05:12.880 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:12.884+0000 7fd4fea74ec0 20 remove_watcher() i=5 2019-12-08T13:05:12.916 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:12.920+0000 7fd4fea74ec0 20 remove_watcher() i=6 2019-12-08T13:05:12.945 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:12.949+0000 7fd4fea74ec0 20 remove_watcher() i=7 2019-12-08T13:05:12.953 INFO:teuthology.orchestra.run.smithi079:> radosgw-admin gc process --include-all 2019-12-08T13:05:13.064 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:13.068+0000 7ff6d3a56ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:13.104 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:13.108+0000 7ff6d3a56ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T13:05:13.104 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:13.108+0000 7ff6d3a56ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:13.111 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:13.115+0000 7ff6d3a56ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T13:05:13.111 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:13.115+0000 7ff6d3a56ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:13.117 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:13.121+0000 7ff6d3a56ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T13:05:13.117 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:13.121+0000 7ff6d3a56ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:13.150 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:13.155+0000 7ff6d3a56ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T13:05:13.304 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:13.308+0000 7ff6d3a56ec0 20 RGWRados::pool_iterate: got zonegroup_info.fee0148b-7ae2-4cf0-a79e-86045a29cb7c 2019-12-08T13:05:13.305 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:13.308+0000 7ff6d3a56ec0 20 RGWRados::pool_iterate: got zone_info.f8ab349b-4577-410d-b524-4ecaf50bb1bd 2019-12-08T13:05:13.305 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:13.308+0000 7ff6d3a56ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-08T13:05:13.305 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:13.308+0000 7ff6d3a56ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-08T13:05:13.305 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:13.308+0000 7ff6d3a56ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:13.313 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:13.317+0000 7ff6d3a56ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T13:05:13.314 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:13.317+0000 7ff6d3a56ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:13.322 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:13.326+0000 7ff6d3a56ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-08T13:05:13.322 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:13.326+0000 7ff6d3a56ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:13.331 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:13.335+0000 7ff6d3a56ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T13:05:13.331 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:13.335+0000 7ff6d3a56ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:13.340 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:13.344+0000 7ff6d3a56ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-08T13:05:13.340 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:13.344+0000 7ff6d3a56ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:13.344 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:13.348+0000 7ff6d3a56ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T13:05:13.345 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:13.348+0000 7ff6d3a56ec0 10 cannot find current period zonegroup using local zonegroup 2019-12-08T13:05:13.345 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:13.348+0000 7ff6d3a56ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:13.358 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:13.362+0000 7ff6d3a56ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T13:05:13.358 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:13.362+0000 7ff6d3a56ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:13.367 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:13.371+0000 7ff6d3a56ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T13:05:13.368 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:13.371+0000 7ff6d3a56ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:13.376 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:13.380+0000 7ff6d3a56ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-08T13:05:13.376 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:13.380+0000 7ff6d3a56ec0 20 zonegroup default 2019-12-08T13:05:13.376 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:13.380+0000 7ff6d3a56ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:13.381 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:13.385+0000 7ff6d3a56ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T13:05:13.381 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:13.385+0000 7ff6d3a56ec0 10 Cannot find current period zone using local zone 2019-12-08T13:05:13.382 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:13.385+0000 7ff6d3a56ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:13.386 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:13.390+0000 7ff6d3a56ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T13:05:13.386 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:13.390+0000 7ff6d3a56ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:13.395 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:13.398+0000 7ff6d3a56ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T13:05:13.395 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:13.398+0000 7ff6d3a56ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:13.403 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:13.407+0000 7ff6d3a56ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-08T13:05:13.403 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:13.407+0000 7ff6d3a56ec0 20 zone default found 2019-12-08T13:05:13.403 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:13.407+0000 7ff6d3a56ec0 20 started sync module instance, tier type = 2019-12-08T13:05:13.403 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:13.407+0000 7ff6d3a56ec0 20 started zone id=f8ab349b-4577-410d-b524-4ecaf50bb1bd (name=default) with tier type = 2019-12-08T13:05:13.733 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:13.737+0000 7ff6d3a56ec0 20 add_watcher() i=0 2019-12-08T13:05:13.733 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:13.737+0000 7ff6d3a56ec0 20 add_watcher() i=1 2019-12-08T13:05:13.734 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:13.737+0000 7ff6d3a56ec0 20 add_watcher() i=2 2019-12-08T13:05:13.734 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:13.737+0000 7ff6d3a56ec0 20 add_watcher() i=3 2019-12-08T13:05:13.734 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:13.737+0000 7ff6d3a56ec0 20 add_watcher() i=4 2019-12-08T13:05:13.734 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:13.737+0000 7ff6d3a56ec0 20 add_watcher() i=5 2019-12-08T13:05:13.734 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:13.737+0000 7ff6d3a56ec0 20 add_watcher() i=6 2019-12-08T13:05:13.763 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:13.766+0000 7ff6c0c80700 0 -- 172.21.15.79:0/3665586840 >> [v2:172.21.15.79:6810/10449,v1:172.21.15.79:6811/10449] conn(0x7ff6a800b390 msgr2=0x7ff6a800b7a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-08T13:05:13.763 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:13.767+0000 7ff6d3a56ec0 20 add_watcher() i=7 2019-12-08T13:05:13.763 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:13.767+0000 7ff6d3a56ec0 2 all 8 watchers are set, enabling cache 2019-12-08T13:05:13.763 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:13.767+0000 7ff6917e2700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-08T13:05:13.779 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:13.783+0000 7ff6c0c80700 0 -- 172.21.15.79:0/2965167128 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7ff6040034e0 msgr2=0x7ff6040039e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-12-08T13:05:15.374 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:15.378+0000 7ff6037fe700 20 reqs_thread_entry: start 2019-12-08T13:05:15.375 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:15.379+0000 7ff6017fa700 20 reqs_thread_entry: start 2019-12-08T13:05:15.375 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:15.379+0000 7ff6d3a56ec0 20 init_complete bucket index max shards: 0 2019-12-08T13:05:15.376 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:15.380+0000 7ff5ef7fe700 20 reqs_thread_entry: start 2019-12-08T13:05:15.376 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:15.380+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2019-12-08T13:05:15.510 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:15.514+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:15.535 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:15.539+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T13:05:15.545 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:15.549+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:15.611 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:15.615+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2019-12-08T13:05:15.698 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:15.702+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:15.729 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:15.733+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T13:05:15.742 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:15.746+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:15.802 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:15.806+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2019-12-08T13:05:15.911 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:15.914+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:15.932 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:15.936+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T13:05:15.943 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:15.947+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:15.981 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:15.985+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2019-12-08T13:05:16.031 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:16.035+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:16.052 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:16.056+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T13:05:16.063 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:16.067+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:16.111 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:16.114+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2019-12-08T13:05:16.186 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:16.189+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:16.213 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:16.216+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T13:05:16.231 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:16.234+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:16.283 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:16.285+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2019-12-08T13:05:16.345 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:16.347+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:16.372 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:16.375+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T13:05:16.382 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:16.385+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:16.423 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:16.426+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2019-12-08T13:05:16.476 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:16.479+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:16.498 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:16.501+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T13:05:16.507 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:16.510+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:16.559 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:16.562+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2019-12-08T13:05:16.630 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:16.633+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:16.654 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:16.658+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T13:05:16.663 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:16.666+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:16.717 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:16.720+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2019-12-08T13:05:16.784 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:16.787+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:16.804 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:16.807+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T13:05:16.814 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:16.817+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:16.862 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:16.865+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2019-12-08T13:05:16.937 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:16.940+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:16.960 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:16.963+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T13:05:16.973 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:16.976+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:17.020 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:17.023+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2019-12-08T13:05:17.097 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:17.100+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:17.127 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:17.130+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T13:05:17.142 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:17.145+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:17.188 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:17.191+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2019-12-08T13:05:17.345 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:17.348+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:17.369 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:17.372+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T13:05:17.381 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:17.384+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:17.433 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:17.435+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2019-12-08T13:05:17.478 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:17.481+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:17.494 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:17.498+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T13:05:17.507 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:17.510+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:17.543 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:17.547+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2019-12-08T13:05:17.593 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:17.596+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:17.613 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:17.616+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T13:05:17.622 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:17.626+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:17.661 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:17.664+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2019-12-08T13:05:17.726 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:17.729+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:17.751 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:17.755+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T13:05:17.765 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:17.767+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:17.819 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:17.822+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2019-12-08T13:05:17.877 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:17.879+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:17.909 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:17.913+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T13:05:17.923 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:17.926+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:17.967 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:17.970+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2019-12-08T13:05:18.100 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:18.103+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:18.136 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:18.140+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T13:05:18.149 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:18.152+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:18.200 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:18.203+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2019-12-08T13:05:18.266 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:18.269+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:18.293 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:18.296+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T13:05:18.308 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:18.311+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:18.355 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:18.358+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2019-12-08T13:05:18.445 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:18.448+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:18.487 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:18.490+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T13:05:18.506 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:18.510+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:18.581 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:18.584+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2019-12-08T13:05:18.667 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:18.670+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:18.697 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:18.700+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T13:05:18.722 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:18.725+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:18.776 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:18.779+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2019-12-08T13:05:18.838 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:18.841+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:18.858 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:18.861+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T13:05:18.868 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:18.872+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:18.909 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:18.912+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2019-12-08T13:05:18.994 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:18.997+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:19.021 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:19.024+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T13:05:19.034 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:19.037+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:19.074 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:19.077+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2019-12-08T13:05:19.127 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:19.130+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:19.151 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:19.154+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T13:05:19.167 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:19.170+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:19.222 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:19.225+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2019-12-08T13:05:19.340 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:19.343+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:19.365 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:19.368+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T13:05:19.375 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:19.379+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:19.428 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:19.431+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2019-12-08T13:05:19.486 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:19.489+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:19.515 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:19.518+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T13:05:19.528 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:19.531+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:19.562 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:19.564+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2019-12-08T13:05:19.651 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:19.654+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:19.684 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:19.687+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T13:05:19.700 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:19.703+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:19.757 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:19.760+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2019-12-08T13:05:19.823 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:19.826+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:19.852 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:19.855+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T13:05:19.871 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:19.874+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:19.928 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:19.931+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2019-12-08T13:05:20.009 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:20.012+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:20.031 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:20.034+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T13:05:20.044 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:20.047+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:20.081 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:20.084+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2019-12-08T13:05:20.134 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:20.137+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:20.153 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:20.156+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T13:05:20.162 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:20.166+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:20.195 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:20.198+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2019-12-08T13:05:20.237 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:20.240+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:20.255 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:20.258+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T13:05:20.266 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:20.269+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:20.295 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:20.298+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2019-12-08T13:05:20.426 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:20.429+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:20.453 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:20.457+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T13:05:20.465 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:20.469+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:20.518 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:20.521+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2019-12-08T13:05:20.579 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:20.582+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:20.594 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:20.597+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned ENOENT for non expired entries, so setting cache entry to TRUE 2019-12-08T13:05:20.604 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:20.607+0000 7ff6d3a56ec0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2019-12-08T13:05:20.684 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:20.687+0000 7ff6d3a56ec0 20 remove_watcher() i=0 2019-12-08T13:05:20.684 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:20.687+0000 7ff6d3a56ec0 2 removed watcher, disabling cache 2019-12-08T13:05:20.762 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:20.765+0000 7ff6d3a56ec0 20 remove_watcher() i=1 2019-12-08T13:05:20.836 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:20.839+0000 7ff6d3a56ec0 20 remove_watcher() i=2 2019-12-08T13:05:20.887 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:20.890+0000 7ff6d3a56ec0 20 remove_watcher() i=3 2019-12-08T13:05:20.927 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:20.930+0000 7ff6d3a56ec0 20 remove_watcher() i=4 2019-12-08T13:05:20.977 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:20.980+0000 7ff6d3a56ec0 20 remove_watcher() i=5 2019-12-08T13:05:21.010 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:21.013+0000 7ff6d3a56ec0 20 remove_watcher() i=6 2019-12-08T13:05:21.044 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:21.047+0000 7ff6d3a56ec0 20 remove_watcher() i=7 2019-12-08T13:05:21.052 INFO:teuthology.run_tasks:Running task s3tests... 2019-12-08T13:05:21.090 DEBUG:tasks.s3tests:s3tests config is {'client.0': {'rgw_server': 'client.0', 'force-branch': 'ceph-master', 'slow_backend': True}} 2019-12-08T13:05:21.090 INFO:tasks.s3tests:Downloading s3-tests... 2019-12-08T13:05:21.090 INFO:tasks.s3tests:Using branch 'ceph-master' for s3tests 2019-12-08T13:05:21.090 INFO:teuthology.orchestra.run.smithi079:> git clone -b ceph-master git://git.ceph.com/git/s3-tests.git /home/ubuntu/cephtest/s3-tests 2019-12-08T13:05:21.193 INFO:teuthology.orchestra.run.smithi079.stdout:Cloning into '/home/ubuntu/cephtest/s3-tests'... 2019-12-08T13:05:21.753 INFO:tasks.s3tests:Creating rgw users... 2019-12-08T13:05:21.754 DEBUG:tasks.s3tests:Creating user bar.client.0 on client.0 2019-12-08T13:05:21.754 INFO:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid bar.client.0 --display-name 'Mr. bar.client.0' --access-key EFJKXQDVBXFYQJQKPDOM --secret g59h100+yDD3QPjAc9NQHqWi0Q5+pFFqZPW2YLsuG0+ApBCNmqe0Vw== --email bar.client.0+test@test.test --cluster ceph 2019-12-08T13:05:21.913 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:21.916+0000 7fac1d1b2ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:21.950 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:21.954+0000 7fac1d1b2ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T13:05:21.951 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:21.954+0000 7fac1d1b2ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:21.960 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:21.963+0000 7fac1d1b2ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T13:05:21.960 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:21.963+0000 7fac1d1b2ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:21.969 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:21.972+0000 7fac1d1b2ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T13:05:21.969 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:21.972+0000 7fac1d1b2ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:21.990 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:21.993+0000 7fac1d1b2ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T13:05:22.217 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:22.219+0000 7fac1d1b2ec0 20 RGWRados::pool_iterate: got zonegroup_info.fee0148b-7ae2-4cf0-a79e-86045a29cb7c 2019-12-08T13:05:22.217 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:22.219+0000 7fac1d1b2ec0 20 RGWRados::pool_iterate: got zone_info.f8ab349b-4577-410d-b524-4ecaf50bb1bd 2019-12-08T13:05:22.217 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:22.219+0000 7fac1d1b2ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-08T13:05:22.217 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:22.219+0000 7fac1d1b2ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-08T13:05:22.217 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:22.219+0000 7fac1d1b2ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:22.234 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:22.237+0000 7fac1d1b2ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T13:05:22.234 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:22.237+0000 7fac1d1b2ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:22.252 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:22.255+0000 7fac1d1b2ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-08T13:05:22.253 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:22.256+0000 7fac1d1b2ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:22.267 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:22.270+0000 7fac1d1b2ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T13:05:22.267 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:22.270+0000 7fac1d1b2ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:22.281 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:22.284+0000 7fac1d1b2ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-08T13:05:22.281 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:22.284+0000 7fac1d1b2ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:22.289 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:22.292+0000 7fac1d1b2ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T13:05:22.289 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:22.292+0000 7fac1d1b2ec0 10 cannot find current period zonegroup using local zonegroup 2019-12-08T13:05:22.289 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:22.292+0000 7fac1d1b2ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:22.298 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:22.301+0000 7fac1d1b2ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T13:05:22.298 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:22.301+0000 7fac1d1b2ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:22.310 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:22.313+0000 7fac1d1b2ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T13:05:22.310 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:22.313+0000 7fac1d1b2ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:22.323 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:22.326+0000 7fac1d1b2ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-08T13:05:22.324 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:22.326+0000 7fac1d1b2ec0 20 zonegroup default 2019-12-08T13:05:22.324 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:22.326+0000 7fac1d1b2ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:22.331 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:22.335+0000 7fac1d1b2ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T13:05:22.332 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:22.335+0000 7fac1d1b2ec0 10 Cannot find current period zone using local zone 2019-12-08T13:05:22.332 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:22.335+0000 7fac1d1b2ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:22.339 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:22.342+0000 7fac1d1b2ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T13:05:22.339 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:22.342+0000 7fac1d1b2ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:22.349 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:22.352+0000 7fac1d1b2ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T13:05:22.349 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:22.352+0000 7fac1d1b2ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:22.359 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:22.362+0000 7fac1d1b2ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-08T13:05:22.359 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:22.362+0000 7fac1d1b2ec0 20 zone default found 2019-12-08T13:05:22.359 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:22.362+0000 7fac1d1b2ec0 20 started sync module instance, tier type = 2019-12-08T13:05:22.359 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:22.362+0000 7fac1d1b2ec0 20 started zone id=f8ab349b-4577-410d-b524-4ecaf50bb1bd (name=default) with tier type = 2019-12-08T13:05:22.736 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:22.738+0000 7fac1d1b2ec0 20 add_watcher() i=0 2019-12-08T13:05:22.736 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:22.738+0000 7fac1d1b2ec0 20 add_watcher() i=1 2019-12-08T13:05:22.736 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:22.738+0000 7fac1d1b2ec0 20 add_watcher() i=2 2019-12-08T13:05:22.736 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:22.738+0000 7fac1d1b2ec0 20 add_watcher() i=3 2019-12-08T13:05:22.736 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:22.738+0000 7fac1d1b2ec0 20 add_watcher() i=4 2019-12-08T13:05:22.736 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:22.738+0000 7fac1d1b2ec0 20 add_watcher() i=5 2019-12-08T13:05:22.737 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:22.738+0000 7fac1d1b2ec0 20 add_watcher() i=6 2019-12-08T13:05:22.790 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:22.793+0000 7fac1d1b2ec0 20 add_watcher() i=7 2019-12-08T13:05:22.790 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:22.793+0000 7fac1d1b2ec0 2 all 8 watchers are set, enabling cache 2019-12-08T13:05:22.790 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:22.793+0000 7fabdafdd700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-08T13:05:22.797 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:22.800+0000 7fac0a3dc700 0 -- 172.21.15.79:0/3466096177 >> [v2:172.21.15.13:3300/0,v1:172.21.15.13:6789/0] conn(0x561353e04260 msgr2=0x561353e0a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-08T13:05:22.832 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:22.835+0000 7fac0a3dc700 0 -- 172.21.15.79:0/53697183 >> [v2:172.21.15.79:6800/9057,v1:172.21.15.79:6801/9057] conn(0x7fab4c0224c0 msgr2=0x7fab4c024990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-12-08T13:05:24.423 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:24.425+0000 7fab497fa700 20 reqs_thread_entry: start 2019-12-08T13:05:24.423 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:24.426+0000 7fab42ffd700 20 reqs_thread_entry: start 2019-12-08T13:05:24.423 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:24.426+0000 7fac1d1b2ec0 20 init_complete bucket index max shards: 0 2019-12-08T13:05:24.424 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:24.427+0000 7fab417fa700 20 reqs_thread_entry: start 2019-12-08T13:05:24.424 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:24.427+0000 7fac1d1b2ec0 20 get_system_obj_state: rctx=0x7ffd0e9cfb28 obj=default.rgw.meta:users.uid:bar.client.0 state=0x561353e85a60 s->prefetch_data=0 2019-12-08T13:05:24.424 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:24.427+0000 7fac1d1b2ec0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2019-12-08T13:05:24.436 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:24.439+0000 7fac1d1b2ec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x0 2019-12-08T13:05:24.437 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:24.439+0000 7fac1d1b2ec0 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-12-08T13:05:24.437 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:24.439+0000 7fac1d1b2ec0 20 get_system_obj_state: rctx=0x7ffd0e9cfb38 obj=default.rgw.meta:users.email:bar.client.0+test@test.test state=0x561353e877f0 s->prefetch_data=0 2019-12-08T13:05:24.437 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:24.439+0000 7fac1d1b2ec0 10 cache get: name=default.rgw.meta+users.email+bar.client.0+test@test.test : miss 2019-12-08T13:05:24.443 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:24.447+0000 7fac1d1b2ec0 10 cache put: name=default.rgw.meta+users.email+bar.client.0+test@test.test info.flags=0x0 2019-12-08T13:05:24.444 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:24.447+0000 7fac1d1b2ec0 10 adding default.rgw.meta+users.email+bar.client.0+test@test.test to cache LRU end 2019-12-08T13:05:24.444 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:24.447+0000 7fac1d1b2ec0 20 get_system_obj_state: rctx=0x7ffd0e9cfb38 obj=default.rgw.meta:users.keys:EFJKXQDVBXFYQJQKPDOM state=0x561353e877f0 s->prefetch_data=0 2019-12-08T13:05:24.444 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:24.447+0000 7fac1d1b2ec0 10 cache get: name=default.rgw.meta+users.keys+EFJKXQDVBXFYQJQKPDOM : miss 2019-12-08T13:05:24.452 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:24.455+0000 7fac1d1b2ec0 10 cache put: name=default.rgw.meta+users.keys+EFJKXQDVBXFYQJQKPDOM info.flags=0x0 2019-12-08T13:05:24.452 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:24.455+0000 7fac1d1b2ec0 10 adding default.rgw.meta+users.keys+EFJKXQDVBXFYQJQKPDOM to cache LRU end 2019-12-08T13:05:24.452 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:24.455+0000 7fac1d1b2ec0 20 get_system_obj_state: rctx=0x7ffd0e9cf748 obj=default.rgw.meta:users.keys:EFJKXQDVBXFYQJQKPDOM state=0x561353e877f0 s->prefetch_data=0 2019-12-08T13:05:24.452 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:24.455+0000 7fac1d1b2ec0 10 cache get: name=default.rgw.meta+users.keys+EFJKXQDVBXFYQJQKPDOM : type miss (requested=0x6, cached=0x0) 2019-12-08T13:05:24.458 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:24.461+0000 7fac1d1b2ec0 10 cache put: name=default.rgw.meta+users.keys+EFJKXQDVBXFYQJQKPDOM info.flags=0x0 2019-12-08T13:05:24.458 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:24.461+0000 7fac1d1b2ec0 10 moving default.rgw.meta+users.keys+EFJKXQDVBXFYQJQKPDOM to cache LRU end 2019-12-08T13:05:24.458 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:24.461+0000 7fac1d1b2ec0 20 get_system_obj_state: rctx=0x7ffd0e9cf8c8 obj=default.rgw.meta:users.keys:EFJKXQDVBXFYQJQKPDOM state=0x561353e877f0 s->prefetch_data=0 2019-12-08T13:05:24.458 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:24.461+0000 7fac1d1b2ec0 10 cache get: name=default.rgw.meta+users.keys+EFJKXQDVBXFYQJQKPDOM : type miss (requested=0x6, cached=0x0) 2019-12-08T13:05:24.463 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:24.466+0000 7fac1d1b2ec0 10 cache put: name=default.rgw.meta+users.keys+EFJKXQDVBXFYQJQKPDOM info.flags=0x0 2019-12-08T13:05:24.464 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:24.466+0000 7fac1d1b2ec0 10 moving default.rgw.meta+users.keys+EFJKXQDVBXFYQJQKPDOM to cache LRU end 2019-12-08T13:05:24.514 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:24.517+0000 7fac1d1b2ec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2019-12-08T13:05:24.514 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:24.517+0000 7fac1d1b2ec0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-12-08T13:05:24.514 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:24.517+0000 7fac1d1b2ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=617 2019-12-08T13:05:24.528 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:24.531+0000 7fabeb7fe700 10 RGWWatcher::handle_notify() notify_id 571230650427 cookie 94641011506704 notifier 4978 bl.length()=617 2019-12-08T13:05:24.529 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:24.531+0000 7fabeb7fe700 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2019-12-08T13:05:24.529 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:24.531+0000 7fabeb7fe700 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-12-08T13:05:25.631 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:25.634+0000 7fac1d1b2ec0 10 cache put: name=default.rgw.meta+users.email+bar.client.0+test@test.test info.flags=0x7 2019-12-08T13:05:25.631 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:25.634+0000 7fac1d1b2ec0 10 moving default.rgw.meta+users.email+bar.client.0+test@test.test to cache LRU end 2019-12-08T13:05:25.631 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:25.634+0000 7fac1d1b2ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=194 2019-12-08T13:05:25.643 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:25.646+0000 7fabeb7fe700 10 RGWWatcher::handle_notify() notify_id 571230650428 cookie 94641011506704 notifier 4978 bl.length()=194 2019-12-08T13:05:25.643 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:25.646+0000 7fabeb7fe700 10 cache put: name=default.rgw.meta+users.email+bar.client.0+test@test.test info.flags=0x7 2019-12-08T13:05:25.643 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:25.646+0000 7fabeb7fe700 10 moving default.rgw.meta+users.email+bar.client.0+test@test.test to cache LRU end 2019-12-08T13:05:25.923 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:25.926+0000 7fac1d1b2ec0 10 cache put: name=default.rgw.meta+users.keys+EFJKXQDVBXFYQJQKPDOM info.flags=0x7 2019-12-08T13:05:25.924 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:25.926+0000 7fac1d1b2ec0 10 moving default.rgw.meta+users.keys+EFJKXQDVBXFYQJQKPDOM to cache LRU end 2019-12-08T13:05:25.924 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:25.926+0000 7fac1d1b2ec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=186 2019-12-08T13:05:25.949 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:25.952+0000 7fabeb7fe700 10 RGWWatcher::handle_notify() notify_id 571230650429 cookie 94641011517152 notifier 4978 bl.length()=186 2019-12-08T13:05:25.949 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:25.952+0000 7fabeb7fe700 10 cache put: name=default.rgw.meta+users.keys+EFJKXQDVBXFYQJQKPDOM info.flags=0x7 2019-12-08T13:05:25.949 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:25.952+0000 7fabeb7fe700 10 moving default.rgw.meta+users.keys+EFJKXQDVBXFYQJQKPDOM to cache LRU end 2019-12-08T13:05:26.247 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2019-12-08T13:05:26.248 INFO:teuthology.orchestra.run.smithi079.stdout: "user_id": "bar.client.0", 2019-12-08T13:05:26.248 INFO:teuthology.orchestra.run.smithi079.stdout: "display_name": "Mr. bar.client.0", 2019-12-08T13:05:26.248 INFO:teuthology.orchestra.run.smithi079.stdout: "email": "bar.client.0+test@test.test", 2019-12-08T13:05:26.248 INFO:teuthology.orchestra.run.smithi079.stdout: "suspended": 0, 2019-12-08T13:05:26.248 INFO:teuthology.orchestra.run.smithi079.stdout: "max_buckets": 1000, 2019-12-08T13:05:26.249 INFO:teuthology.orchestra.run.smithi079.stdout: "subusers": [], 2019-12-08T13:05:26.249 INFO:teuthology.orchestra.run.smithi079.stdout: "keys": [ 2019-12-08T13:05:26.249 INFO:teuthology.orchestra.run.smithi079.stdout: { 2019-12-08T13:05:26.249 INFO:teuthology.orchestra.run.smithi079.stdout: "user": "bar.client.0", 2019-12-08T13:05:26.249 INFO:teuthology.orchestra.run.smithi079.stdout: "access_key": "EFJKXQDVBXFYQJQKPDOM", 2019-12-08T13:05:26.249 INFO:teuthology.orchestra.run.smithi079.stdout: "secret_key": "g59h100+yDD3QPjAc9NQHqWi0Q5+pFFqZPW2YLsuG0+ApBCNmqe0Vw==" 2019-12-08T13:05:26.249 INFO:teuthology.orchestra.run.smithi079.stdout: } 2019-12-08T13:05:26.250 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2019-12-08T13:05:26.250 INFO:teuthology.orchestra.run.smithi079.stdout: "swift_keys": [], 2019-12-08T13:05:26.250 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": [], 2019-12-08T13:05:26.250 INFO:teuthology.orchestra.run.smithi079.stdout: "op_mask": "read, write, delete", 2019-12-08T13:05:26.250 INFO:teuthology.orchestra.run.smithi079.stdout: "default_placement": "", 2019-12-08T13:05:26.250 INFO:teuthology.orchestra.run.smithi079.stdout: "default_storage_class": "", 2019-12-08T13:05:26.250 INFO:teuthology.orchestra.run.smithi079.stdout: "placement_tags": [], 2019-12-08T13:05:26.251 INFO:teuthology.orchestra.run.smithi079.stdout: "bucket_quota": { 2019-12-08T13:05:26.251 INFO:teuthology.orchestra.run.smithi079.stdout: "enabled": false, 2019-12-08T13:05:26.251 INFO:teuthology.orchestra.run.smithi079.stdout: "check_on_raw": false, 2019-12-08T13:05:26.251 INFO:teuthology.orchestra.run.smithi079.stdout: "max_size": -1, 2019-12-08T13:05:26.251 INFO:teuthology.orchestra.run.smithi079.stdout: "max_size_kb": 0, 2019-12-08T13:05:26.251 INFO:teuthology.orchestra.run.smithi079.stdout: "max_objects": -1 2019-12-08T13:05:26.251 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2019-12-08T13:05:26.251 INFO:teuthology.orchestra.run.smithi079.stdout: "user_quota": { 2019-12-08T13:05:26.252 INFO:teuthology.orchestra.run.smithi079.stdout: "enabled": false, 2019-12-08T13:05:26.252 INFO:teuthology.orchestra.run.smithi079.stdout: "check_on_raw": false, 2019-12-08T13:05:26.252 INFO:teuthology.orchestra.run.smithi079.stdout: "max_size": -1, 2019-12-08T13:05:26.252 INFO:teuthology.orchestra.run.smithi079.stdout: "max_size_kb": 0, 2019-12-08T13:05:26.252 INFO:teuthology.orchestra.run.smithi079.stdout: "max_objects": -1 2019-12-08T13:05:26.252 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2019-12-08T13:05:26.253 INFO:teuthology.orchestra.run.smithi079.stdout: "temp_url_keys": [], 2019-12-08T13:05:26.253 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "rgw", 2019-12-08T13:05:26.253 INFO:teuthology.orchestra.run.smithi079.stdout: "mfa_ids": [] 2019-12-08T13:05:26.253 INFO:teuthology.orchestra.run.smithi079.stdout:} 2019-12-08T13:05:26.253 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T13:05:26.297 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:26.300+0000 7fac1d1b2ec0 20 remove_watcher() i=0 2019-12-08T13:05:26.297 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:26.300+0000 7fac1d1b2ec0 2 removed watcher, disabling cache 2019-12-08T13:05:26.373 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:26.376+0000 7fac1d1b2ec0 20 remove_watcher() i=1 2019-12-08T13:05:26.451 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:26.454+0000 7fac1d1b2ec0 20 remove_watcher() i=2 2019-12-08T13:05:26.508 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:26.511+0000 7fac1d1b2ec0 20 remove_watcher() i=3 2019-12-08T13:05:26.543 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:26.546+0000 7fac1d1b2ec0 20 remove_watcher() i=4 2019-12-08T13:05:26.586 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:26.589+0000 7fac1d1b2ec0 20 remove_watcher() i=5 2019-12-08T13:05:26.613 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:26.616+0000 7fac1d1b2ec0 20 remove_watcher() i=6 2019-12-08T13:05:26.646 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:26.649+0000 7fac1d1b2ec0 20 remove_watcher() i=7 2019-12-08T13:05:26.654 INFO:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid bar.client.0 --totp-serial 7494149826 --totp-seed J7I5FT7MURRDUNE4YRRTUNBWUJ7XTJ3ZCLF22DVJA2K7X447RZSCPQJKGVSAJDJ3 --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2019-12-08T13:05:26.783 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:26.786+0000 7feb3a0e9ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:26.817 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:26.820+0000 7feb3a0e9ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T13:05:26.818 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:26.820+0000 7feb3a0e9ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:26.826 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:26.829+0000 7feb3a0e9ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T13:05:26.826 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:26.829+0000 7feb3a0e9ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:26.833 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:26.837+0000 7feb3a0e9ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T13:05:26.834 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:26.837+0000 7feb3a0e9ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:26.857 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:26.860+0000 7feb3a0e9ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T13:05:27.082 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:27.085+0000 7feb3a0e9ec0 20 RGWRados::pool_iterate: got zonegroup_info.fee0148b-7ae2-4cf0-a79e-86045a29cb7c 2019-12-08T13:05:27.082 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:27.085+0000 7feb3a0e9ec0 20 RGWRados::pool_iterate: got zone_info.f8ab349b-4577-410d-b524-4ecaf50bb1bd 2019-12-08T13:05:27.082 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:27.085+0000 7feb3a0e9ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-08T13:05:27.083 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:27.085+0000 7feb3a0e9ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-08T13:05:27.083 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:27.085+0000 7feb3a0e9ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:27.103 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:27.105+0000 7feb3a0e9ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T13:05:27.103 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:27.106+0000 7feb3a0e9ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:27.124 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:27.127+0000 7feb3a0e9ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-08T13:05:27.125 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:27.127+0000 7feb3a0e9ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:27.144 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:27.147+0000 7feb3a0e9ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T13:05:27.144 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:27.147+0000 7feb3a0e9ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:27.165 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:27.168+0000 7feb3a0e9ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-08T13:05:27.166 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:27.168+0000 7feb3a0e9ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:27.177 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:27.180+0000 7feb3a0e9ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T13:05:27.178 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:27.180+0000 7feb3a0e9ec0 10 cannot find current period zonegroup using local zonegroup 2019-12-08T13:05:27.178 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:27.180+0000 7feb3a0e9ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:27.189 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:27.192+0000 7feb3a0e9ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T13:05:27.189 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:27.192+0000 7feb3a0e9ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:27.207 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:27.211+0000 7feb3a0e9ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T13:05:27.208 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:27.211+0000 7feb3a0e9ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:27.226 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:27.229+0000 7feb3a0e9ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-08T13:05:27.226 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:27.229+0000 7feb3a0e9ec0 20 zonegroup default 2019-12-08T13:05:27.226 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:27.229+0000 7feb3a0e9ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:27.237 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:27.240+0000 7feb3a0e9ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T13:05:27.237 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:27.240+0000 7feb3a0e9ec0 10 Cannot find current period zone using local zone 2019-12-08T13:05:27.237 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:27.240+0000 7feb3a0e9ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:27.247 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:27.250+0000 7feb3a0e9ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T13:05:27.247 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:27.250+0000 7feb3a0e9ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:27.264 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:27.267+0000 7feb3a0e9ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T13:05:27.264 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:27.267+0000 7feb3a0e9ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:27.278 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:27.281+0000 7feb3a0e9ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-08T13:05:27.279 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:27.281+0000 7feb3a0e9ec0 20 zone default found 2019-12-08T13:05:27.279 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:27.281+0000 7feb3a0e9ec0 20 started sync module instance, tier type = 2019-12-08T13:05:27.279 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:27.281+0000 7feb3a0e9ec0 20 started zone id=f8ab349b-4577-410d-b524-4ecaf50bb1bd (name=default) with tier type = 2019-12-08T13:05:27.669 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:27.672+0000 7feb3a0e9ec0 20 add_watcher() i=0 2019-12-08T13:05:27.670 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:27.672+0000 7feb3a0e9ec0 20 add_watcher() i=1 2019-12-08T13:05:27.670 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:27.672+0000 7feb3a0e9ec0 20 add_watcher() i=2 2019-12-08T13:05:27.670 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:27.672+0000 7feb3a0e9ec0 20 add_watcher() i=3 2019-12-08T13:05:27.670 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:27.672+0000 7feb3a0e9ec0 20 add_watcher() i=4 2019-12-08T13:05:27.670 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:27.672+0000 7feb3a0e9ec0 20 add_watcher() i=5 2019-12-08T13:05:27.670 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:27.672+0000 7feb3a0e9ec0 20 add_watcher() i=6 2019-12-08T13:05:27.695 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:27.698+0000 7feb3a0e9ec0 20 add_watcher() i=7 2019-12-08T13:05:27.695 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:27.698+0000 7feb3a0e9ec0 2 all 8 watchers are set, enabling cache 2019-12-08T13:05:27.695 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:27.698+0000 7feaf7fdf700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-08T13:05:27.698 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:27.701+0000 7feb27313700 0 -- 172.21.15.79:0/2356191810 >> v2:172.21.15.79:3300/0 conn(0x558a9007c340 msgr2=0x558a90082770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0)._try_send injecting socket failure 2019-12-08T13:05:27.721 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:27.724+0000 7feb26b12700 0 -- 172.21.15.79:0/494512427 >> v1:172.21.15.79:6789/0 conn(0x558a90088fc0 legacy=0x558a9008b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-08T13:05:29.163 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:29.166+0000 7fea667fc700 20 reqs_thread_entry: start 2019-12-08T13:05:29.163 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:29.166+0000 7fea5ffff700 20 reqs_thread_entry: start 2019-12-08T13:05:29.164 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:29.166+0000 7feb3a0e9ec0 20 init_complete bucket index max shards: 0 2019-12-08T13:05:29.164 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:29.167+0000 7fea5e7fc700 20 reqs_thread_entry: start 2019-12-08T13:05:29.164 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:29.167+0000 7feb3a0e9ec0 20 get_system_obj_state: rctx=0x7fff299bfb68 obj=default.rgw.meta:users.uid:bar.client.0 state=0x558a900feae0 s->prefetch_data=0 2019-12-08T13:05:29.165 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:29.167+0000 7feb3a0e9ec0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2019-12-08T13:05:29.184 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:29.186+0000 7feb3a0e9ec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x16 2019-12-08T13:05:29.184 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:29.186+0000 7feb3a0e9ec0 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-12-08T13:05:29.184 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:29.186+0000 7feb3a0e9ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-08T13:05:29.184 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:29.186+0000 7feb3a0e9ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-08T13:05:29.184 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:29.186+0000 7feb3a0e9ec0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : type miss (requested=0x11, cached=0x16) 2019-12-08T13:05:29.184 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:29.186+0000 7feb3a0e9ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:29.200 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:29.203+0000 7feb3a0e9ec0 20 rados_obj.operate() r=0 bl.length=432 2019-12-08T13:05:29.200 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:29.203+0000 7feb3a0e9ec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x11 2019-12-08T13:05:29.200 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:29.203+0000 7feb3a0e9ec0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-12-08T13:05:31.604 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:31.606+0000 7feb3a0e9ec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2019-12-08T13:05:31.604 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:31.606+0000 7feb3a0e9ec0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-12-08T13:05:31.604 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:31.606+0000 7feb3a0e9ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=631 2019-12-08T13:05:31.634 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:31.637+0000 7feb0cff9700 10 RGWWatcher::handle_notify() notify_id 579820585022 cookie 94053610208432 notifier 4601 bl.length()=631 2019-12-08T13:05:31.635 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:31.637+0000 7feb0cff9700 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2019-12-08T13:05:31.635 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:31.637+0000 7feb0cff9700 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-12-08T13:05:31.899 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:31.902+0000 7feb3a0e9ec0 20 remove_watcher() i=0 2019-12-08T13:05:31.899 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:31.902+0000 7feb3a0e9ec0 2 removed watcher, disabling cache 2019-12-08T13:05:31.951 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:31.954+0000 7feb3a0e9ec0 20 remove_watcher() i=1 2019-12-08T13:05:32.005 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:32.008+0000 7feb3a0e9ec0 20 remove_watcher() i=2 2019-12-08T13:05:32.072 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:32.075+0000 7feb3a0e9ec0 20 remove_watcher() i=3 2019-12-08T13:05:32.112 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:32.115+0000 7feb3a0e9ec0 20 remove_watcher() i=4 2019-12-08T13:05:32.174 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:32.177+0000 7feb3a0e9ec0 20 remove_watcher() i=5 2019-12-08T13:05:32.216 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:32.219+0000 7feb3a0e9ec0 20 remove_watcher() i=6 2019-12-08T13:05:32.250 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:32.253+0000 7feb3a0e9ec0 20 remove_watcher() i=7 2019-12-08T13:05:32.257 DEBUG:tasks.s3tests:Creating user foo.client.0 on client.0 2019-12-08T13:05:32.258 INFO:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foo.client.0 --display-name 'Mr. foo.client.0' --access-key YOGQLORAMSODZVKZLPPC --secret RxNTpvG93JZBeiG6hi0yw/PRo69eSCDpR+v/p459foyH/nNBbwG7/A== --email foo.client.0+test@test.test --cluster ceph 2019-12-08T13:05:32.385 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:32.388+0000 7f0d01253ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:32.671 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:32.674+0000 7f0d01253ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T13:05:32.671 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:32.674+0000 7f0d01253ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:32.678 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:32.681+0000 7f0d01253ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T13:05:32.678 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:32.681+0000 7f0d01253ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:32.683 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:32.686+0000 7f0d01253ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T13:05:32.683 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:32.686+0000 7f0d01253ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:32.697 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:32.699+0000 7f0d01253ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T13:05:33.709 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:33.712+0000 7f0d01253ec0 20 RGWRados::pool_iterate: got zonegroup_info.fee0148b-7ae2-4cf0-a79e-86045a29cb7c 2019-12-08T13:05:33.709 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:33.712+0000 7f0d01253ec0 20 RGWRados::pool_iterate: got zone_info.f8ab349b-4577-410d-b524-4ecaf50bb1bd 2019-12-08T13:05:33.709 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:33.712+0000 7f0d01253ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-08T13:05:33.710 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:33.712+0000 7f0d01253ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-08T13:05:33.710 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:33.712+0000 7f0d01253ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:33.717 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:33.720+0000 7f0d01253ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T13:05:33.717 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:33.720+0000 7f0d01253ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:33.730 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:33.733+0000 7f0d01253ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-08T13:05:33.730 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:33.733+0000 7f0d01253ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:33.739 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:33.742+0000 7f0d01253ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T13:05:33.739 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:33.742+0000 7f0d01253ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:33.748 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:33.751+0000 7f0d01253ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-08T13:05:33.748 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:33.751+0000 7f0d01253ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:33.755 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:33.758+0000 7f0d01253ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T13:05:33.755 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:33.758+0000 7f0d01253ec0 10 cannot find current period zonegroup using local zonegroup 2019-12-08T13:05:33.755 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:33.758+0000 7f0d01253ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:33.761 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:33.764+0000 7f0d01253ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T13:05:33.761 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:33.764+0000 7f0d01253ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:33.771 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:33.773+0000 7f0d01253ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T13:05:33.771 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:33.773+0000 7f0d01253ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:33.780 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:33.783+0000 7f0d01253ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-08T13:05:33.781 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:33.783+0000 7f0d01253ec0 20 zonegroup default 2019-12-08T13:05:33.781 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:33.783+0000 7f0d01253ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:33.790 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:33.793+0000 7f0d01253ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T13:05:33.790 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:33.793+0000 7f0d01253ec0 10 Cannot find current period zone using local zone 2019-12-08T13:05:33.790 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:33.793+0000 7f0d01253ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:33.799 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:33.802+0000 7f0d01253ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T13:05:33.799 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:33.802+0000 7f0d01253ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:33.808 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:33.811+0000 7f0d01253ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T13:05:33.808 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:33.811+0000 7f0d01253ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:33.817 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:33.820+0000 7f0d01253ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-08T13:05:33.817 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:33.820+0000 7f0d01253ec0 20 zone default found 2019-12-08T13:05:33.818 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:33.820+0000 7f0d01253ec0 20 started sync module instance, tier type = 2019-12-08T13:05:33.818 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:33.820+0000 7f0d01253ec0 20 started zone id=f8ab349b-4577-410d-b524-4ecaf50bb1bd (name=default) with tier type = 2019-12-08T13:05:34.204 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:34.207+0000 7f0d01253ec0 20 add_watcher() i=0 2019-12-08T13:05:34.205 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:34.207+0000 7f0d01253ec0 20 add_watcher() i=1 2019-12-08T13:05:34.205 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:34.207+0000 7f0d01253ec0 20 add_watcher() i=2 2019-12-08T13:05:34.205 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:34.207+0000 7f0d01253ec0 20 add_watcher() i=3 2019-12-08T13:05:34.205 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:34.207+0000 7f0d01253ec0 20 add_watcher() i=4 2019-12-08T13:05:34.205 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:34.207+0000 7f0d01253ec0 20 add_watcher() i=5 2019-12-08T13:05:34.224 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:34.225+0000 7f0d01253ec0 20 add_watcher() i=6 2019-12-08T13:05:34.240 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:34.243+0000 7f0d01253ec0 20 add_watcher() i=7 2019-12-08T13:05:34.240 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:34.243+0000 7f0d01253ec0 2 all 8 watchers are set, enabling cache 2019-12-08T13:05:34.240 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:34.243+0000 7f0cbefdd700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-08T13:05:34.242 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:34.246+0000 7f0cee47d700 0 -- 172.21.15.79:0/1783848282 >> v2:172.21.15.13:3300/0 conn(0x560a11516cc0 msgr2=0x560a11519140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-12-08T13:05:34.283 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:34.286+0000 7f0cedc7c700 0 -- 172.21.15.79:0/1290316678 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560a11521f80 msgr2=0x560a11524490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-08T13:05:35.988 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:35.991+0000 7f0c2d7fa700 20 reqs_thread_entry: start 2019-12-08T13:05:35.989 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:35.991+0000 7f0c26ffd700 20 reqs_thread_entry: start 2019-12-08T13:05:35.989 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:35.991+0000 7f0d01253ec0 20 init_complete bucket index max shards: 0 2019-12-08T13:05:35.989 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:35.992+0000 7f0c257fa700 20 reqs_thread_entry: start 2019-12-08T13:05:35.990 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:35.992+0000 7f0d01253ec0 20 get_system_obj_state: rctx=0x7ffe2e92eeb8 obj=default.rgw.meta:users.uid:foo.client.0 state=0x560a1158eb40 s->prefetch_data=0 2019-12-08T13:05:35.990 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:35.993+0000 7f0d01253ec0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2019-12-08T13:05:36.001 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:36.004+0000 7f0d01253ec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x0 2019-12-08T13:05:36.001 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:36.004+0000 7f0d01253ec0 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-12-08T13:05:36.001 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:36.004+0000 7f0d01253ec0 20 get_system_obj_state: rctx=0x7ffe2e92eec8 obj=default.rgw.meta:users.email:foo.client.0+test@test.test state=0x560a115908d0 s->prefetch_data=0 2019-12-08T13:05:36.002 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:36.004+0000 7f0d01253ec0 10 cache get: name=default.rgw.meta+users.email+foo.client.0+test@test.test : miss 2019-12-08T13:05:36.013 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:36.016+0000 7f0d01253ec0 10 cache put: name=default.rgw.meta+users.email+foo.client.0+test@test.test info.flags=0x0 2019-12-08T13:05:36.013 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:36.016+0000 7f0d01253ec0 10 adding default.rgw.meta+users.email+foo.client.0+test@test.test to cache LRU end 2019-12-08T13:05:36.014 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:36.016+0000 7f0d01253ec0 20 get_system_obj_state: rctx=0x7ffe2e92eec8 obj=default.rgw.meta:users.keys:YOGQLORAMSODZVKZLPPC state=0x560a115908d0 s->prefetch_data=0 2019-12-08T13:05:36.014 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:36.016+0000 7f0d01253ec0 10 cache get: name=default.rgw.meta+users.keys+YOGQLORAMSODZVKZLPPC : miss 2019-12-08T13:05:36.024 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:36.027+0000 7f0d01253ec0 10 cache put: name=default.rgw.meta+users.keys+YOGQLORAMSODZVKZLPPC info.flags=0x0 2019-12-08T13:05:36.024 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:36.027+0000 7f0d01253ec0 10 adding default.rgw.meta+users.keys+YOGQLORAMSODZVKZLPPC to cache LRU end 2019-12-08T13:05:36.024 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:36.027+0000 7f0d01253ec0 20 get_system_obj_state: rctx=0x7ffe2e92ead8 obj=default.rgw.meta:users.keys:YOGQLORAMSODZVKZLPPC state=0x560a115908d0 s->prefetch_data=0 2019-12-08T13:05:36.024 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:36.027+0000 7f0d01253ec0 10 cache get: name=default.rgw.meta+users.keys+YOGQLORAMSODZVKZLPPC : type miss (requested=0x6, cached=0x0) 2019-12-08T13:05:36.033 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:36.036+0000 7f0d01253ec0 10 cache put: name=default.rgw.meta+users.keys+YOGQLORAMSODZVKZLPPC info.flags=0x0 2019-12-08T13:05:36.033 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:36.036+0000 7f0d01253ec0 10 moving default.rgw.meta+users.keys+YOGQLORAMSODZVKZLPPC to cache LRU end 2019-12-08T13:05:36.033 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:36.036+0000 7f0d01253ec0 20 get_system_obj_state: rctx=0x7ffe2e92ec58 obj=default.rgw.meta:users.keys:YOGQLORAMSODZVKZLPPC state=0x560a115908d0 s->prefetch_data=0 2019-12-08T13:05:36.034 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:36.036+0000 7f0d01253ec0 10 cache get: name=default.rgw.meta+users.keys+YOGQLORAMSODZVKZLPPC : type miss (requested=0x6, cached=0x0) 2019-12-08T13:05:36.042 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:36.045+0000 7f0d01253ec0 10 cache put: name=default.rgw.meta+users.keys+YOGQLORAMSODZVKZLPPC info.flags=0x0 2019-12-08T13:05:36.042 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:36.045+0000 7f0d01253ec0 10 moving default.rgw.meta+users.keys+YOGQLORAMSODZVKZLPPC to cache LRU end 2019-12-08T13:05:36.123 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:36.126+0000 7f0d01253ec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2019-12-08T13:05:36.123 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:36.126+0000 7f0d01253ec0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-12-08T13:05:36.124 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:36.126+0000 7f0d01253ec0 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=617 2019-12-08T13:05:36.140 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:36.143+0000 7f0ccf7fe700 10 RGWWatcher::handle_notify() notify_id 584115552314 cookie 94601240130112 notifier 5011 bl.length()=617 2019-12-08T13:05:36.140 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:36.143+0000 7f0ccf7fe700 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2019-12-08T13:05:36.140 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:36.143+0000 7f0ccf7fe700 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-12-08T13:05:36.729 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:36.732+0000 7f0d01253ec0 10 cache put: name=default.rgw.meta+users.email+foo.client.0+test@test.test info.flags=0x7 2019-12-08T13:05:36.730 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:36.732+0000 7f0d01253ec0 10 moving default.rgw.meta+users.email+foo.client.0+test@test.test to cache LRU end 2019-12-08T13:05:36.730 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:36.732+0000 7f0d01253ec0 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=194 2019-12-08T13:05:36.742 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:36.745+0000 7f0ccf7fe700 10 RGWWatcher::handle_notify() notify_id 584115552287 cookie 94601240144864 notifier 5011 bl.length()=194 2019-12-08T13:05:36.742 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:36.745+0000 7f0ccf7fe700 10 cache put: name=default.rgw.meta+users.email+foo.client.0+test@test.test info.flags=0x7 2019-12-08T13:05:36.742 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:36.745+0000 7f0ccf7fe700 10 moving default.rgw.meta+users.email+foo.client.0+test@test.test to cache LRU end 2019-12-08T13:05:37.305 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:37.308+0000 7f0d01253ec0 10 cache put: name=default.rgw.meta+users.keys+YOGQLORAMSODZVKZLPPC info.flags=0x7 2019-12-08T13:05:37.306 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:37.308+0000 7f0d01253ec0 10 moving default.rgw.meta+users.keys+YOGQLORAMSODZVKZLPPC to cache LRU end 2019-12-08T13:05:37.306 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:37.308+0000 7f0d01253ec0 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=186 2019-12-08T13:05:37.317 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:37.320+0000 7f0ccf7fe700 10 RGWWatcher::handle_notify() notify_id 584115552315 cookie 94601240130112 notifier 5011 bl.length()=186 2019-12-08T13:05:37.317 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:37.320+0000 7f0ccf7fe700 10 cache put: name=default.rgw.meta+users.keys+YOGQLORAMSODZVKZLPPC info.flags=0x7 2019-12-08T13:05:37.318 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:37.320+0000 7f0ccf7fe700 10 moving default.rgw.meta+users.keys+YOGQLORAMSODZVKZLPPC to cache LRU end 2019-12-08T13:05:37.555 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2019-12-08T13:05:37.555 INFO:teuthology.orchestra.run.smithi079.stdout: "user_id": "foo.client.0", 2019-12-08T13:05:37.556 INFO:teuthology.orchestra.run.smithi079.stdout: "display_name": "Mr. foo.client.0", 2019-12-08T13:05:37.556 INFO:teuthology.orchestra.run.smithi079.stdout: "email": "foo.client.0+test@test.test", 2019-12-08T13:05:37.556 INFO:teuthology.orchestra.run.smithi079.stdout: "suspended": 0, 2019-12-08T13:05:37.556 INFO:teuthology.orchestra.run.smithi079.stdout: "max_buckets": 1000, 2019-12-08T13:05:37.556 INFO:teuthology.orchestra.run.smithi079.stdout: "subusers": [], 2019-12-08T13:05:37.556 INFO:teuthology.orchestra.run.smithi079.stdout: "keys": [ 2019-12-08T13:05:37.556 INFO:teuthology.orchestra.run.smithi079.stdout: { 2019-12-08T13:05:37.557 INFO:teuthology.orchestra.run.smithi079.stdout: "user": "foo.client.0", 2019-12-08T13:05:37.557 INFO:teuthology.orchestra.run.smithi079.stdout: "access_key": "YOGQLORAMSODZVKZLPPC", 2019-12-08T13:05:37.557 INFO:teuthology.orchestra.run.smithi079.stdout: "secret_key": "RxNTpvG93JZBeiG6hi0yw/PRo69eSCDpR+v/p459foyH/nNBbwG7/A==" 2019-12-08T13:05:37.557 INFO:teuthology.orchestra.run.smithi079.stdout: } 2019-12-08T13:05:37.557 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2019-12-08T13:05:37.557 INFO:teuthology.orchestra.run.smithi079.stdout: "swift_keys": [], 2019-12-08T13:05:37.557 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": [], 2019-12-08T13:05:37.558 INFO:teuthology.orchestra.run.smithi079.stdout: "op_mask": "read, write, delete", 2019-12-08T13:05:37.558 INFO:teuthology.orchestra.run.smithi079.stdout: "default_placement": "", 2019-12-08T13:05:37.558 INFO:teuthology.orchestra.run.smithi079.stdout: "default_storage_class": "", 2019-12-08T13:05:37.558 INFO:teuthology.orchestra.run.smithi079.stdout: "placement_tags": [], 2019-12-08T13:05:37.558 INFO:teuthology.orchestra.run.smithi079.stdout: "bucket_quota": { 2019-12-08T13:05:37.558 INFO:teuthology.orchestra.run.smithi079.stdout: "enabled": false, 2019-12-08T13:05:37.558 INFO:teuthology.orchestra.run.smithi079.stdout: "check_on_raw": false, 2019-12-08T13:05:37.559 INFO:teuthology.orchestra.run.smithi079.stdout: "max_size": -1, 2019-12-08T13:05:37.559 INFO:teuthology.orchestra.run.smithi079.stdout: "max_size_kb": 0, 2019-12-08T13:05:37.559 INFO:teuthology.orchestra.run.smithi079.stdout: "max_objects": -1 2019-12-08T13:05:37.559 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2019-12-08T13:05:37.559 INFO:teuthology.orchestra.run.smithi079.stdout: "user_quota": { 2019-12-08T13:05:37.559 INFO:teuthology.orchestra.run.smithi079.stdout: "enabled": false, 2019-12-08T13:05:37.559 INFO:teuthology.orchestra.run.smithi079.stdout: "check_on_raw": false, 2019-12-08T13:05:37.560 INFO:teuthology.orchestra.run.smithi079.stdout: "max_size": -1, 2019-12-08T13:05:37.560 INFO:teuthology.orchestra.run.smithi079.stdout: "max_size_kb": 0, 2019-12-08T13:05:37.560 INFO:teuthology.orchestra.run.smithi079.stdout: "max_objects": -1 2019-12-08T13:05:37.560 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2019-12-08T13:05:37.560 INFO:teuthology.orchestra.run.smithi079.stdout: "temp_url_keys": [], 2019-12-08T13:05:37.561 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "rgw", 2019-12-08T13:05:37.561 INFO:teuthology.orchestra.run.smithi079.stdout: "mfa_ids": [] 2019-12-08T13:05:37.561 INFO:teuthology.orchestra.run.smithi079.stdout:} 2019-12-08T13:05:37.561 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T13:05:37.606 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:37.609+0000 7f0d01253ec0 20 remove_watcher() i=0 2019-12-08T13:05:37.606 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:37.609+0000 7f0d01253ec0 2 removed watcher, disabling cache 2019-12-08T13:05:37.712 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:37.715+0000 7f0d01253ec0 20 remove_watcher() i=1 2019-12-08T13:05:37.761 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:37.764+0000 7f0d01253ec0 20 remove_watcher() i=2 2019-12-08T13:05:37.823 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:37.826+0000 7f0d01253ec0 20 remove_watcher() i=3 2019-12-08T13:05:37.876 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:37.879+0000 7f0d01253ec0 20 remove_watcher() i=4 2019-12-08T13:05:37.929 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:37.932+0000 7f0d01253ec0 20 remove_watcher() i=5 2019-12-08T13:05:37.999 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:38.002+0000 7f0d01253ec0 20 remove_watcher() i=6 2019-12-08T13:05:38.045 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:38.048+0000 7f0d01253ec0 20 remove_watcher() i=7 2019-12-08T13:05:38.055 INFO:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foo.client.0 --totp-serial 6603067241 --totp-seed BQQ4ODNYSJQTAXVPPSYK5ZRLXQPH7UOYAOOURK2NEXQCBY362SAMKHAI5W5MS4OL --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2019-12-08T13:05:38.219 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:38.222+0000 7f286b40dec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:38.263 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:38.266+0000 7f286b40dec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T13:05:38.263 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:38.266+0000 7f286b40dec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:38.274 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:38.277+0000 7f286b40dec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T13:05:38.274 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:38.277+0000 7f286b40dec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:38.284 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:38.287+0000 7f286b40dec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T13:05:38.284 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:38.287+0000 7f286b40dec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:38.315 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:38.318+0000 7f286b40dec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T13:05:38.556 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:38.559+0000 7f286b40dec0 20 RGWRados::pool_iterate: got zonegroup_info.fee0148b-7ae2-4cf0-a79e-86045a29cb7c 2019-12-08T13:05:38.557 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:38.559+0000 7f286b40dec0 20 RGWRados::pool_iterate: got zone_info.f8ab349b-4577-410d-b524-4ecaf50bb1bd 2019-12-08T13:05:38.557 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:38.559+0000 7f286b40dec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-08T13:05:38.557 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:38.559+0000 7f286b40dec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-08T13:05:38.557 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:38.559+0000 7f286b40dec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:38.572 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:38.575+0000 7f286b40dec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T13:05:38.572 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:38.575+0000 7f286b40dec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:38.607 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:38.610+0000 7f286b40dec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-08T13:05:38.607 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:38.610+0000 7f286b40dec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:38.622 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:38.625+0000 7f286b40dec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T13:05:38.622 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:38.625+0000 7f286b40dec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:38.638 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:38.641+0000 7f286b40dec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-08T13:05:38.638 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:38.641+0000 7f286b40dec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:38.647 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:38.650+0000 7f286b40dec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T13:05:38.647 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:38.650+0000 7f286b40dec0 10 cannot find current period zonegroup using local zonegroup 2019-12-08T13:05:38.647 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:38.650+0000 7f286b40dec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:38.655 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:38.658+0000 7f286b40dec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T13:05:38.655 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:38.658+0000 7f286b40dec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:38.667 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:38.670+0000 7f286b40dec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T13:05:38.667 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:38.670+0000 7f286b40dec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:38.678 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:38.681+0000 7f286b40dec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-08T13:05:38.678 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:38.681+0000 7f286b40dec0 20 zonegroup default 2019-12-08T13:05:38.678 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:38.681+0000 7f286b40dec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:38.684 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:38.687+0000 7f286b40dec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T13:05:38.684 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:38.687+0000 7f286b40dec0 10 Cannot find current period zone using local zone 2019-12-08T13:05:38.684 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:38.687+0000 7f286b40dec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:38.690 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:38.693+0000 7f286b40dec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T13:05:38.690 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:38.693+0000 7f286b40dec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:38.701 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:38.704+0000 7f286b40dec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T13:05:38.701 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:38.704+0000 7f286b40dec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:38.711 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:38.714+0000 7f286b40dec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-08T13:05:38.711 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:38.714+0000 7f286b40dec0 20 zone default found 2019-12-08T13:05:38.712 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:38.714+0000 7f286b40dec0 20 started sync module instance, tier type = 2019-12-08T13:05:38.712 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:38.714+0000 7f286b40dec0 20 started zone id=f8ab349b-4577-410d-b524-4ecaf50bb1bd (name=default) with tier type = 2019-12-08T13:05:39.024 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:39.027+0000 7f286b40dec0 20 add_watcher() i=0 2019-12-08T13:05:39.024 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:39.027+0000 7f286b40dec0 20 add_watcher() i=1 2019-12-08T13:05:39.024 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:39.027+0000 7f286b40dec0 20 add_watcher() i=2 2019-12-08T13:05:39.024 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:39.027+0000 7f286b40dec0 20 add_watcher() i=3 2019-12-08T13:05:39.024 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:39.027+0000 7f286b40dec0 20 add_watcher() i=4 2019-12-08T13:05:39.024 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:39.027+0000 7f286b40dec0 20 add_watcher() i=5 2019-12-08T13:05:39.025 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:39.028+0000 7f286b40dec0 20 add_watcher() i=6 2019-12-08T13:05:39.052 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:39.055+0000 7f286b40dec0 20 add_watcher() i=7 2019-12-08T13:05:39.052 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:39.055+0000 7f286b40dec0 2 all 8 watchers are set, enabling cache 2019-12-08T13:05:39.052 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:39.055+0000 7f2828fe1700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-08T13:05:39.061 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:39.059+0000 7f2857e36700 0 -- 172.21.15.79:0/1983391687 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x556f90670df0 msgr2=0x556f90673300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-12-08T13:05:39.259 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:39.262+0000 7f2857e36700 0 --2- 172.21.15.79:0/1983391687 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x556f90670df0 0x556f90673300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2019-12-08T13:05:39.336 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:39.340+0000 7f2858e38700 0 -- 172.21.15.79:0/709765901 >> [v2:172.21.15.79:6800/9057,v1:172.21.15.79:6801/9057] conn(0x7f279c0224a0 msgr2=0x7f279c024990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-08T13:05:41.017 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:41.021+0000 7f279affd700 20 reqs_thread_entry: start 2019-12-08T13:05:41.017 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:41.021+0000 7f2798ff9700 20 reqs_thread_entry: start 2019-12-08T13:05:41.017 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:41.021+0000 7f286b40dec0 20 init_complete bucket index max shards: 0 2019-12-08T13:05:41.018 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:41.021+0000 7f278effd700 20 reqs_thread_entry: start 2019-12-08T13:05:41.018 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:41.021+0000 7f286b40dec0 20 get_system_obj_state: rctx=0x7ffdb4221348 obj=default.rgw.meta:users.uid:foo.client.0 state=0x556f906eb7d0 s->prefetch_data=0 2019-12-08T13:05:41.018 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:41.021+0000 7f286b40dec0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2019-12-08T13:05:41.029 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:41.033+0000 7f286b40dec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x16 2019-12-08T13:05:41.029 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:41.033+0000 7f286b40dec0 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-12-08T13:05:41.029 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:41.033+0000 7f286b40dec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-08T13:05:41.030 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:41.033+0000 7f286b40dec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-08T13:05:41.030 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:41.033+0000 7f286b40dec0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : type miss (requested=0x11, cached=0x16) 2019-12-08T13:05:41.030 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:41.033+0000 7f286b40dec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:41.041 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:41.045+0000 7f286b40dec0 20 rados_obj.operate() r=0 bl.length=432 2019-12-08T13:05:41.041 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:41.045+0000 7f286b40dec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x11 2019-12-08T13:05:41.041 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:41.045+0000 7f286b40dec0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-12-08T13:05:41.143 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:41.147+0000 7f286b40dec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2019-12-08T13:05:41.144 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:41.147+0000 7f286b40dec0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-12-08T13:05:41.144 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:41.147+0000 7f286b40dec0 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=631 2019-12-08T13:05:41.154 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:41.158+0000 7f283dffb700 10 RGWWatcher::handle_notify() notify_id 584115552316 cookie 93937652307040 notifier 4613 bl.length()=631 2019-12-08T13:05:41.154 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:41.158+0000 7f283dffb700 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2019-12-08T13:05:41.154 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:41.158+0000 7f283dffb700 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-12-08T13:05:41.693 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:41.697+0000 7f286b40dec0 20 remove_watcher() i=0 2019-12-08T13:05:41.693 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:41.697+0000 7f286b40dec0 2 removed watcher, disabling cache 2019-12-08T13:05:41.763 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:41.767+0000 7f286b40dec0 20 remove_watcher() i=1 2019-12-08T13:05:41.833 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:41.837+0000 7f286b40dec0 20 remove_watcher() i=2 2019-12-08T13:05:41.906 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:41.910+0000 7f286b40dec0 20 remove_watcher() i=3 2019-12-08T13:05:41.936 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:41.940+0000 7f286b40dec0 20 remove_watcher() i=4 2019-12-08T13:05:41.975 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:41.980+0000 7f286b40dec0 20 remove_watcher() i=5 2019-12-08T13:05:42.013 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:42.017+0000 7f286b40dec0 20 remove_watcher() i=6 2019-12-08T13:05:42.061 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:42.065+0000 7f286b40dec0 20 remove_watcher() i=7 2019-12-08T13:05:42.070 DEBUG:tasks.s3tests:Creating user testx$tenanteduser.client.0 on client.0 2019-12-08T13:05:42.070 INFO:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid 'testx$tenanteduser.client.0' --display-name 'Mr. testx$tenanteduser.client.0' --access-key XOAOYEVBLUJWADDSYXFV --secret rV0SWru9LmLtoHcl0OVBWemG+0044HgT3wDaME1StHIDymI3va9k5Q== --email 'testx$tenanteduser.client.0+test@test.test' --cluster ceph 2019-12-08T13:05:42.198 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:42.202+0000 7fa58dd31ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:42.239 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:42.243+0000 7fa58dd31ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T13:05:42.240 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:42.243+0000 7fa58dd31ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:42.245 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:42.249+0000 7fa58dd31ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T13:05:42.245 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:42.249+0000 7fa58dd31ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:42.253 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:42.257+0000 7fa58dd31ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T13:05:42.253 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:42.257+0000 7fa58dd31ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:42.292 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:42.296+0000 7fa58dd31ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T13:05:42.548 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:42.552+0000 7fa58dd31ec0 20 RGWRados::pool_iterate: got zonegroup_info.fee0148b-7ae2-4cf0-a79e-86045a29cb7c 2019-12-08T13:05:42.549 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:42.552+0000 7fa58dd31ec0 20 RGWRados::pool_iterate: got zone_info.f8ab349b-4577-410d-b524-4ecaf50bb1bd 2019-12-08T13:05:42.549 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:42.552+0000 7fa58dd31ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-08T13:05:42.549 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:42.552+0000 7fa58dd31ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-08T13:05:42.549 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:42.552+0000 7fa58dd31ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:42.565 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:42.569+0000 7fa58dd31ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T13:05:42.566 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:42.569+0000 7fa58dd31ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:42.578 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:42.582+0000 7fa58dd31ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-08T13:05:42.578 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:42.582+0000 7fa58dd31ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:42.586 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:42.590+0000 7fa58dd31ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T13:05:42.586 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:42.590+0000 7fa58dd31ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:42.604 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:42.608+0000 7fa58dd31ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-08T13:05:42.604 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:42.608+0000 7fa58dd31ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:42.610 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:42.614+0000 7fa58dd31ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T13:05:42.610 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:42.614+0000 7fa58dd31ec0 10 cannot find current period zonegroup using local zonegroup 2019-12-08T13:05:42.610 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:42.614+0000 7fa58dd31ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:42.615 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:42.619+0000 7fa58dd31ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T13:05:42.615 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:42.619+0000 7fa58dd31ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:42.635 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:42.639+0000 7fa58dd31ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T13:05:42.635 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:42.639+0000 7fa58dd31ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:42.649 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:42.652+0000 7fa58dd31ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-08T13:05:42.649 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:42.652+0000 7fa58dd31ec0 20 zonegroup default 2019-12-08T13:05:42.649 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:42.653+0000 7fa58dd31ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:42.654 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:42.658+0000 7fa58dd31ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T13:05:42.654 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:42.658+0000 7fa58dd31ec0 10 Cannot find current period zone using local zone 2019-12-08T13:05:42.654 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:42.658+0000 7fa58dd31ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:42.658 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:42.662+0000 7fa58dd31ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T13:05:42.659 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:42.662+0000 7fa58dd31ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:42.675 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:42.679+0000 7fa58dd31ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T13:05:42.675 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:42.679+0000 7fa58dd31ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:42.685 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:42.689+0000 7fa58dd31ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-08T13:05:42.686 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:42.689+0000 7fa58dd31ec0 20 zone default found 2019-12-08T13:05:42.686 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:42.689+0000 7fa58dd31ec0 20 started sync module instance, tier type = 2019-12-08T13:05:42.686 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:42.689+0000 7fa58dd31ec0 20 started zone id=f8ab349b-4577-410d-b524-4ecaf50bb1bd (name=default) with tier type = 2019-12-08T13:05:42.985 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:42.989+0000 7fa58dd31ec0 20 add_watcher() i=0 2019-12-08T13:05:42.985 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:42.989+0000 7fa58dd31ec0 20 add_watcher() i=1 2019-12-08T13:05:42.985 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:42.989+0000 7fa58dd31ec0 20 add_watcher() i=2 2019-12-08T13:05:42.985 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:42.989+0000 7fa58dd31ec0 20 add_watcher() i=3 2019-12-08T13:05:42.986 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:42.989+0000 7fa58dd31ec0 20 add_watcher() i=4 2019-12-08T13:05:42.986 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:42.989+0000 7fa58dd31ec0 20 add_watcher() i=5 2019-12-08T13:05:42.986 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:42.989+0000 7fa58dd31ec0 20 add_watcher() i=6 2019-12-08T13:05:43.014 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:43.018+0000 7fa58dd31ec0 20 add_watcher() i=7 2019-12-08T13:05:43.014 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:43.018+0000 7fa58dd31ec0 2 all 8 watchers are set, enabling cache 2019-12-08T13:05:43.014 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:43.018+0000 7fa54b7de700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-08T13:05:43.020 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:43.024+0000 7fa57a75a700 0 -- 172.21.15.79:0/1145805669 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x560b83443c10 msgr2=0x560b83446120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-12-08T13:05:43.053 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:43.058+0000 7fa57af5b700 0 -- 172.21.15.79:0/1476886706 >> [v2:172.21.15.79:6800/9057,v1:172.21.15.79:6801/9057] conn(0x7fa4bc0224a0 msgr2=0x7fa4bc024990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-08T13:05:44.618 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:44.621+0000 7fa4b9ffb700 20 reqs_thread_entry: start 2019-12-08T13:05:44.618 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:44.621+0000 7fa4b3fff700 20 reqs_thread_entry: start 2019-12-08T13:05:44.618 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:44.622+0000 7fa58dd31ec0 20 init_complete bucket index max shards: 0 2019-12-08T13:05:44.619 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:44.622+0000 7fa4b27fc700 20 reqs_thread_entry: start 2019-12-08T13:05:44.619 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:44.622+0000 7fa58dd31ec0 20 get_system_obj_state: rctx=0x7ffe773a7438 obj=default.rgw.meta:users.uid:testx$tenanteduser.client.0 state=0x560b834bfa80 s->prefetch_data=0 2019-12-08T13:05:44.619 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:44.622+0000 7fa58dd31ec0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2019-12-08T13:05:44.625 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:44.629+0000 7fa58dd31ec0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x0 2019-12-08T13:05:44.625 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:44.629+0000 7fa58dd31ec0 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-12-08T13:05:44.626 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:44.629+0000 7fa58dd31ec0 20 get_system_obj_state: rctx=0x7ffe773a7448 obj=default.rgw.meta:users.email:testx$tenanteduser.client.0+test@test.test state=0x560b834c1830 s->prefetch_data=0 2019-12-08T13:05:44.626 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:44.629+0000 7fa58dd31ec0 10 cache get: name=default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test : miss 2019-12-08T13:05:44.631 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:44.635+0000 7fa58dd31ec0 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test info.flags=0x0 2019-12-08T13:05:44.631 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:44.635+0000 7fa58dd31ec0 10 adding default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test to cache LRU end 2019-12-08T13:05:44.631 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:44.635+0000 7fa58dd31ec0 20 get_system_obj_state: rctx=0x7ffe773a7448 obj=default.rgw.meta:users.keys:XOAOYEVBLUJWADDSYXFV state=0x560b834c1830 s->prefetch_data=0 2019-12-08T13:05:44.631 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:44.635+0000 7fa58dd31ec0 10 cache get: name=default.rgw.meta+users.keys+XOAOYEVBLUJWADDSYXFV : miss 2019-12-08T13:05:44.640 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:44.644+0000 7fa58dd31ec0 10 cache put: name=default.rgw.meta+users.keys+XOAOYEVBLUJWADDSYXFV info.flags=0x0 2019-12-08T13:05:44.640 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:44.644+0000 7fa58dd31ec0 10 adding default.rgw.meta+users.keys+XOAOYEVBLUJWADDSYXFV to cache LRU end 2019-12-08T13:05:44.640 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:44.644+0000 7fa58dd31ec0 20 get_system_obj_state: rctx=0x7ffe773a7058 obj=default.rgw.meta:users.keys:XOAOYEVBLUJWADDSYXFV state=0x560b834c1830 s->prefetch_data=0 2019-12-08T13:05:44.640 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:44.644+0000 7fa58dd31ec0 10 cache get: name=default.rgw.meta+users.keys+XOAOYEVBLUJWADDSYXFV : type miss (requested=0x6, cached=0x0) 2019-12-08T13:05:44.651 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:44.655+0000 7fa58dd31ec0 10 cache put: name=default.rgw.meta+users.keys+XOAOYEVBLUJWADDSYXFV info.flags=0x0 2019-12-08T13:05:44.651 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:44.655+0000 7fa58dd31ec0 10 moving default.rgw.meta+users.keys+XOAOYEVBLUJWADDSYXFV to cache LRU end 2019-12-08T13:05:44.651 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:44.655+0000 7fa58dd31ec0 20 get_system_obj_state: rctx=0x7ffe773a71d8 obj=default.rgw.meta:users.keys:XOAOYEVBLUJWADDSYXFV state=0x560b834c1830 s->prefetch_data=0 2019-12-08T13:05:44.651 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:44.655+0000 7fa58dd31ec0 10 cache get: name=default.rgw.meta+users.keys+XOAOYEVBLUJWADDSYXFV : type miss (requested=0x6, cached=0x0) 2019-12-08T13:05:44.659 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:44.663+0000 7fa58dd31ec0 10 cache put: name=default.rgw.meta+users.keys+XOAOYEVBLUJWADDSYXFV info.flags=0x0 2019-12-08T13:05:44.659 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:44.663+0000 7fa58dd31ec0 10 moving default.rgw.meta+users.keys+XOAOYEVBLUJWADDSYXFV to cache LRU end 2019-12-08T13:05:44.715 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:44.719+0000 7fa58dd31ec0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2019-12-08T13:05:44.715 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:44.719+0000 7fa58dd31ec0 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-12-08T13:05:44.715 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:44.719+0000 7fa58dd31ec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=691 2019-12-08T13:05:44.742 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:44.746+0000 7fa55bfff700 10 RGWWatcher::handle_notify() notify_id 584115552319 cookie 94607446832016 notifier 5050 bl.length()=691 2019-12-08T13:05:44.743 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:44.746+0000 7fa55bfff700 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2019-12-08T13:05:44.743 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:44.746+0000 7fa55bfff700 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-12-08T13:05:44.924 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:44.928+0000 7fa58dd31ec0 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test info.flags=0x7 2019-12-08T13:05:44.925 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:44.928+0000 7fa58dd31ec0 10 moving default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test to cache LRU end 2019-12-08T13:05:44.925 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:44.928+0000 7fa58dd31ec0 10 distributing notification oid=default.rgw.control:notify.7 bl.length()=224 2019-12-08T13:05:44.935 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:44.939+0000 7fa55bfff700 10 RGWWatcher::handle_notify() notify_id 584115552317 cookie 94607446836816 notifier 5050 bl.length()=224 2019-12-08T13:05:44.935 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:44.939+0000 7fa55bfff700 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test info.flags=0x7 2019-12-08T13:05:44.935 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:44.939+0000 7fa55bfff700 10 moving default.rgw.meta+users.email+testx$tenanteduser.client.0+test@test.test to cache LRU end 2019-12-08T13:05:45.077 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:45.080+0000 7fa58dd31ec0 10 cache put: name=default.rgw.meta+users.keys+XOAOYEVBLUJWADDSYXFV info.flags=0x7 2019-12-08T13:05:45.077 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:45.080+0000 7fa58dd31ec0 10 moving default.rgw.meta+users.keys+XOAOYEVBLUJWADDSYXFV to cache LRU end 2019-12-08T13:05:45.077 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:45.080+0000 7fa58dd31ec0 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=201 2019-12-08T13:05:45.085 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:45.089+0000 7fa55bfff700 10 RGWWatcher::handle_notify() notify_id 584115552318 cookie 94607446819504 notifier 5050 bl.length()=201 2019-12-08T13:05:45.085 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:45.089+0000 7fa55bfff700 10 cache put: name=default.rgw.meta+users.keys+XOAOYEVBLUJWADDSYXFV info.flags=0x7 2019-12-08T13:05:45.085 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:45.089+0000 7fa55bfff700 10 moving default.rgw.meta+users.keys+XOAOYEVBLUJWADDSYXFV to cache LRU end 2019-12-08T13:05:45.290 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2019-12-08T13:05:45.290 INFO:teuthology.orchestra.run.smithi079.stdout: "user_id": "testx$tenanteduser.client.0", 2019-12-08T13:05:45.291 INFO:teuthology.orchestra.run.smithi079.stdout: "display_name": "Mr. testx$tenanteduser.client.0", 2019-12-08T13:05:45.291 INFO:teuthology.orchestra.run.smithi079.stdout: "email": "testx$tenanteduser.client.0+test@test.test", 2019-12-08T13:05:45.291 INFO:teuthology.orchestra.run.smithi079.stdout: "suspended": 0, 2019-12-08T13:05:45.291 INFO:teuthology.orchestra.run.smithi079.stdout: "max_buckets": 1000, 2019-12-08T13:05:45.291 INFO:teuthology.orchestra.run.smithi079.stdout: "subusers": [], 2019-12-08T13:05:45.291 INFO:teuthology.orchestra.run.smithi079.stdout: "keys": [ 2019-12-08T13:05:45.292 INFO:teuthology.orchestra.run.smithi079.stdout: { 2019-12-08T13:05:45.292 INFO:teuthology.orchestra.run.smithi079.stdout: "user": "testx$tenanteduser.client.0", 2019-12-08T13:05:45.292 INFO:teuthology.orchestra.run.smithi079.stdout: "access_key": "XOAOYEVBLUJWADDSYXFV", 2019-12-08T13:05:45.292 INFO:teuthology.orchestra.run.smithi079.stdout: "secret_key": "rV0SWru9LmLtoHcl0OVBWemG+0044HgT3wDaME1StHIDymI3va9k5Q==" 2019-12-08T13:05:45.292 INFO:teuthology.orchestra.run.smithi079.stdout: } 2019-12-08T13:05:45.292 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2019-12-08T13:05:45.292 INFO:teuthology.orchestra.run.smithi079.stdout: "swift_keys": [], 2019-12-08T13:05:45.293 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": [], 2019-12-08T13:05:45.293 INFO:teuthology.orchestra.run.smithi079.stdout: "op_mask": "read, write, delete", 2019-12-08T13:05:45.293 INFO:teuthology.orchestra.run.smithi079.stdout: "default_placement": "", 2019-12-08T13:05:45.293 INFO:teuthology.orchestra.run.smithi079.stdout: "default_storage_class": "", 2019-12-08T13:05:45.293 INFO:teuthology.orchestra.run.smithi079.stdout: "placement_tags": [], 2019-12-08T13:05:45.293 INFO:teuthology.orchestra.run.smithi079.stdout: "bucket_quota": { 2019-12-08T13:05:45.293 INFO:teuthology.orchestra.run.smithi079.stdout: "enabled": false, 2019-12-08T13:05:45.294 INFO:teuthology.orchestra.run.smithi079.stdout: "check_on_raw": false, 2019-12-08T13:05:45.294 INFO:teuthology.orchestra.run.smithi079.stdout: "max_size": -1, 2019-12-08T13:05:45.294 INFO:teuthology.orchestra.run.smithi079.stdout: "max_size_kb": 0, 2019-12-08T13:05:45.294 INFO:teuthology.orchestra.run.smithi079.stdout: "max_objects": -1 2019-12-08T13:05:45.294 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2019-12-08T13:05:45.294 INFO:teuthology.orchestra.run.smithi079.stdout: "user_quota": { 2019-12-08T13:05:45.295 INFO:teuthology.orchestra.run.smithi079.stdout: "enabled": false, 2019-12-08T13:05:45.295 INFO:teuthology.orchestra.run.smithi079.stdout: "check_on_raw": false, 2019-12-08T13:05:45.295 INFO:teuthology.orchestra.run.smithi079.stdout: "max_size": -1, 2019-12-08T13:05:45.295 INFO:teuthology.orchestra.run.smithi079.stdout: "max_size_kb": 0, 2019-12-08T13:05:45.295 INFO:teuthology.orchestra.run.smithi079.stdout: "max_objects": -1 2019-12-08T13:05:45.295 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2019-12-08T13:05:45.295 INFO:teuthology.orchestra.run.smithi079.stdout: "temp_url_keys": [], 2019-12-08T13:05:45.295 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "rgw", 2019-12-08T13:05:45.296 INFO:teuthology.orchestra.run.smithi079.stdout: "mfa_ids": [] 2019-12-08T13:05:45.296 INFO:teuthology.orchestra.run.smithi079.stdout:} 2019-12-08T13:05:45.296 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T13:05:45.353 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:45.357+0000 7fa58dd31ec0 20 remove_watcher() i=0 2019-12-08T13:05:45.353 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:45.357+0000 7fa58dd31ec0 2 removed watcher, disabling cache 2019-12-08T13:05:45.411 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:45.415+0000 7fa58dd31ec0 20 remove_watcher() i=1 2019-12-08T13:05:45.486 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:45.490+0000 7fa58dd31ec0 20 remove_watcher() i=2 2019-12-08T13:05:45.531 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:45.535+0000 7fa58dd31ec0 20 remove_watcher() i=3 2019-12-08T13:05:45.595 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:45.599+0000 7fa58dd31ec0 20 remove_watcher() i=4 2019-12-08T13:05:45.650 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:45.654+0000 7fa58dd31ec0 20 remove_watcher() i=5 2019-12-08T13:05:45.687 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:45.691+0000 7fa58dd31ec0 20 remove_watcher() i=6 2019-12-08T13:05:45.731 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:45.735+0000 7fa58dd31ec0 20 remove_watcher() i=7 2019-12-08T13:05:45.737 INFO:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid 'testx$tenanteduser.client.0' --totp-serial 2729415123 --totp-seed FXHQWWD6MCCLRC45PE7GI5OQSLIJ7OGGSMDHKAPIOUUYBWLJS2UDGXYTIFQRV457 --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2019-12-08T13:05:45.862 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:45.866+0000 7f8f541c8ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:45.884 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:45.888+0000 7f8f541c8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T13:05:45.885 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:45.888+0000 7f8f541c8ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:45.893 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:45.897+0000 7f8f541c8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T13:05:45.893 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:45.897+0000 7f8f541c8ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:45.901 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:45.905+0000 7f8f541c8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T13:05:45.902 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:45.905+0000 7f8f541c8ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:45.916 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:45.920+0000 7f8f541c8ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T13:05:46.100 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:46.104+0000 7f8f541c8ec0 20 RGWRados::pool_iterate: got zonegroup_info.fee0148b-7ae2-4cf0-a79e-86045a29cb7c 2019-12-08T13:05:46.101 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:46.104+0000 7f8f541c8ec0 20 RGWRados::pool_iterate: got zone_info.f8ab349b-4577-410d-b524-4ecaf50bb1bd 2019-12-08T13:05:46.101 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:46.104+0000 7f8f541c8ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-08T13:05:46.101 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:46.104+0000 7f8f541c8ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-08T13:05:46.101 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:46.104+0000 7f8f541c8ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:46.114 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:46.118+0000 7f8f541c8ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T13:05:46.114 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:46.118+0000 7f8f541c8ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:46.129 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:46.133+0000 7f8f541c8ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-08T13:05:46.129 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:46.133+0000 7f8f541c8ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:46.140 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:46.144+0000 7f8f541c8ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T13:05:46.140 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:46.144+0000 7f8f541c8ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:46.153 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:46.157+0000 7f8f541c8ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-08T13:05:46.153 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:46.157+0000 7f8f541c8ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:46.162 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:46.166+0000 7f8f541c8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T13:05:46.162 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:46.166+0000 7f8f541c8ec0 10 cannot find current period zonegroup using local zonegroup 2019-12-08T13:05:46.162 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:46.166+0000 7f8f541c8ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:46.168 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:46.172+0000 7f8f541c8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T13:05:46.168 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:46.172+0000 7f8f541c8ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:46.182 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:46.186+0000 7f8f541c8ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T13:05:46.182 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:46.186+0000 7f8f541c8ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:46.193 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:46.197+0000 7f8f541c8ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-08T13:05:46.193 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:46.197+0000 7f8f541c8ec0 20 zonegroup default 2019-12-08T13:05:46.193 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:46.197+0000 7f8f541c8ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:46.202 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:46.206+0000 7f8f541c8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T13:05:46.202 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:46.206+0000 7f8f541c8ec0 10 Cannot find current period zone using local zone 2019-12-08T13:05:46.202 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:46.206+0000 7f8f541c8ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:46.211 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:46.215+0000 7f8f541c8ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T13:05:46.211 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:46.215+0000 7f8f541c8ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:46.222 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:46.226+0000 7f8f541c8ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T13:05:46.223 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:46.226+0000 7f8f541c8ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:46.231 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:46.235+0000 7f8f541c8ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-08T13:05:46.231 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:46.235+0000 7f8f541c8ec0 20 zone default found 2019-12-08T13:05:46.232 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:46.235+0000 7f8f541c8ec0 20 started sync module instance, tier type = 2019-12-08T13:05:46.232 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:46.235+0000 7f8f541c8ec0 20 started zone id=f8ab349b-4577-410d-b524-4ecaf50bb1bd (name=default) with tier type = 2019-12-08T13:05:46.391 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:01:03:11.094 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T13:05:46.400 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:01:03:11.103 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T13:05:46.405 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:01:03:11.043 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T13:05:46.408 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:01:03:11.046 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T13:05:46.412 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:01:03:11.050 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T13:05:46.415 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:01:03:11.053 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T13:05:46.566 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:01:03:11.203 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T13:05:46.569 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:01:03:11.206 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T13:05:46.569 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:01:03:11.271 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T13:05:46.578 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:46.582+0000 7f8f541c8ec0 20 add_watcher() i=0 2019-12-08T13:05:46.578 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:46.582+0000 7f8f541c8ec0 20 add_watcher() i=1 2019-12-08T13:05:46.578 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:46.582+0000 7f8f541c8ec0 20 add_watcher() i=2 2019-12-08T13:05:46.578 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:46.582+0000 7f8f541c8ec0 20 add_watcher() i=3 2019-12-08T13:05:46.578 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:46.582+0000 7f8f541c8ec0 20 add_watcher() i=4 2019-12-08T13:05:46.579 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:46.582+0000 7f8f541c8ec0 20 add_watcher() i=5 2019-12-08T13:05:46.579 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:46.582+0000 7f8f541c8ec0 20 add_watcher() i=6 2019-12-08T13:05:46.611 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:46.615+0000 7f8f541c8ec0 20 add_watcher() i=7 2019-12-08T13:05:46.612 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:46.615+0000 7f8f541c8ec0 2 all 8 watchers are set, enabling cache 2019-12-08T13:05:46.612 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:46.616+0000 7f8f11fdb700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-08T13:05:46.629 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:46.633+0000 7f8f41bf3700 0 -- 172.21.15.79:0/1808766377 >> v2:172.21.15.79:3300/0 conn(0x559b56ff7e10 msgr2=0x559b56ff8220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=0)._try_send injecting socket failure 2019-12-08T13:05:46.839 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:46.843+0000 7f8f41bf3700 0 --2- 172.21.15.79:0/1808766377 >> v2:172.21.15.79:3300/0 conn(0x559b56ff7e10 0x559b56ff8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2019-12-08T13:05:46.969 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:46.973+0000 7f8f413f2700 0 -- 172.21.15.79:0/3248229475 >> v1:172.21.15.13:6789/0 conn(0x559b56f07cd0 legacy=0x559b56f080e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-08T13:05:48.428 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:48.432+0000 7f8e83fff700 20 reqs_thread_entry: start 2019-12-08T13:05:48.428 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:48.432+0000 7f8e81ffb700 20 reqs_thread_entry: start 2019-12-08T13:05:48.429 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:48.432+0000 7f8f541c8ec0 20 init_complete bucket index max shards: 0 2019-12-08T13:05:48.429 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:48.433+0000 7f8e6ffff700 20 reqs_thread_entry: start 2019-12-08T13:05:48.429 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:48.433+0000 7f8f541c8ec0 20 get_system_obj_state: rctx=0x7ffe5f4947b8 obj=default.rgw.meta:users.uid:testx$tenanteduser.client.0 state=0x559b57083450 s->prefetch_data=0 2019-12-08T13:05:48.430 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:48.433+0000 7f8f541c8ec0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2019-12-08T13:05:48.456 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:48.460+0000 7f8f541c8ec0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x16 2019-12-08T13:05:48.456 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:48.460+0000 7f8f541c8ec0 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-12-08T13:05:48.456 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:48.460+0000 7f8f541c8ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-08T13:05:48.456 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:48.460+0000 7f8f541c8ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-08T13:05:48.457 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:48.460+0000 7f8f541c8ec0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : type miss (requested=0x11, cached=0x16) 2019-12-08T13:05:48.457 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:48.460+0000 7f8f541c8ec0 20 rados->read ofs=0 len=0 2019-12-08T13:05:48.481 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:48.485+0000 7f8f541c8ec0 20 rados_obj.operate() r=0 bl.length=491 2019-12-08T13:05:48.481 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:48.485+0000 7f8f541c8ec0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x11 2019-12-08T13:05:48.481 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:48.485+0000 7f8f541c8ec0 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-12-08T13:05:48.630 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:48.634+0000 7f8f541c8ec0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2019-12-08T13:05:48.630 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:48.634+0000 7f8f541c8ec0 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-12-08T13:05:48.630 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:48.634+0000 7f8f541c8ec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=705 2019-12-08T13:05:48.650 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:48.654+0000 7f8f227fc700 10 RGWWatcher::handle_notify() notify_id 584115552320 cookie 94125667820768 notifier 5068 bl.length()=705 2019-12-08T13:05:48.650 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:48.654+0000 7f8f227fc700 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2019-12-08T13:05:48.651 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:48.654+0000 7f8f227fc700 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-12-08T13:05:48.770 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:48.774+0000 7f8f541c8ec0 20 remove_watcher() i=0 2019-12-08T13:05:48.771 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:48.774+0000 7f8f541c8ec0 2 removed watcher, disabling cache 2019-12-08T13:05:48.856 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:48.860+0000 7f8f541c8ec0 20 remove_watcher() i=1 2019-12-08T13:05:48.939 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:48.943+0000 7f8f541c8ec0 20 remove_watcher() i=2 2019-12-08T13:05:48.987 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:48.991+0000 7f8f541c8ec0 20 remove_watcher() i=3 2019-12-08T13:05:49.033 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:49.037+0000 7f8f541c8ec0 20 remove_watcher() i=4 2019-12-08T13:05:49.072 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:49.076+0000 7f8f541c8ec0 20 remove_watcher() i=5 2019-12-08T13:05:49.130 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:49.134+0000 7f8f541c8ec0 20 remove_watcher() i=6 2019-12-08T13:05:49.180 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T13:05:49.184+0000 7f8f541c8ec0 20 remove_watcher() i=7 2019-12-08T13:05:49.188 INFO:tasks.s3tests:Configuring s3-tests... 2019-12-08T13:05:49.189 INFO:teuthology.orchestra.run.smithi079:> cd /home/ubuntu/cephtest/s3-tests && ./bootstrap 2019-12-08T13:05:55.448 INFO:teuthology.orchestra.run.smithi079.stderr:./bootstrap: missing required RPM packages. Installing via sudo. 2019-12-08T13:05:55.613 INFO:teuthology.orchestra.run.smithi079.stdout:Loaded plugins: fastestmirror, langpacks, priorities 2019-12-08T13:05:55.653 INFO:teuthology.orchestra.run.smithi079.stdout:Loading mirror speeds from cached hostfile 2019-12-08T13:05:55.654 INFO:teuthology.orchestra.run.smithi079.stdout: * base: mirrors.umflint.edu 2019-12-08T13:05:55.654 INFO:teuthology.orchestra.run.smithi079.stdout: * epel: download-cc-rdu01.fedoraproject.org 2019-12-08T13:05:55.655 INFO:teuthology.orchestra.run.smithi079.stdout: * extras: mirror.facebook.net 2019-12-08T13:05:55.655 INFO:teuthology.orchestra.run.smithi079.stdout: * updates: mirror.math.princeton.edu 2019-12-08T13:05:56.317 INFO:teuthology.orchestra.run.smithi079.stdout:7 packages excluded due to repository priority protections 2019-12-08T13:05:56.663 INFO:teuthology.orchestra.run.smithi079.stdout:Resolving Dependencies 2019-12-08T13:05:56.664 INFO:teuthology.orchestra.run.smithi079.stdout:--> Running transaction check 2019-12-08T13:05:56.664 INFO:teuthology.orchestra.run.smithi079.stdout:---> Package libffi-devel.x86_64 0:3.0.13-18.el7 will be installed 2019-12-08T13:05:57.069 INFO:teuthology.orchestra.run.smithi079.stdout:--> Finished Dependency Resolution 2019-12-08T13:05:57.299 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T13:05:57.299 INFO:teuthology.orchestra.run.smithi079.stdout:Dependencies Resolved 2019-12-08T13:05:57.300 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T13:05:57.300 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2019-12-08T13:05:57.300 INFO:teuthology.orchestra.run.smithi079.stdout: Package Arch Version Repository Size 2019-12-08T13:05:57.300 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2019-12-08T13:05:57.301 INFO:teuthology.orchestra.run.smithi079.stdout:Installing: 2019-12-08T13:05:57.301 INFO:teuthology.orchestra.run.smithi079.stdout: libffi-devel x86_64 3.0.13-18.el7 base 23 k 2019-12-08T13:05:57.301 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T13:05:57.301 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction Summary 2019-12-08T13:05:57.301 INFO:teuthology.orchestra.run.smithi079.stdout:================================================================================ 2019-12-08T13:05:57.301 INFO:teuthology.orchestra.run.smithi079.stdout:Install 1 Package 2019-12-08T13:05:57.301 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T13:05:57.302 INFO:teuthology.orchestra.run.smithi079.stdout:Total download size: 23 k 2019-12-08T13:05:57.302 INFO:teuthology.orchestra.run.smithi079.stdout:Installed size: 27 k 2019-12-08T13:05:57.302 INFO:teuthology.orchestra.run.smithi079.stdout:Downloading packages: 2019-12-08T13:05:57.427 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction check 2019-12-08T13:05:57.433 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction test 2019-12-08T13:05:57.435 INFO:teuthology.orchestra.run.smithi079.stdout:Transaction test succeeded 2019-12-08T13:05:57.435 INFO:teuthology.orchestra.run.smithi079.stdout:Running transaction 2019-12-08T13:05:58.017 INFO:teuthology.orchestra.run.smithi079.stdout: Installing : libffi-devel-3.0.13-18.el7.x86_64 1/1 2019-12-08T13:05:58.435 INFO:teuthology.orchestra.run.smithi079.stdout: Verifying : libffi-devel-3.0.13-18.el7.x86_64 1/1 2019-12-08T13:05:58.435 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T13:05:58.435 INFO:teuthology.orchestra.run.smithi079.stdout:Installed: 2019-12-08T13:05:58.436 INFO:teuthology.orchestra.run.smithi079.stdout: libffi-devel.x86_64 0:3.0.13-18.el7 2019-12-08T13:05:58.436 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T13:05:58.436 INFO:teuthology.orchestra.run.smithi079.stdout:Complete! 2019-12-08T13:05:58.593 INFO:teuthology.orchestra.run.smithi079.stdout:New python executable in /home/ubuntu/cephtest/s3-tests/virtualenv/bin/python 2019-12-08T13:05:59.861 INFO:teuthology.orchestra.run.smithi079.stdout:Installing setuptools, pip, wheel...done. 2019-12-08T13:06:00.177 INFO:teuthology.orchestra.run.smithi079.stderr:Cache entry deserialization failed, entry ignored 2019-12-08T13:06:00.317 INFO:teuthology.orchestra.run.smithi079.stdout:Collecting pip 2019-12-08T13:06:00.399 INFO:teuthology.orchestra.run.smithi079.stdout: Using cached https://files.pythonhosted.org/packages/00/b6/9cfa56b4081ad13874b0c6f96af8ce16cfbc1cb06bedf8e9164ce5551ec1/pip-19.3.1-py2.py3-none-any.whl 2019-12-08T13:06:00.467 INFO:teuthology.orchestra.run.smithi079.stdout:Installing collected packages: pip 2019-12-08T13:06:00.467 INFO:teuthology.orchestra.run.smithi079.stdout: Found existing installation: pip 9.0.1 2019-12-08T13:06:00.531 INFO:teuthology.orchestra.run.smithi079.stdout: Uninstalling pip-9.0.1: 2019-12-08T13:06:00.575 INFO:teuthology.orchestra.run.smithi079.stdout: Successfully uninstalled pip-9.0.1 2019-12-08T13:06:01.190 INFO:teuthology.orchestra.run.smithi079.stdout:Successfully installed pip-19.3.1 2019-12-08T13:06:01.451 INFO:teuthology.orchestra.run.smithi079.stderr:DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support 2019-12-08T13:06:02.002 INFO:teuthology.orchestra.run.smithi079.stdout:Collecting setuptools==32.3.1 2019-12-08T13:06:02.005 INFO:teuthology.orchestra.run.smithi079.stdout: Using cached https://files.pythonhosted.org/packages/69/19/b1dff551058ce79d88b1e3688f1c735590d7ddf44d10681512133b35019f/setuptools-32.3.1-py2.py3-none-any.whl 2019-12-08T13:06:02.051 INFO:teuthology.orchestra.run.smithi079.stdout:Installing collected packages: setuptools 2019-12-08T13:06:02.051 INFO:teuthology.orchestra.run.smithi079.stdout: Found existing installation: setuptools 28.8.0 2019-12-08T13:06:02.066 INFO:teuthology.orchestra.run.smithi079.stdout: Uninstalling setuptools-28.8.0: 2019-12-08T13:06:02.075 INFO:teuthology.orchestra.run.smithi079.stdout: Successfully uninstalled setuptools-28.8.0 2019-12-08T13:06:02.202 INFO:teuthology.orchestra.run.smithi079.stdout:Successfully installed setuptools-32.3.1 2019-12-08T13:06:02.674 INFO:teuthology.orchestra.run.smithi079.stderr:DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support 2019-12-08T13:06:02.904 INFO:teuthology.orchestra.run.smithi079.stdout:Processing /home/ubuntu/.cache/pip/wheels/54/b7/c7/2ada654ee54483c9329871665aaf4a6056c3ce36f29cf66e67/PyYAML-5.2-cp27-cp27mu-linux_x86_64.whl 2019-12-08T13:06:02.971 INFO:teuthology.orchestra.run.smithi079.stdout:Collecting nose>=1.0.0 2019-12-08T13:06:02.974 INFO:teuthology.orchestra.run.smithi079.stdout: Using cached https://files.pythonhosted.org/packages/99/4f/13fb671119e65c4dce97c60e67d3fd9e6f7f809f2b307e2611f4701205cb/nose-1.3.7-py2-none-any.whl 2019-12-08T13:06:03.083 INFO:teuthology.orchestra.run.smithi079.stdout:Collecting boto>=2.6.0 2019-12-08T13:06:03.090 INFO:teuthology.orchestra.run.smithi079.stdout: Using cached https://files.pythonhosted.org/packages/23/10/c0b78c27298029e4454a472a1919bde20cb182dab1662cec7f2ca1dcc523/boto-2.49.0-py2.py3-none-any.whl 2019-12-08T13:06:03.601 INFO:teuthology.orchestra.run.smithi079.stdout:Collecting boto3>=1.0.0 2019-12-08T13:06:03.678 INFO:teuthology.orchestra.run.smithi079.stdout: Downloading https://files.pythonhosted.org/packages/1f/a5/6b25e39aea40bc03163615c07572d90aaddc9951f5af9c21204d3da46398/boto3-1.10.34-py2.py3-none-any.whl (128kB) 2019-12-08T13:06:03.802 INFO:teuthology.orchestra.run.smithi079.stdout:Processing /home/ubuntu/.cache/pip/wheels/56/0f/19/fbbf81e5764e6d8b74501c4357a88c14c94466ec777c03734c/bunch-1.0.1-cp27-none-any.whl 2019-12-08T13:06:04.084 INFO:teuthology.orchestra.run.smithi079.stdout:Collecting gevent>=1.0 2019-12-08T13:06:04.102 INFO:teuthology.orchestra.run.smithi079.stdout: Using cached https://files.pythonhosted.org/packages/e6/e9/3a693414f706e12abe60554cd73c5ae8f848b182ae58018f93d86c9eb418/gevent-1.4.0-cp27-cp27mu-manylinux1_x86_64.whl 2019-12-08T13:06:04.405 INFO:teuthology.orchestra.run.smithi079.stdout:Collecting isodate>=0.4.4 2019-12-08T13:06:04.416 INFO:teuthology.orchestra.run.smithi079.stdout: Downloading https://files.pythonhosted.org/packages/9b/9f/b36f7774ff5ea8e428fdcfc4bb332c39ee5b9362ddd3d40d9516a55221b2/isodate-0.6.0-py2.py3-none-any.whl (45kB) 2019-12-08T13:06:04.558 INFO:teuthology.orchestra.run.smithi079.stdout:Collecting requests>=0.14.0 2019-12-08T13:06:04.567 INFO:teuthology.orchestra.run.smithi079.stdout: Downloading https://files.pythonhosted.org/packages/51/bd/23c926cd341ea6b7dd0b2a00aba99ae0f828be89d72b2190f27c11d4b7fb/requests-2.22.0-py2.py3-none-any.whl (57kB) 2019-12-08T13:06:04.887 INFO:teuthology.orchestra.run.smithi079.stdout:Collecting pytz>=2011k 2019-12-08T13:06:04.898 INFO:teuthology.orchestra.run.smithi079.stdout: Downloading https://files.pythonhosted.org/packages/e7/f9/f0b53f88060247251bf481fa6ea62cd0d25bf1b11a87888e53ce5b7c8ad2/pytz-2019.3-py2.py3-none-any.whl (509kB) 2019-12-08T13:06:05.116 INFO:teuthology.orchestra.run.smithi079.stdout:Collecting ordereddict 2019-12-08T13:06:05.127 INFO:teuthology.orchestra.run.smithi079.stdout: Downloading https://files.pythonhosted.org/packages/53/25/ef88e8e45db141faa9598fbf7ad0062df8f50f881a36ed6a0073e1572126/ordereddict-1.1.tar.gz 2019-12-08T13:06:05.456 INFO:teuthology.orchestra.run.smithi079.stdout:Processing /home/ubuntu/.cache/pip/wheels/51/ab/65/f318b4271019823cf7d7c178ac76a8ea4d6e6271fe9f5ba488/httplib2-0.14.0-cp27-none-any.whl 2019-12-08T13:06:05.860 INFO:teuthology.orchestra.run.smithi079.stdout:Collecting lxml 2019-12-08T13:06:05.874 INFO:teuthology.orchestra.run.smithi079.stdout: Using cached https://files.pythonhosted.org/packages/25/73/730ad7249847f741c7e622f52b971daa5540f6fb87589bc92c717f5aafba/lxml-4.4.2-cp27-cp27mu-manylinux1_x86_64.whl 2019-12-08T13:06:06.060 INFO:teuthology.orchestra.run.smithi079.stdout:Collecting jmespath<1.0.0,>=0.7.1 2019-12-08T13:06:06.069 INFO:teuthology.orchestra.run.smithi079.stdout: Downloading https://files.pythonhosted.org/packages/83/94/7179c3832a6d45b266ddb2aac329e101367fbdb11f425f13771d27f225bb/jmespath-0.9.4-py2.py3-none-any.whl 2019-12-08T13:06:06.649 INFO:teuthology.orchestra.run.smithi079.stdout:Collecting botocore<1.14.0,>=1.13.34 2019-12-08T13:06:06.659 INFO:teuthology.orchestra.run.smithi079.stdout: Downloading https://files.pythonhosted.org/packages/59/cb/b4772a4abc128f6fd637af9d7fc93a1db11617859af680fc2b2e6282eb95/botocore-1.13.34-py2.py3-none-any.whl (5.8MB) 2019-12-08T13:06:07.289 INFO:teuthology.orchestra.run.smithi079.stdout:Collecting s3transfer<0.3.0,>=0.2.0 2019-12-08T13:06:07.300 INFO:teuthology.orchestra.run.smithi079.stdout: Downloading https://files.pythonhosted.org/packages/16/8a/1fc3dba0c4923c2a76e1ff0d52b305c44606da63f718d14d3231e21c51b0/s3transfer-0.2.1-py2.py3-none-any.whl (70kB) 2019-12-08T13:06:07.510 INFO:teuthology.orchestra.run.smithi079.stdout:Collecting greenlet>=0.4.14; platform_python_implementation == "CPython" 2019-12-08T13:06:07.512 INFO:teuthology.orchestra.run.smithi079.stdout: Using cached https://files.pythonhosted.org/packages/8b/6e/f2d25875713ad0885c8d3c69269697406652e6f64e1a6bd8264f7a609327/greenlet-0.4.15-cp27-cp27mu-manylinux1_x86_64.whl 2019-12-08T13:06:07.590 INFO:teuthology.orchestra.run.smithi079.stdout:Collecting six 2019-12-08T13:06:07.601 INFO:teuthology.orchestra.run.smithi079.stdout: Downloading https://files.pythonhosted.org/packages/65/26/32b8464df2a97e6dd1b656ed26b2c194606c16fe163c695a992b36c11cdf/six-1.13.0-py2.py3-none-any.whl 2019-12-08T13:06:07.696 INFO:teuthology.orchestra.run.smithi079.stdout:Collecting chardet<3.1.0,>=3.0.2 2019-12-08T13:06:07.706 INFO:teuthology.orchestra.run.smithi079.stdout: Downloading https://files.pythonhosted.org/packages/bc/a9/01ffebfb562e4274b6487b4bb1ddec7ca55ec7510b22e4c51f14098443b8/chardet-3.0.4-py2.py3-none-any.whl (133kB) 2019-12-08T13:06:07.837 INFO:teuthology.orchestra.run.smithi079.stdout:Collecting idna<2.9,>=2.5 2019-12-08T13:06:07.848 INFO:teuthology.orchestra.run.smithi079.stdout: Downloading https://files.pythonhosted.org/packages/14/2c/cd551d81dbe15200be1cf41cd03869a46fe7226e7450af7a6545bfc474c9/idna-2.8-py2.py3-none-any.whl (58kB) 2019-12-08T13:06:07.988 INFO:teuthology.orchestra.run.smithi079.stdout:Collecting urllib3!=1.25.0,!=1.25.1,<1.26,>=1.21.1 2019-12-08T13:06:07.997 INFO:teuthology.orchestra.run.smithi079.stdout: Downloading https://files.pythonhosted.org/packages/b4/40/a9837291310ee1ccc242ceb6ebfd9eb21539649f193a7c8c86ba15b98539/urllib3-1.25.7-py2.py3-none-any.whl (125kB) 2019-12-08T13:06:08.134 INFO:teuthology.orchestra.run.smithi079.stdout:Collecting certifi>=2017.4.17 2019-12-08T13:06:08.144 INFO:teuthology.orchestra.run.smithi079.stdout: Downloading https://files.pythonhosted.org/packages/b9/63/df50cac98ea0d5b006c55a399c3bf1db9da7b5a24de7890bc9cfd5dd9e99/certifi-2019.11.28-py2.py3-none-any.whl (156kB) 2019-12-08T13:06:08.265 INFO:teuthology.orchestra.run.smithi079.stdout:Collecting docutils<0.16,>=0.10 2019-12-08T13:06:08.277 INFO:teuthology.orchestra.run.smithi079.stdout: Downloading https://files.pythonhosted.org/packages/3a/dc/bf2b15d1fa15a6f7a9e77a61b74ecbbae7258558fcda8ffc9a6638a6b327/docutils-0.15.2-py2-none-any.whl (548kB) 2019-12-08T13:06:08.485 INFO:teuthology.orchestra.run.smithi079.stdout:Collecting python-dateutil<2.8.1,>=2.1; python_version >= "2.7" 2019-12-08T13:06:08.494 INFO:teuthology.orchestra.run.smithi079.stdout: Downloading https://files.pythonhosted.org/packages/41/17/c62faccbfbd163c7f57f3844689e3a78bae1f403648a6afb1d0866d87fbb/python_dateutil-2.8.0-py2.py3-none-any.whl (226kB) 2019-12-08T13:06:08.593 INFO:teuthology.orchestra.run.smithi079.stdout:Collecting futures<4.0.0,>=2.2.0; python_version == "2.6" or python_version == "2.7" 2019-12-08T13:06:08.602 INFO:teuthology.orchestra.run.smithi079.stdout: Downloading https://files.pythonhosted.org/packages/d8/a6/f46ae3f1da0cd4361c344888f59ec2f5785e69c872e175a748ef6071cdb5/futures-3.3.0-py2-none-any.whl 2019-12-08T13:06:08.634 INFO:teuthology.orchestra.run.smithi079.stdout:Building wheels for collected packages: ordereddict 2019-12-08T13:06:08.634 INFO:teuthology.orchestra.run.smithi079.stdout: Building wheel for ordereddict (setup.py): started 2019-12-08T13:06:08.958 INFO:teuthology.orchestra.run.smithi079.stdout: Building wheel for ordereddict (setup.py): finished with status 'done' 2019-12-08T13:06:08.958 INFO:teuthology.orchestra.run.smithi079.stdout: Created wheel for ordereddict: filename=ordereddict-1.1-cp27-none-any.whl size=3327 sha256=f5f996b21cb8258be1d1ebc35cdc36edc00b1568abfc3897c7720298500a6e12 2019-12-08T13:06:08.959 INFO:teuthology.orchestra.run.smithi079.stdout: Stored in directory: /home/ubuntu/.cache/pip/wheels/78/d3/a8/9f52c7a389a0ffba6f575a3886b5f7a55461fb6ec34aa5fd38 2019-12-08T13:06:08.964 INFO:teuthology.orchestra.run.smithi079.stdout:Successfully built ordereddict 2019-12-08T13:06:09.095 INFO:teuthology.orchestra.run.smithi079.stdout:Installing collected packages: PyYAML, nose, boto, jmespath, docutils, six, python-dateutil, urllib3, botocore, futures, s3transfer, boto3, bunch, greenlet, gevent, isodate, chardet, idna, certifi, requests, pytz, ordereddict, httplib2, lxml 2019-12-08T13:06:11.383 INFO:teuthology.orchestra.run.smithi079.stdout:Successfully installed PyYAML-5.2 boto-2.49.0 boto3-1.10.34 botocore-1.13.34 bunch-1.0.1 certifi-2019.11.28 chardet-3.0.4 docutils-0.15.2 futures-3.3.0 gevent-1.4.0 greenlet-0.4.15 httplib2-0.14.0 idna-2.8 isodate-0.6.0 jmespath-0.9.4 lxml-4.4.2 nose-1.3.7 ordereddict-1.1 python-dateutil-2.8.0 pytz-2019.3 requests-2.22.0 s3transfer-0.2.1 six-1.13.0 urllib3-1.25.7 2019-12-08T13:06:11.729 INFO:teuthology.orchestra.run.smithi079.stdout:running develop 2019-12-08T13:06:11.780 INFO:teuthology.orchestra.run.smithi079.stdout:running egg_info 2019-12-08T13:06:11.780 INFO:teuthology.orchestra.run.smithi079.stdout:creating s3tests.egg-info 2019-12-08T13:06:11.780 INFO:teuthology.orchestra.run.smithi079.stdout:writing requirements to s3tests.egg-info/requires.txt 2019-12-08T13:06:11.780 INFO:teuthology.orchestra.run.smithi079.stdout:writing s3tests.egg-info/PKG-INFO 2019-12-08T13:06:11.780 INFO:teuthology.orchestra.run.smithi079.stdout:writing top-level names to s3tests.egg-info/top_level.txt 2019-12-08T13:06:11.780 INFO:teuthology.orchestra.run.smithi079.stdout:writing dependency_links to s3tests.egg-info/dependency_links.txt 2019-12-08T13:06:11.781 INFO:teuthology.orchestra.run.smithi079.stdout:writing entry points to s3tests.egg-info/entry_points.txt 2019-12-08T13:06:11.781 INFO:teuthology.orchestra.run.smithi079.stdout:writing manifest file 's3tests.egg-info/SOURCES.txt' 2019-12-08T13:06:11.783 INFO:teuthology.orchestra.run.smithi079.stdout:reading manifest file 's3tests.egg-info/SOURCES.txt' 2019-12-08T13:06:11.784 INFO:teuthology.orchestra.run.smithi079.stdout:writing manifest file 's3tests.egg-info/SOURCES.txt' 2019-12-08T13:06:11.785 INFO:teuthology.orchestra.run.smithi079.stdout:running build_ext 2019-12-08T13:06:11.785 INFO:teuthology.orchestra.run.smithi079.stdout:Creating /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/s3tests.egg-link (link to .) 2019-12-08T13:06:11.786 INFO:teuthology.orchestra.run.smithi079.stdout:Adding s3tests 0.0.1 to easy-install.pth file 2019-12-08T13:06:11.788 INFO:teuthology.orchestra.run.smithi079.stdout:Installing s3tests-fuzz-headers script to /home/ubuntu/cephtest/s3-tests/virtualenv/bin 2019-12-08T13:06:11.788 INFO:teuthology.orchestra.run.smithi079.stdout:Installing s3tests-generate-objects script to /home/ubuntu/cephtest/s3-tests/virtualenv/bin 2019-12-08T13:06:11.788 INFO:teuthology.orchestra.run.smithi079.stdout:Installing s3tests-test-roundtrip script to /home/ubuntu/cephtest/s3-tests/virtualenv/bin 2019-12-08T13:06:11.788 INFO:teuthology.orchestra.run.smithi079.stdout:Installing s3tests-analysis-rwstats script to /home/ubuntu/cephtest/s3-tests/virtualenv/bin 2019-12-08T13:06:11.789 INFO:teuthology.orchestra.run.smithi079.stdout:Installing s3tests-test-readwrite script to /home/ubuntu/cephtest/s3-tests/virtualenv/bin 2019-12-08T13:06:11.789 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T13:06:11.789 INFO:teuthology.orchestra.run.smithi079.stdout:Installed /home/ubuntu/cephtest/s3-tests 2019-12-08T13:06:11.789 INFO:teuthology.orchestra.run.smithi079.stdout:Processing dependencies for s3tests==0.0.1 2019-12-08T13:06:11.838 INFO:teuthology.orchestra.run.smithi079.stdout:Searching for isodate==0.6.0 2019-12-08T13:06:11.839 INFO:teuthology.orchestra.run.smithi079.stdout:Best match: isodate 0.6.0 2019-12-08T13:06:11.839 INFO:teuthology.orchestra.run.smithi079.stdout:Adding isodate 0.6.0 to easy-install.pth file 2019-12-08T13:06:11.839 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T13:06:11.839 INFO:teuthology.orchestra.run.smithi079.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-12-08T13:06:11.840 INFO:teuthology.orchestra.run.smithi079.stdout:Searching for gevent==1.4.0 2019-12-08T13:06:11.840 INFO:teuthology.orchestra.run.smithi079.stdout:Best match: gevent 1.4.0 2019-12-08T13:06:11.840 INFO:teuthology.orchestra.run.smithi079.stdout:Adding gevent 1.4.0 to easy-install.pth file 2019-12-08T13:06:11.840 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T13:06:11.840 INFO:teuthology.orchestra.run.smithi079.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-12-08T13:06:11.842 INFO:teuthology.orchestra.run.smithi079.stdout:Searching for bunch==1.0.1 2019-12-08T13:06:11.842 INFO:teuthology.orchestra.run.smithi079.stdout:Best match: bunch 1.0.1 2019-12-08T13:06:11.842 INFO:teuthology.orchestra.run.smithi079.stdout:Adding bunch 1.0.1 to easy-install.pth file 2019-12-08T13:06:11.842 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T13:06:11.842 INFO:teuthology.orchestra.run.smithi079.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-12-08T13:06:11.843 INFO:teuthology.orchestra.run.smithi079.stdout:Searching for PyYAML==5.2 2019-12-08T13:06:11.843 INFO:teuthology.orchestra.run.smithi079.stdout:Best match: PyYAML 5.2 2019-12-08T13:06:11.843 INFO:teuthology.orchestra.run.smithi079.stdout:Adding PyYAML 5.2 to easy-install.pth file 2019-12-08T13:06:11.843 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T13:06:11.843 INFO:teuthology.orchestra.run.smithi079.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-12-08T13:06:11.845 INFO:teuthology.orchestra.run.smithi079.stdout:Searching for boto3==1.10.34 2019-12-08T13:06:11.845 INFO:teuthology.orchestra.run.smithi079.stdout:Best match: boto3 1.10.34 2019-12-08T13:06:11.845 INFO:teuthology.orchestra.run.smithi079.stdout:Adding boto3 1.10.34 to easy-install.pth file 2019-12-08T13:06:11.846 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T13:06:11.846 INFO:teuthology.orchestra.run.smithi079.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-12-08T13:06:11.846 INFO:teuthology.orchestra.run.smithi079.stdout:Searching for boto==2.49.0 2019-12-08T13:06:11.846 INFO:teuthology.orchestra.run.smithi079.stdout:Best match: boto 2.49.0 2019-12-08T13:06:11.846 INFO:teuthology.orchestra.run.smithi079.stdout:Adding boto 2.49.0 to easy-install.pth file 2019-12-08T13:06:11.846 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T13:06:11.846 INFO:teuthology.orchestra.run.smithi079.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-12-08T13:06:11.847 INFO:teuthology.orchestra.run.smithi079.stdout:Searching for six==1.13.0 2019-12-08T13:06:11.847 INFO:teuthology.orchestra.run.smithi079.stdout:Best match: six 1.13.0 2019-12-08T13:06:11.847 INFO:teuthology.orchestra.run.smithi079.stdout:Adding six 1.13.0 to easy-install.pth file 2019-12-08T13:06:11.847 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T13:06:11.847 INFO:teuthology.orchestra.run.smithi079.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-12-08T13:06:11.847 INFO:teuthology.orchestra.run.smithi079.stdout:Searching for greenlet==0.4.15 2019-12-08T13:06:11.847 INFO:teuthology.orchestra.run.smithi079.stdout:Best match: greenlet 0.4.15 2019-12-08T13:06:11.847 INFO:teuthology.orchestra.run.smithi079.stdout:Adding greenlet 0.4.15 to easy-install.pth file 2019-12-08T13:06:11.848 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T13:06:11.848 INFO:teuthology.orchestra.run.smithi079.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-12-08T13:06:11.850 INFO:teuthology.orchestra.run.smithi079.stdout:Searching for s3transfer==0.2.1 2019-12-08T13:06:11.850 INFO:teuthology.orchestra.run.smithi079.stdout:Best match: s3transfer 0.2.1 2019-12-08T13:06:11.850 INFO:teuthology.orchestra.run.smithi079.stdout:Adding s3transfer 0.2.1 to easy-install.pth file 2019-12-08T13:06:11.851 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T13:06:11.851 INFO:teuthology.orchestra.run.smithi079.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-12-08T13:06:11.851 INFO:teuthology.orchestra.run.smithi079.stdout:Searching for botocore==1.13.34 2019-12-08T13:06:11.851 INFO:teuthology.orchestra.run.smithi079.stdout:Best match: botocore 1.13.34 2019-12-08T13:06:11.853 INFO:teuthology.orchestra.run.smithi079.stdout:Adding botocore 1.13.34 to easy-install.pth file 2019-12-08T13:06:11.853 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T13:06:11.854 INFO:teuthology.orchestra.run.smithi079.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-12-08T13:06:11.854 INFO:teuthology.orchestra.run.smithi079.stdout:Searching for jmespath==0.9.4 2019-12-08T13:06:11.854 INFO:teuthology.orchestra.run.smithi079.stdout:Best match: jmespath 0.9.4 2019-12-08T13:06:11.854 INFO:teuthology.orchestra.run.smithi079.stdout:Adding jmespath 0.9.4 to easy-install.pth file 2019-12-08T13:06:11.854 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T13:06:11.854 INFO:teuthology.orchestra.run.smithi079.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-12-08T13:06:11.854 INFO:teuthology.orchestra.run.smithi079.stdout:Searching for futures==3.3.0 2019-12-08T13:06:11.855 INFO:teuthology.orchestra.run.smithi079.stdout:Best match: futures 3.3.0 2019-12-08T13:06:11.855 INFO:teuthology.orchestra.run.smithi079.stdout:Adding futures 3.3.0 to easy-install.pth file 2019-12-08T13:06:11.855 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T13:06:11.855 INFO:teuthology.orchestra.run.smithi079.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-12-08T13:06:11.855 INFO:teuthology.orchestra.run.smithi079.stdout:Searching for urllib3==1.25.7 2019-12-08T13:06:11.855 INFO:teuthology.orchestra.run.smithi079.stdout:Best match: urllib3 1.25.7 2019-12-08T13:06:11.855 INFO:teuthology.orchestra.run.smithi079.stdout:Adding urllib3 1.25.7 to easy-install.pth file 2019-12-08T13:06:11.856 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T13:06:11.856 INFO:teuthology.orchestra.run.smithi079.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-12-08T13:06:11.856 INFO:teuthology.orchestra.run.smithi079.stdout:Searching for python-dateutil==2.8.0 2019-12-08T13:06:11.856 INFO:teuthology.orchestra.run.smithi079.stdout:Best match: python-dateutil 2.8.0 2019-12-08T13:06:11.856 INFO:teuthology.orchestra.run.smithi079.stdout:Adding python-dateutil 2.8.0 to easy-install.pth file 2019-12-08T13:06:11.856 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T13:06:11.856 INFO:teuthology.orchestra.run.smithi079.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-12-08T13:06:11.856 INFO:teuthology.orchestra.run.smithi079.stdout:Searching for docutils==0.15.2 2019-12-08T13:06:11.857 INFO:teuthology.orchestra.run.smithi079.stdout:Best match: docutils 0.15.2 2019-12-08T13:06:11.857 INFO:teuthology.orchestra.run.smithi079.stdout:Adding docutils 0.15.2 to easy-install.pth file 2019-12-08T13:06:11.857 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T13:06:11.857 INFO:teuthology.orchestra.run.smithi079.stdout:Using /home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages 2019-12-08T13:06:11.857 INFO:teuthology.orchestra.run.smithi079.stdout:Finished processing dependencies for s3tests==0.0.1 2019-12-08T13:06:11.863 INFO:teuthology.orchestra.run.smithi079:> cat > /home/ubuntu/cephtest/archive/s3-tests.client.0.conf 2019-12-08T13:06:11.944 INFO:tasks.s3tests:Configuring boto... 2019-12-08T13:06:11.944 INFO:teuthology.orchestra.run.smithi079:> cat > /home/ubuntu/cephtest/boto.cfg 2019-12-08T13:06:12.041 INFO:teuthology.orchestra.run.smithi079:s3 tests against rgw> S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg REQUESTS_CA_BUNDLE=/etc/pki/tls/certs/ca-bundle.crt /home/ubuntu/cephtest/s3-tests/virtualenv/bin/nosetests -w /home/ubuntu/cephtest/s3-tests -v -a '!fails_on_rgw,!lifecycle_expiration,!fails_strict_rfc2616,!fails_with_subdomain' 2019-12-08T13:06:15.587 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_headers.test_object_create_bad_contentlength_none ... ok 2019-12-08T13:06:17.890 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_headers.test_object_create_bad_authorization_empty ... ok 2019-12-08T13:06:21.906 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_headers.test_object_create_date_and_amz_date ... ok 2019-12-08T13:06:26.138 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_headers.test_object_create_amz_date_and_no_date ... ok 2019-12-08T13:06:29.008 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_headers.test_object_create_bad_authorization_none ... ok 2019-12-08T13:06:30.552 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_headers.test_bucket_create_contentlength_none ... ok 2019-12-08T13:06:34.377 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_headers.test_object_acl_create_contentlength_none ... ok 2019-12-08T13:06:37.361 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_headers.test_bucket_create_bad_contentlength_none ... ok 2019-12-08T13:06:37.642 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_headers.test_bucket_create_bad_authorization_empty ... ok 2019-12-08T13:06:38.521 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_headers.test_bucket_create_bad_authorization_none ... ok 2019-12-08T13:06:42.209 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_headers.test_object_create_bad_contentlength_mismatch_below_aws2 ... ok 2019-12-08T13:06:46.283 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_headers.test_object_create_bad_authorization_incorrect_aws2 ... ok 2019-12-08T13:06:48.890 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_headers.test_object_create_bad_authorization_invalid_aws2 ... ok 2019-12-08T13:06:50.771 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_headers.test_object_create_bad_date_none_aws2 ... ok 2019-12-08T13:06:50.861 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_headers.test_bucket_create_bad_authorization_invalid_aws2 ... ok 2019-12-08T13:06:51.054 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_headers.test_bucket_create_bad_date_none_aws2 ... ok 2019-12-08T13:06:51.055 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_headers.test_object_create_bad_md5_invalid_garbage_aws4 ... SKIP 2019-12-08T13:06:51.055 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_headers.test_object_create_bad_contentlength_mismatch_below_aws4 ... SKIP 2019-12-08T13:06:51.055 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_headers.test_object_create_bad_authorization_incorrect_aws4 ... SKIP 2019-12-08T13:06:51.055 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_headers.test_object_create_bad_authorization_invalid_aws4 ... SKIP 2019-12-08T13:06:51.055 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_headers.test_object_create_bad_ua_empty_aws4 ... SKIP 2019-12-08T13:06:51.055 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_headers.test_object_create_bad_ua_none_aws4 ... SKIP 2019-12-08T13:06:51.056 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_headers.test_object_create_bad_date_invalid_aws4 ... SKIP 2019-12-08T13:06:51.056 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_headers.test_object_create_bad_amz_date_invalid_aws4 ... SKIP 2019-12-08T13:06:51.058 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_headers.test_object_create_bad_date_empty_aws4 ... SKIP 2019-12-08T13:06:51.058 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_headers.test_object_create_bad_amz_date_empty_aws4 ... SKIP 2019-12-08T13:06:51.058 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_headers.test_object_create_bad_date_none_aws4 ... SKIP 2019-12-08T13:06:51.058 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_headers.test_object_create_bad_amz_date_none_aws4 ... SKIP 2019-12-08T13:06:51.058 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_headers.test_object_create_bad_date_before_today_aws4 ... SKIP 2019-12-08T13:06:51.059 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_headers.test_object_create_bad_amz_date_before_today_aws4 ... SKIP 2019-12-08T13:06:51.059 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_headers.test_object_create_bad_date_after_today_aws4 ... SKIP 2019-12-08T13:06:51.059 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_headers.test_object_create_bad_amz_date_after_today_aws4 ... SKIP 2019-12-08T13:06:51.059 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_headers.test_object_create_bad_date_before_epoch_aws4 ... SKIP 2019-12-08T13:06:51.059 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_headers.test_object_create_bad_amz_date_before_epoch_aws4 ... SKIP 2019-12-08T13:06:51.063 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_headers.test_object_create_bad_date_after_end_aws4 ... SKIP 2019-12-08T13:06:51.063 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_headers.test_object_create_bad_amz_date_after_end_aws4 ... SKIP 2019-12-08T13:06:51.063 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_headers.test_object_create_missing_signed_custom_header_aws4 ... SKIP 2019-12-08T13:06:51.063 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_headers.test_object_create_missing_signed_header_aws4 ... SKIP 2019-12-08T13:06:51.063 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_headers.test_bucket_create_bad_authorization_invalid_aws4 ... SKIP 2019-12-08T13:06:51.064 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_headers.test_bucket_create_bad_ua_empty_aws4 ... SKIP 2019-12-08T13:06:51.064 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_headers.test_bucket_create_bad_ua_none_aws4 ... SKIP 2019-12-08T13:06:51.064 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_headers.test_bucket_create_bad_date_invalid_aws4 ... SKIP 2019-12-08T13:06:51.064 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_headers.test_bucket_create_bad_amz_date_invalid_aws4 ... SKIP 2019-12-08T13:06:51.064 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_headers.test_bucket_create_bad_date_empty_aws4 ... SKIP 2019-12-08T13:06:51.064 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_headers.test_bucket_create_bad_amz_date_empty_aws4 ... SKIP 2019-12-08T13:06:51.064 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_headers.test_bucket_create_bad_date_none_aws4 ... SKIP 2019-12-08T13:06:51.065 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_headers.test_bucket_create_bad_amz_date_none_aws4 ... SKIP 2019-12-08T13:06:51.065 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_headers.test_bucket_create_bad_date_before_today_aws4 ... SKIP 2019-12-08T13:06:51.065 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_headers.test_bucket_create_bad_amz_date_before_today_aws4 ... SKIP 2019-12-08T13:06:51.065 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_headers.test_bucket_create_bad_date_after_today_aws4 ... SKIP 2019-12-08T13:06:51.065 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_headers.test_bucket_create_bad_amz_date_after_today_aws4 ... SKIP 2019-12-08T13:06:51.065 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_headers.test_bucket_create_bad_date_before_epoch_aws4 ... SKIP 2019-12-08T13:06:51.065 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_headers.test_bucket_create_bad_amz_date_before_epoch_aws4 ... SKIP 2019-12-08T13:06:59.402 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_s3.test_versioning_obj_read_not_exist_null ... ok 2019-12-08T13:06:59.403 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_s3.test_lifecycle_transition ... SKIP 2019-12-08T13:06:59.403 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_s3.test_lifecycle_transition_single_rule_multi_trans ... SKIP 2019-12-08T13:06:59.403 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_s3.test_lifecycle_set_noncurrent_transition ... SKIP 2019-12-08T13:06:59.403 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_s3.test_object_storage_class ... SKIP 2019-12-08T13:06:59.403 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_s3.test_object_storage_class_multipart ... SKIP 2019-12-08T13:06:59.403 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_s3.test_object_modify_storage_class ... SKIP 2019-12-08T13:06:59.403 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_s3.test_object_modify_storage_class_multipart ... SKIP 2019-12-08T13:06:59.404 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_s3.test_object_storage_class_copy ... SKIP 2019-12-08T13:06:59.404 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_s3.test_object_storage_class_copy_multipart ... SKIP 2019-12-08T13:07:05.227 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_s3.test_atomic_dual_conditional_write_1mb ... ok 2019-12-08T13:07:13.038 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_s3.test_atomic_write_bucket_gone ... ok 2019-12-08T13:07:19.854 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_s3.test_encryption_sse_c_multipart_invalid_chunks_1 ... ok 2019-12-08T13:07:24.025 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_s3.test_encryption_sse_c_multipart_invalid_chunks_2 ... ok 2019-12-08T13:07:30.324 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_s3.test_bucket_policy_set_condition_operator_end_with_IfExists ... ok 2019-12-08T13:07:34.306 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_s3.test_bucket_policy_put_obj_enc ... ok 2019-12-08T13:07:38.294 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_s3.test_bucket_policy_put_obj_request_obj_tag ... ok 2019-12-08T13:07:45.189 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_s3_website.check_can_test_website ... SKIP 2019-12-08T13:07:45.189 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_s3_website.test_website_nonexistant_bucket_rgw ... SKIP 2019-12-08T13:07:45.190 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_public_index ... SKIP 2019-12-08T13:07:45.191 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_public_index ... SKIP 2019-12-08T13:07:45.191 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_empty ... SKIP 2019-12-08T13:07:45.191 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_empty ... SKIP 2019-12-08T13:07:45.191 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_private_index ... SKIP 2019-12-08T13:07:45.191 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_private_index ... SKIP 2019-12-08T13:07:45.191 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_empty_missingerrordoc ... SKIP 2019-12-08T13:07:45.192 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_empty_missingerrordoc ... SKIP 2019-12-08T13:07:45.195 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_private_index_missingerrordoc ... SKIP 2019-12-08T13:07:45.195 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_private_index_missingerrordoc ... SKIP 2019-12-08T13:07:45.195 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_empty_blockederrordoc ... SKIP 2019-12-08T13:07:45.195 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_empty_blockederrordoc ... SKIP 2019-12-08T13:07:45.196 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_private_index_blockederrordoc ... SKIP 2019-12-08T13:07:45.196 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_private_index_blockederrordoc ... SKIP 2019-12-08T13:07:45.196 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_empty_gooderrordoc ... SKIP 2019-12-08T13:07:45.200 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_empty_gooderrordoc ... SKIP 2019-12-08T13:07:45.200 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_s3_website.test_website_public_bucket_list_private_index_gooderrordoc ... SKIP 2019-12-08T13:07:45.201 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_s3_website.test_website_private_bucket_list_private_index_gooderrordoc ... SKIP 2019-12-08T13:07:45.201 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_s3_website.test_website_bucket_private_redirectall_base ... SKIP 2019-12-08T13:07:45.201 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_s3_website.test_website_bucket_private_redirectall_path ... SKIP 2019-12-08T13:07:45.201 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_s3_website.test_website_bucket_private_redirectall_path_upgrade ... SKIP 2019-12-08T13:07:45.201 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_s3_website.test_website_xredirect_nonwebsite ... SKIP 2019-12-08T13:07:45.201 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_s3_website.test_website_xredirect_public_relative ... SKIP 2019-12-08T13:07:45.202 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_s3_website.test_website_xredirect_public_abs ... SKIP 2019-12-08T13:07:45.202 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_s3_website.test_website_xredirect_private_relative ... SKIP 2019-12-08T13:07:45.202 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_s3_website.test_website_xredirect_private_abs ... SKIP 2019-12-08T13:07:45.203 INFO:teuthology.orchestra.run.smithi079.stderr:SKIP 2019-12-08T13:07:45.219 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.functional.test_utils.test_generate ... ok 2019-12-08T13:09:31.185 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.fuzz.test.test_fuzzer.test_load_graph ... ok 2019-12-08T13:09:31.185 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.fuzz.test.test_fuzzer.test_descend_leaf_node ... ok 2019-12-08T13:09:31.186 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.fuzz.test.test_fuzzer.test_descend_node ... ok 2019-12-08T13:09:31.186 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.fuzz.test.test_fuzzer.test_descend_bad_node ... ok 2019-12-08T13:09:31.187 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.fuzz.test.test_fuzzer.test_descend_nonexistant_child ... ok 2019-12-08T13:09:31.187 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_printable ... ok 2019-12-08T13:09:31.187 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_binary ... ok 2019-12-08T13:09:31.537 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_printable_no_whitespace ... ok 2019-12-08T13:09:31.695 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_binary_no_whitespace ... ok 2019-12-08T13:09:32.011 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_no_args ... ok 2019-12-08T13:09:32.035 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_no_charset ... ok 2019-12-08T13:09:32.055 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_exact_length ... ok 2019-12-08T13:09:32.055 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_bad_charset ... ok 2019-12-08T13:09:32.055 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_random_missing_length ... ok 2019-12-08T13:09:32.055 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.fuzz.test.test_fuzzer.test_assemble_decision ... ok 2019-12-08T13:09:32.055 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_escape ... ok 2019-12-08T13:09:32.055 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_indirect ... ok 2019-12-08T13:09:32.055 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_indirect_double ... ok 2019-12-08T13:09:32.056 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_recursive ... ok 2019-12-08T13:09:32.056 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_recursive_mutual ... ok 2019-12-08T13:09:32.056 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_recursive_not_too_eager ... ok 2019-12-08T13:09:32.056 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.fuzz.test.test_fuzzer.test_make_choice_unweighted_with_space ... ok 2019-12-08T13:09:32.060 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.fuzz.test.test_fuzzer.test_weighted_choices ... ok 2019-12-08T13:09:32.060 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.fuzz.test.test_fuzzer.test_null_choices ... ok 2019-12-08T13:09:32.060 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.fuzz.test.test_fuzzer.test_weighted_null_choices ... ok 2019-12-08T13:09:32.060 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.fuzz.test.test_fuzzer.test_null_child ... ok 2019-12-08T13:09:32.065 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.fuzz.test.test_fuzzer.test_weighted_set ... ok 2019-12-08T13:09:32.065 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.fuzz.test.test_fuzzer.test_header_presence ... ok 2019-12-08T13:09:32.065 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.fuzz.test.test_fuzzer.test_duplicate_header ... ok 2019-12-08T13:09:32.065 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests.fuzz.test.test_fuzzer.test_expand_headers ... ok 2019-12-08T13:09:32.094 INFO:teuthology.orchestra.run.smithi079.stderr:test_realistic.TestFileValidator.test_new_file_is_valid ... ok 2019-12-08T13:09:32.119 INFO:teuthology.orchestra.run.smithi079.stderr:test_realistic.TestFileValidator.test_new_file_is_valid_on_several_calls ... ok 2019-12-08T13:09:32.119 INFO:teuthology.orchestra.run.smithi079.stderr:test_realistic.TestFileValidator.test_new_file_is_valid_when_size_is_1 ... ok 2019-12-08T13:09:32.310 INFO:teuthology.orchestra.run.smithi079.stderr:test_realistic.TestFiles.test_random_file_valid ... ok 2019-12-08T13:09:37.917 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_md5_invalid_short ... ok 2019-12-08T13:09:51.653 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_md5_bad ... ok 2019-12-08T13:09:55.424 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_md5_empty ... ok 2019-12-08T13:10:01.097 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_md5_none ... ok 2019-12-08T13:10:06.956 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_expect_mismatch ... ok 2019-12-08T13:10:14.255 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_expect_empty ... ok 2019-12-08T13:10:18.076 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_expect_none ... ok 2019-12-08T13:10:19.342 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_contentlength_negative ... ok 2019-12-08T13:10:22.422 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:01:07:47.125 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T13:10:22.468 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:01:07:47.107 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T13:10:22.475 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:01:07:47.178 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T13:10:22.476 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:01:07:47.115 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T13:10:22.478 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:01:07:47.116 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T13:10:22.491 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:01:07:47.129 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T13:10:22.591 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:01:07:47.230 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T13:10:22.603 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:01:07:47.241 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T13:10:22.637 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:01:07:47.340 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T13:10:25.304 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_contenttype_invalid ... ok 2019-12-08T13:10:29.765 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_contenttype_empty ... ok 2019-12-08T13:10:33.177 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_contenttype_none ... ok 2019-12-08T13:10:36.849 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_headers.test_bucket_put_bad_canned_acl ... ok 2019-12-08T13:10:39.257 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_expect_mismatch ... ok 2019-12-08T13:10:41.760 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_expect_empty ... ok 2019-12-08T13:10:41.852 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_contentlength_negative ... ok 2019-12-08T13:10:44.161 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_md5_invalid_garbage_aws2 ... ok 2019-12-08T13:10:48.814 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_ua_empty_aws2 ... ok 2019-12-08T13:10:54.201 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_ua_none_aws2 ... ok 2019-12-08T13:10:56.814 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_date_invalid_aws2 ... ok 2019-12-08T13:10:57.696 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:01:08:22.399 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T13:10:57.706 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:01:08:22.409 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T13:10:57.708 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:01:08:22.347 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T13:10:57.711 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:01:08:22.350 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T13:10:57.712 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:01:08:22.350 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T13:10:57.716 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:01:08:22.355 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T13:10:57.757 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:01:08:22.396 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T13:10:57.763 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:01:08:22.402 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T13:10:57.819 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:01:08:22.522 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T13:10:58.700 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_date_empty_aws2 ... ok 2019-12-08T13:11:00.782 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_date_before_today_aws2 ... ok 2019-12-08T13:11:02.642 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_date_before_epoch_aws2 ... ok 2019-12-08T13:11:04.387 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_headers.test_object_create_bad_date_after_end_aws2 ... ok 2019-12-08T13:11:06.981 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_ua_empty_aws2 ... ok 2019-12-08T13:11:10.128 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_ua_none_aws2 ... ok 2019-12-08T13:11:10.181 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_date_invalid_aws2 ... ok 2019-12-08T13:11:10.210 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_date_empty_aws2 ... ok 2019-12-08T13:11:10.466 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_date_before_today_aws2 ... ok 2019-12-08T13:11:10.547 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_date_after_today_aws2 ... ok 2019-12-08T13:11:10.614 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_headers.test_bucket_create_bad_date_before_epoch_aws2 ... ok 2019-12-08T13:11:14.873 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_empty ... ok 2019-12-08T13:11:21.245 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_distinct ... ok 2019-12-08T13:11:28.773 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_many ... ok 2019-12-08T13:11:35.504 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_many ... ok 2019-12-08T13:11:41.851 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_basic_key_count ... ok 2019-12-08T13:11:50.337 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_basic ... ok 2019-12-08T13:11:56.789 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_basic ... ok 2019-12-08T13:12:08.888 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_prefix ... ok 2019-12-08T13:12:21.390 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_prefix ... ok 2019-12-08T13:12:24.408 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_prefix_ends_with_delimiter ... ok 2019-12-08T13:12:27.430 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_prefix_ends_with_delimiter ... ok 2019-12-08T13:12:35.792 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_alt ... ok 2019-12-08T13:12:41.744 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_alt ... ok 2019-12-08T13:12:55.650 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_prefix_underscore ... ok 2019-12-08T13:13:08.197 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_prefix_underscore ... ok 2019-12-08T13:13:15.755 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_percentage ... ok 2019-12-08T13:13:24.821 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_percentage ... ok 2019-12-08T13:13:29.751 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_whitespace ... ok 2019-12-08T13:13:38.174 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_whitespace ... ok 2019-12-08T13:13:44.870 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_dot ... ok 2019-12-08T13:13:54.563 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_dot ... ok 2019-12-08T13:14:01.534 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_unreadable ... ok 2019-12-08T13:14:08.155 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_unreadable ... ok 2019-12-08T13:14:15.455 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_empty ... ok 2019-12-08T13:14:21.540 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_empty ... ok 2019-12-08T13:14:29.044 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_none ... ok 2019-12-08T13:14:34.729 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_none ... ok 2019-12-08T13:14:39.916 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_fetchowner_notempty ... ok 2019-12-08T13:14:45.681 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_fetchowner_defaultempty ... ok 2019-12-08T13:14:50.426 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_fetchowner_empty ... ok 2019-12-08T13:14:55.964 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_not_exist ... ok 2019-12-08T13:15:02.014 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_delimiter_not_exist ... ok 2019-12-08T13:16:10.941 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:01:13:35.643 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T13:16:10.956 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:01:13:35.659 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T13:16:10.957 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:01:13:35.595 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T13:16:10.960 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:01:13:35.599 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T13:16:10.962 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:01:13:35.601 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T13:16:10.964 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:01:13:35.603 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T13:16:11.172 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:01:13:35.875 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T13:16:11.200 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:01:13:35.838 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T13:16:11.200 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:01:13:35.840 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T13:18:44.448 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:01:16:09.151 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T13:18:44.453 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:01:16:09.156 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T13:18:44.485 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:01:16:09.123 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T13:18:44.531 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:01:16:09.169 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T13:18:44.535 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:01:16:09.173 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T13:18:44.538 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:01:16:09.176 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T13:18:44.596 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:01:16:09.299 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T13:18:44.629 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:01:16:09.267 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T13:18:44.637 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:01:16:09.275 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T13:21:22.125 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:01:18:46.828 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T13:21:22.133 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:01:18:46.835 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T13:21:22.136 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:01:18:46.773 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T13:21:22.137 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:01:18:46.775 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T13:21:22.140 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:01:18:46.778 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T13:21:22.144 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:01:18:46.782 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T13:21:22.238 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:01:18:46.876 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T13:21:22.247 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:01:18:46.885 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T13:21:22.254 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:01:18:46.957 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T13:26:35.672 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:01:24:00.375 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T13:26:35.684 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:01:24:00.387 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T13:26:35.689 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:01:24:00.326 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T13:26:35.694 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:01:24:00.331 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T13:26:35.695 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:01:24:00.331 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T13:26:35.700 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:01:24:00.337 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T13:26:35.870 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:01:24:00.507 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T13:26:35.875 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:01:24:00.512 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T13:26:35.922 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:01:24:00.624 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T13:27:06.717 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:01:24:31.419 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T13:27:06.733 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:01:24:31.436 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T13:27:06.734 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:01:24:31.371 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T13:27:06.759 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:01:24:31.395 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T13:27:06.765 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:01:24:31.467 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T13:27:06.774 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:01:24:31.410 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T13:27:06.776 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:01:24:31.413 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T13:27:06.802 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:01:24:31.439 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T13:27:06.811 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:01:24:31.440 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T13:31:47.835 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:01:29:12.538 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T13:31:47.841 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:01:29:12.543 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T13:31:47.851 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:01:29:12.488 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T13:31:47.852 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:01:29:12.488 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T13:31:47.855 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:01:29:12.491 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T13:31:47.858 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:01:29:12.495 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T13:31:48.009 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:01:29:12.646 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T13:31:48.026 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:01:29:12.662 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T13:31:48.040 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:01:29:12.742 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T13:33:00.899 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_delimiter_not_skip_special ... ok 2019-12-08T13:33:07.158 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_basic ... ok 2019-12-08T13:33:11.823 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_basic ... ok 2019-12-08T13:33:18.039 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_alt ... ok 2019-12-08T13:33:25.351 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_alt ... ok 2019-12-08T13:33:30.989 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_empty ... ok 2019-12-08T13:33:37.218 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_empty ... ok 2019-12-08T13:33:42.708 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_none ... ok 2019-12-08T13:33:47.866 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_none ... ok 2019-12-08T13:33:55.890 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_not_exist ... ok 2019-12-08T13:34:00.672 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_not_exist ... ok 2019-12-08T13:34:07.797 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_unreadable ... ok 2019-12-08T13:34:14.931 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_unreadable ... ok 2019-12-08T13:34:21.425 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_delimiter_basic ... ok 2019-12-08T13:34:30.002 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_delimiter_basic ... ok 2019-12-08T13:34:35.364 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_delimiter_alt ... ok 2019-12-08T13:34:42.279 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_delimiter_alt ... ok 2019-12-08T13:34:48.105 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_delimiter_prefix_not_exist ... ok 2019-12-08T13:34:54.932 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_delimiter_prefix_not_exist ... ok 2019-12-08T13:35:02.350 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_delimiter_delimiter_not_exist ... ok 2019-12-08T13:35:06.743 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_delimiter_delimiter_not_exist ... ok 2019-12-08T13:35:11.578 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_prefix_delimiter_prefix_delimiter_not_exist ... ok 2019-12-08T13:35:18.929 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_prefix_delimiter_prefix_delimiter_not_exist ... ok 2019-12-08T13:35:23.962 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_maxkeys_one ... ok 2019-12-08T13:35:28.541 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:01:32:53.244 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T13:35:28.574 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:01:32:53.211 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T13:35:28.592 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:01:32:53.294 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T13:35:28.600 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:01:32:53.237 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T13:35:28.617 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:01:32:53.254 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T13:35:28.634 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:01:32:53.271 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T13:35:28.699 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:01:32:53.401 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T13:35:28.707 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:01:32:53.344 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T13:35:28.735 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:01:32:53.372 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T13:35:31.298 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_maxkeys_one ... ok 2019-12-08T13:35:35.920 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_maxkeys_zero ... ok 2019-12-08T13:35:42.169 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_maxkeys_zero ... ok 2019-12-08T13:35:50.423 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_maxkeys_none ... ok 2019-12-08T13:35:54.605 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_maxkeys_none ... ok 2019-12-08T13:36:22.078 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_unordered ... ok 2019-12-08T13:36:58.625 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_unordered ... ok 2019-12-08T13:36:59.146 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:01:34:23.849 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T13:36:59.154 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:01:34:23.856 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T13:36:59.164 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:01:34:23.801 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T13:36:59.165 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:01:34:23.802 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T13:36:59.168 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:01:34:23.805 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T13:36:59.170 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:01:34:23.808 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T13:36:59.234 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:01:34:23.871 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T13:36:59.240 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:01:34:23.878 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T13:36:59.264 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:01:34:23.967 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T13:37:04.014 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_maxkeys_invalid ... ok 2019-12-08T13:37:10.774 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_marker_none ... ok 2019-12-08T13:37:16.982 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_marker_empty ... ok 2019-12-08T13:37:25.930 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_continuationtoken_empty ... ok 2019-12-08T13:37:32.130 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_marker_unreadable ... ok 2019-12-08T13:37:41.185 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_startafter_unreadable ... ok 2019-12-08T13:37:46.638 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_marker_not_in_list ... ok 2019-12-08T13:37:53.768 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_startafter_not_in_list ... ok 2019-12-08T13:38:00.473 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_marker_after_list ... ok 2019-12-08T13:38:07.218 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_startafter_after_list ... ok 2019-12-08T13:38:15.823 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_return_data ... ok 2019-12-08T13:38:35.173 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_return_data_versioning ... ok 2019-12-08T13:38:41.567 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_objects_anonymous ... ok 2019-12-08T13:38:46.921 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_objects_anonymous ... ok 2019-12-08T13:38:49.425 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_objects_anonymous_fail ... ok 2019-12-08T13:38:51.043 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_listv2_objects_anonymous_fail ... ok 2019-12-08T13:38:51.460 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_notexist ... ok 2019-12-08T13:38:51.975 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucketv2_notexist ... ok 2019-12-08T13:38:52.488 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_delete_notexist ... ok 2019-12-08T13:38:57.301 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_delete_nonempty ... ok 2019-12-08T13:39:04.732 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_concurrent_set_canned_acl ... ok 2019-12-08T13:39:04.935 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_write_to_nonexist_bucket ... ok 2019-12-08T13:39:12.738 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_delete ... ok 2019-12-08T13:39:16.488 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_read_notexist ... ok 2019-12-08T13:39:18.872 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_requestid_matches_header_on_error ... ok 2019-12-08T13:39:31.379 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_multi_object_delete ... ok 2019-12-08T13:39:43.142 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_multi_objectv2_delete ... ok 2019-12-08T13:39:47.425 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_head_zero_bytes ... ok 2019-12-08T13:39:50.965 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_write_check_etag ... ok 2019-12-08T13:39:53.975 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_write_cache_control ... ok 2019-12-08T13:39:56.616 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_write_expires ... ok 2019-12-08T13:40:05.211 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_write_read_update_read_delete ... ok 2019-12-08T13:40:08.714 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_set_get_metadata_none_to_good ... ok 2019-12-08T13:40:12.439 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_set_get_metadata_none_to_empty ... ok 2019-12-08T13:40:20.224 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_set_get_metadata_overwrite_to_empty ... ok 2019-12-08T13:40:24.367 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_set_get_unicode_metadata ... ok 2019-12-08T13:40:29.600 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_metadata_replaced_on_put ... ok 2019-12-08T13:40:32.639 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_write_file ... ok 2019-12-08T13:40:37.365 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_post_object_anonymous_request ... ok 2019-12-08T13:40:40.999 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_post_object_authenticated_request ... ok 2019-12-08T13:40:44.896 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_post_object_authenticated_no_content_type ... ok 2019-12-08T13:40:48.494 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_post_object_authenticated_request_bad_access_key ... ok 2019-12-08T13:40:53.971 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_post_object_set_success_code ... ok 2019-12-08T13:40:57.300 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_post_object_set_invalid_success_code ... ok 2019-12-08T13:41:02.819 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_post_object_upload_larger_than_chunk ... ok 2019-12-08T13:41:06.622 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_post_object_set_key_from_filename ... ok 2019-12-08T13:41:10.210 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_post_object_ignored_header ... ok 2019-12-08T13:41:14.477 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_post_object_case_insensitive_condition_fields ... ok 2019-12-08T13:41:21.235 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_post_object_escaped_field_values ... ok 2019-12-08T13:41:27.441 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_post_object_success_redirect_action ... ok 2019-12-08T13:41:29.805 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_post_object_invalid_signature ... ok 2019-12-08T13:41:32.245 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_post_object_invalid_access_key ... ok 2019-12-08T13:41:36.160 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_post_object_invalid_date_format ... ok 2019-12-08T13:41:40.017 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_post_object_no_key_specified ... ok 2019-12-08T13:41:42.561 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_post_object_missing_signature ... ok 2019-12-08T13:41:44.446 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_post_object_missing_policy_condition ... ok 2019-12-08T13:41:48.630 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_post_object_user_specified_header ... ok 2019-12-08T13:41:51.650 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_post_object_request_missing_policy_specified_field ... ok 2019-12-08T13:41:55.866 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_post_object_condition_is_case_sensitive ... ok 2019-12-08T13:41:59.022 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_post_object_expires_is_case_sensitive ... ok 2019-12-08T13:42:00.727 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_post_object_expired_policy ... ok 2019-12-08T13:42:02.825 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_post_object_invalid_request_field_value ... ok 2019-12-08T13:42:06.278 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_post_object_missing_expires_condition ... ok 2019-12-08T13:42:09.166 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_post_object_missing_conditions_list ... ok 2019-12-08T13:42:11.423 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:01:39:36.125 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T13:42:11.445 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:01:39:36.147 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T13:42:11.446 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:01:39:36.085 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T13:42:11.448 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:01:39:36.087 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T13:42:11.452 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:01:39:36.090 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T13:42:11.457 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:01:39:36.095 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T13:42:11.632 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:01:39:36.270 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T13:42:11.649 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:01:39:36.287 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T13:42:11.699 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:01:39:36.402 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T13:42:11.833 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_post_object_upload_size_limit_exceeded ... ok 2019-12-08T13:42:14.644 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_post_object_missing_content_length_argument ... ok 2019-12-08T13:42:16.105 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_post_object_invalid_content_length_argument ... ok 2019-12-08T13:42:18.337 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_post_object_upload_size_below_minimum ... ok 2019-12-08T13:42:21.135 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_post_object_empty_conditions ... ok 2019-12-08T13:42:25.849 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_get_object_ifmatch_good ... ok 2019-12-08T13:42:30.360 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_get_object_ifmatch_failed ... ok 2019-12-08T13:42:33.555 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_get_object_ifnonematch_good ... ok 2019-12-08T13:42:38.529 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_get_object_ifnonematch_failed ... ok 2019-12-08T13:42:44.914 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_get_object_ifmodifiedsince_good ... ok 2019-12-08T13:42:50.008 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_get_object_ifmodifiedsince_failed ... ok 2019-12-08T13:42:54.143 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_get_object_ifunmodifiedsince_good ... ok 2019-12-08T13:42:59.535 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_get_object_ifunmodifiedsince_failed ... ok 2019-12-08T13:43:04.452 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_put_object_ifmatch_good ... ok 2019-12-08T13:43:10.057 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_put_object_ifmatch_failed ... ok 2019-12-08T13:43:17.567 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_put_object_ifmatch_overwrite_existed_good ... ok 2019-12-08T13:43:20.065 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_put_object_ifmatch_nonexisted_failed ... ok 2019-12-08T13:43:26.141 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_put_object_ifnonmatch_good ... ok 2019-12-08T13:43:33.564 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_put_object_ifnonmatch_failed ... ok 2019-12-08T13:43:37.926 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_put_object_ifnonmatch_nonexisted_good ... ok 2019-12-08T13:43:43.157 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_put_object_ifnonmatch_overwrite_existed_failed ... ok 2019-12-08T13:43:46.850 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get ... ok 2019-12-08T13:43:50.724 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:01:41:15.426 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T13:43:50.740 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:01:41:15.442 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T13:43:50.763 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:01:41:15.402 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T13:43:50.789 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:01:41:15.427 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T13:43:50.799 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:01:41:15.438 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T13:43:50.816 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:01:41:15.455 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T13:43:50.839 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:01:41:15.478 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T13:43:50.844 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:01:41:15.546 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T13:43:50.865 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:01:41:15.504 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T13:43:56.263 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get_bucket_gone ... ok 2019-12-08T13:44:06.674 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_delete_key_bucket_gone ... ok 2019-12-08T13:44:11.269 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get_object_gone ... ok 2019-12-08T13:44:14.260 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_head ... ok 2019-12-08T13:44:25.044 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_head_extended ... ok 2019-12-08T13:44:30.894 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get_bucket_acl ... ok 2019-12-08T13:44:36.779 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get_object_acl ... ok 2019-12-08T13:44:39.505 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_raw_authenticated ... ok 2019-12-08T13:44:42.158 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_raw_response_headers ... ok 2019-12-08T13:44:45.472 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_raw_authenticated_bucket_acl ... ok 2019-12-08T13:44:46.252 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:01:42:10.955 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T13:44:46.257 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:01:42:10.960 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T13:44:46.306 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:01:42:10.945 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T13:44:46.307 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:01:42:10.946 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T13:44:46.356 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:01:42:10.995 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T13:44:46.388 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:01:42:11.090 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T13:44:46.419 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:01:42:11.058 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T13:44:46.441 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:01:42:11.080 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T13:44:46.510 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:01:42:11.149 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T13:44:47.379 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_raw_authenticated_object_acl ... ok 2019-12-08T13:44:55.488 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_raw_authenticated_bucket_gone ... ok 2019-12-08T13:45:01.124 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_raw_authenticated_object_gone ... ok 2019-12-08T13:45:05.237 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get_x_amz_expires_not_expired ... ok 2019-12-08T13:45:10.011 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get_x_amz_expires_out_range_zero ... ok 2019-12-08T13:45:12.617 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get_x_amz_expires_out_max_range ... ok 2019-12-08T13:45:15.484 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_raw_get_x_amz_expires_out_positive_range ... ok 2019-12-08T13:45:19.576 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_anon_put ... ok 2019-12-08T13:45:26.608 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_anon_put_write_access ... ok 2019-12-08T13:45:28.353 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_put_authenticated ... ok 2019-12-08T13:45:30.879 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_raw_put_authenticated_expired ... ok 2019-12-08T13:45:31.437 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_naming_bad_short_one ... ok 2019-12-08T13:45:31.886 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_naming_bad_short_two ... ok 2019-12-08T13:45:32.353 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_naming_bad_ip ... ok 2019-12-08T13:45:32.797 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_naming_dns_underscore ... ok 2019-12-08T13:45:36.158 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_exists ... ok 2019-12-08T13:45:40.518 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_get_location ... ok 2019-12-08T13:45:43.014 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_exists_nonowner ... ok 2019-12-08T13:45:44.091 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_default ... ok 2019-12-08T13:45:45.771 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_canned_during_create ... ok 2019-12-08T13:45:49.974 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_canned ... ok 2019-12-08T13:45:52.085 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_canned_publicreadwrite ... ok 2019-12-08T13:45:53.909 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_canned_authenticatedread ... ok 2019-12-08T13:45:57.369 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_acl_default ... ok 2019-12-08T13:46:00.157 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_acl_canned_during_create ... ok 2019-12-08T13:46:05.490 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_acl_canned ... ok 2019-12-08T13:46:08.856 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_acl_canned_publicreadwrite ... ok 2019-12-08T13:46:13.310 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_acl_canned_authenticatedread ... ok 2019-12-08T13:46:18.394 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_acl_canned_bucketownerread ... ok 2019-12-08T13:46:24.461 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_acl_canned_bucketownerfullcontrol ... ok 2019-12-08T13:46:31.106 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_acl_full_control_verify_owner ... ok 2019-12-08T13:46:38.040 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_acl_full_control_verify_attributes ... ok 2019-12-08T13:46:41.683 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_canned_private_to_private ... ok 2019-12-08T13:46:47.405 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_acl ... ok 2019-12-08T13:46:54.175 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_acl_write ... ok 2019-12-08T13:47:01.045 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_acl_writeacp ... ok 2019-12-08T13:47:05.070 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_acl_read ... ok 2019-12-08T13:47:12.072 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_acl_readacp ... ok 2019-12-08T13:47:20.259 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_grant_userid_fullcontrol ... ok 2019-12-08T13:47:22.865 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:01:44:47.568 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T13:47:22.873 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:01:44:47.575 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T13:47:22.885 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:01:44:47.525 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T13:47:22.890 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:01:44:47.529 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T13:47:22.896 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:01:44:47.535 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T13:47:22.897 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:01:44:47.537 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T13:47:23.011 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:01:44:47.651 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T13:47:23.023 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:01:44:47.663 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T13:47:23.028 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:01:44:47.731 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T13:47:24.008 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_grant_userid_read ... ok 2019-12-08T13:47:28.641 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_grant_userid_readacp ... ok 2019-12-08T13:47:34.893 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_grant_userid_write ... ok 2019-12-08T13:47:38.996 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_grant_userid_writeacp ... ok 2019-12-08T13:47:42.826 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_grant_nonexist_user ... ok 2019-12-08T13:47:51.498 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_no_grants ... ok 2019-12-08T13:47:55.988 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_header_acl_grants ... ok 2019-12-08T13:48:02.998 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_header_acl_grants ... ok 2019-12-08T13:48:07.304 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_grant_email ... ok 2019-12-08T13:48:10.130 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_grant_email_notexist ... ok 2019-12-08T13:48:17.624 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_acl_revoke_all ... ok 2019-12-08T13:48:25.453 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_private_object_private ... ok 2019-12-08T13:48:34.398 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_private_objectv2_private ... ok 2019-12-08T13:48:41.866 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_private_object_publicread ... ok 2019-12-08T13:48:50.278 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_private_objectv2_publicread ... ok 2019-12-08T13:48:57.068 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_private_object_publicreadwrite ... ok 2019-12-08T13:49:04.660 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_private_objectv2_publicreadwrite ... ok 2019-12-08T13:49:12.735 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_publicread_object_private ... ok 2019-12-08T13:49:21.682 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_publicread_object_publicread ... ok 2019-12-08T13:49:30.581 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_publicread_object_publicreadwrite ... ok 2019-12-08T13:49:44.190 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_publicreadwrite_object_private ... ok 2019-12-08T13:49:58.242 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_publicreadwrite_object_publicread ... ok 2019-12-08T13:50:12.400 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_access_bucket_publicreadwrite_object_publicreadwrite ... ok 2019-12-08T13:50:26.782 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_buckets_create_then_list ... ok 2019-12-08T13:50:27.499 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_list_buckets_anonymous ... ok 2019-12-08T13:50:28.492 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_list_buckets_invalid_auth ... ok 2019-12-08T13:50:28.801 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_list_buckets_bad_auth ... ok 2019-12-08T13:50:37.303 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_naming_good_starts_alpha ... ok 2019-12-08T13:50:47.300 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_naming_good_starts_digit ... ok 2019-12-08T13:50:49.200 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_naming_good_contains_period ... ok 2019-12-08T13:50:53.585 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_naming_good_contains_hyphen ... ok 2019-12-08T13:51:04.379 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_recreate_not_overriding ... ok 2019-12-08T13:51:38.991 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_create_special_key_names ... ok 2019-12-08T13:51:50.295 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_list_special_prefix ... ok 2019-12-08T13:51:56.334 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_copy_zero_size ... ok 2019-12-08T13:52:01.512 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_copy_same_bucket ... ok 2019-12-08T13:52:05.525 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_copy_verify_contenttype ... ok 2019-12-08T13:52:09.391 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_copy_to_itself ... ok 2019-12-08T13:52:13.008 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:01:49:37.710 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T13:52:13.019 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:01:49:37.721 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T13:52:13.020 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:01:49:37.661 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T13:52:13.026 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:01:49:37.667 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T13:52:13.029 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:01:49:37.669 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T13:52:13.033 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:01:49:37.674 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T13:52:13.152 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:01:49:37.793 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T13:52:13.173 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:01:49:37.814 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T13:52:13.269 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:01:49:37.971 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T13:52:14.235 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_copy_to_itself_with_metadata ... ok 2019-12-08T13:52:22.977 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_copy_diff_bucket ... ok 2019-12-08T13:52:29.514 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_copy_not_owned_bucket ... ok 2019-12-08T13:52:34.625 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:01:49:59.327 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T13:52:34.631 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:01:49:59.333 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T13:52:34.643 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:01:49:59.284 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T13:52:34.646 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:01:49:59.287 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T13:52:34.649 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:01:49:59.291 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T13:52:34.650 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:01:49:59.291 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T13:52:34.689 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:01:49:59.330 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T13:52:34.690 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:01:49:59.331 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T13:52:34.699 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:01:49:59.402 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T13:52:38.094 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_copy_not_owned_object_bucket ... ok 2019-12-08T13:52:45.243 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_copy_canned_acl ... ok 2019-12-08T13:52:56.698 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_copy_retaining_metadata ... ok 2019-12-08T13:53:08.616 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_copy_replacing_metadata ... ok 2019-12-08T13:53:11.299 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_copy_bucket_not_found ... ok 2019-12-08T13:53:13.276 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_copy_key_not_found ... ok 2019-12-08T13:53:43.912 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_copy_versioned_bucket ... ok 2019-12-08T13:53:57.969 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_copy_versioned_url_encoding ... ok 2019-12-08T13:54:32.945 INFO:tasks.rgw.client.0.smithi079.stdout:2019-12-08T13:54:32.849+0000 3fa61700 -1 handle_data failed with exit code -5 2019-12-08T13:54:59.796 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_copy_versioning_multipart_upload ... ok 2019-12-08T13:55:03.176 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_empty ... ok 2019-12-08T13:55:10.284 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_small ... ok 2019-12-08T13:55:28.695 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_multipart_copy_small ... ok 2019-12-08T13:55:34.811 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_multipart_copy_invalid_range ... ok 2019-12-08T13:55:46.990 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_multipart_copy_without_range ... ok 2019-12-08T13:56:32.074 INFO:tasks.rgw.client.0.smithi079.stdout:2019-12-08T13:56:32.071+0000 40262700 -1 handle_data failed with exit code -5 2019-12-08T13:56:43.641 INFO:tasks.rgw.client.0.smithi079.stdout:2019-12-08T13:56:43.642+0000 3fa61700 -1 handle_data failed with exit code -5 2019-12-08T13:56:44.342 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_multipart_copy_special_names ... ok 2019-12-08T13:57:12.147 INFO:tasks.rgw.client.0.smithi079.stdout:2019-12-08T13:57:12.123+0000 40262700 -1 handle_data failed with exit code -5 2019-12-08T13:57:39.540 INFO:tasks.rgw.client.0.smithi079.stdout:2019-12-08T13:57:39.527+0000 3fa61700 -1 handle_data failed with exit code -5 2019-12-08T13:57:43.062 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload ... ok 2019-12-08T13:57:48.822 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:01:55:13.523 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T13:57:48.828 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:01:55:13.530 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T13:57:48.834 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:01:55:13.476 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T13:57:48.838 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:01:55:13.480 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T13:57:48.844 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:01:55:13.486 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T13:57:48.852 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:01:55:13.494 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T13:57:49.024 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:01:55:13.666 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T13:57:49.048 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:01:55:13.750 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T13:57:49.056 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:01:55:13.699 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T13:58:32.641 INFO:tasks.rgw.client.0.smithi079.stdout:2019-12-08T13:58:32.512+0000 40262700 -1 handle_data failed with exit code -5 2019-12-08T13:58:55.131 INFO:tasks.rgw.client.0.smithi079.stdout:2019-12-08T13:58:55.047+0000 3fa61700 -1 handle_data failed with exit code -5 2019-12-08T13:59:18.267 INFO:tasks.rgw.client.0.smithi079.stdout:2019-12-08T13:59:17.985+0000 3fa61700 -1 handle_data failed with exit code -5 2019-12-08T13:59:19.308 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_multipart_copy_versioned ... ok 2019-12-08T13:59:19.430 INFO:tasks.rgw.client.0.smithi079.stdout:2019-12-08T13:59:19.339+0000 40262700 -1 handle_data failed with exit code -5 2019-12-08T13:59:51.968 INFO:tasks.rgw.client.0.smithi079.stdout:2019-12-08T13:59:51.939+0000 3fa61700 -1 handle_data failed with exit code -5 2019-12-08T14:00:25.338 INFO:tasks.rgw.client.0.smithi079.stdout:2019-12-08T14:00:25.324+0000 3fa61700 -1 handle_data failed with exit code -5 2019-12-08T14:00:35.258 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:01:57:59.900 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T14:00:35.263 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:01:57:59.965 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T14:00:35.285 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:01:57:59.927 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T14:00:35.289 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:01:57:59.991 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T14:00:35.318 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:01:57:59.960 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T14:00:35.334 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:01:57:59.977 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T14:00:35.365 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:01:58:00.007 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T14:00:35.405 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:01:58:00.107 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T14:00:35.454 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:01:58:00.097 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T14:01:01.131 INFO:tasks.rgw.client.0.smithi079.stdout:2019-12-08T14:01:01.087+0000 3fa61700 -1 handle_data failed with exit code -5 2019-12-08T14:01:32.840 INFO:tasks.rgw.client.0.smithi079.stdout:2019-12-08T14:01:32.779+0000 3fa61700 -1 handle_data failed with exit code -5 2019-12-08T14:02:06.339 INFO:tasks.rgw.client.0.smithi079.stdout:2019-12-08T14:02:06.324+0000 3fa61700 -1 handle_data failed with exit code -5 2019-12-08T14:02:34.110 INFO:tasks.rgw.client.0.smithi079.stdout:2019-12-08T14:02:34.060+0000 3fa61700 -1 handle_data failed with exit code -5 2019-12-08T14:02:55.919 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:02:00:20.620 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T14:02:55.927 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:02:00:20.629 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T14:02:55.933 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:02:00:20.575 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T14:02:55.937 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:02:00:20.579 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T14:02:55.946 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:02:00:20.588 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T14:02:55.950 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:02:00:20.592 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T14:02:56.048 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:02:00:20.690 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T14:02:56.061 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:02:00:20.703 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T14:02:56.104 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:02:00:20.805 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T14:03:08.879 INFO:tasks.rgw.client.0.smithi079.stdout:2019-12-08T14:03:08.716+0000 3fa61700 -1 handle_data failed with exit code -5 2019-12-08T14:03:38.887 INFO:tasks.rgw.client.0.smithi079.stdout:2019-12-08T14:03:38.863+0000 3fa61700 -1 handle_data failed with exit code -5 2019-12-08T14:05:21.414 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_resend_part ... ok 2019-12-08T14:06:28.888 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_multiple_sizes ... ok 2019-12-08T14:06:47.854 INFO:tasks.rgw.client.0.smithi079.stdout:2019-12-08T14:06:47.805+0000 40262700 -1 handle_data failed with exit code -5 2019-12-08T14:07:02.451 INFO:tasks.rgw.client.0.smithi079.stdout:2019-12-08T14:07:02.441+0000 3fa61700 -1 handle_data failed with exit code -5 2019-12-08T14:07:14.174 INFO:tasks.rgw.client.0.smithi079.stdout:2019-12-08T14:07:14.141+0000 3fa61700 -1 handle_data failed with exit code -5 2019-12-08T14:07:32.935 INFO:tasks.rgw.client.0.smithi079.stdout:2019-12-08T14:07:32.873+0000 3fa61700 -1 handle_data failed with exit code -5 2019-12-08T14:07:52.952 INFO:tasks.rgw.client.0.smithi079.stdout:2019-12-08T14:07:52.917+0000 40262700 -1 handle_data failed with exit code -5 2019-12-08T14:08:09.214 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:02:05:33.916 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T14:08:09.224 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:02:05:33.926 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T14:08:09.232 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:02:05:33.873 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T14:08:09.235 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:02:05:33.876 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T14:08:09.237 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:02:05:33.878 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T14:08:09.239 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:02:05:33.880 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T14:08:09.427 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:02:05:34.068 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T14:08:09.428 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:02:05:34.069 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T14:08:09.460 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:02:05:34.161 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T14:08:09.808 INFO:tasks.rgw.client.0.smithi079.stdout:2019-12-08T14:08:09.778+0000 3fa61700 -1 handle_data failed with exit code -5 2019-12-08T14:08:10.524 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_multipart_copy_multiple_sizes ... ok 2019-12-08T14:08:39.053 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_size_too_small ... ok 2019-12-08T14:09:02.287 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:02:06:26.988 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T14:09:02.295 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:02:06:26.936 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T14:09:02.297 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:02:06:26.999 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T14:09:02.300 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:02:06:26.941 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T14:09:02.351 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:02:06:26.991 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T14:09:02.353 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:02:06:26.994 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T14:09:02.372 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:02:06:27.012 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T14:09:02.396 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:02:06:27.036 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T14:09:02.396 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:02:06:27.098 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T14:09:03.950 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_contents ... ok 2019-12-08T14:09:22.829 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_overwrite_existing_object ... ok 2019-12-08T14:09:34.974 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_abort_multipart_upload ... ok 2019-12-08T14:09:37.987 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_abort_multipart_upload_not_found ... ok 2019-12-08T14:10:00.886 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_list_multipart_upload ... ok 2019-12-08T14:10:06.725 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_missing_part ... ok 2019-12-08T14:10:15.175 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_multipart_upload_incorrect_etag ... ok 2019-12-08T14:10:18.032 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_100_continue ... ok 2019-12-08T14:10:23.894 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_set_cors ... ok 2019-12-08T14:10:47.664 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_cors_origin_response ... ok 2019-12-08T14:10:56.140 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_cors_origin_wildcard ... ok 2019-12-08T14:11:03.740 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_cors_header_option ... ok 2019-12-08T14:11:10.791 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_atomic_read_1mb ... ok 2019-12-08T14:11:19.868 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_atomic_read_4mb ... ok 2019-12-08T14:11:34.476 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_atomic_read_8mb ... ok 2019-12-08T14:11:45.988 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_atomic_write_1mb ... ok 2019-12-08T14:11:58.801 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_atomic_write_4mb ... ok 2019-12-08T14:12:21.161 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_atomic_write_8mb ... ok 2019-12-08T14:12:35.860 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_atomic_dual_write_1mb ... ok 2019-12-08T14:12:54.181 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_atomic_dual_write_4mb ... ok 2019-12-08T14:13:13.095 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_atomic_dual_write_8mb ... ok 2019-12-08T14:13:20.965 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:02:10:45.667 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T14:13:20.978 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:02:10:45.619 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T14:13:20.979 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:02:10:45.681 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T14:13:20.980 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:02:10:45.621 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T14:13:20.984 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:02:10:45.624 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T14:13:20.986 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:02:10:45.626 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T14:13:21.159 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:02:10:45.800 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T14:13:21.161 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:02:10:45.802 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T14:13:21.226 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:02:10:45.928 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T14:13:21.568 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_atomic_conditional_write_1mb ... ok 2019-12-08T14:13:28.304 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_atomic_multipart_upload_write ... ok 2019-12-08T14:13:47.266 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_multipart_resend_first_finishes_last ... ok 2019-12-08T14:13:52.306 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_ranged_request_response_code ... ok 2019-12-08T14:14:01.763 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_ranged_big_request_response_code ... ok 2019-12-08T14:14:06.271 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_ranged_request_skip_leading_bytes_response_code ... ok 2019-12-08T14:14:11.138 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_ranged_request_return_trailing_bytes_response_code ... ok 2019-12-08T14:14:15.441 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_ranged_request_invalid_range ... ok 2019-12-08T14:14:18.659 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_ranged_request_empty_object ... ok 2019-12-08T14:14:27.483 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_versioning_bucket_create_suspend ... ok 2019-12-08T14:17:24.170 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:02:14:48.871 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T14:17:24.175 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:02:14:48.877 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T14:17:24.227 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:02:14:48.867 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T14:17:24.229 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:02:14:48.870 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T14:17:24.231 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:02:14:48.872 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T14:17:24.239 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:02:14:48.880 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T14:17:24.337 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:02:14:49.039 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T14:17:24.355 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:02:14:48.996 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T14:17:24.363 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:02:14:49.003 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T14:18:31.999 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:02:15:56.700 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T14:18:32.007 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:02:15:56.709 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T14:18:32.012 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:02:15:56.652 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T14:18:32.012 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:02:15:56.653 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T14:18:32.016 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:02:15:56.656 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T14:18:32.017 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:02:15:56.657 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T14:18:32.074 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:02:15:56.775 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T14:18:32.087 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:02:15:56.727 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T14:18:32.095 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:02:15:56.735 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T14:18:33.154 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_create_read_remove ... ok 2019-12-08T14:19:27.133 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_create_read_remove_head ... ok 2019-12-08T14:19:39.080 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_plain_null_version_removal ... ok 2019-12-08T14:19:59.713 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_plain_null_version_overwrite ... ok 2019-12-08T14:20:14.767 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_plain_null_version_overwrite_suspended ... ok 2019-12-08T14:22:16.341 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_suspend_versions ... ok 2019-12-08T14:23:41.973 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:02:21:06.674 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T14:23:41.981 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:02:21:06.683 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T14:23:41.991 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:02:21:06.632 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T14:23:41.994 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:02:21:06.635 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T14:23:42.007 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:02:21:06.648 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T14:23:42.013 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:02:21:06.654 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T14:23:42.164 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:02:21:06.805 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T14:23:42.198 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:02:21:06.839 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T14:23:42.202 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:02:21:06.903 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T14:24:07.654 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_create_versions_remove_all ... ok 2019-12-08T14:25:11.404 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:02:22:36.106 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T14:25:11.414 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:02:22:36.116 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T14:25:11.416 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:02:22:36.057 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T14:25:11.433 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:02:22:36.074 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T14:25:11.436 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:02:22:36.077 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T14:25:11.443 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:02:22:36.083 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T14:25:11.511 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:02:22:36.151 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T14:25:11.562 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:02:22:36.203 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T14:25:11.634 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:02:22:36.336 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T14:25:46.628 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:02:23:11.330 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T14:25:46.635 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:02:23:11.337 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T14:25:46.674 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:02:23:11.376 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T14:25:46.680 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:02:23:11.321 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T14:25:46.691 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:02:23:11.332 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T14:25:46.694 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:02:23:11.335 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T14:25:46.696 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:02:23:11.337 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T14:25:46.720 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:02:23:11.360 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T14:25:46.727 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:02:23:11.368 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T14:28:52.453 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:02:26:17.155 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T14:28:52.460 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:02:26:17.162 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T14:28:52.465 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:02:26:17.106 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T14:28:52.465 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:02:26:17.107 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T14:28:52.469 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:02:26:17.111 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T14:28:52.472 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:02:26:17.114 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T14:28:52.604 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:02:26:17.245 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T14:28:52.608 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:02:26:17.249 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T14:28:52.694 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:02:26:17.396 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T14:30:49.998 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_create_versions_remove_special_names ... ok 2019-12-08T14:32:19.013 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_create_overwrite_multipart ... ok 2019-12-08T14:32:58.253 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_versioning_obj_list_marker ... ok 2019-12-08T14:33:37.661 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_versioning_copy_obj_version ... ok 2019-12-08T14:34:01.153 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_versioning_multi_object_delete ... ok 2019-12-08T14:34:04.615 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:02:31:29.317 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T14:34:04.623 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:02:31:29.325 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T14:34:04.627 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:02:31:29.269 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T14:34:04.631 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:02:31:29.274 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T14:34:04.634 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:02:31:29.277 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T14:34:04.639 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:02:31:29.282 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T14:34:04.833 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:02:31:29.535 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T14:34:04.856 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:02:31:29.498 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T14:34:04.864 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:02:31:29.506 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T14:34:08.592 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:02:31:33.294 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T14:34:08.641 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:02:31:33.343 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T14:34:08.644 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:02:31:33.286 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T14:34:08.646 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:02:31:33.288 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T14:34:08.666 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:02:31:33.368 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T14:34:08.668 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:02:31:33.310 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T14:34:08.670 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:02:31:33.312 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T14:34:08.691 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:02:31:33.333 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T14:34:08.693 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:02:31:33.335 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T14:34:30.197 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_versioning_multi_object_delete_with_marker ... ok 2019-12-08T14:34:35.651 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_versioning_multi_object_delete_with_marker_create ... ok 2019-12-08T14:34:49.679 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_versioned_object_acl ... ok 2019-12-08T14:35:04.581 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_versioned_object_acl_no_version_specified ... ok 2019-12-08T14:35:09.437 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_versioned_concurrent_object_create_concurrent_remove ... Exception in thread Thread-53: 2019-12-08T14:35:09.437 INFO:teuthology.orchestra.run.smithi079.stderr:Traceback (most recent call last): 2019-12-08T14:35:09.437 INFO:teuthology.orchestra.run.smithi079.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-08T14:35:09.438 INFO:teuthology.orchestra.run.smithi079.stderr: self.run() 2019-12-08T14:35:09.438 INFO:teuthology.orchestra.run.smithi079.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-08T14:35:09.438 INFO:teuthology.orchestra.run.smithi079.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-08T14:35:09.438 INFO:teuthology.orchestra.run.smithi079.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-12-08T14:35:09.438 INFO:teuthology.orchestra.run.smithi079.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-08T14:35:09.438 INFO:teuthology.orchestra.run.smithi079.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-08T14:35:09.438 INFO:teuthology.orchestra.run.smithi079.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-08T14:35:09.439 INFO:teuthology.orchestra.run.smithi079.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-08T14:35:09.439 INFO:teuthology.orchestra.run.smithi079.stderr: raise error_class(parsed_response, operation_name) 2019-12-08T14:35:09.439 INFO:teuthology.orchestra.run.smithi079.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-08T14:35:09.439 INFO:teuthology.orchestra.run.smithi079.stderr: 2019-12-08T14:35:09.470 INFO:teuthology.orchestra.run.smithi079.stderr:Exception in thread Thread-54: 2019-12-08T14:35:09.470 INFO:teuthology.orchestra.run.smithi079.stderr:Traceback (most recent call last): 2019-12-08T14:35:09.470 INFO:teuthology.orchestra.run.smithi079.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-08T14:35:09.470 INFO:teuthology.orchestra.run.smithi079.stderr: self.run() 2019-12-08T14:35:09.470 INFO:teuthology.orchestra.run.smithi079.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-08T14:35:09.470 INFO:teuthology.orchestra.run.smithi079.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-08T14:35:09.471 INFO:teuthology.orchestra.run.smithi079.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-12-08T14:35:09.471 INFO:teuthology.orchestra.run.smithi079.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-08T14:35:09.471 INFO:teuthology.orchestra.run.smithi079.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-08T14:35:09.471 INFO:teuthology.orchestra.run.smithi079.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-08T14:35:09.471 INFO:teuthology.orchestra.run.smithi079.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-08T14:35:09.471 INFO:teuthology.orchestra.run.smithi079.stderr: raise error_class(parsed_response, operation_name) 2019-12-08T14:35:09.472 INFO:teuthology.orchestra.run.smithi079.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-08T14:35:09.472 INFO:teuthology.orchestra.run.smithi079.stderr: 2019-12-08T14:35:09.475 INFO:teuthology.orchestra.run.smithi079.stderr:Exception in thread Thread-55: 2019-12-08T14:35:09.475 INFO:teuthology.orchestra.run.smithi079.stderr:Traceback (most recent call last): 2019-12-08T14:35:09.475 INFO:teuthology.orchestra.run.smithi079.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-08T14:35:09.475 INFO:teuthology.orchestra.run.smithi079.stderr: self.run() 2019-12-08T14:35:09.475 INFO:teuthology.orchestra.run.smithi079.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-08T14:35:09.476 INFO:teuthology.orchestra.run.smithi079.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-08T14:35:09.476 INFO:teuthology.orchestra.run.smithi079.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-12-08T14:35:09.476 INFO:teuthology.orchestra.run.smithi079.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-08T14:35:09.476 INFO:teuthology.orchestra.run.smithi079.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-08T14:35:09.476 INFO:teuthology.orchestra.run.smithi079.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-08T14:35:09.476 INFO:teuthology.orchestra.run.smithi079.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-08T14:35:09.476 INFO:teuthology.orchestra.run.smithi079.stderr: raise error_class(parsed_response, operation_name) 2019-12-08T14:35:09.477 INFO:teuthology.orchestra.run.smithi079.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-08T14:35:09.477 INFO:teuthology.orchestra.run.smithi079.stderr: 2019-12-08T14:35:10.316 INFO:teuthology.orchestra.run.smithi079.stderr:Exception in thread Thread-52: 2019-12-08T14:35:10.316 INFO:teuthology.orchestra.run.smithi079.stderr:Traceback (most recent call last): 2019-12-08T14:35:10.317 INFO:teuthology.orchestra.run.smithi079.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-08T14:35:10.317 INFO:teuthology.orchestra.run.smithi079.stderr: self.run() 2019-12-08T14:35:10.317 INFO:teuthology.orchestra.run.smithi079.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-08T14:35:10.317 INFO:teuthology.orchestra.run.smithi079.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-08T14:35:10.317 INFO:teuthology.orchestra.run.smithi079.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-12-08T14:35:10.317 INFO:teuthology.orchestra.run.smithi079.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-08T14:35:10.317 INFO:teuthology.orchestra.run.smithi079.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-08T14:35:10.318 INFO:teuthology.orchestra.run.smithi079.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-08T14:35:10.318 INFO:teuthology.orchestra.run.smithi079.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-08T14:35:10.318 INFO:teuthology.orchestra.run.smithi079.stderr: raise error_class(parsed_response, operation_name) 2019-12-08T14:35:10.318 INFO:teuthology.orchestra.run.smithi079.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-08T14:35:10.318 INFO:teuthology.orchestra.run.smithi079.stderr: 2019-12-08T14:35:21.570 INFO:teuthology.orchestra.run.smithi079.stderr:Exception in thread Thread-65: 2019-12-08T14:35:21.570 INFO:teuthology.orchestra.run.smithi079.stderr:Traceback (most recent call last): 2019-12-08T14:35:21.570 INFO:teuthology.orchestra.run.smithi079.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-08T14:35:21.570 INFO:teuthology.orchestra.run.smithi079.stderr: self.run() 2019-12-08T14:35:21.570 INFO:teuthology.orchestra.run.smithi079.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-08T14:35:21.570 INFO:teuthology.orchestra.run.smithi079.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-08T14:35:21.571 INFO:teuthology.orchestra.run.smithi079.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-12-08T14:35:21.571 INFO:teuthology.orchestra.run.smithi079.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-08T14:35:21.571 INFO:teuthology.orchestra.run.smithi079.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-08T14:35:21.571 INFO:teuthology.orchestra.run.smithi079.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-08T14:35:21.571 INFO:teuthology.orchestra.run.smithi079.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-08T14:35:21.571 INFO:teuthology.orchestra.run.smithi079.stderr: raise error_class(parsed_response, operation_name) 2019-12-08T14:35:21.571 INFO:teuthology.orchestra.run.smithi079.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-08T14:35:21.572 INFO:teuthology.orchestra.run.smithi079.stderr: 2019-12-08T14:35:22.144 INFO:teuthology.orchestra.run.smithi079.stderr:Exception in thread Thread-64: 2019-12-08T14:35:22.144 INFO:teuthology.orchestra.run.smithi079.stderr:Traceback (most recent call last): 2019-12-08T14:35:22.144 INFO:teuthology.orchestra.run.smithi079.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-08T14:35:22.144 INFO:teuthology.orchestra.run.smithi079.stderr: self.run() 2019-12-08T14:35:22.144 INFO:teuthology.orchestra.run.smithi079.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-08T14:35:22.144 INFO:teuthology.orchestra.run.smithi079.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-08T14:35:22.145 INFO:teuthology.orchestra.run.smithi079.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-12-08T14:35:22.145 INFO:teuthology.orchestra.run.smithi079.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-08T14:35:22.145 INFO:teuthology.orchestra.run.smithi079.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-08T14:35:22.145 INFO:teuthology.orchestra.run.smithi079.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-08T14:35:22.145 INFO:teuthology.orchestra.run.smithi079.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-08T14:35:22.145 INFO:teuthology.orchestra.run.smithi079.stderr: raise error_class(parsed_response, operation_name) 2019-12-08T14:35:22.145 INFO:teuthology.orchestra.run.smithi079.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-08T14:35:22.146 INFO:teuthology.orchestra.run.smithi079.stderr: 2019-12-08T14:35:22.248 INFO:teuthology.orchestra.run.smithi079.stderr:Exception in thread Thread-63: 2019-12-08T14:35:22.249 INFO:teuthology.orchestra.run.smithi079.stderr:Traceback (most recent call last): 2019-12-08T14:35:22.249 INFO:teuthology.orchestra.run.smithi079.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-08T14:35:22.249 INFO:teuthology.orchestra.run.smithi079.stderr: self.run() 2019-12-08T14:35:22.249 INFO:teuthology.orchestra.run.smithi079.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-08T14:35:22.249 INFO:teuthology.orchestra.run.smithi079.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-08T14:35:22.249 INFO:teuthology.orchestra.run.smithi079.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-12-08T14:35:22.249 INFO:teuthology.orchestra.run.smithi079.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-08T14:35:22.250 INFO:teuthology.orchestra.run.smithi079.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-08T14:35:22.250 INFO:teuthology.orchestra.run.smithi079.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-08T14:35:22.250 INFO:teuthology.orchestra.run.smithi079.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-08T14:35:22.250 INFO:teuthology.orchestra.run.smithi079.stderr: raise error_class(parsed_response, operation_name) 2019-12-08T14:35:22.250 INFO:teuthology.orchestra.run.smithi079.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-08T14:35:22.250 INFO:teuthology.orchestra.run.smithi079.stderr: 2019-12-08T14:35:22.301 INFO:teuthology.orchestra.run.smithi079.stderr:Exception in thread Thread-62: 2019-12-08T14:35:22.301 INFO:teuthology.orchestra.run.smithi079.stderr:Traceback (most recent call last): 2019-12-08T14:35:22.301 INFO:teuthology.orchestra.run.smithi079.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-08T14:35:22.301 INFO:teuthology.orchestra.run.smithi079.stderr: self.run() 2019-12-08T14:35:22.301 INFO:teuthology.orchestra.run.smithi079.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-08T14:35:22.301 INFO:teuthology.orchestra.run.smithi079.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-08T14:35:22.302 INFO:teuthology.orchestra.run.smithi079.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-12-08T14:35:22.302 INFO:teuthology.orchestra.run.smithi079.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-08T14:35:22.302 INFO:teuthology.orchestra.run.smithi079.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-08T14:35:22.302 INFO:teuthology.orchestra.run.smithi079.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-08T14:35:22.302 INFO:teuthology.orchestra.run.smithi079.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-08T14:35:22.302 INFO:teuthology.orchestra.run.smithi079.stderr: raise error_class(parsed_response, operation_name) 2019-12-08T14:35:22.303 INFO:teuthology.orchestra.run.smithi079.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-08T14:35:22.303 INFO:teuthology.orchestra.run.smithi079.stderr: 2019-12-08T14:35:32.058 INFO:teuthology.orchestra.run.smithi079.stderr:Exception in thread Thread-74: 2019-12-08T14:35:32.058 INFO:teuthology.orchestra.run.smithi079.stderr:Traceback (most recent call last): 2019-12-08T14:35:32.058 INFO:teuthology.orchestra.run.smithi079.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-08T14:35:32.058 INFO:teuthology.orchestra.run.smithi079.stderr: self.run() 2019-12-08T14:35:32.059 INFO:teuthology.orchestra.run.smithi079.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-08T14:35:32.059 INFO:teuthology.orchestra.run.smithi079.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-08T14:35:32.059 INFO:teuthology.orchestra.run.smithi079.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-12-08T14:35:32.059 INFO:teuthology.orchestra.run.smithi079.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-08T14:35:32.059 INFO:teuthology.orchestra.run.smithi079.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-08T14:35:32.059 INFO:teuthology.orchestra.run.smithi079.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-08T14:35:32.059 INFO:teuthology.orchestra.run.smithi079.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-08T14:35:32.060 INFO:teuthology.orchestra.run.smithi079.stderr: raise error_class(parsed_response, operation_name) 2019-12-08T14:35:32.060 INFO:teuthology.orchestra.run.smithi079.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-08T14:35:32.060 INFO:teuthology.orchestra.run.smithi079.stderr: 2019-12-08T14:35:32.741 INFO:teuthology.orchestra.run.smithi079.stderr:Exception in thread Thread-75: 2019-12-08T14:35:32.741 INFO:teuthology.orchestra.run.smithi079.stderr:Traceback (most recent call last): 2019-12-08T14:35:32.741 INFO:teuthology.orchestra.run.smithi079.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-08T14:35:32.741 INFO:teuthology.orchestra.run.smithi079.stderr: self.run() 2019-12-08T14:35:32.742 INFO:teuthology.orchestra.run.smithi079.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-08T14:35:32.742 INFO:teuthology.orchestra.run.smithi079.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-08T14:35:32.742 INFO:teuthology.orchestra.run.smithi079.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-12-08T14:35:32.742 INFO:teuthology.orchestra.run.smithi079.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-08T14:35:32.742 INFO:teuthology.orchestra.run.smithi079.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-08T14:35:32.742 INFO:teuthology.orchestra.run.smithi079.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-08T14:35:32.742 INFO:teuthology.orchestra.run.smithi079.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-08T14:35:32.743 INFO:teuthology.orchestra.run.smithi079.stderr: raise error_class(parsed_response, operation_name) 2019-12-08T14:35:32.743 INFO:teuthology.orchestra.run.smithi079.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-08T14:35:32.743 INFO:teuthology.orchestra.run.smithi079.stderr: 2019-12-08T14:35:33.216 INFO:teuthology.orchestra.run.smithi079.stderr:Exception in thread Thread-72: 2019-12-08T14:35:33.216 INFO:teuthology.orchestra.run.smithi079.stderr:Traceback (most recent call last): 2019-12-08T14:35:33.217 INFO:teuthology.orchestra.run.smithi079.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-08T14:35:33.217 INFO:teuthology.orchestra.run.smithi079.stderr: self.run() 2019-12-08T14:35:33.217 INFO:teuthology.orchestra.run.smithi079.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-08T14:35:33.217 INFO:teuthology.orchestra.run.smithi079.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-08T14:35:33.217 INFO:teuthology.orchestra.run.smithi079.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-12-08T14:35:33.217 INFO:teuthology.orchestra.run.smithi079.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-08T14:35:33.218 INFO:teuthology.orchestra.run.smithi079.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-08T14:35:33.218 INFO:teuthology.orchestra.run.smithi079.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-08T14:35:33.218 INFO:teuthology.orchestra.run.smithi079.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-08T14:35:33.218 INFO:teuthology.orchestra.run.smithi079.stderr: raise error_class(parsed_response, operation_name) 2019-12-08T14:35:33.218 INFO:teuthology.orchestra.run.smithi079.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-08T14:35:33.218 INFO:teuthology.orchestra.run.smithi079.stderr: 2019-12-08T14:35:33.560 INFO:teuthology.orchestra.run.smithi079.stderr:Exception in thread Thread-73: 2019-12-08T14:35:33.560 INFO:teuthology.orchestra.run.smithi079.stderr:Traceback (most recent call last): 2019-12-08T14:35:33.561 INFO:teuthology.orchestra.run.smithi079.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-08T14:35:33.561 INFO:teuthology.orchestra.run.smithi079.stderr: self.run() 2019-12-08T14:35:33.561 INFO:teuthology.orchestra.run.smithi079.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-08T14:35:33.561 INFO:teuthology.orchestra.run.smithi079.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-08T14:35:33.561 INFO:teuthology.orchestra.run.smithi079.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-12-08T14:35:33.561 INFO:teuthology.orchestra.run.smithi079.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-08T14:35:33.561 INFO:teuthology.orchestra.run.smithi079.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-08T14:35:33.562 INFO:teuthology.orchestra.run.smithi079.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-08T14:35:33.562 INFO:teuthology.orchestra.run.smithi079.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-08T14:35:33.562 INFO:teuthology.orchestra.run.smithi079.stderr: raise error_class(parsed_response, operation_name) 2019-12-08T14:35:33.562 INFO:teuthology.orchestra.run.smithi079.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-08T14:35:33.562 INFO:teuthology.orchestra.run.smithi079.stderr: 2019-12-08T14:35:43.946 INFO:teuthology.orchestra.run.smithi079.stderr:Exception in thread Thread-83: 2019-12-08T14:35:43.947 INFO:teuthology.orchestra.run.smithi079.stderr:Traceback (most recent call last): 2019-12-08T14:35:43.947 INFO:teuthology.orchestra.run.smithi079.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-08T14:35:43.947 INFO:teuthology.orchestra.run.smithi079.stderr: self.run() 2019-12-08T14:35:43.947 INFO:teuthology.orchestra.run.smithi079.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-08T14:35:43.947 INFO:teuthology.orchestra.run.smithi079.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-08T14:35:43.947 INFO:teuthology.orchestra.run.smithi079.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-12-08T14:35:43.948 INFO:teuthology.orchestra.run.smithi079.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-08T14:35:43.948 INFO:teuthology.orchestra.run.smithi079.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-08T14:35:43.948 INFO:teuthology.orchestra.run.smithi079.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-08T14:35:43.948 INFO:teuthology.orchestra.run.smithi079.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-08T14:35:43.948 INFO:teuthology.orchestra.run.smithi079.stderr: raise error_class(parsed_response, operation_name) 2019-12-08T14:35:43.948 INFO:teuthology.orchestra.run.smithi079.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-08T14:35:43.949 INFO:teuthology.orchestra.run.smithi079.stderr: 2019-12-08T14:35:43.960 INFO:teuthology.orchestra.run.smithi079.stderr:Exception in thread Thread-85: 2019-12-08T14:35:43.960 INFO:teuthology.orchestra.run.smithi079.stderr:Traceback (most recent call last): 2019-12-08T14:35:43.960 INFO:teuthology.orchestra.run.smithi079.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-08T14:35:43.960 INFO:teuthology.orchestra.run.smithi079.stderr: self.run() 2019-12-08T14:35:43.961 INFO:teuthology.orchestra.run.smithi079.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-08T14:35:43.961 INFO:teuthology.orchestra.run.smithi079.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-08T14:35:43.961 INFO:teuthology.orchestra.run.smithi079.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-12-08T14:35:43.961 INFO:teuthology.orchestra.run.smithi079.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-08T14:35:43.961 INFO:teuthology.orchestra.run.smithi079.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-08T14:35:43.961 INFO:teuthology.orchestra.run.smithi079.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-08T14:35:43.961 INFO:teuthology.orchestra.run.smithi079.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-08T14:35:43.962 INFO:teuthology.orchestra.run.smithi079.stderr: raise error_class(parsed_response, operation_name) 2019-12-08T14:35:43.962 INFO:teuthology.orchestra.run.smithi079.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-08T14:35:43.962 INFO:teuthology.orchestra.run.smithi079.stderr: 2019-12-08T14:35:44.214 INFO:teuthology.orchestra.run.smithi079.stderr:Exception in thread Thread-84: 2019-12-08T14:35:44.214 INFO:teuthology.orchestra.run.smithi079.stderr:Traceback (most recent call last): 2019-12-08T14:35:44.214 INFO:teuthology.orchestra.run.smithi079.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-08T14:35:44.214 INFO:teuthology.orchestra.run.smithi079.stderr: self.run() 2019-12-08T14:35:44.215 INFO:teuthology.orchestra.run.smithi079.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-08T14:35:44.215 INFO:teuthology.orchestra.run.smithi079.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-08T14:35:44.215 INFO:teuthology.orchestra.run.smithi079.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-12-08T14:35:44.215 INFO:teuthology.orchestra.run.smithi079.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-08T14:35:44.215 INFO:teuthology.orchestra.run.smithi079.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-08T14:35:44.215 INFO:teuthology.orchestra.run.smithi079.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-08T14:35:44.215 INFO:teuthology.orchestra.run.smithi079.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-08T14:35:44.216 INFO:teuthology.orchestra.run.smithi079.stderr: raise error_class(parsed_response, operation_name) 2019-12-08T14:35:44.216 INFO:teuthology.orchestra.run.smithi079.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-08T14:35:44.216 INFO:teuthology.orchestra.run.smithi079.stderr: 2019-12-08T14:35:44.267 INFO:teuthology.orchestra.run.smithi079.stderr:Exception in thread Thread-81: 2019-12-08T14:35:44.267 INFO:teuthology.orchestra.run.smithi079.stderr:Traceback (most recent call last): 2019-12-08T14:35:44.267 INFO:teuthology.orchestra.run.smithi079.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-08T14:35:44.268 INFO:teuthology.orchestra.run.smithi079.stderr: self.run() 2019-12-08T14:35:44.268 INFO:teuthology.orchestra.run.smithi079.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-08T14:35:44.268 INFO:teuthology.orchestra.run.smithi079.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-08T14:35:44.268 INFO:teuthology.orchestra.run.smithi079.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-12-08T14:35:44.268 INFO:teuthology.orchestra.run.smithi079.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-08T14:35:44.268 INFO:teuthology.orchestra.run.smithi079.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-08T14:35:44.268 INFO:teuthology.orchestra.run.smithi079.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-08T14:35:44.269 INFO:teuthology.orchestra.run.smithi079.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-08T14:35:44.269 INFO:teuthology.orchestra.run.smithi079.stderr: raise error_class(parsed_response, operation_name) 2019-12-08T14:35:44.269 INFO:teuthology.orchestra.run.smithi079.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-08T14:35:44.269 INFO:teuthology.orchestra.run.smithi079.stderr: 2019-12-08T14:35:54.844 INFO:teuthology.orchestra.run.smithi079.stderr:Exception in thread Thread-95: 2019-12-08T14:35:54.844 INFO:teuthology.orchestra.run.smithi079.stderr:Traceback (most recent call last): 2019-12-08T14:35:54.844 INFO:teuthology.orchestra.run.smithi079.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-08T14:35:54.844 INFO:teuthology.orchestra.run.smithi079.stderr: self.run() 2019-12-08T14:35:54.844 INFO:teuthology.orchestra.run.smithi079.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-08T14:35:54.845 INFO:teuthology.orchestra.run.smithi079.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-08T14:35:54.845 INFO:teuthology.orchestra.run.smithi079.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-12-08T14:35:54.845 INFO:teuthology.orchestra.run.smithi079.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-08T14:35:54.845 INFO:teuthology.orchestra.run.smithi079.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-08T14:35:54.845 INFO:teuthology.orchestra.run.smithi079.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-08T14:35:54.845 INFO:teuthology.orchestra.run.smithi079.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-08T14:35:54.845 INFO:teuthology.orchestra.run.smithi079.stderr: raise error_class(parsed_response, operation_name) 2019-12-08T14:35:54.846 INFO:teuthology.orchestra.run.smithi079.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-08T14:35:54.846 INFO:teuthology.orchestra.run.smithi079.stderr: 2019-12-08T14:35:54.864 INFO:teuthology.orchestra.run.smithi079.stderr:Exception in thread Thread-92: 2019-12-08T14:35:54.864 INFO:teuthology.orchestra.run.smithi079.stderr:Traceback (most recent call last): 2019-12-08T14:35:54.864 INFO:teuthology.orchestra.run.smithi079.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-08T14:35:54.864 INFO:teuthology.orchestra.run.smithi079.stderr: self.run() 2019-12-08T14:35:54.865 INFO:teuthology.orchestra.run.smithi079.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-08T14:35:54.865 INFO:teuthology.orchestra.run.smithi079.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-08T14:35:54.865 INFO:teuthology.orchestra.run.smithi079.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-12-08T14:35:54.865 INFO:teuthology.orchestra.run.smithi079.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-08T14:35:54.865 INFO:teuthology.orchestra.run.smithi079.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-08T14:35:54.865 INFO:teuthology.orchestra.run.smithi079.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-08T14:35:54.865 INFO:teuthology.orchestra.run.smithi079.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-08T14:35:54.866 INFO:teuthology.orchestra.run.smithi079.stderr: raise error_class(parsed_response, operation_name) 2019-12-08T14:35:54.866 INFO:teuthology.orchestra.run.smithi079.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-08T14:35:54.866 INFO:teuthology.orchestra.run.smithi079.stderr: 2019-12-08T14:35:54.895 INFO:teuthology.orchestra.run.smithi079.stderr:Exception in thread Thread-94: 2019-12-08T14:35:54.896 INFO:teuthology.orchestra.run.smithi079.stderr:Traceback (most recent call last): 2019-12-08T14:35:54.896 INFO:teuthology.orchestra.run.smithi079.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-08T14:35:54.896 INFO:teuthology.orchestra.run.smithi079.stderr: self.run() 2019-12-08T14:35:54.896 INFO:teuthology.orchestra.run.smithi079.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-08T14:35:54.896 INFO:teuthology.orchestra.run.smithi079.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-08T14:35:54.896 INFO:teuthology.orchestra.run.smithi079.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-12-08T14:35:54.896 INFO:teuthology.orchestra.run.smithi079.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-08T14:35:54.897 INFO:teuthology.orchestra.run.smithi079.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-08T14:35:54.897 INFO:teuthology.orchestra.run.smithi079.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-08T14:35:54.897 INFO:teuthology.orchestra.run.smithi079.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-08T14:35:54.897 INFO:teuthology.orchestra.run.smithi079.stderr: raise error_class(parsed_response, operation_name) 2019-12-08T14:35:54.897 INFO:teuthology.orchestra.run.smithi079.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-08T14:35:54.897 INFO:teuthology.orchestra.run.smithi079.stderr: 2019-12-08T14:35:55.419 INFO:teuthology.orchestra.run.smithi079.stderr:Exception in thread Thread-93: 2019-12-08T14:35:55.419 INFO:teuthology.orchestra.run.smithi079.stderr:Traceback (most recent call last): 2019-12-08T14:35:55.420 INFO:teuthology.orchestra.run.smithi079.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-08T14:35:55.420 INFO:teuthology.orchestra.run.smithi079.stderr: self.run() 2019-12-08T14:35:55.420 INFO:teuthology.orchestra.run.smithi079.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-08T14:35:55.420 INFO:teuthology.orchestra.run.smithi079.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-08T14:35:55.420 INFO:teuthology.orchestra.run.smithi079.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-12-08T14:35:55.420 INFO:teuthology.orchestra.run.smithi079.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-08T14:35:55.420 INFO:teuthology.orchestra.run.smithi079.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-08T14:35:55.421 INFO:teuthology.orchestra.run.smithi079.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-08T14:35:55.421 INFO:teuthology.orchestra.run.smithi079.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-08T14:35:55.421 INFO:teuthology.orchestra.run.smithi079.stderr: raise error_class(parsed_response, operation_name) 2019-12-08T14:35:55.421 INFO:teuthology.orchestra.run.smithi079.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-08T14:35:55.421 INFO:teuthology.orchestra.run.smithi079.stderr: 2019-12-08T14:36:05.325 INFO:teuthology.orchestra.run.smithi079.stderr:ok 2019-12-08T14:36:11.492 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_versioned_concurrent_object_create_and_remove ... Exception in thread Thread-103: 2019-12-08T14:36:11.492 INFO:teuthology.orchestra.run.smithi079.stderr:Traceback (most recent call last): 2019-12-08T14:36:11.492 INFO:teuthology.orchestra.run.smithi079.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-08T14:36:11.492 INFO:teuthology.orchestra.run.smithi079.stderr: self.run() 2019-12-08T14:36:11.492 INFO:teuthology.orchestra.run.smithi079.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-08T14:36:11.493 INFO:teuthology.orchestra.run.smithi079.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-08T14:36:11.493 INFO:teuthology.orchestra.run.smithi079.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-12-08T14:36:11.493 INFO:teuthology.orchestra.run.smithi079.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-08T14:36:11.493 INFO:teuthology.orchestra.run.smithi079.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-08T14:36:11.493 INFO:teuthology.orchestra.run.smithi079.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-08T14:36:11.493 INFO:teuthology.orchestra.run.smithi079.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-08T14:36:11.493 INFO:teuthology.orchestra.run.smithi079.stderr: raise error_class(parsed_response, operation_name) 2019-12-08T14:36:11.494 INFO:teuthology.orchestra.run.smithi079.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-08T14:36:11.494 INFO:teuthology.orchestra.run.smithi079.stderr: 2019-12-08T14:36:11.597 INFO:teuthology.orchestra.run.smithi079.stderr:Exception in thread Thread-105: 2019-12-08T14:36:11.597 INFO:teuthology.orchestra.run.smithi079.stderr:Traceback (most recent call last): 2019-12-08T14:36:11.597 INFO:teuthology.orchestra.run.smithi079.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-08T14:36:11.598 INFO:teuthology.orchestra.run.smithi079.stderr: self.run() 2019-12-08T14:36:11.598 INFO:teuthology.orchestra.run.smithi079.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-08T14:36:11.598 INFO:teuthology.orchestra.run.smithi079.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-08T14:36:11.598 INFO:teuthology.orchestra.run.smithi079.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-12-08T14:36:11.598 INFO:teuthology.orchestra.run.smithi079.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-08T14:36:11.598 INFO:teuthology.orchestra.run.smithi079.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-08T14:36:11.598 INFO:teuthology.orchestra.run.smithi079.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-08T14:36:11.599 INFO:teuthology.orchestra.run.smithi079.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-08T14:36:11.599 INFO:teuthology.orchestra.run.smithi079.stderr: raise error_class(parsed_response, operation_name) 2019-12-08T14:36:11.599 INFO:teuthology.orchestra.run.smithi079.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-08T14:36:11.599 INFO:teuthology.orchestra.run.smithi079.stderr: 2019-12-08T14:36:11.954 INFO:teuthology.orchestra.run.smithi079.stderr:Exception in thread Thread-104: 2019-12-08T14:36:11.955 INFO:teuthology.orchestra.run.smithi079.stderr:Traceback (most recent call last): 2019-12-08T14:36:11.955 INFO:teuthology.orchestra.run.smithi079.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-08T14:36:11.955 INFO:teuthology.orchestra.run.smithi079.stderr: self.run() 2019-12-08T14:36:11.955 INFO:teuthology.orchestra.run.smithi079.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-08T14:36:11.955 INFO:teuthology.orchestra.run.smithi079.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-08T14:36:11.955 INFO:teuthology.orchestra.run.smithi079.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-12-08T14:36:11.955 INFO:teuthology.orchestra.run.smithi079.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-08T14:36:11.956 INFO:teuthology.orchestra.run.smithi079.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-08T14:36:11.956 INFO:teuthology.orchestra.run.smithi079.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-08T14:36:11.956 INFO:teuthology.orchestra.run.smithi079.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-08T14:36:11.956 INFO:teuthology.orchestra.run.smithi079.stderr: raise error_class(parsed_response, operation_name) 2019-12-08T14:36:11.956 INFO:teuthology.orchestra.run.smithi079.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-08T14:36:11.956 INFO:teuthology.orchestra.run.smithi079.stderr: 2019-12-08T14:36:11.958 INFO:teuthology.orchestra.run.smithi079.stderr:Exception in thread Thread-106: 2019-12-08T14:36:11.958 INFO:teuthology.orchestra.run.smithi079.stderr:Traceback (most recent call last): 2019-12-08T14:36:11.959 INFO:teuthology.orchestra.run.smithi079.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-08T14:36:11.959 INFO:teuthology.orchestra.run.smithi079.stderr: self.run() 2019-12-08T14:36:11.959 INFO:teuthology.orchestra.run.smithi079.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-08T14:36:11.959 INFO:teuthology.orchestra.run.smithi079.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-08T14:36:11.959 INFO:teuthology.orchestra.run.smithi079.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-12-08T14:36:11.959 INFO:teuthology.orchestra.run.smithi079.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-08T14:36:11.960 INFO:teuthology.orchestra.run.smithi079.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-08T14:36:11.960 INFO:teuthology.orchestra.run.smithi079.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-08T14:36:11.960 INFO:teuthology.orchestra.run.smithi079.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-08T14:36:11.960 INFO:teuthology.orchestra.run.smithi079.stderr: raise error_class(parsed_response, operation_name) 2019-12-08T14:36:11.960 INFO:teuthology.orchestra.run.smithi079.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-08T14:36:11.960 INFO:teuthology.orchestra.run.smithi079.stderr: 2019-12-08T14:36:11.961 INFO:teuthology.orchestra.run.smithi079.stderr:Exception in thread Thread-102: 2019-12-08T14:36:11.961 INFO:teuthology.orchestra.run.smithi079.stderr:Traceback (most recent call last): 2019-12-08T14:36:11.961 INFO:teuthology.orchestra.run.smithi079.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-08T14:36:11.962 INFO:teuthology.orchestra.run.smithi079.stderr: self.run() 2019-12-08T14:36:11.962 INFO:teuthology.orchestra.run.smithi079.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-08T14:36:11.962 INFO:teuthology.orchestra.run.smithi079.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-08T14:36:11.962 INFO:teuthology.orchestra.run.smithi079.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-12-08T14:36:11.962 INFO:teuthology.orchestra.run.smithi079.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-08T14:36:11.962 INFO:teuthology.orchestra.run.smithi079.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-08T14:36:11.962 INFO:teuthology.orchestra.run.smithi079.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-08T14:36:11.964 INFO:teuthology.orchestra.run.smithi079.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-08T14:36:11.964 INFO:teuthology.orchestra.run.smithi079.stderr: raise error_class(parsed_response, operation_name) 2019-12-08T14:36:11.964 INFO:teuthology.orchestra.run.smithi079.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-08T14:36:11.964 INFO:teuthology.orchestra.run.smithi079.stderr: 2019-12-08T14:36:11.967 INFO:teuthology.orchestra.run.smithi079.stderr:Exception in thread Thread-108: 2019-12-08T14:36:11.967 INFO:teuthology.orchestra.run.smithi079.stderr:Traceback (most recent call last): 2019-12-08T14:36:11.967 INFO:teuthology.orchestra.run.smithi079.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-08T14:36:11.967 INFO:teuthology.orchestra.run.smithi079.stderr: self.run() 2019-12-08T14:36:11.968 INFO:teuthology.orchestra.run.smithi079.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-08T14:36:11.968 INFO:teuthology.orchestra.run.smithi079.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-08T14:36:11.968 INFO:teuthology.orchestra.run.smithi079.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-12-08T14:36:11.968 INFO:teuthology.orchestra.run.smithi079.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-08T14:36:11.968 INFO:teuthology.orchestra.run.smithi079.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-08T14:36:11.968 INFO:teuthology.orchestra.run.smithi079.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-08T14:36:11.968 INFO:teuthology.orchestra.run.smithi079.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-08T14:36:11.969 INFO:teuthology.orchestra.run.smithi079.stderr: raise error_class(parsed_response, operation_name) 2019-12-08T14:36:11.969 INFO:teuthology.orchestra.run.smithi079.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-08T14:36:11.969 INFO:teuthology.orchestra.run.smithi079.stderr: 2019-12-08T14:36:12.075 INFO:teuthology.orchestra.run.smithi079.stderr:Exception in thread Thread-107: 2019-12-08T14:36:12.075 INFO:teuthology.orchestra.run.smithi079.stderr:Traceback (most recent call last): 2019-12-08T14:36:12.075 INFO:teuthology.orchestra.run.smithi079.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-08T14:36:12.075 INFO:teuthology.orchestra.run.smithi079.stderr: self.run() 2019-12-08T14:36:12.075 INFO:teuthology.orchestra.run.smithi079.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-08T14:36:12.076 INFO:teuthology.orchestra.run.smithi079.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-08T14:36:12.076 INFO:teuthology.orchestra.run.smithi079.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-12-08T14:36:12.076 INFO:teuthology.orchestra.run.smithi079.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-08T14:36:12.076 INFO:teuthology.orchestra.run.smithi079.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-08T14:36:12.076 INFO:teuthology.orchestra.run.smithi079.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-08T14:36:12.076 INFO:teuthology.orchestra.run.smithi079.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-08T14:36:12.076 INFO:teuthology.orchestra.run.smithi079.stderr: raise error_class(parsed_response, operation_name) 2019-12-08T14:36:12.077 INFO:teuthology.orchestra.run.smithi079.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-08T14:36:12.077 INFO:teuthology.orchestra.run.smithi079.stderr: 2019-12-08T14:36:12.140 INFO:teuthology.orchestra.run.smithi079.stderr:Exception in thread Thread-109: 2019-12-08T14:36:12.140 INFO:teuthology.orchestra.run.smithi079.stderr:Traceback (most recent call last): 2019-12-08T14:36:12.140 INFO:teuthology.orchestra.run.smithi079.stderr: File "/usr/lib64/python2.7/threading.py", line 812, in __bootstrap_inner 2019-12-08T14:36:12.141 INFO:teuthology.orchestra.run.smithi079.stderr: self.run() 2019-12-08T14:36:12.141 INFO:teuthology.orchestra.run.smithi079.stderr: File "/usr/lib64/python2.7/threading.py", line 765, in run 2019-12-08T14:36:12.141 INFO:teuthology.orchestra.run.smithi079.stderr: self.__target(*self.__args, **self.__kwargs) 2019-12-08T14:36:12.141 INFO:teuthology.orchestra.run.smithi079.stderr: File "/home/ubuntu/cephtest/s3-tests/s3tests_boto3/functional/test_s3.py", line 8575, in _do_create_object 2019-12-08T14:36:12.141 INFO:teuthology.orchestra.run.smithi079.stderr: client.put_object(Bucket=bucket_name, Key=key, Body=body) 2019-12-08T14:36:12.141 INFO:teuthology.orchestra.run.smithi079.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 272, in _api_call 2019-12-08T14:36:12.141 INFO:teuthology.orchestra.run.smithi079.stderr: return self._make_api_call(operation_name, kwargs) 2019-12-08T14:36:12.142 INFO:teuthology.orchestra.run.smithi079.stderr: File "/home/ubuntu/cephtest/s3-tests/virtualenv/lib/python2.7/site-packages/botocore/client.py", line 576, in _make_api_call 2019-12-08T14:36:12.142 INFO:teuthology.orchestra.run.smithi079.stderr: raise error_class(parsed_response, operation_name) 2019-12-08T14:36:12.142 INFO:teuthology.orchestra.run.smithi079.stderr:ClientError: An error occurred (InvalidArgument) when calling the PutObject operation: Unknown 2019-12-08T14:36:12.142 INFO:teuthology.orchestra.run.smithi079.stderr: 2019-12-08T14:36:23.092 INFO:teuthology.orchestra.run.smithi079.stderr:ok 2019-12-08T14:36:26.497 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_set ... ok 2019-12-08T14:36:31.436 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_get ... ok 2019-12-08T14:36:37.856 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_get_no_id ... ok 2019-12-08T14:36:40.328 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_id_too_long ... ok 2019-12-08T14:36:42.262 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_same_id ... ok 2019-12-08T14:36:45.318 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_invalid_status ... ok 2019-12-08T14:36:48.571 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_set_date ... ok 2019-12-08T14:36:51.592 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_set_invalid_date ... ok 2019-12-08T14:36:57.436 INFO:teuthology.orchestra.run.smithi079.stderr:Check for valid x-amz-expiration header after PUT ... ok 2019-12-08T14:37:04.853 INFO:teuthology.orchestra.run.smithi079.stderr:Check for valid x-amz-expiration header on HEAD request ... ok 2019-12-08T14:37:12.404 INFO:teuthology.orchestra.run.smithi079.stderr:Check for valid x-amz-expiration header on GET request ... ok 2019-12-08T14:37:20.796 INFO:teuthology.orchestra.run.smithi079.stderr:Check x-amz-expiration-header object tags interaction ... ok 2019-12-08T14:37:27.489 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_set_noncurrent ... ok 2019-12-08T14:37:30.765 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_set_deletemarker ... ok 2019-12-08T14:37:37.179 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_set_filter ... ok 2019-12-08T14:37:43.955 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_set_empty_filter ... ok 2019-12-08T14:37:46.847 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_lifecycle_set_multipart ... ok 2019-12-08T14:37:50.451 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_encrypted_transfer_1b ... ok 2019-12-08T14:37:55.352 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_encrypted_transfer_1kb ... ok 2019-12-08T14:38:01.600 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_encrypted_transfer_1MB ... ok 2019-12-08T14:38:04.684 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_encrypted_transfer_13b ... ok 2019-12-08T14:38:10.294 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_method_head ... ok 2019-12-08T14:38:15.762 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_present ... ok 2019-12-08T14:38:19.020 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_other_key ... ok 2019-12-08T14:38:21.135 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_invalid_md5 ... ok 2019-12-08T14:38:24.749 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_no_md5 ... ok 2019-12-08T14:38:28.146 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_no_key ... ok 2019-12-08T14:38:31.499 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_encryption_key_no_sse_c ... ok 2019-12-08T14:39:14.969 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:02:36:39.670 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T14:39:14.984 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:02:36:39.686 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T14:39:14.988 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:02:36:39.628 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T14:39:14.994 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:02:36:39.632 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T14:39:14.994 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:02:36:39.633 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T14:39:14.996 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:02:36:39.636 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T14:39:15.183 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:02:36:39.824 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T14:39:15.185 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:02:36:39.825 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T14:39:15.308 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:02:36:40.010 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T14:39:56.133 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_multipart_upload ... ok 2019-12-08T14:40:35.164 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_multipart_bad_download ... ok 2019-12-08T14:40:40.485 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_encryption_sse_c_post_object_authenticated_request ... ok 2019-12-08T14:40:44.200 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_method_head ... ok 2019-12-08T14:40:49.963 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_present ... ok 2019-12-08T14:40:52.324 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_no_key ... ok 2019-12-08T14:40:54.502 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_not_declared ... ok 2019-12-08T14:42:14.638 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_multipart_upload ... ok 2019-12-08T14:42:30.725 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:02:39:55.427 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T14:42:30.732 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:02:39:55.434 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T14:42:30.782 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:02:39:55.422 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T14:42:30.784 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:02:39:55.424 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T14:42:30.787 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:02:39:55.426 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T14:42:30.811 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:02:39:55.451 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T14:42:30.842 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:02:39:55.544 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T14:42:30.907 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:02:39:55.547 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T14:42:30.942 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:02:39:55.582 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T14:42:44.099 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_multipart_invalid_chunks_1 ... ok 2019-12-08T14:43:16.143 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_multipart_invalid_chunks_2 ... ok 2019-12-08T14:43:20.466 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_post_object_authenticated_request ... ok 2019-12-08T14:43:23.655 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_transfer_1b ... ok 2019-12-08T14:43:28.240 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_transfer_1kb ... ok 2019-12-08T14:43:33.716 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_transfer_1MB ... ok 2019-12-08T14:43:37.741 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_transfer_13b ... ok 2019-12-08T14:43:41.769 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_sse_kms_read_declare ... ok 2019-12-08T14:43:48.689 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy ... ok 2019-12-08T14:43:53.242 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucketv2_policy ... ok 2019-12-08T14:44:01.672 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_acl ... ok 2019-12-08T14:44:08.550 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucketv2_policy_acl ... ok 2019-12-08T14:44:19.566 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_another_bucket ... ok 2019-12-08T14:44:27.270 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:02:41:51.972 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T14:44:27.278 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:02:41:51.980 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T14:44:27.290 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:02:41:51.929 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T14:44:27.290 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:02:41:51.930 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T14:44:27.297 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:02:41:51.936 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T14:44:27.300 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:02:41:51.939 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T14:44:27.392 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:02:41:52.032 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T14:44:27.407 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:02:41:52.109 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T14:44:27.418 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:02:41:52.058 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T14:44:27.447 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucketv2_policy_another_bucket ... ok 2019-12-08T14:44:33.516 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_get_obj_tagging ... ok 2019-12-08T14:44:40.021 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_get_obj_head_tagging ... ok 2019-12-08T14:44:44.435 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_put_max_tags ... ok 2019-12-08T14:44:50.888 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_put_excess_tags ... ok 2019-12-08T14:44:56.331 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_put_max_kvsize_tags ... ok 2019-12-08T14:45:02.210 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_put_excess_key_tags ... ok 2019-12-08T14:45:08.103 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_put_excess_val_tags ... ok 2019-12-08T14:45:15.509 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_put_modify_tags ... ok 2019-12-08T14:45:22.359 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_put_delete_tags ... ok 2019-12-08T14:45:26.388 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_post_object_tags_anonymous_request ... ok 2019-12-08T14:45:29.338 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_post_object_tags_authenticated_request ... ok 2019-12-08T14:45:33.230 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_put_obj_with_tags ... ok 2019-12-08T14:45:41.560 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_get_tags_acl_public ... ok 2019-12-08T14:45:48.840 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_put_tags_acl_public ... ok 2019-12-08T14:46:01.109 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_delete_tags_obj_public ... ok 2019-12-08T14:46:16.513 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_versioning_bucket_atomic_upload_return_version_id ... ok 2019-12-08T14:47:54.583 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_versioning_bucket_multipart_upload_return_version_id ... ok 2019-12-08T14:48:08.679 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_get_obj_existing_tag ... ok 2019-12-08T14:48:16.595 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_get_obj_tagging_existing_tag ... ok 2019-12-08T14:48:25.815 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_put_obj_tagging_existing_tag ... ok 2019-12-08T14:48:42.553 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_put_obj_copy_source ... ok 2019-12-08T14:48:56.911 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_put_obj_copy_source_meta ... ok 2019-12-08T14:49:02.253 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_put_obj_acl ... ok 2019-12-08T14:49:13.533 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_put_obj_grant ... ok 2019-12-08T14:49:25.542 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_bucket_policy_get_obj_acl_existing_tag ... ok 2019-12-08T14:49:28.885 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_lock ... ok 2019-12-08T14:49:30.757 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_lock_invalid_bucket ... ok 2019-12-08T14:49:32.883 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_lock_with_days_and_years ... ok 2019-12-08T14:49:36.477 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_lock_invalid_days ... ok 2019-12-08T14:49:39.558 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_lock_invalid_years ... ok 2019-12-08T14:49:40.653 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:02:47:05.355 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T14:49:40.667 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:02:47:05.369 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T14:49:40.674 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:02:47:05.312 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T14:49:40.674 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:02:47:05.312 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T14:49:40.676 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:02:47:05.315 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T14:49:40.679 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:02:47:05.316 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T14:49:40.852 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:02:47:05.490 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T14:49:40.869 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:02:47:05.507 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T14:49:40.932 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:02:47:05.634 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T14:49:42.017 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_lock_invalid_status ... ok 2019-12-08T14:49:44.106 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_lock_suspend_versioning ... ok 2019-12-08T14:49:47.071 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_lock_get_obj_lock ... ok 2019-12-08T14:49:49.840 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_lock_get_obj_lock_invalid_bucket ... ok 2019-12-08T14:50:01.521 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_retention ... ok 2019-12-08T14:50:04.473 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_retention_invalid_bucket ... ok 2019-12-08T14:50:12.751 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_retention_invalid_mode ... ok 2019-12-08T14:50:22.624 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_lock_get_obj_retention ... ok 2019-12-08T14:50:26.891 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_lock_get_obj_retention_invalid_bucket ... ok 2019-12-08T14:50:42.235 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_retention_versionid ... ok 2019-12-08T14:50:52.839 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:02:48:17.541 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T14:50:52.874 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:02:48:17.576 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T14:50:52.885 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:02:48:17.524 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T14:50:52.902 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:02:48:17.541 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T14:50:52.921 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:02:48:17.560 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T14:50:52.928 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:02:48:17.631 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T14:50:52.930 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:02:48:17.569 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T14:50:52.960 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:02:48:17.598 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T14:50:52.983 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:02:48:17.621 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T14:50:53.865 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_retention_override_default_retention ... ok 2019-12-08T14:51:11.442 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_retention_increase_period ... ok 2019-12-08T14:51:22.981 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_retention_shorten_period ... ok 2019-12-08T14:51:35.937 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_obj_retention_shorten_period_bypass ... ok 2019-12-08T14:51:50.098 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_lock_delete_object_with_retention ... ok 2019-12-08T14:51:57.195 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_legal_hold ... ok 2019-12-08T14:52:01.273 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_legal_hold_invalid_bucket ... ok 2019-12-08T14:52:07.903 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_lock_put_legal_hold_invalid_status ... ok 2019-12-08T14:52:15.998 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_lock_get_legal_hold ... ok 2019-12-08T14:52:21.441 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_lock_get_legal_hold_invalid_bucket ... ok 2019-12-08T14:52:28.137 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_lock_delete_object_with_legal_hold_on ... ok 2019-12-08T14:52:38.953 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_lock_delete_object_with_legal_hold_off ... ok 2019-12-08T14:52:54.466 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_lock_get_obj_metadata ... ok 2019-12-08T14:53:05.850 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_s3.test_object_lock_uploading_obj ... ok 2019-12-08T14:53:05.869 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.functional.test_utils.test_generate ... ok 2019-12-08T14:54:51.771 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:02:52:16.473 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T14:54:51.781 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:02:52:16.483 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T14:54:51.788 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:02:52:16.426 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T14:54:51.791 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:02:52:16.429 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T14:54:51.795 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:02:52:16.433 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T14:54:51.803 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:02:52:16.441 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T14:54:51.980 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:02:52:16.618 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T14:54:51.999 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:02:52:16.701 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T14:54:52.004 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:02:52:16.642 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T14:59:14.872 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:02:56:39.573 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T14:59:14.921 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:02:56:39.559 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T14:59:14.922 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:02:56:39.560 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T14:59:14.942 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:02:56:39.580 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T14:59:14.947 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:02:56:39.649 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T14:59:14.958 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:02:56:39.596 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T14:59:15.039 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:02:56:39.676 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T14:59:15.095 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:02:56:39.733 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T14:59:15.181 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:02:56:39.883 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T15:00:01.502 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:02:57:26.205 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T15:00:01.514 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:02:57:26.216 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T15:00:01.515 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:02:57:26.153 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T15:00:01.520 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:02:57:26.158 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T15:00:01.521 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:02:57:26.159 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T15:00:01.529 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:02:57:26.167 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T15:00:01.566 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:02:57:26.204 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T15:00:01.582 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:02:57:26.219 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T15:00:01.597 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:02:57:26.299 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T15:05:13.041 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:03:02:37.743 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T15:05:13.053 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:03:02:37.755 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T15:05:13.059 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:03:02:37.696 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T15:05:13.061 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:03:02:37.698 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T15:05:13.063 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:03:02:37.701 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T15:05:13.069 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:03:02:37.704 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T15:05:13.260 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:03:02:37.962 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T15:05:13.282 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:03:02:37.920 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T15:05:13.283 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:03:02:37.921 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T15:05:41.781 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:03:03:06.483 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T15:05:41.791 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:03:03:06.493 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T15:05:41.839 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:03:03:06.477 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T15:05:41.858 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:03:03:06.495 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T15:05:41.861 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:03:03:06.563 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T15:05:41.886 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:03:03:06.524 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T15:05:41.903 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:03:03:06.541 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T15:05:41.922 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:03:03:06.560 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T15:05:41.949 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:03:03:06.586 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T15:07:37.388 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:03:05:02.090 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T15:07:37.397 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:03:05:02.099 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T15:07:37.423 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:03:05:02.060 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T15:07:37.440 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:03:05:02.077 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T15:07:37.446 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:03:05:02.083 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T15:07:37.460 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:03:05:02.098 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T15:07:37.491 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:03:05:02.193 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T15:07:37.503 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:03:05:02.141 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T15:07:37.530 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:03:05:02.167 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T15:10:24.131 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:03:07:48.833 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T15:10:24.140 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:03:07:48.842 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T15:10:24.146 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:03:07:48.783 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T15:10:24.149 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:03:07:48.786 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T15:10:24.169 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:03:07:48.805 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T15:10:24.171 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:03:07:48.808 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T15:10:24.265 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:03:07:48.967 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T15:10:24.280 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:03:07:48.916 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T15:10:24.311 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:03:07:48.947 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T15:15:35.439 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:03:13:00.140 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T15:15:35.452 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:03:13:00.153 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T15:15:35.453 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:03:13:00.089 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T15:15:35.457 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:03:13:00.093 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T15:15:35.458 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:03:13:00.094 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T15:15:35.462 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:03:13:00.098 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T15:15:35.650 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:03:13:00.286 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T15:15:35.713 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:03:13:00.415 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T15:15:35.716 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:03:13:00.352 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T15:15:59.454 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:03:13:24.155 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T15:15:59.489 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:03:13:24.190 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T15:15:59.490 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:03:13:24.126 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T15:15:59.516 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:03:13:24.151 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T15:15:59.518 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:03:13:24.154 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T15:15:59.520 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:03:13:24.222 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T15:15:59.535 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:03:13:24.170 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T15:15:59.541 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:03:13:24.177 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T15:15:59.573 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:03:13:24.208 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T15:20:47.675 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:03:18:12.377 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T15:20:47.680 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:03:18:12.382 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T15:20:47.689 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:03:18:12.319 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T15:20:47.689 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:03:18:12.321 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T15:20:47.690 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:03:18:12.324 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T15:20:47.692 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:03:18:12.328 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T15:20:47.849 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:03:18:12.484 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T15:20:47.860 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:03:18:12.495 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T15:20:47.924 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:03:18:12.626 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T15:24:21.633 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:03:21:46.335 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T15:24:21.640 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:03:21:46.342 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T15:24:21.743 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:03:21:46.378 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T15:24:21.752 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:03:21:46.386 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T15:24:21.755 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:03:21:46.390 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T15:24:21.761 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:03:21:46.396 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T15:24:21.798 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:03:21:46.499 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T15:24:21.869 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:03:21:46.504 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T15:24:21.886 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:03:21:46.521 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T15:25:59.875 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:03:23:24.577 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T15:25:59.885 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:03:23:24.586 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T15:25:59.923 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:03:23:24.557 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T15:25:59.923 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:03:23:24.557 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T15:25:59.924 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:03:23:24.559 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T15:25:59.924 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:03:23:24.559 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T15:25:59.977 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:03:23:24.679 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T15:25:59.994 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:03:23:24.629 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T15:26:00.002 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:03:23:24.636 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T15:31:12.135 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:03:28:36.836 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T15:31:12.172 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:03:28:36.806 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T15:31:12.186 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:03:28:36.820 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T15:31:12.188 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:03:28:36.822 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T15:31:12.202 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:03:28:36.836 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T15:31:12.207 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:03:28:36.909 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T15:31:12.372 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:03:28:37.006 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T15:31:12.413 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:03:28:37.047 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T15:31:12.414 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:03:28:37.115 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T15:32:43.587 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:03:30:08.289 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T15:32:43.606 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:03:30:08.240 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T15:32:43.620 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:03:30:08.322 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T15:32:43.620 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:03:30:08.254 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T15:32:43.626 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:03:30:08.260 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T15:32:43.642 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:03:30:08.276 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T15:32:43.679 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:03:30:08.381 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T15:32:43.694 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:03:30:08.328 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T15:32:43.700 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:03:30:08.334 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T15:41:05.913 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:03:38:30.615 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T15:41:05.928 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:03:38:30.630 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T15:41:05.945 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:03:38:30.577 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T15:41:05.950 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:03:38:30.583 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T15:41:05.954 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:03:38:30.587 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T15:41:05.979 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:03:38:30.613 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T15:41:06.191 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:03:38:30.824 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T15:41:06.251 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:03:38:30.884 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T15:41:06.420 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:03:38:31.122 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T15:41:34.352 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:03:38:59.055 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T15:41:34.368 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:03:38:58.999 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T15:41:34.368 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:03:38:59.067 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T15:41:34.369 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:03:38:59.002 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T15:41:34.370 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:03:38:59.003 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T15:41:34.378 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:03:38:59.010 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T15:41:34.420 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:03:38:59.053 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T15:41:34.445 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:03:38:59.078 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T15:41:34.460 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:03:38:59.163 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T15:46:47.981 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:03:44:12.684 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T15:46:47.989 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:03:44:12.692 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T15:46:48.001 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:03:44:12.634 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T15:46:48.005 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:03:44:12.638 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T15:46:48.009 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:03:44:12.642 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T15:46:48.017 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:03:44:12.651 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T15:46:48.190 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:03:44:12.823 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T15:46:48.228 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:03:44:12.931 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T15:46:48.246 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:03:44:12.880 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T15:49:28.589 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:03:46:53.291 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T15:49:28.593 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:03:46:53.295 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T15:49:28.658 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:03:46:53.291 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T15:49:28.659 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:03:46:53.292 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T15:49:28.659 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:03:46:53.292 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T15:49:28.661 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:03:46:53.294 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T15:49:28.685 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:03:46:53.387 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T15:49:28.735 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:03:46:53.369 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T15:49:28.739 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:03:46:53.370 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T15:52:00.697 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:03:49:25.400 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T15:52:00.711 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:03:49:25.414 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T15:52:00.721 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:03:49:25.355 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T15:52:00.725 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:03:49:25.359 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T15:52:00.726 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:03:49:25.359 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T15:52:00.732 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:03:49:25.365 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T15:52:00.849 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:03:49:25.483 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T15:52:00.878 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:03:49:25.511 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T15:52:00.924 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:03:49:25.626 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T15:57:11.669 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:03:54:36.372 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T15:57:11.679 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:03:54:36.382 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T15:57:11.682 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:03:54:36.315 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T15:57:11.683 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:03:54:36.317 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T15:57:11.686 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:03:54:36.320 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T15:57:11.690 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:03:54:36.324 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T15:57:11.900 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:03:54:36.603 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T15:57:11.942 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:03:54:36.575 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T15:57:11.968 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:03:54:36.601 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T15:57:50.680 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:03:55:15.383 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T15:57:50.718 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:03:55:15.351 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T15:57:50.721 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:03:55:15.354 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T15:57:50.723 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:03:55:15.426 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T15:57:50.733 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:03:55:15.367 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T15:57:50.740 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:03:55:15.374 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T15:57:50.763 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:03:55:15.466 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T15:57:50.776 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:03:55:15.410 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T15:57:50.788 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:03:55:15.422 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T16:02:21.737 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:03:59:46.439 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T16:02:21.743 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:03:59:46.446 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T16:02:21.752 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:03:59:46.385 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T16:02:21.754 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:03:59:46.388 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T16:02:21.760 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:03:59:46.394 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T16:02:21.762 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:03:59:46.396 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T16:02:21.922 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:03:59:46.555 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T16:02:21.957 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:03:59:46.590 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T16:02:22.000 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:03:59:46.703 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T16:06:12.642 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:04:03:37.345 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T16:06:12.645 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:04:03:37.348 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T16:06:12.700 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:04:03:37.334 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T16:06:12.720 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:04:03:37.354 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T16:06:12.838 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:04:03:37.472 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T16:06:12.861 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:04:03:37.495 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T16:06:12.881 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:04:03:37.515 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T16:06:12.960 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:04:03:37.594 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T16:06:12.963 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:04:03:37.666 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T16:07:31.205 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:04:04:55.908 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T16:07:31.215 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:04:04:55.918 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T16:07:31.224 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:04:04:55.858 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T16:07:31.232 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:04:04:55.866 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T16:07:31.248 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:04:04:55.882 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T16:07:31.260 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:04:04:55.894 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T16:07:31.331 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:04:04:56.034 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T16:07:31.339 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:04:04:55.973 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T16:07:31.371 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:04:04:56.005 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T16:12:43.440 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:04:10:08.142 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T16:12:43.449 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:04:10:08.152 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T16:12:43.450 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:04:10:08.084 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T16:12:43.455 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:04:10:08.090 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T16:12:43.456 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:04:10:08.090 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T16:12:43.462 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:04:10:08.097 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T16:12:43.655 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:04:10:08.289 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T16:12:43.660 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:04:10:08.295 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T16:12:43.683 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:04:10:08.386 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T16:14:34.831 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:04:11:59.534 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T16:14:34.858 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:04:11:59.561 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T16:14:34.876 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:04:11:59.510 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T16:14:34.877 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:04:11:59.511 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T16:14:34.879 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:04:11:59.513 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T16:14:34.891 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:04:11:59.525 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T16:14:34.941 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:04:11:59.575 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T16:14:34.957 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:04:11:59.660 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T16:14:34.963 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:04:11:59.598 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T16:17:53.613 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:04:15:18.309 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T16:17:53.627 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:04:15:18.256 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T16:17:53.628 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:04:15:18.262 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T16:17:53.628 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:04:15:18.332 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T16:17:53.629 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:04:15:18.263 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T16:17:53.634 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:04:15:18.268 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T16:17:53.758 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:04:15:18.392 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T16:17:53.767 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:04:15:18.402 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T16:17:53.831 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:04:15:18.534 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T16:22:56.968 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:04:20:21.671 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T16:22:57.047 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:04:20:21.750 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T16:22:57.071 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:04:20:21.705 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T16:22:57.077 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:04:20:21.712 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T16:22:57.103 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:04:20:21.738 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T16:22:57.106 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:04:20:21.741 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T16:22:57.279 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:04:20:21.982 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T16:22:57.296 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:04:20:21.930 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T16:22:57.297 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:04:20:21.931 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T16:23:05.811 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:04:20:30.514 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T16:23:05.821 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:04:20:30.524 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T16:23:05.828 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:04:20:30.463 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T16:23:05.833 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:04:20:30.467 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T16:23:05.838 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:04:20:30.473 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T16:23:05.841 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:04:20:30.475 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T16:23:05.869 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:04:20:30.504 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T16:23:05.871 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:04:20:30.506 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T16:23:05.895 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:04:20:30.597 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T16:27:13.400 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:04:24:38.103 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T16:27:13.405 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:04:24:38.108 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T16:27:13.451 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:04:24:38.086 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T16:27:13.456 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:04:24:38.090 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T16:27:13.459 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:04:24:38.094 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T16:27:13.476 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:04:24:38.111 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T16:27:13.611 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:04:24:38.314 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T16:27:13.642 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:04:24:38.277 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T16:27:13.662 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:04:24:38.296 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T16:28:16.039 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:04:25:40.742 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T16:28:16.044 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:04:25:40.747 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T16:28:16.047 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:04:25:40.681 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T16:28:16.051 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:04:25:40.686 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T16:28:16.052 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:04:25:40.687 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T16:28:16.057 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:04:25:40.691 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T16:28:16.108 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:04:25:40.742 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T16:28:16.112 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:04:25:40.747 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T16:28:16.114 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:04:25:40.817 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T16:29:03.190 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_load_graph ... ok 2019-12-08T16:29:03.197 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_descend_leaf_node ... ok 2019-12-08T16:29:03.197 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_descend_node ... ok 2019-12-08T16:29:03.197 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_descend_bad_node ... ok 2019-12-08T16:29:03.197 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_descend_nonexistant_child ... ok 2019-12-08T16:29:03.200 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_printable ... ok 2019-12-08T16:29:03.200 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_binary ... ok 2019-12-08T16:29:03.558 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_printable_no_whitespace ... ok 2019-12-08T16:29:03.732 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_binary_no_whitespace ... ok 2019-12-08T16:29:04.070 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_no_args ... ok 2019-12-08T16:29:04.098 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_no_charset ... ok 2019-12-08T16:29:04.117 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_exact_length ... ok 2019-12-08T16:29:04.117 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_bad_charset ... ok 2019-12-08T16:29:04.117 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_random_missing_length ... ok 2019-12-08T16:29:04.118 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_assemble_decision ... ok 2019-12-08T16:29:04.118 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_escape ... ok 2019-12-08T16:29:04.118 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_indirect ... ok 2019-12-08T16:29:04.118 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_indirect_double ... ok 2019-12-08T16:29:04.118 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_recursive ... ok 2019-12-08T16:29:04.118 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_recursive_mutual ... ok 2019-12-08T16:29:04.118 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_recursive_not_too_eager ... ok 2019-12-08T16:29:04.119 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_make_choice_unweighted_with_space ... ok 2019-12-08T16:29:04.122 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_weighted_choices ... ok 2019-12-08T16:29:04.122 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_null_choices ... ok 2019-12-08T16:29:04.122 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_weighted_null_choices ... ok 2019-12-08T16:29:04.123 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_null_child ... ok 2019-12-08T16:29:04.127 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_weighted_set ... ok 2019-12-08T16:29:04.127 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_header_presence ... ok 2019-12-08T16:29:04.127 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_duplicate_header ... ok 2019-12-08T16:29:04.127 INFO:teuthology.orchestra.run.smithi079.stderr:s3tests_boto3.fuzz.test.test_fuzzer.test_expand_headers ... ok 2019-12-08T16:29:04.148 INFO:teuthology.orchestra.run.smithi079.stderr:test_realistic.TestFileValidator.test_new_file_is_valid ... ok 2019-12-08T16:29:04.170 INFO:teuthology.orchestra.run.smithi079.stderr:test_realistic.TestFileValidator.test_new_file_is_valid_on_several_calls ... ok 2019-12-08T16:29:04.170 INFO:teuthology.orchestra.run.smithi079.stderr:test_realistic.TestFileValidator.test_new_file_is_valid_when_size_is_1 ... ok 2019-12-08T16:29:04.307 INFO:teuthology.orchestra.run.smithi079.stderr:test_realistic.TestFiles.test_random_file_valid ... ok 2019-12-08T16:29:04.308 INFO:teuthology.orchestra.run.smithi079.stderr: 2019-12-08T16:29:04.308 INFO:teuthology.orchestra.run.smithi079.stderr:---------------------------------------------------------------------- 2019-12-08T16:29:04.308 INFO:teuthology.orchestra.run.smithi079.stderr:Ran 611 tests in 12171.993s 2019-12-08T16:29:04.308 INFO:teuthology.orchestra.run.smithi079.stderr: 2019-12-08T16:29:04.308 INFO:teuthology.orchestra.run.smithi079.stderr:OK (SKIP=75) 2019-12-08T16:29:04.361 DEBUG:tasks.s3tests:Scanning radosgw logs for leaked encryption keys... 2019-12-08T16:29:04.362 INFO:teuthology.orchestra.run.smithi079:> grep --binary-files=text pO3upElrwuEXSoFwCfnZPdSsmt/xWeFa0N9KgDijwVs= /var/log/ceph/rgw.ceph.client.0.log 2019-12-08T16:29:04.480 DEBUG:teuthology.orchestra.run:got remote process result: 1 2019-12-08T16:29:04.480 INFO:tasks.s3tests:Cleaning up boto... 2019-12-08T16:29:04.481 INFO:teuthology.orchestra.run.smithi079:> rm /home/ubuntu/cephtest/boto.cfg 2019-12-08T16:29:04.529 INFO:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid bar.client.0 --purge-data --cluster ceph 2019-12-08T16:29:04.637 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:04.638+0000 7f76ef7aeec0 20 rados->read ofs=0 len=0 2019-12-08T16:29:04.666 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:04.666+0000 7f76ef7aeec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T16:29:04.666 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:04.666+0000 7f76ef7aeec0 20 rados->read ofs=0 len=0 2019-12-08T16:29:04.674 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:04.674+0000 7f76ef7aeec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T16:29:04.674 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:04.674+0000 7f76ef7aeec0 20 rados->read ofs=0 len=0 2019-12-08T16:29:04.683 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:04.684+0000 7f76ef7aeec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T16:29:04.683 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:04.684+0000 7f76ef7aeec0 20 rados->read ofs=0 len=0 2019-12-08T16:29:04.704 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:04.705+0000 7f76ef7aeec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T16:29:04.902 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:04.902+0000 7f76ef7aeec0 20 RGWRados::pool_iterate: got zonegroup_info.fee0148b-7ae2-4cf0-a79e-86045a29cb7c 2019-12-08T16:29:04.902 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:04.902+0000 7f76ef7aeec0 20 RGWRados::pool_iterate: got zone_info.f8ab349b-4577-410d-b524-4ecaf50bb1bd 2019-12-08T16:29:04.902 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:04.902+0000 7f76ef7aeec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-08T16:29:04.902 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:04.902+0000 7f76ef7aeec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-08T16:29:04.902 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:04.902+0000 7f76ef7aeec0 20 rados->read ofs=0 len=0 2019-12-08T16:29:04.919 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:04.920+0000 7f76ef7aeec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T16:29:04.919 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:04.920+0000 7f76ef7aeec0 20 rados->read ofs=0 len=0 2019-12-08T16:29:04.935 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:04.936+0000 7f76ef7aeec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-08T16:29:04.936 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:04.936+0000 7f76ef7aeec0 20 rados->read ofs=0 len=0 2019-12-08T16:29:04.951 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:04.951+0000 7f76ef7aeec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T16:29:04.951 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:04.952+0000 7f76ef7aeec0 20 rados->read ofs=0 len=0 2019-12-08T16:29:04.965 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:04.966+0000 7f76ef7aeec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-08T16:29:04.965 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:04.966+0000 7f76ef7aeec0 20 rados->read ofs=0 len=0 2019-12-08T16:29:04.974 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:04.975+0000 7f76ef7aeec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T16:29:04.974 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:04.975+0000 7f76ef7aeec0 10 cannot find current period zonegroup using local zonegroup 2019-12-08T16:29:04.974 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:04.975+0000 7f76ef7aeec0 20 rados->read ofs=0 len=0 2019-12-08T16:29:04.983 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:04.984+0000 7f76ef7aeec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T16:29:04.983 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:04.984+0000 7f76ef7aeec0 20 rados->read ofs=0 len=0 2019-12-08T16:29:04.998 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:04.999+0000 7f76ef7aeec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T16:29:04.998 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:04.999+0000 7f76ef7aeec0 20 rados->read ofs=0 len=0 2019-12-08T16:29:05.017 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:05.017+0000 7f76ef7aeec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-08T16:29:05.017 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:05.017+0000 7f76ef7aeec0 20 zonegroup default 2019-12-08T16:29:05.017 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:05.017+0000 7f76ef7aeec0 20 rados->read ofs=0 len=0 2019-12-08T16:29:05.024 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:05.025+0000 7f76ef7aeec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T16:29:05.024 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:05.025+0000 7f76ef7aeec0 10 Cannot find current period zone using local zone 2019-12-08T16:29:05.024 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:05.025+0000 7f76ef7aeec0 20 rados->read ofs=0 len=0 2019-12-08T16:29:05.035 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:05.036+0000 7f76ef7aeec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T16:29:05.036 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:05.036+0000 7f76ef7aeec0 20 rados->read ofs=0 len=0 2019-12-08T16:29:05.050 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:05.051+0000 7f76ef7aeec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T16:29:05.050 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:05.051+0000 7f76ef7aeec0 20 rados->read ofs=0 len=0 2019-12-08T16:29:05.070 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:05.071+0000 7f76ef7aeec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-08T16:29:05.070 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:05.071+0000 7f76ef7aeec0 20 zone default found 2019-12-08T16:29:05.070 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:05.071+0000 7f76ef7aeec0 20 started sync module instance, tier type = 2019-12-08T16:29:05.070 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:05.071+0000 7f76ef7aeec0 20 started zone id=f8ab349b-4577-410d-b524-4ecaf50bb1bd (name=default) with tier type = 2019-12-08T16:29:05.448 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:05.449+0000 7f76ef7aeec0 20 add_watcher() i=0 2019-12-08T16:29:05.448 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:05.449+0000 7f76ef7aeec0 20 add_watcher() i=1 2019-12-08T16:29:05.449 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:05.449+0000 7f76ef7aeec0 20 add_watcher() i=2 2019-12-08T16:29:05.449 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:05.449+0000 7f76ef7aeec0 20 add_watcher() i=3 2019-12-08T16:29:05.449 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:05.449+0000 7f76ef7aeec0 20 add_watcher() i=4 2019-12-08T16:29:05.449 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:05.449+0000 7f76ef7aeec0 20 add_watcher() i=5 2019-12-08T16:29:05.449 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:05.449+0000 7f76ef7aeec0 20 add_watcher() i=6 2019-12-08T16:29:05.484 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:05.485+0000 7f76ef7aeec0 20 add_watcher() i=7 2019-12-08T16:29:05.484 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:05.485+0000 7f76ef7aeec0 2 all 8 watchers are set, enabling cache 2019-12-08T16:29:05.485 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:05.485+0000 7f76ad7e2700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-08T16:29:05.500 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:05.500+0000 7f76dc9d8700 0 -- >> v2:172.21.15.13:3300/0 conn(0x555e9ab2d180 msgr2=0x555e9ab2f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-08T16:29:05.536 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:05.537+0000 7f76dc1d7700 0 -- 172.21.15.79:0/785237094 >> [v2:172.21.15.13:6800/9325,v1:172.21.15.13:6801/9325] conn(0x555e9ab32b90 msgr2=0x555e9ab32fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-08T16:29:07.384 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:07.384+0000 7f761f7fe700 20 reqs_thread_entry: start 2019-12-08T16:29:07.384 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:07.384+0000 7f761d7fa700 20 reqs_thread_entry: start 2019-12-08T16:29:07.384 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:07.384+0000 7f76ef7aeec0 20 init_complete bucket index max shards: 0 2019-12-08T16:29:07.384 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:07.385+0000 7f760b7fe700 20 reqs_thread_entry: start 2019-12-08T16:29:07.385 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:07.385+0000 7f76ef7aeec0 20 get_system_obj_state: rctx=0x7ffc3e770c78 obj=default.rgw.meta:users.uid:bar.client.0 state=0x555e9ab9b040 s->prefetch_data=0 2019-12-08T16:29:07.385 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:07.385+0000 7f76ef7aeec0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2019-12-08T16:29:07.397 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:07.398+0000 7f76ef7aeec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x16 2019-12-08T16:29:07.398 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:07.398+0000 7f76ef7aeec0 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-12-08T16:29:07.398 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:07.398+0000 7f76ef7aeec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-08T16:29:07.398 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:07.398+0000 7f76ef7aeec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-08T16:29:07.398 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:07.398+0000 7f76ef7aeec0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : type miss (requested=0x11, cached=0x16) 2019-12-08T16:29:07.398 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:07.398+0000 7f76ef7aeec0 20 rados->read ofs=0 len=0 2019-12-08T16:29:07.415 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:07.416+0000 7f76ef7aeec0 20 rados_obj.operate() r=0 bl.length=446 2019-12-08T16:29:07.416 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:07.416+0000 7f76ef7aeec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x11 2019-12-08T16:29:07.416 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:07.416+0000 7f76ef7aeec0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-12-08T16:29:07.433 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:07.433+0000 7f76ef7aeec0 10 removing key index: EFJKXQDVBXFYQJQKPDOM 2019-12-08T16:29:07.433 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:07.433+0000 7f76ef7aeec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=170 2019-12-08T16:29:07.442 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:07.443+0000 7f76d27fc700 10 RGWWatcher::handle_notify() notify_id 584115552321 cookie 93864810599360 notifier 4643 bl.length()=170 2019-12-08T16:29:07.628 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:07.629+0000 7f76ef7aeec0 10 removing email index: bar.client.0+test@test.test 2019-12-08T16:29:07.629 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:07.629+0000 7f76ef7aeec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=178 2019-12-08T16:29:07.645 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:07.646+0000 7f76d27fc700 10 RGWWatcher::handle_notify() notify_id 584115552322 cookie 93864810590000 notifier 4643 bl.length()=178 2019-12-08T16:29:07.938 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:07.939+0000 7f76ef7aeec0 10 removing user buckets index 2019-12-08T16:29:07.938 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:07.939+0000 7f76ef7aeec0 10 distributing notification oid=default.rgw.control:notify.2 bl.length()=169 2019-12-08T16:29:07.955 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:07.956+0000 7f76d27fc700 10 RGWWatcher::handle_notify() notify_id 584115552341 cookie 93864810592944 notifier 4643 bl.length()=169 2019-12-08T16:29:08.171 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:08.172+0000 7f76ef7aeec0 10 removing user index: bar.client.0 2019-12-08T16:29:08.172 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:08.172+0000 7f76ef7aeec0 10 removing default.rgw.meta+users.uid+bar.client.0 from cache 2019-12-08T16:29:08.172 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:08.172+0000 7f76ef7aeec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=161 2019-12-08T16:29:08.189 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:08.190+0000 7f76d27fc700 10 RGWWatcher::handle_notify() notify_id 584115552323 cookie 93864810590000 notifier 4643 bl.length()=161 2019-12-08T16:29:08.444 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:08.445+0000 7f76ef7aeec0 20 remove_watcher() i=0 2019-12-08T16:29:08.444 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:08.445+0000 7f76ef7aeec0 2 removed watcher, disabling cache 2019-12-08T16:29:08.519 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:08.520+0000 7f76ef7aeec0 20 remove_watcher() i=1 2019-12-08T16:29:08.585 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:08.586+0000 7f76ef7aeec0 20 remove_watcher() i=2 2019-12-08T16:29:08.788 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:08.789+0000 7f76ef7aeec0 20 remove_watcher() i=3 2019-12-08T16:29:08.830 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:08.830+0000 7f76ef7aeec0 20 remove_watcher() i=4 2019-12-08T16:29:08.879 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:08.880+0000 7f76ef7aeec0 20 remove_watcher() i=5 2019-12-08T16:29:08.936 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:08.937+0000 7f76ef7aeec0 20 remove_watcher() i=6 2019-12-08T16:29:08.988 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:08.989+0000 7f76ef7aeec0 20 remove_watcher() i=7 2019-12-08T16:29:08.997 INFO:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid foo.client.0 --purge-data --cluster ceph 2019-12-08T16:29:09.114 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:09.115+0000 7feabbda7ec0 20 rados->read ofs=0 len=0 2019-12-08T16:29:09.151 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:09.152+0000 7feabbda7ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T16:29:09.152 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:09.152+0000 7feabbda7ec0 20 rados->read ofs=0 len=0 2019-12-08T16:29:09.161 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:09.161+0000 7feabbda7ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T16:29:09.161 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:09.161+0000 7feabbda7ec0 20 rados->read ofs=0 len=0 2019-12-08T16:29:09.178 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:09.179+0000 7feabbda7ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T16:29:09.179 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:09.179+0000 7feabbda7ec0 20 rados->read ofs=0 len=0 2019-12-08T16:29:09.200 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:09.201+0000 7feabbda7ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T16:29:09.414 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:09.414+0000 7feabbda7ec0 20 RGWRados::pool_iterate: got zonegroup_info.fee0148b-7ae2-4cf0-a79e-86045a29cb7c 2019-12-08T16:29:09.414 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:09.414+0000 7feabbda7ec0 20 RGWRados::pool_iterate: got zone_info.f8ab349b-4577-410d-b524-4ecaf50bb1bd 2019-12-08T16:29:09.415 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:09.414+0000 7feabbda7ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-08T16:29:09.415 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:09.414+0000 7feabbda7ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-08T16:29:09.415 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:09.414+0000 7feabbda7ec0 20 rados->read ofs=0 len=0 2019-12-08T16:29:09.433 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:09.432+0000 7feabbda7ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T16:29:09.433 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:09.432+0000 7feabbda7ec0 20 rados->read ofs=0 len=0 2019-12-08T16:29:09.451 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:09.450+0000 7feabbda7ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-08T16:29:09.451 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:09.450+0000 7feabbda7ec0 20 rados->read ofs=0 len=0 2019-12-08T16:29:09.467 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:09.467+0000 7feabbda7ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T16:29:09.467 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:09.467+0000 7feabbda7ec0 20 rados->read ofs=0 len=0 2019-12-08T16:29:09.484 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:09.483+0000 7feabbda7ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-08T16:29:09.484 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:09.483+0000 7feabbda7ec0 20 rados->read ofs=0 len=0 2019-12-08T16:29:09.496 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:09.496+0000 7feabbda7ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T16:29:09.496 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:09.496+0000 7feabbda7ec0 10 cannot find current period zonegroup using local zonegroup 2019-12-08T16:29:09.496 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:09.496+0000 7feabbda7ec0 20 rados->read ofs=0 len=0 2019-12-08T16:29:09.506 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:09.506+0000 7feabbda7ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T16:29:09.506 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:09.506+0000 7feabbda7ec0 20 rados->read ofs=0 len=0 2019-12-08T16:29:09.520 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:09.520+0000 7feabbda7ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T16:29:09.520 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:09.520+0000 7feabbda7ec0 20 rados->read ofs=0 len=0 2019-12-08T16:29:09.536 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:09.536+0000 7feabbda7ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-08T16:29:09.536 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:09.536+0000 7feabbda7ec0 20 zonegroup default 2019-12-08T16:29:09.536 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:09.536+0000 7feabbda7ec0 20 rados->read ofs=0 len=0 2019-12-08T16:29:09.546 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:09.546+0000 7feabbda7ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T16:29:09.546 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:09.546+0000 7feabbda7ec0 10 Cannot find current period zone using local zone 2019-12-08T16:29:09.546 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:09.546+0000 7feabbda7ec0 20 rados->read ofs=0 len=0 2019-12-08T16:29:09.557 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:09.557+0000 7feabbda7ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T16:29:09.557 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:09.557+0000 7feabbda7ec0 20 rados->read ofs=0 len=0 2019-12-08T16:29:09.570 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:09.570+0000 7feabbda7ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T16:29:09.570 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:09.570+0000 7feabbda7ec0 20 rados->read ofs=0 len=0 2019-12-08T16:29:09.593 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:09.593+0000 7feabbda7ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-08T16:29:09.594 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:09.593+0000 7feabbda7ec0 20 zone default found 2019-12-08T16:29:09.594 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:09.593+0000 7feabbda7ec0 20 started sync module instance, tier type = 2019-12-08T16:29:09.594 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:09.593+0000 7feabbda7ec0 20 started zone id=f8ab349b-4577-410d-b524-4ecaf50bb1bd (name=default) with tier type = 2019-12-08T16:29:10.009 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:10.008+0000 7feabbda7ec0 20 add_watcher() i=0 2019-12-08T16:29:10.009 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:10.008+0000 7feabbda7ec0 20 add_watcher() i=1 2019-12-08T16:29:10.009 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:10.008+0000 7feabbda7ec0 20 add_watcher() i=2 2019-12-08T16:29:10.009 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:10.008+0000 7feabbda7ec0 20 add_watcher() i=3 2019-12-08T16:29:10.010 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:10.008+0000 7feabbda7ec0 20 add_watcher() i=4 2019-12-08T16:29:10.010 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:10.008+0000 7feabbda7ec0 20 add_watcher() i=5 2019-12-08T16:29:10.010 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:10.008+0000 7feabbda7ec0 20 add_watcher() i=6 2019-12-08T16:29:10.046 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:10.046+0000 7feabbda7ec0 20 add_watcher() i=7 2019-12-08T16:29:10.047 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:10.046+0000 7feabbda7ec0 2 all 8 watchers are set, enabling cache 2019-12-08T16:29:10.047 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:10.046+0000 7fe9fbfff700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-08T16:29:10.053 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:10.053+0000 7feaa3fff700 0 -- 172.21.15.79:0/1273883903 >> [v2:172.21.15.79:3300/0,v1:172.21.15.79:6789/0] conn(0x5626d765dd30 msgr2=0x5626d7660200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-12-08T16:29:10.079 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:10.079+0000 7feaa3fff700 0 -- 172.21.15.79:0/879025701 >> v2:172.21.15.79:3300/0 conn(0x5626d7665080 msgr2=0x5626d7667590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-08T16:29:11.920 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:11.919+0000 7fe9e67fc700 20 reqs_thread_entry: start 2019-12-08T16:29:11.920 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:11.920+0000 7fe9dffff700 20 reqs_thread_entry: start 2019-12-08T16:29:11.920 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:11.920+0000 7feabbda7ec0 20 init_complete bucket index max shards: 0 2019-12-08T16:29:11.921 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:11.920+0000 7fe9de7fc700 20 reqs_thread_entry: start 2019-12-08T16:29:11.921 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:11.920+0000 7feabbda7ec0 20 get_system_obj_state: rctx=0x7ffc9fbf9b68 obj=default.rgw.meta:users.uid:foo.client.0 state=0x5626d76d9930 s->prefetch_data=0 2019-12-08T16:29:11.921 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:11.920+0000 7feabbda7ec0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2019-12-08T16:29:11.938 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:11.938+0000 7feabbda7ec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x16 2019-12-08T16:29:11.938 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:11.938+0000 7feabbda7ec0 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-12-08T16:29:11.938 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:11.938+0000 7feabbda7ec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-08T16:29:11.938 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:11.938+0000 7feabbda7ec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-08T16:29:11.939 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:11.938+0000 7feabbda7ec0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : type miss (requested=0x11, cached=0x16) 2019-12-08T16:29:11.939 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:11.938+0000 7feabbda7ec0 20 rados->read ofs=0 len=0 2019-12-08T16:29:11.960 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:11.959+0000 7feabbda7ec0 20 rados_obj.operate() r=0 bl.length=446 2019-12-08T16:29:11.960 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:11.959+0000 7feabbda7ec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x11 2019-12-08T16:29:11.960 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:11.959+0000 7feabbda7ec0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-12-08T16:29:11.975 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:11.975+0000 7feabbda7ec0 10 removing key index: YOGQLORAMSODZVKZLPPC 2019-12-08T16:29:11.975 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:11.975+0000 7feabbda7ec0 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=170 2019-12-08T16:29:11.985 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:11.984+0000 7fea99ffb700 10 RGWWatcher::handle_notify() notify_id 584115552901 cookie 94724822431328 notifier 4652 bl.length()=170 2019-12-08T16:29:12.457 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:12.456+0000 7feabbda7ec0 10 removing email index: foo.client.0+test@test.test 2019-12-08T16:29:12.457 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:12.456+0000 7feabbda7ec0 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=178 2019-12-08T16:29:12.472 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:12.472+0000 7fea99ffb700 10 RGWWatcher::handle_notify() notify_id 584115552750 cookie 94724822445952 notifier 4652 bl.length()=178 2019-12-08T16:29:12.708 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:12.708+0000 7feabbda7ec0 10 removing user buckets index 2019-12-08T16:29:12.708 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:12.708+0000 7feabbda7ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=169 2019-12-08T16:29:12.731 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:12.731+0000 7fea99ffb700 10 RGWWatcher::handle_notify() notify_id 584115552324 cookie 94724822433248 notifier 4652 bl.length()=169 2019-12-08T16:29:13.027 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:13.027+0000 7feabbda7ec0 10 removing user index: foo.client.0 2019-12-08T16:29:13.028 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:13.027+0000 7feabbda7ec0 10 removing default.rgw.meta+users.uid+foo.client.0 from cache 2019-12-08T16:29:13.028 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:13.027+0000 7feabbda7ec0 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=161 2019-12-08T16:29:13.044 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:13.044+0000 7fea99ffb700 10 RGWWatcher::handle_notify() notify_id 584115552902 cookie 94724822431328 notifier 4652 bl.length()=161 2019-12-08T16:29:13.295 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:13.294+0000 7feabbda7ec0 20 remove_watcher() i=0 2019-12-08T16:29:13.295 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:13.294+0000 7feabbda7ec0 2 removed watcher, disabling cache 2019-12-08T16:29:13.362 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:13.362+0000 7feabbda7ec0 20 remove_watcher() i=1 2019-12-08T16:29:13.428 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:13.428+0000 7feabbda7ec0 20 remove_watcher() i=2 2019-12-08T16:29:13.487 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:13.487+0000 7feabbda7ec0 20 remove_watcher() i=3 2019-12-08T16:29:13.546 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:13.546+0000 7feabbda7ec0 20 remove_watcher() i=4 2019-12-08T16:29:13.610 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:13.610+0000 7feabbda7ec0 20 remove_watcher() i=5 2019-12-08T16:29:13.682 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:13.682+0000 7feabbda7ec0 20 remove_watcher() i=6 2019-12-08T16:29:13.727 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:13.727+0000 7feabbda7ec0 20 remove_watcher() i=7 2019-12-08T16:29:13.735 INFO:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid 'testx$tenanteduser.client.0' --purge-data --cluster ceph 2019-12-08T16:29:13.875 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:13.875+0000 7f3c28bbcec0 20 rados->read ofs=0 len=0 2019-12-08T16:29:13.912 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:13.912+0000 7f3c28bbcec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T16:29:13.912 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:13.912+0000 7f3c28bbcec0 20 rados->read ofs=0 len=0 2019-12-08T16:29:13.921 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:13.921+0000 7f3c28bbcec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T16:29:13.921 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:13.921+0000 7f3c28bbcec0 20 rados->read ofs=0 len=0 2019-12-08T16:29:13.930 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:13.930+0000 7f3c28bbcec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T16:29:13.930 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:13.930+0000 7f3c28bbcec0 20 rados->read ofs=0 len=0 2019-12-08T16:29:13.948 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:13.948+0000 7f3c28bbcec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T16:29:14.163 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:14.162+0000 7f3c28bbcec0 20 RGWRados::pool_iterate: got zonegroup_info.fee0148b-7ae2-4cf0-a79e-86045a29cb7c 2019-12-08T16:29:14.163 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:14.162+0000 7f3c28bbcec0 20 RGWRados::pool_iterate: got zone_info.f8ab349b-4577-410d-b524-4ecaf50bb1bd 2019-12-08T16:29:14.163 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:14.162+0000 7f3c28bbcec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-08T16:29:14.163 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:14.162+0000 7f3c28bbcec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-08T16:29:14.163 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:14.162+0000 7f3c28bbcec0 20 rados->read ofs=0 len=0 2019-12-08T16:29:14.179 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:14.179+0000 7f3c28bbcec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T16:29:14.180 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:14.179+0000 7f3c28bbcec0 20 rados->read ofs=0 len=0 2019-12-08T16:29:14.197 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:14.196+0000 7f3c28bbcec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-08T16:29:14.197 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:14.196+0000 7f3c28bbcec0 20 rados->read ofs=0 len=0 2019-12-08T16:29:14.214 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:14.214+0000 7f3c28bbcec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T16:29:14.214 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:14.214+0000 7f3c28bbcec0 20 rados->read ofs=0 len=0 2019-12-08T16:29:14.241 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:14.241+0000 7f3c28bbcec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-08T16:29:14.241 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:14.241+0000 7f3c28bbcec0 20 rados->read ofs=0 len=0 2019-12-08T16:29:14.251 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:14.251+0000 7f3c28bbcec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T16:29:14.252 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:14.251+0000 7f3c28bbcec0 10 cannot find current period zonegroup using local zonegroup 2019-12-08T16:29:14.252 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:14.251+0000 7f3c28bbcec0 20 rados->read ofs=0 len=0 2019-12-08T16:29:14.259 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:14.258+0000 7f3c28bbcec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T16:29:14.259 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:14.259+0000 7f3c28bbcec0 20 rados->read ofs=0 len=0 2019-12-08T16:29:14.275 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:14.274+0000 7f3c28bbcec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T16:29:14.275 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:14.275+0000 7f3c28bbcec0 20 rados->read ofs=0 len=0 2019-12-08T16:29:14.293 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:14.290+0000 7f3c28bbcec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-08T16:29:14.293 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:14.290+0000 7f3c28bbcec0 20 zonegroup default 2019-12-08T16:29:14.293 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:14.290+0000 7f3c28bbcec0 20 rados->read ofs=0 len=0 2019-12-08T16:29:14.299 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:14.299+0000 7f3c28bbcec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T16:29:14.300 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:14.299+0000 7f3c28bbcec0 10 Cannot find current period zone using local zone 2019-12-08T16:29:14.301 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:14.299+0000 7f3c28bbcec0 20 rados->read ofs=0 len=0 2019-12-08T16:29:14.309 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:14.309+0000 7f3c28bbcec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T16:29:14.309 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:14.309+0000 7f3c28bbcec0 20 rados->read ofs=0 len=0 2019-12-08T16:29:14.323 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:14.322+0000 7f3c28bbcec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T16:29:14.323 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:14.322+0000 7f3c28bbcec0 20 rados->read ofs=0 len=0 2019-12-08T16:29:14.339 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:14.339+0000 7f3c28bbcec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-08T16:29:14.340 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:14.339+0000 7f3c28bbcec0 20 zone default found 2019-12-08T16:29:14.340 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:14.339+0000 7f3c28bbcec0 20 started sync module instance, tier type = 2019-12-08T16:29:14.340 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:14.339+0000 7f3c28bbcec0 20 started zone id=f8ab349b-4577-410d-b524-4ecaf50bb1bd (name=default) with tier type = 2019-12-08T16:29:14.680 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:14.679+0000 7f3c28bbcec0 20 add_watcher() i=0 2019-12-08T16:29:14.680 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:14.679+0000 7f3c28bbcec0 20 add_watcher() i=1 2019-12-08T16:29:14.680 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:14.679+0000 7f3c28bbcec0 20 add_watcher() i=2 2019-12-08T16:29:14.680 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:14.679+0000 7f3c28bbcec0 20 add_watcher() i=3 2019-12-08T16:29:14.680 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:14.679+0000 7f3c28bbcec0 20 add_watcher() i=4 2019-12-08T16:29:14.681 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:14.679+0000 7f3c28bbcec0 20 add_watcher() i=5 2019-12-08T16:29:14.684 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:14.684+0000 7f3c28bbcec0 20 add_watcher() i=6 2019-12-08T16:29:14.709 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:14.708+0000 7f3c28bbcec0 20 add_watcher() i=7 2019-12-08T16:29:14.709 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:14.708+0000 7f3c28bbcec0 2 all 8 watchers are set, enabling cache 2019-12-08T16:29:14.709 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:14.708+0000 7f3be67dc700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-08T16:29:14.730 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:14.729+0000 7f3c15de6700 0 -- 172.21.15.79:0/2756676423 >> v2:172.21.15.13:3300/0 conn(0x55b80d8dc2c0 msgr2=0x55b80d8de6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-08T16:29:14.906 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:14.905+0000 7f3c15de6700 0 -- 172.21.15.79:0/2756676423 >> [v2:172.21.15.13:6816/9326,v1:172.21.15.13:6817/9326] conn(0x55b80d8efe90 msgr2=0x55b80d8f2310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-08T16:29:16.287 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:16.287+0000 7f3b5cff9700 20 reqs_thread_entry: start 2019-12-08T16:29:16.288 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:16.287+0000 7f3b567fc700 20 reqs_thread_entry: start 2019-12-08T16:29:16.288 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:16.287+0000 7f3c28bbcec0 20 init_complete bucket index max shards: 0 2019-12-08T16:29:16.288 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:16.288+0000 7f3b54ff9700 20 reqs_thread_entry: start 2019-12-08T16:29:16.288 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:16.288+0000 7f3c28bbcec0 20 get_system_obj_state: rctx=0x7ffe4fc04458 obj=default.rgw.meta:users.uid:testx$tenanteduser.client.0 state=0x55b80d953660 s->prefetch_data=0 2019-12-08T16:29:16.289 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:16.288+0000 7f3c28bbcec0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2019-12-08T16:29:16.306 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:16.305+0000 7f3c28bbcec0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x16 2019-12-08T16:29:16.306 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:16.305+0000 7f3c28bbcec0 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-12-08T16:29:16.306 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:16.305+0000 7f3c28bbcec0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2019-12-08T16:29:16.306 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:16.305+0000 7f3c28bbcec0 20 get_system_obj_state: s->obj_tag was set empty 2019-12-08T16:29:16.306 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:16.305+0000 7f3c28bbcec0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : type miss (requested=0x11, cached=0x16) 2019-12-08T16:29:16.306 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:16.305+0000 7f3c28bbcec0 20 rados->read ofs=0 len=0 2019-12-08T16:29:16.332 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:16.331+0000 7f3c28bbcec0 20 rados_obj.operate() r=0 bl.length=505 2019-12-08T16:29:16.332 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:16.331+0000 7f3c28bbcec0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x11 2019-12-08T16:29:16.332 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:16.331+0000 7f3c28bbcec0 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2019-12-08T16:29:16.343 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:16.342+0000 7f3c28bbcec0 10 removing key index: XOAOYEVBLUJWADDSYXFV 2019-12-08T16:29:16.343 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:16.342+0000 7f3c28bbcec0 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=170 2019-12-08T16:29:16.359 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:16.358+0000 7f3bf6ffd700 10 RGWWatcher::handle_notify() notify_id 584115552903 cookie 94248989627280 notifier 5107 bl.length()=170 2019-12-08T16:29:16.763 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:16.763+0000 7f3c28bbcec0 10 removing email index: testx$tenanteduser.client.0+test@test.test 2019-12-08T16:29:16.763 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:16.763+0000 7f3c28bbcec0 10 distributing notification oid=default.rgw.control:notify.7 bl.length()=193 2019-12-08T16:29:16.775 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:16.775+0000 7f3bf6ffd700 10 RGWWatcher::handle_notify() notify_id 584115552904 cookie 94248989645712 notifier 5107 bl.length()=193 2019-12-08T16:29:17.040 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:17.040+0000 7f3c28bbcec0 10 removing user buckets index 2019-12-08T16:29:17.041 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:17.040+0000 7f3c28bbcec0 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=184 2019-12-08T16:29:17.056 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:17.056+0000 7f3bf6ffd700 10 RGWWatcher::handle_notify() notify_id 584115552751 cookie 94248989642992 notifier 5107 bl.length()=184 2019-12-08T16:29:17.191 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:17.191+0000 7f3c28bbcec0 10 removing user index: testx$tenanteduser.client.0 2019-12-08T16:29:17.191 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:17.191+0000 7f3c28bbcec0 10 removing default.rgw.meta+users.uid+testx$tenanteduser.client.0 from cache 2019-12-08T16:29:17.191 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:17.191+0000 7f3c28bbcec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=176 2019-12-08T16:29:17.205 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:17.205+0000 7f3bf6ffd700 10 RGWWatcher::handle_notify() notify_id 584115552325 cookie 94248989639600 notifier 5107 bl.length()=176 2019-12-08T16:29:17.591 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:17.590+0000 7f3c28bbcec0 20 remove_watcher() i=0 2019-12-08T16:29:17.591 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:17.590+0000 7f3c28bbcec0 2 removed watcher, disabling cache 2019-12-08T16:29:17.637 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:17.637+0000 7f3c28bbcec0 20 remove_watcher() i=1 2019-12-08T16:29:17.718 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:17.718+0000 7f3c28bbcec0 20 remove_watcher() i=2 2019-12-08T16:29:17.772 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:17.772+0000 7f3c28bbcec0 20 remove_watcher() i=3 2019-12-08T16:29:17.807 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:17.807+0000 7f3c28bbcec0 20 remove_watcher() i=4 2019-12-08T16:29:17.841 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:17.841+0000 7f3c28bbcec0 20 remove_watcher() i=5 2019-12-08T16:29:17.887 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:17.887+0000 7f3c28bbcec0 20 remove_watcher() i=6 2019-12-08T16:29:17.934 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:17.934+0000 7f3c28bbcec0 20 remove_watcher() i=7 2019-12-08T16:29:17.944 INFO:tasks.s3tests:Removing s3-tests... 2019-12-08T16:29:17.944 INFO:teuthology.orchestra.run.smithi079:> rm -rf /home/ubuntu/cephtest/s3-tests 2019-12-08T16:29:18.081 INFO:teuthology.run_tasks:Running task swift... 2019-12-08T16:29:18.093 INFO:tasks.swift:clients=['client.0'] 2019-12-08T16:29:18.094 INFO:tasks.swift:Downloading swift... 2019-12-08T16:29:18.094 INFO:teuthology.orchestra.run.smithi079:> git clone -b ceph-master git://git.ceph.com/git/swift.git /home/ubuntu/cephtest/swift 2019-12-08T16:29:18.204 INFO:teuthology.orchestra.run.smithi079.stdout:Cloning into '/home/ubuntu/cephtest/swift'... 2019-12-08T16:29:18.666 INFO:tasks.swift:Creating rgw users... 2019-12-08T16:29:18.667 INFO:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph user create --subuser foo.client.0:foo --display-name 'Mr. foo.client.0 foo' --secret C22tnV4pK3EftuoSfEgQjDDiumfUSvJu1p3ZbeBl1CjrpuLg3nKyxg== --email foo.client.0+test@test.test --key-type swift --access full 2019-12-08T16:29:18.844 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:18.843+0000 7f46f6e72ec0 20 rados->read ofs=0 len=0 2019-12-08T16:29:18.873 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:18.873+0000 7f46f6e72ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T16:29:18.873 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:18.873+0000 7f46f6e72ec0 20 rados->read ofs=0 len=0 2019-12-08T16:29:18.884 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:18.884+0000 7f46f6e72ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T16:29:18.884 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:18.884+0000 7f46f6e72ec0 20 rados->read ofs=0 len=0 2019-12-08T16:29:18.892 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:18.892+0000 7f46f6e72ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T16:29:18.892 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:18.892+0000 7f46f6e72ec0 20 rados->read ofs=0 len=0 2019-12-08T16:29:18.916 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:18.915+0000 7f46f6e72ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T16:29:19.345 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:19.345+0000 7f46f6e72ec0 20 RGWRados::pool_iterate: got zonegroup_info.fee0148b-7ae2-4cf0-a79e-86045a29cb7c 2019-12-08T16:29:19.346 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:19.345+0000 7f46f6e72ec0 20 RGWRados::pool_iterate: got zone_info.f8ab349b-4577-410d-b524-4ecaf50bb1bd 2019-12-08T16:29:19.346 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:19.345+0000 7f46f6e72ec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-08T16:29:19.346 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:19.345+0000 7f46f6e72ec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-08T16:29:19.346 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:19.345+0000 7f46f6e72ec0 20 rados->read ofs=0 len=0 2019-12-08T16:29:19.357 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:19.356+0000 7f46f6e72ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T16:29:19.357 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:19.357+0000 7f46f6e72ec0 20 rados->read ofs=0 len=0 2019-12-08T16:29:19.371 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:19.370+0000 7f46f6e72ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-08T16:29:19.371 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:19.370+0000 7f46f6e72ec0 20 rados->read ofs=0 len=0 2019-12-08T16:29:19.388 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:19.387+0000 7f46f6e72ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T16:29:19.388 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:19.387+0000 7f46f6e72ec0 20 rados->read ofs=0 len=0 2019-12-08T16:29:19.398 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:19.398+0000 7f46f6e72ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-08T16:29:19.398 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:19.398+0000 7f46f6e72ec0 20 rados->read ofs=0 len=0 2019-12-08T16:29:19.405 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:19.405+0000 7f46f6e72ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T16:29:19.405 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:19.405+0000 7f46f6e72ec0 10 cannot find current period zonegroup using local zonegroup 2019-12-08T16:29:19.405 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:19.405+0000 7f46f6e72ec0 20 rados->read ofs=0 len=0 2019-12-08T16:29:19.416 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:19.416+0000 7f46f6e72ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T16:29:19.416 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:19.416+0000 7f46f6e72ec0 20 rados->read ofs=0 len=0 2019-12-08T16:29:19.429 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:19.429+0000 7f46f6e72ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T16:29:19.429 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:19.429+0000 7f46f6e72ec0 20 rados->read ofs=0 len=0 2019-12-08T16:29:19.444 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:19.443+0000 7f46f6e72ec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-08T16:29:19.444 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:19.443+0000 7f46f6e72ec0 20 zonegroup default 2019-12-08T16:29:19.444 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:19.443+0000 7f46f6e72ec0 20 rados->read ofs=0 len=0 2019-12-08T16:29:19.451 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:19.451+0000 7f46f6e72ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T16:29:19.451 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:19.451+0000 7f46f6e72ec0 10 Cannot find current period zone using local zone 2019-12-08T16:29:19.452 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:19.451+0000 7f46f6e72ec0 20 rados->read ofs=0 len=0 2019-12-08T16:29:19.456 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:19.456+0000 7f46f6e72ec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T16:29:19.456 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:19.456+0000 7f46f6e72ec0 20 rados->read ofs=0 len=0 2019-12-08T16:29:19.466 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:19.465+0000 7f46f6e72ec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T16:29:19.466 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:19.465+0000 7f46f6e72ec0 20 rados->read ofs=0 len=0 2019-12-08T16:29:19.475 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:19.475+0000 7f46f6e72ec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-08T16:29:19.475 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:19.475+0000 7f46f6e72ec0 20 zone default found 2019-12-08T16:29:19.475 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:19.475+0000 7f46f6e72ec0 20 started sync module instance, tier type = 2019-12-08T16:29:19.475 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:19.475+0000 7f46f6e72ec0 20 started zone id=f8ab349b-4577-410d-b524-4ecaf50bb1bd (name=default) with tier type = 2019-12-08T16:29:19.861 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:19.861+0000 7f46f6e72ec0 20 add_watcher() i=0 2019-12-08T16:29:19.862 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:19.861+0000 7f46f6e72ec0 20 add_watcher() i=1 2019-12-08T16:29:19.862 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:19.861+0000 7f46f6e72ec0 20 add_watcher() i=2 2019-12-08T16:29:19.862 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:19.861+0000 7f46f6e72ec0 20 add_watcher() i=3 2019-12-08T16:29:19.862 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:19.861+0000 7f46f6e72ec0 20 add_watcher() i=4 2019-12-08T16:29:19.862 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:19.861+0000 7f46f6e72ec0 20 add_watcher() i=5 2019-12-08T16:29:19.862 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:19.862+0000 7f46f6e72ec0 20 add_watcher() i=6 2019-12-08T16:29:19.894 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:19.893+0000 7f46f6e72ec0 20 add_watcher() i=7 2019-12-08T16:29:19.894 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:19.893+0000 7f46f6e72ec0 2 all 8 watchers are set, enabling cache 2019-12-08T16:29:19.894 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:19.893+0000 7f46b4fe1700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-08T16:29:19.909 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:19.908+0000 7f46e409c700 0 -- 172.21.15.79:0/3329815221 >> [v2:172.21.15.79:3301/0,v1:172.21.15.79:6790/0] conn(0x7f46280034e0 msgr2=0x7f46280039e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-12-08T16:29:19.945 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:19.945+0000 7f46e489d700 0 -- 172.21.15.79:0/3965042741 >> [v2:172.21.15.79:6800/9057,v1:172.21.15.79:6801/9057] conn(0x7f4628022480 msgr2=0x7f4628024970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2019-12-08T16:29:22.057 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:22.057+0000 7f4626ffd700 20 reqs_thread_entry: start 2019-12-08T16:29:22.057 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:22.057+0000 7f46f6e72ec0 20 init_complete bucket index max shards: 0 2019-12-08T16:29:22.058 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:22.057+0000 7f4624ff9700 20 reqs_thread_entry: start 2019-12-08T16:29:22.058 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:22.057+0000 7f461affd700 20 reqs_thread_entry: start 2019-12-08T16:29:22.058 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:22.057+0000 7f46f6e72ec0 20 get_system_obj_state: rctx=0x7ffcbd670018 obj=default.rgw.meta:users.uid:foo.client.0 state=0x5650945c1890 s->prefetch_data=0 2019-12-08T16:29:22.058 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:22.057+0000 7f46f6e72ec0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2019-12-08T16:29:22.066 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:22.066+0000 7f46f6e72ec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x0 2019-12-08T16:29:22.066 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:22.066+0000 7f46f6e72ec0 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-12-08T16:29:22.066 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:22.066+0000 7f46f6e72ec0 20 get_system_obj_state: rctx=0x7ffcbd670028 obj=default.rgw.meta:users.email:foo.client.0+test@test.test state=0x5650945c3620 s->prefetch_data=0 2019-12-08T16:29:22.066 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:22.066+0000 7f46f6e72ec0 10 cache get: name=default.rgw.meta+users.email+foo.client.0+test@test.test : miss 2019-12-08T16:29:22.073 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:22.072+0000 7f46f6e72ec0 10 cache put: name=default.rgw.meta+users.email+foo.client.0+test@test.test info.flags=0x0 2019-12-08T16:29:22.073 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:22.072+0000 7f46f6e72ec0 10 adding default.rgw.meta+users.email+foo.client.0+test@test.test to cache LRU end 2019-12-08T16:29:22.073 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:22.073+0000 7f46f6e72ec0 20 get_system_obj_state: rctx=0x7ffcbd66fc38 obj=default.rgw.meta:users.swift:foo.client.0:foo state=0x5650945c3620 s->prefetch_data=0 2019-12-08T16:29:22.073 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:22.073+0000 7f46f6e72ec0 10 cache get: name=default.rgw.meta+users.swift+foo.client.0:foo : miss 2019-12-08T16:29:22.080 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:22.080+0000 7f46f6e72ec0 10 cache put: name=default.rgw.meta+users.swift+foo.client.0:foo info.flags=0x0 2019-12-08T16:29:22.080 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:22.080+0000 7f46f6e72ec0 10 adding default.rgw.meta+users.swift+foo.client.0:foo to cache LRU end 2019-12-08T16:29:22.080 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:22.080+0000 7f46f6e72ec0 20 get_system_obj_state: rctx=0x7ffcbd66fdb8 obj=default.rgw.meta:users.swift:foo.client.0:foo state=0x5650945c38d0 s->prefetch_data=0 2019-12-08T16:29:22.081 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:22.080+0000 7f46f6e72ec0 10 cache get: name=default.rgw.meta+users.swift+foo.client.0:foo : type miss (requested=0x6, cached=0x0) 2019-12-08T16:29:22.086 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:22.086+0000 7f46f6e72ec0 10 cache put: name=default.rgw.meta+users.swift+foo.client.0:foo info.flags=0x0 2019-12-08T16:29:22.086 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:22.086+0000 7f46f6e72ec0 10 moving default.rgw.meta+users.swift+foo.client.0:foo to cache LRU end 2019-12-08T16:29:22.124 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:22.124+0000 7f46f6e72ec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2019-12-08T16:29:22.125 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:22.124+0000 7f46f6e72ec0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-12-08T16:29:22.125 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:22.124+0000 7f46f6e72ec0 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=612 2019-12-08T16:29:22.137 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:22.137+0000 7f46d9ffb700 10 RGWWatcher::handle_notify() notify_id 584115552905 cookie 94904085837008 notifier 4667 bl.length()=612 2019-12-08T16:29:22.137 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:22.137+0000 7f46d9ffb700 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2019-12-08T16:29:22.137 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:22.137+0000 7f46d9ffb700 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-12-08T16:29:22.865 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:22.865+0000 7f46f6e72ec0 10 cache put: name=default.rgw.meta+users.email+foo.client.0+test@test.test info.flags=0x7 2019-12-08T16:29:22.865 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:22.865+0000 7f46f6e72ec0 10 moving default.rgw.meta+users.email+foo.client.0+test@test.test to cache LRU end 2019-12-08T16:29:22.865 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:22.865+0000 7f46f6e72ec0 10 distributing notification oid=default.rgw.control:notify.6 bl.length()=194 2019-12-08T16:29:22.873 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:22.873+0000 7f46d9ffb700 10 RGWWatcher::handle_notify() notify_id 584115552752 cookie 94904085851392 notifier 4667 bl.length()=194 2019-12-08T16:29:22.873 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:22.873+0000 7f46d9ffb700 10 cache put: name=default.rgw.meta+users.email+foo.client.0+test@test.test info.flags=0x7 2019-12-08T16:29:22.874 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:22.873+0000 7f46d9ffb700 10 moving default.rgw.meta+users.email+foo.client.0+test@test.test to cache LRU end 2019-12-08T16:29:23.056 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:23.055+0000 7f46f6e72ec0 10 cache put: name=default.rgw.meta+users.swift+foo.client.0:foo info.flags=0x7 2019-12-08T16:29:23.056 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:23.055+0000 7f46f6e72ec0 10 moving default.rgw.meta+users.swift+foo.client.0:foo to cache LRU end 2019-12-08T16:29:23.056 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:23.055+0000 7f46f6e72ec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=183 2019-12-08T16:29:23.071 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:23.071+0000 7f46d9ffb700 10 RGWWatcher::handle_notify() notify_id 584115552326 cookie 94904085840384 notifier 4667 bl.length()=183 2019-12-08T16:29:23.072 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:23.071+0000 7f46d9ffb700 10 cache put: name=default.rgw.meta+users.swift+foo.client.0:foo info.flags=0x7 2019-12-08T16:29:23.072 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:23.071+0000 7f46d9ffb700 10 moving default.rgw.meta+users.swift+foo.client.0:foo to cache LRU end 2019-12-08T16:29:23.752 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:23.751+0000 7f46f6e72ec0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2019-12-08T16:29:23.752 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:23.751+0000 7f46f6e72ec0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-12-08T16:29:23.752 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:23.751+0000 7f46f6e72ec0 10 distributing notification oid=default.rgw.control:notify.0 bl.length()=636 2019-12-08T16:29:23.763 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:23.762+0000 7f46d9ffb700 10 RGWWatcher::handle_notify() notify_id 584115552906 cookie 94904085837008 notifier 4667 bl.length()=636 2019-12-08T16:29:23.763 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:23.762+0000 7f46d9ffb700 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2019-12-08T16:29:23.763 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:23.762+0000 7f46d9ffb700 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2019-12-08T16:29:23.979 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2019-12-08T16:29:23.979 INFO:teuthology.orchestra.run.smithi079.stdout: "user_id": "foo.client.0", 2019-12-08T16:29:23.979 INFO:teuthology.orchestra.run.smithi079.stdout: "display_name": "Mr. foo.client.0 foo", 2019-12-08T16:29:23.979 INFO:teuthology.orchestra.run.smithi079.stdout: "email": "foo.client.0+test@test.test", 2019-12-08T16:29:23.980 INFO:teuthology.orchestra.run.smithi079.stdout: "suspended": 0, 2019-12-08T16:29:23.980 INFO:teuthology.orchestra.run.smithi079.stdout: "max_buckets": 1000, 2019-12-08T16:29:23.980 INFO:teuthology.orchestra.run.smithi079.stdout: "subusers": [ 2019-12-08T16:29:23.980 INFO:teuthology.orchestra.run.smithi079.stdout: { 2019-12-08T16:29:23.980 INFO:teuthology.orchestra.run.smithi079.stdout: "id": "foo.client.0:foo", 2019-12-08T16:29:23.980 INFO:teuthology.orchestra.run.smithi079.stdout: "permissions": "full-control" 2019-12-08T16:29:23.980 INFO:teuthology.orchestra.run.smithi079.stdout: } 2019-12-08T16:29:23.981 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2019-12-08T16:29:23.981 INFO:teuthology.orchestra.run.smithi079.stdout: "keys": [], 2019-12-08T16:29:23.981 INFO:teuthology.orchestra.run.smithi079.stdout: "swift_keys": [ 2019-12-08T16:29:23.981 INFO:teuthology.orchestra.run.smithi079.stdout: { 2019-12-08T16:29:23.981 INFO:teuthology.orchestra.run.smithi079.stdout: "user": "foo.client.0:foo", 2019-12-08T16:29:23.981 INFO:teuthology.orchestra.run.smithi079.stdout: "secret_key": "C22tnV4pK3EftuoSfEgQjDDiumfUSvJu1p3ZbeBl1CjrpuLg3nKyxg==" 2019-12-08T16:29:23.981 INFO:teuthology.orchestra.run.smithi079.stdout: } 2019-12-08T16:29:23.982 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2019-12-08T16:29:23.982 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": [], 2019-12-08T16:29:23.982 INFO:teuthology.orchestra.run.smithi079.stdout: "op_mask": "read, write, delete", 2019-12-08T16:29:23.982 INFO:teuthology.orchestra.run.smithi079.stdout: "default_placement": "", 2019-12-08T16:29:23.982 INFO:teuthology.orchestra.run.smithi079.stdout: "default_storage_class": "", 2019-12-08T16:29:23.982 INFO:teuthology.orchestra.run.smithi079.stdout: "placement_tags": [], 2019-12-08T16:29:23.982 INFO:teuthology.orchestra.run.smithi079.stdout: "bucket_quota": { 2019-12-08T16:29:23.982 INFO:teuthology.orchestra.run.smithi079.stdout: "enabled": false, 2019-12-08T16:29:23.983 INFO:teuthology.orchestra.run.smithi079.stdout: "check_on_raw": false, 2019-12-08T16:29:23.983 INFO:teuthology.orchestra.run.smithi079.stdout: "max_size": -1, 2019-12-08T16:29:23.983 INFO:teuthology.orchestra.run.smithi079.stdout: "max_size_kb": 0, 2019-12-08T16:29:23.983 INFO:teuthology.orchestra.run.smithi079.stdout: "max_objects": -1 2019-12-08T16:29:23.983 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2019-12-08T16:29:23.983 INFO:teuthology.orchestra.run.smithi079.stdout: "user_quota": { 2019-12-08T16:29:23.983 INFO:teuthology.orchestra.run.smithi079.stdout: "enabled": false, 2019-12-08T16:29:23.984 INFO:teuthology.orchestra.run.smithi079.stdout: "check_on_raw": false, 2019-12-08T16:29:23.984 INFO:teuthology.orchestra.run.smithi079.stdout: "max_size": -1, 2019-12-08T16:29:23.984 INFO:teuthology.orchestra.run.smithi079.stdout: "max_size_kb": 0, 2019-12-08T16:29:23.984 INFO:teuthology.orchestra.run.smithi079.stdout: "max_objects": -1 2019-12-08T16:29:23.984 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2019-12-08T16:29:23.984 INFO:teuthology.orchestra.run.smithi079.stdout: "temp_url_keys": [], 2019-12-08T16:29:23.984 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "rgw", 2019-12-08T16:29:23.984 INFO:teuthology.orchestra.run.smithi079.stdout: "mfa_ids": [] 2019-12-08T16:29:23.985 INFO:teuthology.orchestra.run.smithi079.stdout:} 2019-12-08T16:29:23.985 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T16:29:24.026 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:24.026+0000 7f46f6e72ec0 20 remove_watcher() i=0 2019-12-08T16:29:24.026 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:24.026+0000 7f46f6e72ec0 2 removed watcher, disabling cache 2019-12-08T16:29:24.070 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:24.069+0000 7f46f6e72ec0 20 remove_watcher() i=1 2019-12-08T16:29:24.113 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:24.113+0000 7f46f6e72ec0 20 remove_watcher() i=2 2019-12-08T16:29:24.179 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:24.178+0000 7f46f6e72ec0 20 remove_watcher() i=3 2019-12-08T16:29:24.221 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:24.221+0000 7f46f6e72ec0 20 remove_watcher() i=4 2019-12-08T16:29:24.278 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:24.278+0000 7f46f6e72ec0 20 remove_watcher() i=5 2019-12-08T16:29:24.319 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:24.319+0000 7f46f6e72ec0 20 remove_watcher() i=6 2019-12-08T16:29:24.343 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:24.343+0000 7f46f6e72ec0 20 remove_watcher() i=7 2019-12-08T16:29:24.351 INFO:teuthology.orchestra.run.smithi079:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph user create --subuser bar.client.0:bar --display-name 'Mr. bar.client.0 bar' --secret AmRvn1mKNw9XUeJx5JIBaXwSEbsW6FnpQbU5vO3N21Nx9HGpRvhFyA== --email bar.client.0+test@test.test --key-type swift --access full 2019-12-08T16:29:24.470 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:24.470+0000 7f8f452caec0 20 rados->read ofs=0 len=0 2019-12-08T16:29:24.503 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:24.503+0000 7f8f452caec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T16:29:24.504 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:24.503+0000 7f8f452caec0 20 rados->read ofs=0 len=0 2019-12-08T16:29:24.513 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:24.513+0000 7f8f452caec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T16:29:24.513 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:24.513+0000 7f8f452caec0 20 rados->read ofs=0 len=0 2019-12-08T16:29:24.523 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:24.523+0000 7f8f452caec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T16:29:24.523 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:24.523+0000 7f8f452caec0 20 rados->read ofs=0 len=0 2019-12-08T16:29:24.546 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:24.546+0000 7f8f452caec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T16:29:24.779 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:24.778+0000 7f8f452caec0 20 RGWRados::pool_iterate: got zonegroup_info.fee0148b-7ae2-4cf0-a79e-86045a29cb7c 2019-12-08T16:29:24.779 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:24.778+0000 7f8f452caec0 20 RGWRados::pool_iterate: got zone_info.f8ab349b-4577-410d-b524-4ecaf50bb1bd 2019-12-08T16:29:24.779 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:24.778+0000 7f8f452caec0 20 RGWRados::pool_iterate: got zone_names.default 2019-12-08T16:29:24.779 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:24.778+0000 7f8f452caec0 20 RGWRados::pool_iterate: got zonegroups_names.default 2019-12-08T16:29:24.779 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:24.778+0000 7f8f452caec0 20 rados->read ofs=0 len=0 2019-12-08T16:29:24.791 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:24.791+0000 7f8f452caec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T16:29:24.791 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:24.791+0000 7f8f452caec0 20 rados->read ofs=0 len=0 2019-12-08T16:29:24.804 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:24.803+0000 7f8f452caec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-08T16:29:24.804 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:24.804+0000 7f8f452caec0 20 rados->read ofs=0 len=0 2019-12-08T16:29:24.813 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:24.812+0000 7f8f452caec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T16:29:24.813 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:24.812+0000 7f8f452caec0 20 rados->read ofs=0 len=0 2019-12-08T16:29:24.823 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:24.823+0000 7f8f452caec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-08T16:29:24.824 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:24.823+0000 7f8f452caec0 20 rados->read ofs=0 len=0 2019-12-08T16:29:24.830 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:24.829+0000 7f8f452caec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T16:29:24.830 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:24.829+0000 7f8f452caec0 10 cannot find current period zonegroup using local zonegroup 2019-12-08T16:29:24.830 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:24.829+0000 7f8f452caec0 20 rados->read ofs=0 len=0 2019-12-08T16:29:24.835 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:24.835+0000 7f8f452caec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T16:29:24.836 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:24.835+0000 7f8f452caec0 20 rados->read ofs=0 len=0 2019-12-08T16:29:24.845 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:24.845+0000 7f8f452caec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T16:29:24.845 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:24.845+0000 7f8f452caec0 20 rados->read ofs=0 len=0 2019-12-08T16:29:24.853 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:24.852+0000 7f8f452caec0 20 rados_obj.operate() r=0 bl.length=382 2019-12-08T16:29:24.853 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:24.852+0000 7f8f452caec0 20 zonegroup default 2019-12-08T16:29:24.853 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:24.852+0000 7f8f452caec0 20 rados->read ofs=0 len=0 2019-12-08T16:29:24.865 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:24.865+0000 7f8f452caec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T16:29:24.865 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:24.865+0000 7f8f452caec0 10 Cannot find current period zone using local zone 2019-12-08T16:29:24.865 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:24.865+0000 7f8f452caec0 20 rados->read ofs=0 len=0 2019-12-08T16:29:24.875 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:24.875+0000 7f8f452caec0 20 rados_obj.operate() r=-2 bl.length=0 2019-12-08T16:29:24.875 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:24.875+0000 7f8f452caec0 20 rados->read ofs=0 len=0 2019-12-08T16:29:24.890 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:24.889+0000 7f8f452caec0 20 rados_obj.operate() r=0 bl.length=46 2019-12-08T16:29:24.890 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:24.890+0000 7f8f452caec0 20 rados->read ofs=0 len=0 2019-12-08T16:29:24.898 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:24.897+0000 7f8f452caec0 20 rados_obj.operate() r=0 bl.length=951 2019-12-08T16:29:24.898 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:24.897+0000 7f8f452caec0 20 zone default found 2019-12-08T16:29:24.898 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:24.897+0000 7f8f452caec0 20 started sync module instance, tier type = 2019-12-08T16:29:24.898 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:24.897+0000 7f8f452caec0 20 started zone id=f8ab349b-4577-410d-b524-4ecaf50bb1bd (name=default) with tier type = 2019-12-08T16:29:25.316 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:25.315+0000 7f8f452caec0 20 add_watcher() i=0 2019-12-08T16:29:25.316 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:25.315+0000 7f8f452caec0 20 add_watcher() i=1 2019-12-08T16:29:25.316 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:25.315+0000 7f8f452caec0 20 add_watcher() i=2 2019-12-08T16:29:25.316 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:25.315+0000 7f8f452caec0 20 add_watcher() i=3 2019-12-08T16:29:25.317 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:25.315+0000 7f8f452caec0 20 add_watcher() i=4 2019-12-08T16:29:25.317 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:25.315+0000 7f8f452caec0 20 add_watcher() i=5 2019-12-08T16:29:25.317 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:25.315+0000 7f8f452caec0 20 add_watcher() i=6 2019-12-08T16:29:25.348 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:25.348+0000 7f8f452caec0 20 add_watcher() i=7 2019-12-08T16:29:25.348 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:25.348+0000 7f8f452caec0 2 all 8 watchers are set, enabling cache 2019-12-08T16:29:25.348 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:25.348+0000 7f8f02fdd700 2 RGWDataChangesLog::ChangesRenewThread: start 2019-12-08T16:29:25.352 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:25.352+0000 7f8f31cf3700 0 -- 172.21.15.79:0/435939655 >> v2:172.21.15.13:3300/0 conn(0x562fe882fc40 msgr2=0x562fe8832150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2019-12-08T16:29:25.402 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:25.402+0000 7f8f324f4700 0 -- 172.21.15.79:0/4166622286 >> [v2:172.21.15.13:6800/9325,v1:172.21.15.13:6801/9325] conn(0x562fe8840de0 msgr2=0x562fe8843200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2019-12-08T16:29:27.337 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:27.337+0000 7f8e717fa700 20 reqs_thread_entry: start 2019-12-08T16:29:27.338 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:27.337+0000 7f8e6affd700 20 reqs_thread_entry: start 2019-12-08T16:29:27.338 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:27.337+0000 7f8f452caec0 20 init_complete bucket index max shards: 0 2019-12-08T16:29:27.338 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:27.338+0000 7f8e697fa700 20 reqs_thread_entry: start 2019-12-08T16:29:27.338 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:27.338+0000 7f8f452caec0 20 get_system_obj_state: rctx=0x7ffccba3f408 obj=default.rgw.meta:users.uid:bar.client.0 state=0x562fe88aa620 s->prefetch_data=0 2019-12-08T16:29:27.339 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:27.338+0000 7f8f452caec0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2019-12-08T16:29:27.347 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:27.346+0000 7f8f452caec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x0 2019-12-08T16:29:27.347 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:27.347+0000 7f8f452caec0 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-12-08T16:29:27.347 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:27.347+0000 7f8f452caec0 20 get_system_obj_state: rctx=0x7ffccba3f418 obj=default.rgw.meta:users.email:bar.client.0+test@test.test state=0x562fe88ac3b0 s->prefetch_data=0 2019-12-08T16:29:27.347 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:27.347+0000 7f8f452caec0 10 cache get: name=default.rgw.meta+users.email+bar.client.0+test@test.test : miss 2019-12-08T16:29:27.361 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:27.361+0000 7f8f452caec0 10 cache put: name=default.rgw.meta+users.email+bar.client.0+test@test.test info.flags=0x0 2019-12-08T16:29:27.361 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:27.361+0000 7f8f452caec0 10 adding default.rgw.meta+users.email+bar.client.0+test@test.test to cache LRU end 2019-12-08T16:29:27.361 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:27.361+0000 7f8f452caec0 20 get_system_obj_state: rctx=0x7ffccba3f028 obj=default.rgw.meta:users.swift:bar.client.0:bar state=0x562fe88ac3b0 s->prefetch_data=0 2019-12-08T16:29:27.361 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:27.361+0000 7f8f452caec0 10 cache get: name=default.rgw.meta+users.swift+bar.client.0:bar : miss 2019-12-08T16:29:27.371 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:27.371+0000 7f8f452caec0 10 cache put: name=default.rgw.meta+users.swift+bar.client.0:bar info.flags=0x0 2019-12-08T16:29:27.371 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:27.371+0000 7f8f452caec0 10 adding default.rgw.meta+users.swift+bar.client.0:bar to cache LRU end 2019-12-08T16:29:27.372 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:27.371+0000 7f8f452caec0 20 get_system_obj_state: rctx=0x7ffccba3f1a8 obj=default.rgw.meta:users.swift:bar.client.0:bar state=0x562fe88ac660 s->prefetch_data=0 2019-12-08T16:29:27.372 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:27.371+0000 7f8f452caec0 10 cache get: name=default.rgw.meta+users.swift+bar.client.0:bar : type miss (requested=0x6, cached=0x0) 2019-12-08T16:29:27.382 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:27.382+0000 7f8f452caec0 10 cache put: name=default.rgw.meta+users.swift+bar.client.0:bar info.flags=0x0 2019-12-08T16:29:27.383 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:27.382+0000 7f8f452caec0 10 moving default.rgw.meta+users.swift+bar.client.0:bar to cache LRU end 2019-12-08T16:29:27.453 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:27.453+0000 7f8f452caec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2019-12-08T16:29:27.453 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:27.453+0000 7f8f452caec0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-12-08T16:29:27.453 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:27.453+0000 7f8f452caec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=612 2019-12-08T16:29:27.466 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:27.466+0000 7f8f137fe700 10 RGWWatcher::handle_notify() notify_id 584115552327 cookie 94763764255328 notifier 4676 bl.length()=612 2019-12-08T16:29:27.466 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:27.466+0000 7f8f137fe700 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2019-12-08T16:29:27.467 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:27.466+0000 7f8f137fe700 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-12-08T16:29:28.048 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:28.047+0000 7f8f452caec0 10 cache put: name=default.rgw.meta+users.email+bar.client.0+test@test.test info.flags=0x7 2019-12-08T16:29:28.048 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:28.047+0000 7f8f452caec0 10 moving default.rgw.meta+users.email+bar.client.0+test@test.test to cache LRU end 2019-12-08T16:29:28.048 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:28.047+0000 7f8f452caec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=194 2019-12-08T16:29:28.058 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:28.057+0000 7f8f137fe700 10 RGWWatcher::handle_notify() notify_id 584115552328 cookie 94763764255328 notifier 4676 bl.length()=194 2019-12-08T16:29:28.058 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:28.057+0000 7f8f137fe700 10 cache put: name=default.rgw.meta+users.email+bar.client.0+test@test.test info.flags=0x7 2019-12-08T16:29:28.058 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:28.057+0000 7f8f137fe700 10 moving default.rgw.meta+users.email+bar.client.0+test@test.test to cache LRU end 2019-12-08T16:29:28.199 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:28.199+0000 7f8f452caec0 10 cache put: name=default.rgw.meta+users.swift+bar.client.0:bar info.flags=0x7 2019-12-08T16:29:28.199 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:28.199+0000 7f8f452caec0 10 moving default.rgw.meta+users.swift+bar.client.0:bar to cache LRU end 2019-12-08T16:29:28.199 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:28.199+0000 7f8f452caec0 10 distributing notification oid=default.rgw.control:notify.5 bl.length()=183 2019-12-08T16:29:28.207 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:28.207+0000 7f8f137fe700 10 RGWWatcher::handle_notify() notify_id 584115552329 cookie 94763764265936 notifier 4676 bl.length()=183 2019-12-08T16:29:28.208 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:28.207+0000 7f8f137fe700 10 cache put: name=default.rgw.meta+users.swift+bar.client.0:bar info.flags=0x7 2019-12-08T16:29:28.208 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:28.207+0000 7f8f137fe700 10 moving default.rgw.meta+users.swift+bar.client.0:bar to cache LRU end 2019-12-08T16:29:28.660 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:28.660+0000 7f8f452caec0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2019-12-08T16:29:28.663 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:28.660+0000 7f8f452caec0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-12-08T16:29:28.663 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:28.660+0000 7f8f452caec0 10 distributing notification oid=default.rgw.control:notify.1 bl.length()=636 2019-12-08T16:29:28.679 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:28.679+0000 7f8f137fe700 10 RGWWatcher::handle_notify() notify_id 584115552330 cookie 94763764255328 notifier 4676 bl.length()=636 2019-12-08T16:29:28.679 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:28.679+0000 7f8f137fe700 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2019-12-08T16:29:28.679 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:28.679+0000 7f8f137fe700 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2019-12-08T16:29:28.928 INFO:teuthology.orchestra.run.smithi079.stdout:{ 2019-12-08T16:29:28.929 INFO:teuthology.orchestra.run.smithi079.stdout: "user_id": "bar.client.0", 2019-12-08T16:29:28.929 INFO:teuthology.orchestra.run.smithi079.stdout: "display_name": "Mr. bar.client.0 bar", 2019-12-08T16:29:28.929 INFO:teuthology.orchestra.run.smithi079.stdout: "email": "bar.client.0+test@test.test", 2019-12-08T16:29:28.929 INFO:teuthology.orchestra.run.smithi079.stdout: "suspended": 0, 2019-12-08T16:29:28.929 INFO:teuthology.orchestra.run.smithi079.stdout: "max_buckets": 1000, 2019-12-08T16:29:28.929 INFO:teuthology.orchestra.run.smithi079.stdout: "subusers": [ 2019-12-08T16:29:28.929 INFO:teuthology.orchestra.run.smithi079.stdout: { 2019-12-08T16:29:28.930 INFO:teuthology.orchestra.run.smithi079.stdout: "id": "bar.client.0:bar", 2019-12-08T16:29:28.930 INFO:teuthology.orchestra.run.smithi079.stdout: "permissions": "full-control" 2019-12-08T16:29:28.930 INFO:teuthology.orchestra.run.smithi079.stdout: } 2019-12-08T16:29:28.930 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2019-12-08T16:29:28.930 INFO:teuthology.orchestra.run.smithi079.stdout: "keys": [], 2019-12-08T16:29:28.930 INFO:teuthology.orchestra.run.smithi079.stdout: "swift_keys": [ 2019-12-08T16:29:28.930 INFO:teuthology.orchestra.run.smithi079.stdout: { 2019-12-08T16:29:28.931 INFO:teuthology.orchestra.run.smithi079.stdout: "user": "bar.client.0:bar", 2019-12-08T16:29:28.931 INFO:teuthology.orchestra.run.smithi079.stdout: "secret_key": "AmRvn1mKNw9XUeJx5JIBaXwSEbsW6FnpQbU5vO3N21Nx9HGpRvhFyA==" 2019-12-08T16:29:28.931 INFO:teuthology.orchestra.run.smithi079.stdout: } 2019-12-08T16:29:28.931 INFO:teuthology.orchestra.run.smithi079.stdout: ], 2019-12-08T16:29:28.931 INFO:teuthology.orchestra.run.smithi079.stdout: "caps": [], 2019-12-08T16:29:28.931 INFO:teuthology.orchestra.run.smithi079.stdout: "op_mask": "read, write, delete", 2019-12-08T16:29:28.931 INFO:teuthology.orchestra.run.smithi079.stdout: "default_placement": "", 2019-12-08T16:29:28.932 INFO:teuthology.orchestra.run.smithi079.stdout: "default_storage_class": "", 2019-12-08T16:29:28.932 INFO:teuthology.orchestra.run.smithi079.stdout: "placement_tags": [], 2019-12-08T16:29:28.932 INFO:teuthology.orchestra.run.smithi079.stdout: "bucket_quota": { 2019-12-08T16:29:28.932 INFO:teuthology.orchestra.run.smithi079.stdout: "enabled": false, 2019-12-08T16:29:28.932 INFO:teuthology.orchestra.run.smithi079.stdout: "check_on_raw": false, 2019-12-08T16:29:28.932 INFO:teuthology.orchestra.run.smithi079.stdout: "max_size": -1, 2019-12-08T16:29:28.932 INFO:teuthology.orchestra.run.smithi079.stdout: "max_size_kb": 0, 2019-12-08T16:29:28.933 INFO:teuthology.orchestra.run.smithi079.stdout: "max_objects": -1 2019-12-08T16:29:28.933 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2019-12-08T16:29:28.933 INFO:teuthology.orchestra.run.smithi079.stdout: "user_quota": { 2019-12-08T16:29:28.933 INFO:teuthology.orchestra.run.smithi079.stdout: "enabled": false, 2019-12-08T16:29:28.933 INFO:teuthology.orchestra.run.smithi079.stdout: "check_on_raw": false, 2019-12-08T16:29:28.933 INFO:teuthology.orchestra.run.smithi079.stdout: "max_size": -1, 2019-12-08T16:29:28.933 INFO:teuthology.orchestra.run.smithi079.stdout: "max_size_kb": 0, 2019-12-08T16:29:28.934 INFO:teuthology.orchestra.run.smithi079.stdout: "max_objects": -1 2019-12-08T16:29:28.934 INFO:teuthology.orchestra.run.smithi079.stdout: }, 2019-12-08T16:29:28.934 INFO:teuthology.orchestra.run.smithi079.stdout: "temp_url_keys": [], 2019-12-08T16:29:28.934 INFO:teuthology.orchestra.run.smithi079.stdout: "type": "rgw", 2019-12-08T16:29:28.934 INFO:teuthology.orchestra.run.smithi079.stdout: "mfa_ids": [] 2019-12-08T16:29:28.934 INFO:teuthology.orchestra.run.smithi079.stdout:} 2019-12-08T16:29:28.934 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T16:29:28.982 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:28.982+0000 7f8f452caec0 20 remove_watcher() i=0 2019-12-08T16:29:28.982 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:28.982+0000 7f8f452caec0 2 removed watcher, disabling cache 2019-12-08T16:29:29.050 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:29.050+0000 7f8f452caec0 20 remove_watcher() i=1 2019-12-08T16:29:29.121 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:29.121+0000 7f8f452caec0 20 remove_watcher() i=2 2019-12-08T16:29:29.180 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:29.180+0000 7f8f452caec0 20 remove_watcher() i=3 2019-12-08T16:29:29.250 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:29.250+0000 7f8f452caec0 20 remove_watcher() i=4 2019-12-08T16:29:29.322 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:29.318+0000 7f8f452caec0 20 remove_watcher() i=5 2019-12-08T16:29:29.370 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:29.370+0000 7f8f452caec0 20 remove_watcher() i=6 2019-12-08T16:29:29.419 INFO:teuthology.orchestra.run.smithi079.stderr:2019-12-08T16:29:29.418+0000 7f8f452caec0 20 remove_watcher() i=7 2019-12-08T16:29:29.426 INFO:tasks.swift:Configuring testswift... 2019-12-08T16:29:29.427 INFO:teuthology.orchestra.run.smithi079:> cd /home/ubuntu/cephtest/swift && ./bootstrap 2019-12-08T16:29:31.922 INFO:teuthology.orchestra.run.smithi079.stdout:New python executable in /home/ubuntu/cephtest/swift/virtualenv/bin/python 2019-12-08T16:29:33.170 INFO:teuthology.orchestra.run.smithi079.stdout:Installing setuptools, pip, wheel...done. 2019-12-08T16:29:33.506 INFO:teuthology.orchestra.run.smithi079.stderr:Cache entry deserialization failed, entry ignored 2019-12-08T16:29:33.624 INFO:teuthology.orchestra.run.smithi079.stdout:Collecting pip 2019-12-08T16:29:33.706 INFO:teuthology.orchestra.run.smithi079.stdout: Using cached https://files.pythonhosted.org/packages/00/b6/9cfa56b4081ad13874b0c6f96af8ce16cfbc1cb06bedf8e9164ce5551ec1/pip-19.3.1-py2.py3-none-any.whl 2019-12-08T16:29:33.774 INFO:teuthology.orchestra.run.smithi079.stdout:Installing collected packages: pip 2019-12-08T16:29:33.774 INFO:teuthology.orchestra.run.smithi079.stdout: Found existing installation: pip 9.0.1 2019-12-08T16:29:33.836 INFO:teuthology.orchestra.run.smithi079.stdout: Uninstalling pip-9.0.1: 2019-12-08T16:29:33.878 INFO:teuthology.orchestra.run.smithi079.stdout: Successfully uninstalled pip-9.0.1 2019-12-08T16:29:34.717 INFO:teuthology.orchestra.run.smithi079.stdout:Successfully installed pip-19.3.1 2019-12-08T16:29:35.132 INFO:teuthology.orchestra.run.smithi079.stderr:DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support 2019-12-08T16:29:35.821 INFO:teuthology.orchestra.run.smithi079.stdout:Collecting setuptools==32.3.1 2019-12-08T16:29:35.825 INFO:teuthology.orchestra.run.smithi079.stdout: Using cached https://files.pythonhosted.org/packages/69/19/b1dff551058ce79d88b1e3688f1c735590d7ddf44d10681512133b35019f/setuptools-32.3.1-py2.py3-none-any.whl 2019-12-08T16:29:35.884 INFO:teuthology.orchestra.run.smithi079.stdout:Installing collected packages: setuptools 2019-12-08T16:29:35.884 INFO:teuthology.orchestra.run.smithi079.stdout: Found existing installation: setuptools 28.8.0 2019-12-08T16:29:35.909 INFO:teuthology.orchestra.run.smithi079.stdout: Uninstalling setuptools-28.8.0: 2019-12-08T16:29:35.923 INFO:teuthology.orchestra.run.smithi079.stdout: Successfully uninstalled setuptools-28.8.0 2019-12-08T16:29:36.112 INFO:teuthology.orchestra.run.smithi079.stdout:Successfully installed setuptools-32.3.1 2019-12-08T16:29:36.573 INFO:teuthology.orchestra.run.smithi079.stderr:DEPRECATION: Python 2.7 will reach the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 won't be maintained after that date. A future version of pip will drop support for Python 2.7. More details about Python 2 support in pip, can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support 2019-12-08T16:29:36.747 INFO:teuthology.orchestra.run.smithi079.stdout:Processing /home/ubuntu/.cache/pip/wheels/54/b7/c7/2ada654ee54483c9329871665aaf4a6056c3ce36f29cf66e67/PyYAML-5.2-cp27-cp27mu-linux_x86_64.whl 2019-12-08T16:29:36.809 INFO:teuthology.orchestra.run.smithi079.stdout:Collecting nose>=1.0.0 2019-12-08T16:29:36.810 INFO:teuthology.orchestra.run.smithi079.stdout: Using cached https://files.pythonhosted.org/packages/99/4f/13fb671119e65c4dce97c60e67d3fd9e6f7f809f2b307e2611f4701205cb/nose-1.3.7-py2-none-any.whl 2019-12-08T16:29:36.940 INFO:teuthology.orchestra.run.smithi079.stdout:Collecting boto>=2.0b4 2019-12-08T16:29:36.947 INFO:teuthology.orchestra.run.smithi079.stdout: Using cached https://files.pythonhosted.org/packages/23/10/c0b78c27298029e4454a472a1919bde20cb182dab1662cec7f2ca1dcc523/boto-2.49.0-py2.py3-none-any.whl 2019-12-08T16:29:37.105 INFO:teuthology.orchestra.run.smithi079.stdout:Processing /home/ubuntu/.cache/pip/wheels/56/0f/19/fbbf81e5764e6d8b74501c4357a88c14c94466ec777c03734c/bunch-1.0.1-cp27-none-any.whl 2019-12-08T16:29:37.367 INFO:teuthology.orchestra.run.smithi079.stdout:Collecting gevent>=0.14 2019-12-08T16:29:37.380 INFO:teuthology.orchestra.run.smithi079.stdout: Using cached https://files.pythonhosted.org/packages/e6/e9/3a693414f706e12abe60554cd73c5ae8f848b182ae58018f93d86c9eb418/gevent-1.4.0-cp27-cp27mu-manylinux1_x86_64.whl 2019-12-08T16:29:37.618 INFO:teuthology.orchestra.run.smithi079.stdout:Collecting isodate>=0.4.4 2019-12-08T16:29:37.621 INFO:teuthology.orchestra.run.smithi079.stdout: Using cached https://files.pythonhosted.org/packages/9b/9f/b36f7774ff5ea8e428fdcfc4bb332c39ee5b9362ddd3d40d9516a55221b2/isodate-0.6.0-py2.py3-none-any.whl 2019-12-08T16:29:37.708 INFO:teuthology.orchestra.run.smithi079.stdout:Collecting eventlet>=0.9.14 2019-12-08T16:29:37.768 INFO:teuthology.orchestra.run.smithi079.stdout: Downloading https://files.pythonhosted.org/packages/ef/01/83454d11bac9015f34e93cf11efcae169390ddf2df97cb73ca86de6465ed/eventlet-0.25.1-py2.py3-none-any.whl (222kB) 2019-12-08T16:29:37.928 INFO:teuthology.orchestra.run.smithi079.stdout:Collecting netifaces>=0.5 2019-12-08T16:29:37.938 INFO:teuthology.orchestra.run.smithi079.stdout: Downloading https://files.pythonhosted.org/packages/7e/02/ad1a92a72620cc17d448fe4dbdfbdf8fe1487ee7bfd82bb48308712c2f3c/netifaces-0.10.9-cp27-cp27mu-manylinux1_x86_64.whl 2019-12-08T16:29:38.021 INFO:teuthology.orchestra.run.smithi079.stdout:Collecting xattr<0.7.0,>=0.6 2019-12-08T16:29:38.031 INFO:teuthology.orchestra.run.smithi079.stdout: Downloading https://files.pythonhosted.org/packages/c5/80/b25d549ae4bf4f3e9635a331b759ffca2de4dd8a78dc5106d1ca92f5d08d/xattr-0.6.4.tar.gz 2019-12-08T16:29:38.486 INFO:teuthology.orchestra.run.smithi079.stdout:Collecting simplejson>=2.1.3 2019-12-08T16:29:38.496 INFO:teuthology.orchestra.run.smithi079.stdout: Downloading https://files.pythonhosted.org/packages/98/87/a7b98aa9256c8843f92878966dc3d8d914c14aad97e2c5ce4798d5743e07/simplejson-3.17.0.tar.gz (83kB) 2019-12-08T16:29:38.846 INFO:teuthology.orchestra.run.smithi079.stdout:Collecting WebOb==1.0 2019-12-08T16:29:38.876 INFO:teuthology.orchestra.run.smithi079.stdout: Downloading https://files.pythonhosted.org/packages/bc/eb/91b8dd8f3a8d3c3943bf27a2d322501ad8b227bf29f59e792c2eae092bc9/WebOb-1.0.tar.gz (210kB) 2019-12-08T16:29:39.285 INFO:teuthology.orchestra.run.smithi079.stdout:Collecting greenlet>=0.4.14; platform_python_implementation == "CPython" 2019-12-08T16:29:39.286 INFO:teuthology.orchestra.run.smithi079.stdout: Using cached https://files.pythonhosted.org/packages/8b/6e/f2d25875713ad0885c8d3c69269697406652e6f64e1a6bd8264f7a609327/greenlet-0.4.15-cp27-cp27mu-manylinux1_x86_64.whl 2019-12-08T16:29:39.368 INFO:teuthology.orchestra.run.smithi079.stdout:Collecting six 2019-12-08T16:29:39.370 INFO:teuthology.orchestra.run.smithi079.stdout: Using cached https://files.pythonhosted.org/packages/65/26/32b8464df2a97e6dd1b656ed26b2c194606c16fe163c695a992b36c11cdf/six-1.13.0-py2.py3-none-any.whl 2019-12-08T16:29:39.447 INFO:teuthology.orchestra.run.smithi079.stdout:Collecting monotonic>=1.4 2019-12-08T16:29:39.458 INFO:teuthology.orchestra.run.smithi079.stdout: Downloading https://files.pythonhosted.org/packages/ac/aa/063eca6a416f397bd99552c534c6d11d57f58f2e94c14780f3bbf818c4cf/monotonic-1.5-py2.py3-none-any.whl 2019-12-08T16:29:39.550 INFO:teuthology.orchestra.run.smithi079.stdout:Collecting dnspython>=1.15.0 2019-12-08T16:29:39.561 INFO:teuthology.orchestra.run.smithi079.stdout: Downloading https://files.pythonhosted.org/packages/ec/d3/3aa0e7213ef72b8585747aa0e271a9523e713813b9a20177ebe1e939deb0/dnspython-1.16.0-py2.py3-none-any.whl (188kB) 2019-12-08T16:29:39.718 INFO:teuthology.orchestra.run.smithi079.stdout:Collecting enum34; python_version < "3.4" 2019-12-08T16:29:39.728 INFO:teuthology.orchestra.run.smithi079.stdout: Downloading https://files.pythonhosted.org/packages/c5/db/e56e6b4bbac7c4a06de1c50de6fe1ef3810018ae11732a50f15f62c7d050/enum34-1.1.6-py2-none-any.whl 2019-12-08T16:29:39.768 INFO:teuthology.orchestra.run.smithi079.stdout:Building wheels for collected packages: xattr, simplejson, WebOb 2019-12-08T16:29:39.769 INFO:teuthology.orchestra.run.smithi079.stdout: Building wheel for xattr (setup.py): started 2019-12-08T16:29:40.264 INFO:teuthology.orchestra.run.smithi079.stdout: Building wheel for xattr (setup.py): finished with status 'done' 2019-12-08T16:29:40.265 INFO:teuthology.orchestra.run.smithi079.stdout: Created wheel for xattr: filename=xattr-0.6.4-cp27-cp27mu-linux_x86_64.whl size=24121 sha256=2ad7af0c7c1e2aefb7fa90691e8d6c29399c10f3f7eef78b1eeeb8cff9352d38 2019-12-08T16:29:40.265 INFO:teuthology.orchestra.run.smithi079.stdout: Stored in directory: /home/ubuntu/.cache/pip/wheels/cb/2c/40/ea48345a21b521cdacebf61db13e3bf0c42c77ec664e3fe9e5 2019-12-08T16:29:40.271 INFO:teuthology.orchestra.run.smithi079.stdout: Building wheel for simplejson (setup.py): started 2019-12-08T16:29:41.259 INFO:teuthology.orchestra.run.smithi079.stdout: Building wheel for simplejson (setup.py): finished with status 'done' 2019-12-08T16:29:41.259 INFO:teuthology.orchestra.run.smithi079.stdout: Created wheel for simplejson: filename=simplejson-3.17.0-cp27-cp27mu-linux_x86_64.whl size=113126 sha256=e59194abad37eac16e1ab7d66723dfc377b0ac17555eb0dc74e8ddf00818a707 2019-12-08T16:29:41.260 INFO:teuthology.orchestra.run.smithi079.stdout: Stored in directory: /home/ubuntu/.cache/pip/wheels/86/c0/83/dcd0339abb2640544bb8e0938aab2d069cef55e5647ce6e097 2019-12-08T16:29:41.275 INFO:teuthology.orchestra.run.smithi079.stdout: Building wheel for WebOb (setup.py): started 2019-12-08T16:29:41.552 INFO:teuthology.orchestra.run.smithi079.stdout: Building wheel for WebOb (setup.py): finished with status 'done' 2019-12-08T16:29:41.552 INFO:teuthology.orchestra.run.smithi079.stdout: Created wheel for WebOb: filename=WebOb-1.0-cp27-none-any.whl size=58478 sha256=577389a4ffdbc0029e8a7bfa3f287e9957f46a1fcf65df9b884f51b110cbfb6d 2019-12-08T16:29:41.553 INFO:teuthology.orchestra.run.smithi079.stdout: Stored in directory: /home/ubuntu/.cache/pip/wheels/30/41/c0/8ff9e679d72e05f355e6e2ec87d026131538c953a3b12496eb 2019-12-08T16:29:41.564 INFO:teuthology.orchestra.run.smithi079.stdout:Successfully built xattr simplejson WebOb 2019-12-08T16:29:41.619 INFO:teuthology.orchestra.run.smithi079.stdout:Installing collected packages: PyYAML, nose, boto, bunch, greenlet, gevent, six, isodate, monotonic, dnspython, enum34, eventlet, netifaces, xattr, simplejson, WebOb 2019-12-08T16:29:43.077 INFO:teuthology.orchestra.run.smithi079.stdout:Successfully installed PyYAML-5.2 WebOb-1.0 boto-2.49.0 bunch-1.0.1 dnspython-1.16.0 enum34-1.1.6 eventlet-0.25.1 gevent-1.4.0 greenlet-0.4.15 isodate-0.6.0 monotonic-1.5 netifaces-0.10.9 nose-1.3.7 simplejson-3.17.0 six-1.13.0 xattr-0.6.4 2019-12-08T16:29:43.403 INFO:teuthology.orchestra.run.smithi079.stdout:running develop 2019-12-08T16:29:43.450 INFO:teuthology.orchestra.run.smithi079.stdout:running egg_info 2019-12-08T16:29:43.450 INFO:teuthology.orchestra.run.smithi079.stdout:creating swift.egg-info 2019-12-08T16:29:43.450 INFO:teuthology.orchestra.run.smithi079.stdout:writing swift.egg-info/PKG-INFO 2019-12-08T16:29:43.450 INFO:teuthology.orchestra.run.smithi079.stdout:writing top-level names to swift.egg-info/top_level.txt 2019-12-08T16:29:43.450 INFO:teuthology.orchestra.run.smithi079.stdout:writing dependency_links to swift.egg-info/dependency_links.txt 2019-12-08T16:29:43.455 INFO:teuthology.orchestra.run.smithi079.stdout:writing entry points to swift.egg-info/entry_points.txt 2019-12-08T16:29:43.455 INFO:teuthology.orchestra.run.smithi079.stdout:writing manifest file 'swift.egg-info/SOURCES.txt' 2019-12-08T16:29:43.459 INFO:teuthology.orchestra.run.smithi079.stdout:reading manifest file 'swift.egg-info/SOURCES.txt' 2019-12-08T16:29:43.459 INFO:teuthology.orchestra.run.smithi079.stdout:reading manifest template 'MANIFEST.in' 2019-12-08T16:29:43.459 INFO:teuthology.orchestra.run.smithi079.stderr:warning: no files found matching 'ChangeLog' 2019-12-08T16:29:43.462 INFO:teuthology.orchestra.run.smithi079.stdout:writing manifest file 'swift.egg-info/SOURCES.txt' 2019-12-08T16:29:43.463 INFO:teuthology.orchestra.run.smithi079.stdout:running build_ext 2019-12-08T16:29:43.464 INFO:teuthology.orchestra.run.smithi079.stdout:Creating /home/ubuntu/cephtest/swift/virtualenv/lib/python2.7/site-packages/swift.egg-link (link to .) 2019-12-08T16:29:43.464 INFO:teuthology.orchestra.run.smithi079.stdout:Adding swift 1.4.4 to easy-install.pth file 2019-12-08T16:29:43.480 INFO:teuthology.orchestra.run.smithi079.stdout:Installing swift script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-08T16:29:43.481 INFO:teuthology.orchestra.run.smithi079.stdout:Installing swift-account-auditor script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-08T16:29:43.483 INFO:teuthology.orchestra.run.smithi079.stdout:Installing swift-account-audit script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-08T16:29:43.484 INFO:teuthology.orchestra.run.smithi079.stdout:Installing swift-account-reaper script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-08T16:29:43.485 INFO:teuthology.orchestra.run.smithi079.stdout:Installing swift-account-replicator script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-08T16:29:43.486 INFO:teuthology.orchestra.run.smithi079.stdout:Installing swift-account-server script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-08T16:29:43.486 INFO:teuthology.orchestra.run.smithi079.stdout:Installing swift-container-auditor script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-08T16:29:43.487 INFO:teuthology.orchestra.run.smithi079.stdout:Installing swift-container-replicator script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-08T16:29:43.488 INFO:teuthology.orchestra.run.smithi079.stdout:Installing swift-container-sync script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-08T16:29:43.489 INFO:teuthology.orchestra.run.smithi079.stdout:Installing swift-container-server script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-08T16:29:43.490 INFO:teuthology.orchestra.run.smithi079.stdout:Installing swift-container-updater script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-08T16:29:43.491 INFO:teuthology.orchestra.run.smithi079.stdout:Installing swift-drive-audit script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-08T16:29:43.492 INFO:teuthology.orchestra.run.smithi079.stdout:Installing swift-get-nodes script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-08T16:29:43.493 INFO:teuthology.orchestra.run.smithi079.stdout:Installing swift-init script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-08T16:29:43.494 INFO:teuthology.orchestra.run.smithi079.stdout:Installing swift-object-auditor script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-08T16:29:43.495 INFO:teuthology.orchestra.run.smithi079.stdout:Installing swift-object-expirer script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-08T16:29:43.496 INFO:teuthology.orchestra.run.smithi079.stdout:Installing swift-object-info script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-08T16:29:43.497 INFO:teuthology.orchestra.run.smithi079.stdout:Installing swift-object-replicator script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-08T16:29:43.498 INFO:teuthology.orchestra.run.smithi079.stdout:Installing swift-object-server script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-08T16:29:43.499 INFO:teuthology.orchestra.run.smithi079.stdout:Installing swift-object-updater script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-08T16:29:43.499 INFO:teuthology.orchestra.run.smithi079.stdout:Installing swift-proxy-server script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-08T16:29:43.503 INFO:teuthology.orchestra.run.smithi079.stdout:Installing swift-ring-builder script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-08T16:29:43.505 INFO:teuthology.orchestra.run.smithi079.stdout:Installing swift-stats-populate script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-08T16:29:43.511 INFO:teuthology.orchestra.run.smithi079.stdout:Installing swift-stats-report script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-08T16:29:43.512 INFO:teuthology.orchestra.run.smithi079.stdout:Installing swift-dispersion-populate script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-08T16:29:43.514 INFO:teuthology.orchestra.run.smithi079.stdout:Installing swift-dispersion-report script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-08T16:29:43.516 INFO:teuthology.orchestra.run.smithi079.stdout:Installing swift-bench script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-08T16:29:43.519 INFO:teuthology.orchestra.run.smithi079.stdout:Installing swift-recon script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-08T16:29:43.520 INFO:teuthology.orchestra.run.smithi079.stdout:Installing swift-recon-cron script to /home/ubuntu/cephtest/swift/virtualenv/bin 2019-12-08T16:29:43.520 INFO:teuthology.orchestra.run.smithi079.stdout: 2019-12-08T16:29:43.520 INFO:teuthology.orchestra.run.smithi079.stdout:Installed /home/ubuntu/cephtest/swift 2019-12-08T16:29:43.521 INFO:teuthology.orchestra.run.smithi079.stdout:Processing dependencies for swift==1.4.4 2019-12-08T16:29:43.521 INFO:teuthology.orchestra.run.smithi079.stdout:Finished processing dependencies for swift==1.4.4 2019-12-08T16:29:43.534 INFO:teuthology.orchestra.run.smithi079:> cat > /home/ubuntu/cephtest/archive/testswift.client.0.conf 2019-12-08T16:29:43.577 INFO:teuthology.orchestra.run.smithi079:> SWIFT_TEST_CONFIG_FILE=/home/ubuntu/cephtest/archive/testswift.client.0.conf /home/ubuntu/cephtest/swift/virtualenv/bin/nosetests -w /home/ubuntu/cephtest/swift/test/functional -v -a '!fails_on_rgw' 2019-12-08T16:30:12.293 INFO:teuthology.orchestra.run.smithi079.stderr:testAccountHead (test.functional.tests.TestAccount) ... ok 2019-12-08T16:30:23.234 INFO:teuthology.orchestra.run.smithi079.stderr:testContainerListing (test.functional.tests.TestAccount) ... ok 2019-12-08T16:31:19.425 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:04:28:44.128 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T16:31:19.459 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:04:28:44.093 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T16:31:19.475 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:04:28:44.178 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T16:31:19.482 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:04:28:44.117 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T16:31:19.488 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:04:28:44.123 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T16:31:19.495 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:04:28:44.130 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T16:31:19.570 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:04:28:44.272 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T16:31:19.572 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:04:28:44.206 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T16:31:19.595 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:04:28:44.229 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T16:33:28.349 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:04:30:53.052 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T16:33:28.354 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:04:30:53.057 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T16:33:28.361 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:04:30:52.995 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T16:33:28.361 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:04:30:52.996 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T16:33:28.364 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:04:30:52.998 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T16:33:28.369 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:04:30:53.003 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T16:33:28.454 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:04:30:53.088 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T16:33:28.461 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:04:30:53.096 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T16:33:28.464 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:04:30:53.167 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T16:34:30.876 INFO:teuthology.orchestra.run.smithi079.stderr:testContainerSerializedInfo (test.functional.tests.TestAccount) ... ok 2019-12-08T16:34:43.246 INFO:teuthology.orchestra.run.smithi079.stderr:testContainersOrderedByName (test.functional.tests.TestAccount) ... ok 2019-12-08T16:34:44.536 INFO:teuthology.orchestra.run.smithi079.stderr:testInvalidAuthToken (test.functional.tests.TestAccount) ... ok 2019-12-08T16:34:55.830 INFO:teuthology.orchestra.run.smithi079.stderr:testLastContainerMarker (test.functional.tests.TestAccount) ... ok 2019-12-08T16:35:08.829 INFO:teuthology.orchestra.run.smithi079.stderr:testListingLimit (test.functional.tests.TestAccount) ... ok 2019-12-08T16:35:48.105 INFO:teuthology.orchestra.run.smithi079.stderr:testMarkerLimitContainerList (test.functional.tests.TestAccount) ... ok 2019-12-08T16:35:48.140 INFO:teuthology.orchestra.run.smithi079.stderr:testPUT (test.functional.tests.TestAccount) ... ok 2019-12-08T16:38:41.225 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:04:36:05.928 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T16:38:41.239 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:04:36:05.941 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T16:38:41.250 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:04:36:05.885 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T16:38:41.255 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:04:36:05.889 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T16:38:41.258 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:04:36:05.892 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T16:38:41.260 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:04:36:05.894 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T16:38:41.460 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:04:36:06.094 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T16:38:41.476 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:04:36:06.110 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T16:38:41.482 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:04:36:06.185 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T16:39:41.337 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:04:37:06.040 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T16:39:41.384 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:04:37:06.018 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T16:39:41.385 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:04:37:06.020 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T16:39:41.390 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:04:37:06.025 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T16:39:41.393 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:04:37:06.095 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T16:39:41.393 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:04:37:06.027 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T16:39:41.426 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:04:37:06.060 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T16:39:41.431 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:04:37:06.066 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T16:39:41.495 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:04:37:06.198 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T16:41:38.349 INFO:teuthology.orchestra.run.smithi079.stderr:testGetRequest (test.functional.tests.TestAccountNoContainers) ... ok 2019-12-08T16:41:41.182 INFO:teuthology.orchestra.run.smithi079.stderr:testGetRequest (test.functional.tests.TestAccountNoContainersUTF8) ... ok 2019-12-08T16:42:08.555 INFO:teuthology.orchestra.run.smithi079.stderr:testAccountHead (test.functional.tests.TestAccountUTF8) ... ok 2019-12-08T16:42:19.991 INFO:teuthology.orchestra.run.smithi079.stderr:testContainerListing (test.functional.tests.TestAccountUTF8) ... ok 2019-12-08T16:43:51.780 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:04:41:16.483 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T16:43:51.786 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:04:41:16.489 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T16:43:51.791 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:04:41:16.425 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T16:43:51.793 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:04:41:16.428 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T16:43:51.795 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:04:41:16.429 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T16:43:51.799 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:04:41:16.433 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T16:43:51.965 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:04:41:16.599 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T16:43:51.969 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:04:41:16.672 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T16:43:51.971 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:04:41:16.605 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T16:45:37.907 INFO:teuthology.orchestra.run.smithi079.stderr:testContainerSerializedInfo (test.functional.tests.TestAccountUTF8) ... ok 2019-12-08T16:45:48.879 INFO:teuthology.orchestra.run.smithi079.stderr:testContainersOrderedByName (test.functional.tests.TestAccountUTF8) ... ok 2019-12-08T16:45:49.559 INFO:teuthology.orchestra.run.smithi079.stderr:testInvalidAuthToken (test.functional.tests.TestAccountUTF8) ... ok 2019-12-08T16:46:02.288 INFO:teuthology.orchestra.run.smithi079.stderr:testLastContainerMarker (test.functional.tests.TestAccountUTF8) ... ok 2019-12-08T16:46:18.108 INFO:teuthology.orchestra.run.smithi079.stderr:testListingLimit (test.functional.tests.TestAccountUTF8) ... ok 2019-12-08T16:47:34.779 INFO:teuthology.orchestra.run.smithi079.stderr:testMarkerLimitContainerList (test.functional.tests.TestAccountUTF8) ... ok 2019-12-08T16:47:34.799 INFO:teuthology.orchestra.run.smithi079.stderr:testPUT (test.functional.tests.TestAccountUTF8) ... ok 2019-12-08T16:48:03.469 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:04:45:28.172 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T16:48:03.508 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:04:45:28.211 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T16:48:03.547 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:04:45:28.182 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T16:48:03.550 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:04:45:28.185 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T16:48:03.558 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:04:45:28.193 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T16:48:03.561 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:04:45:28.196 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T16:48:03.629 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:04:45:28.332 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T16:48:03.689 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:04:45:28.323 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T16:48:03.706 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:04:45:28.341 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T16:49:03.123 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:04:46:27.826 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T16:49:03.137 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:04:46:27.840 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T16:49:03.146 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:04:46:27.780 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T16:49:03.147 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:04:46:27.781 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T16:49:03.150 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:04:46:27.784 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T16:49:03.152 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:04:46:27.787 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T16:49:03.209 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:04:46:27.843 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T16:49:03.221 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:04:46:27.924 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T16:49:03.228 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:04:46:27.862 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T16:52:49.653 INFO:teuthology.orchestra.run.smithi079.stderr:testContainerExistenceCachingProblem (test.functional.tests.TestContainer) ... ok 2019-12-08T16:52:52.310 INFO:teuthology.orchestra.run.smithi079.stderr:testContainerFileList (test.functional.tests.TestContainer) ... ok 2019-12-08T16:52:53.689 INFO:teuthology.orchestra.run.smithi079.stderr:testContainerFileListOnContainerThatDoesNotExist (test.functional.tests.TestContainer) ... ok 2019-12-08T16:52:55.626 INFO:teuthology.orchestra.run.smithi079.stderr:testContainerFileListWithLimit (test.functional.tests.TestContainer) ... ok 2019-12-08T16:52:55.800 INFO:teuthology.orchestra.run.smithi079.stderr:testContainerInfo (test.functional.tests.TestContainer) ... ok 2019-12-08T16:52:55.923 INFO:teuthology.orchestra.run.smithi079.stderr:testContainerInfoOnContainerThatDoesNotExist (test.functional.tests.TestContainer) ... ok 2019-12-08T16:53:05.142 INFO:teuthology.orchestra.run.smithi079.stderr:testContainerNameLimit (test.functional.tests.TestContainer) ... ok 2019-12-08T16:53:11.422 INFO:teuthology.orchestra.run.smithi079.stderr:testCreate (test.functional.tests.TestContainer) ... ok 2019-12-08T16:53:21.786 INFO:teuthology.orchestra.run.smithi079.stderr:testDelete (test.functional.tests.TestContainer) ... ok 2019-12-08T16:53:22.390 INFO:teuthology.orchestra.run.smithi079.stderr:testDeleteOnContainerThatDoesNotExist (test.functional.tests.TestContainer) ... ok 2019-12-08T16:53:27.606 INFO:teuthology.orchestra.run.smithi079.stderr:testDeleteOnContainerWithFiles (test.functional.tests.TestContainer) ... ok 2019-12-08T16:53:27.916 INFO:teuthology.orchestra.run.smithi079.stderr:testFileCreateInContainerThatDoesNotExist (test.functional.tests.TestContainer) ... ok 2019-12-08T16:54:15.169 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:04:51:39.871 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T16:54:15.178 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:04:51:39.881 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T16:54:15.183 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:04:51:39.818 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T16:54:15.187 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:04:51:39.821 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T16:54:15.189 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:04:51:39.823 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T16:54:15.190 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:04:51:39.825 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T16:54:15.396 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:04:51:40.030 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T16:54:15.401 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:04:51:40.036 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T16:54:15.405 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:04:51:40.108 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T16:54:48.290 INFO:teuthology.orchestra.run.smithi079.stderr:testFileListingLimitMarkerPrefix (test.functional.tests.TestContainer) ... ok 2019-12-08T16:54:50.112 INFO:teuthology.orchestra.run.smithi079.stderr:testFileOrder (test.functional.tests.TestContainer) ... ok 2019-12-08T16:54:59.269 INFO:teuthology.orchestra.run.smithi079.stderr:testFileThenContainerDelete (test.functional.tests.TestContainer) ... ok 2019-12-08T16:55:03.260 INFO:teuthology.orchestra.run.smithi079.stderr:testLastFileMarker (test.functional.tests.TestContainer) ... ok 2019-12-08T16:55:26.210 INFO:teuthology.orchestra.run.smithi079.stderr:testMarkerLimitFileList (test.functional.tests.TestContainer) ... ok 2019-12-08T16:56:11.668 INFO:teuthology.orchestra.run.smithi079.stderr:testPrefixAndLimit (test.functional.tests.TestContainer) ... ok 2019-12-08T16:56:11.695 INFO:teuthology.orchestra.run.smithi079.stderr:testTooLongName (test.functional.tests.TestContainer) ... ok 2019-12-08T16:56:30.728 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:04:53:55.431 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T16:56:30.764 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:04:53:55.467 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T16:56:30.784 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:04:53:55.419 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T16:56:30.834 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:04:53:55.537 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T16:56:30.837 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:04:53:55.472 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T16:56:30.862 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:04:53:55.496 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T16:56:30.869 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:04:53:55.503 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T16:56:30.959 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:04:53:55.593 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T16:56:30.990 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:04:53:55.624 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T16:57:05.857 INFO:teuthology.orchestra.run.smithi079.stderr:testUnorderedList (test.functional.tests.TestContainer) ... ok 2019-12-08T16:59:26.569 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:04:56:51.272 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T16:59:26.575 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:04:56:51.278 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T16:59:26.585 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:04:56:51.219 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T16:59:26.585 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:04:56:51.220 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T16:59:26.590 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:04:56:51.224 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T16:59:26.591 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:04:56:51.226 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T16:59:26.696 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:04:56:51.399 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T16:59:26.700 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:04:56:51.334 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T16:59:26.700 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:04:56:51.334 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T17:01:07.049 INFO:teuthology.orchestra.run.smithi079.stderr:testContainerListing (test.functional.tests.TestContainerPaths) ... ok 2019-12-08T17:01:15.865 INFO:teuthology.orchestra.run.smithi079.stderr:testStructure (test.functional.tests.TestContainerPaths) ... ok 2019-12-08T17:01:27.405 INFO:teuthology.orchestra.run.smithi079.stderr:testTraverseContainer (test.functional.tests.TestContainerPaths) ... ok 2019-12-08T17:02:41.895 INFO:teuthology.orchestra.run.smithi079.stderr:testContainerExistenceCachingProblem (test.functional.tests.TestContainerUTF8) ... ok 2019-12-08T17:02:44.422 INFO:teuthology.orchestra.run.smithi079.stderr:testContainerFileList (test.functional.tests.TestContainerUTF8) ... ok 2019-12-08T17:02:45.410 INFO:teuthology.orchestra.run.smithi079.stderr:testContainerFileListOnContainerThatDoesNotExist (test.functional.tests.TestContainerUTF8) ... ok 2019-12-08T17:02:47.237 INFO:teuthology.orchestra.run.smithi079.stderr:testContainerFileListWithLimit (test.functional.tests.TestContainerUTF8) ... ok 2019-12-08T17:02:47.935 INFO:teuthology.orchestra.run.smithi079.stderr:testContainerInfo (test.functional.tests.TestContainerUTF8) ... ok 2019-12-08T17:02:48.361 INFO:teuthology.orchestra.run.smithi079.stderr:testContainerInfoOnContainerThatDoesNotExist (test.functional.tests.TestContainerUTF8) ... ok 2019-12-08T17:02:56.862 INFO:teuthology.orchestra.run.smithi079.stderr:testContainerNameLimit (test.functional.tests.TestContainerUTF8) ... ok 2019-12-08T17:03:02.402 INFO:teuthology.orchestra.run.smithi079.stderr:testCreate (test.functional.tests.TestContainerUTF8) ... ok 2019-12-08T17:03:12.191 INFO:teuthology.orchestra.run.smithi079.stderr:testDelete (test.functional.tests.TestContainerUTF8) ... ok 2019-12-08T17:03:12.399 INFO:teuthology.orchestra.run.smithi079.stderr:testDeleteOnContainerThatDoesNotExist (test.functional.tests.TestContainerUTF8) ... ok 2019-12-08T17:03:18.919 INFO:teuthology.orchestra.run.smithi079.stderr:testDeleteOnContainerWithFiles (test.functional.tests.TestContainerUTF8) ... ok 2019-12-08T17:03:19.461 INFO:teuthology.orchestra.run.smithi079.stderr:testFileCreateInContainerThatDoesNotExist (test.functional.tests.TestContainerUTF8) ... ok 2019-12-08T17:04:28.908 INFO:teuthology.orchestra.run.smithi079.stderr:testFileListingLimitMarkerPrefix (test.functional.tests.TestContainerUTF8) ... ok 2019-12-08T17:04:31.210 INFO:teuthology.orchestra.run.smithi079.stderr:testFileOrder (test.functional.tests.TestContainerUTF8) ... ok 2019-12-08T17:04:35.625 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:05:02:00.328 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T17:04:35.639 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:05:02:00.342 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T17:04:35.640 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:05:02:00.274 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T17:04:35.645 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:05:02:00.279 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T17:04:35.649 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:05:02:00.283 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T17:04:35.654 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:05:02:00.288 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T17:04:35.826 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:05:02:00.461 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T17:04:35.852 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:05:02:00.555 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T17:04:35.887 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:05:02:00.521 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T17:04:41.799 INFO:teuthology.orchestra.run.smithi079.stderr:testFileThenContainerDelete (test.functional.tests.TestContainerUTF8) ... ok 2019-12-08T17:04:45.103 INFO:teuthology.orchestra.run.smithi079.stderr:testLastFileMarker (test.functional.tests.TestContainerUTF8) ... ok 2019-12-08T17:04:52.986 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:05:02:17.689 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T17:04:53.006 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:05:02:17.640 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T17:04:53.009 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:05:02:17.712 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T17:04:53.027 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:05:02:17.662 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T17:04:53.041 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:05:02:17.744 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T17:04:53.046 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:05:02:17.680 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T17:04:53.053 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:05:02:17.687 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T17:04:53.055 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:05:02:17.690 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T17:04:53.078 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:05:02:17.713 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T17:05:05.214 INFO:teuthology.orchestra.run.smithi079.stderr:testMarkerLimitFileList (test.functional.tests.TestContainerUTF8) ... ok 2019-12-08T17:06:15.273 INFO:teuthology.orchestra.run.smithi079.stderr:testPrefixAndLimit (test.functional.tests.TestContainerUTF8) ... ok 2019-12-08T17:06:15.328 INFO:teuthology.orchestra.run.smithi079.stderr:testTooLongName (test.functional.tests.TestContainerUTF8) ... ok 2019-12-08T17:06:34.273 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:06:34.260+0000 1694f700 -1 osd.7 136 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:05:49.645582+0000 front 2019-12-08T17:05:49.498928+0000 (oldest deadline 2019-12-08T17:06:34.242627+0000) 2019-12-08T17:06:35.097 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:06:35.084+0000 1694f700 -1 osd.6 136 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:05:50.117232+0000 front 2019-12-08T17:05:50.115980+0000 (oldest deadline 2019-12-08T17:06:34.189241+0000) 2019-12-08T17:06:35.273 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:06:35.267+0000 1694f700 -1 osd.7 136 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:05:49.645582+0000 front 2019-12-08T17:05:49.498928+0000 (oldest deadline 2019-12-08T17:06:34.242627+0000) 2019-12-08T17:06:35.403 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:06:35.390+0000 1694f700 -1 osd.4 136 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:05:51.440088+0000 front 2019-12-08T17:05:51.395668+0000 (oldest deadline 2019-12-08T17:06:35.344862+0000) 2019-12-08T17:06:35.436 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:06:35.429+0000 1694f700 -1 osd.1 136 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:05:49.661805+0000 front 2019-12-08T17:05:50.233900+0000 (oldest deadline 2019-12-08T17:06:34.938473+0000) 2019-12-08T17:06:35.991 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:06:35.973+0000 1694f700 -1 osd.5 136 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:05:53.218484+0000 front 2019-12-08T17:05:53.230516+0000 (oldest deadline 2019-12-08T17:06:35.572948+0000) 2019-12-08T17:06:36.104 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:06:36.090+0000 1694f700 -1 osd.3 136 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:05:51.148401+0000 front 2019-12-08T17:05:51.069902+0000 (oldest deadline 2019-12-08T17:06:35.105236+0000) 2019-12-08T17:06:36.141 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:06:36.137+0000 1694f700 -1 osd.6 136 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:05:50.117232+0000 front 2019-12-08T17:05:50.115980+0000 (oldest deadline 2019-12-08T17:06:34.189241+0000) 2019-12-08T17:06:36.144 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:06:36.140+0000 1694f700 -1 osd.0 136 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:05:53.238961+0000 front 2019-12-08T17:05:53.028633+0000 (oldest deadline 2019-12-08T17:06:35.880434+0000) 2019-12-08T17:06:36.233 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:06:36.230+0000 1694f700 -1 osd.7 136 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:05:49.645582+0000 front 2019-12-08T17:05:49.498928+0000 (oldest deadline 2019-12-08T17:06:34.242627+0000) 2019-12-08T17:06:36.437 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:06:36.428+0000 1694f700 -1 osd.4 136 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:05:51.440088+0000 front 2019-12-08T17:05:51.395668+0000 (oldest deadline 2019-12-08T17:06:35.344862+0000) 2019-12-08T17:06:36.448 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:06:36.442+0000 1694f700 -1 osd.1 136 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:05:49.661805+0000 front 2019-12-08T17:05:50.233900+0000 (oldest deadline 2019-12-08T17:06:34.938473+0000) 2019-12-08T17:06:37.109 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:06:37.107+0000 1694f700 -1 osd.0 136 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:05:53.238961+0000 front 2019-12-08T17:05:53.028633+0000 (oldest deadline 2019-12-08T17:06:35.880434+0000) 2019-12-08T17:06:37.115 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:06:37.110+0000 1694f700 -1 osd.6 136 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:05:50.117232+0000 front 2019-12-08T17:05:50.115980+0000 (oldest deadline 2019-12-08T17:06:34.189241+0000) 2019-12-08T17:06:37.253 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:06:37.245+0000 1694f700 -1 osd.7 136 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:05:49.645582+0000 front 2019-12-08T17:05:49.498928+0000 (oldest deadline 2019-12-08T17:06:34.242627+0000) 2019-12-08T17:06:48.873 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:05:04:13.576 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T17:06:48.878 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:05:04:13.581 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T17:06:48.928 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:05:04:13.562 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T17:06:48.929 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:05:04:13.562 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T17:06:48.930 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:05:04:13.564 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T17:06:48.949 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:05:04:13.583 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T17:06:49.011 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:05:04:13.714 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T17:06:49.034 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:05:04:13.668 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T17:06:49.052 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:05:04:13.686 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T17:07:32.326 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:07:32.322+0000 1694f700 -1 osd.2 143 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e141) 2019-12-08T17:07:33.348 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:07:33.346+0000 1694f700 -1 osd.2 143 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e141) 2019-12-08T17:07:34.390 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:07:34.390+0000 1694f700 -1 osd.2 143 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e141) 2019-12-08T17:07:34.564 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:07:34.550+0000 1694f700 -1 osd.0 143 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:06:53.674451+0000 front 2019-12-08T17:06:53.972506+0000 (oldest deadline 2019-12-08T17:07:33.947789+0000) 2019-12-08T17:07:35.102 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:07:35.094+0000 1694f700 -1 osd.4 143 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:06:54.146386+0000 front 2019-12-08T17:06:53.961072+0000 (oldest deadline 2019-12-08T17:07:34.983453+0000) 2019-12-08T17:07:35.172 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:07:35.170+0000 1694f700 -1 osd.3 143 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:06:52.582977+0000 front 2019-12-08T17:06:52.584742+0000 (oldest deadline 2019-12-08T17:07:34.223377+0000) 2019-12-08T17:07:35.393 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:07:35.389+0000 1694f700 -1 osd.2 143 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e141) 2019-12-08T17:07:35.589 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:07:35.587+0000 1694f700 -1 osd.0 143 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:06:53.674451+0000 front 2019-12-08T17:06:53.972506+0000 (oldest deadline 2019-12-08T17:07:33.947789+0000) 2019-12-08T17:07:35.879 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:07:35.872+0000 1694f700 -1 osd.7 143 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:06:52.588407+0000 front 2019-12-08T17:06:52.647916+0000 (oldest deadline 2019-12-08T17:07:35.542840+0000) 2019-12-08T17:07:35.975 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:07:35.966+0000 1694f700 -1 osd.6 143 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:100889 2.31s0 2.77fabb71 (undecoded) ondisk+write+known_if_redirected e143) 2019-12-08T17:07:36.103 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:07:36.097+0000 1694f700 -1 osd.4 143 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:06:54.146386+0000 front 2019-12-08T17:06:53.961072+0000 (oldest deadline 2019-12-08T17:07:34.983453+0000) 2019-12-08T17:07:36.224 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:07:36.220+0000 1694f700 -1 osd.3 143 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:06:52.582977+0000 front 2019-12-08T17:06:52.584742+0000 (oldest deadline 2019-12-08T17:07:34.223377+0000) 2019-12-08T17:07:36.416 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:07:36.415+0000 1694f700 -1 osd.2 143 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e141) 2019-12-08T17:07:36.851 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:07:36.846+0000 1694f700 -1 osd.7 143 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:06:52.588407+0000 front 2019-12-08T17:06:52.647916+0000 (oldest deadline 2019-12-08T17:07:35.542840+0000) 2019-12-08T17:07:37.048 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:07:36.980+0000 1694f700 -1 osd.6 144 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:100889 2.31s0 2.77fabb71 (undecoded) ondisk+write+known_if_redirected e143) 2019-12-08T17:07:38.635 INFO:tasks.rgw.client.0.smithi079.stdout:2019-12-08T17:07:38.603+0000 20e25700 -1 RGWWatcher::handle_error cookie 821871248 err (107) Transport endpoint is not connected 2019-12-08T17:08:04.174 INFO:tasks.rgw.client.0.smithi079.stdout:2019-12-08T17:08:04.132+0000 20e25700 -1 RGWWatcher::handle_error cookie 821505232 err (107) Transport endpoint is not connected 2019-12-08T17:08:44.454 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:08:44.449+0000 1694f700 -1 osd.1 139 get_health_metrics reporting 14 slow ops, oldest is osd_op(client.4449.0:100862 5.f 5.4322fa9f (undecoded) ondisk+write+known_if_redirected e140) 2019-12-08T17:08:45.848 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:08:45.846+0000 1694f700 -1 osd.1 141 get_health_metrics reporting 12 slow ops, oldest is osd_op(client.4449.0:100891 5.f 5.4322fa9f (undecoded) ondisk+write+known_if_redirected e143) 2019-12-08T17:08:46.948 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:08:46.890+0000 1694f700 -1 osd.1 143 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4449.0:100892 5.9 5.84ada7c9 (undecoded) ondisk+write+known_if_redirected e143) 2019-12-08T17:08:52.222 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:05:06:16.924 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T17:08:52.230 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:05:06:16.933 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T17:08:52.237 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:05:06:16.872 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T17:08:52.240 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:05:06:16.875 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T17:08:52.246 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:05:06:16.881 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T17:08:52.257 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:05:06:16.891 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T17:08:52.403 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:05:06:17.106 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T17:08:52.470 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:05:06:17.104 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T17:08:52.507 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:05:06:17.142 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T17:09:29.158 INFO:teuthology.orchestra.run.smithi079.stderr:testUnorderedList (test.functional.tests.TestContainerUTF8) ... ok 2019-12-08T17:10:11.430 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:10:11.429+0000 1694f700 -1 osd.3 149 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:09:31.037128+0000 front 2019-12-08T17:09:29.418318+0000 (oldest deadline 2019-12-08T17:10:11.008508+0000) 2019-12-08T17:10:11.806 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:10:11.800+0000 1694f700 -1 osd.6 149 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:09:31.186870+0000 front 2019-12-08T17:09:26.478567+0000 (oldest deadline 2019-12-08T17:10:11.064293+0000) 2019-12-08T17:10:12.392 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:10:12.390+0000 1694f700 -1 osd.3 149 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:09:31.037128+0000 front 2019-12-08T17:09:29.418318+0000 (oldest deadline 2019-12-08T17:10:11.008508+0000) 2019-12-08T17:10:12.576 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:10:12.571+0000 1694f700 -1 osd.4 149 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:09:31.040458+0000 front 2019-12-08T17:09:30.107690+0000 (oldest deadline 2019-12-08T17:10:11.635468+0000) 2019-12-08T17:10:12.763 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:10:12.758+0000 1694f700 -1 osd.6 149 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:09:31.186870+0000 front 2019-12-08T17:09:26.478567+0000 (oldest deadline 2019-12-08T17:10:11.064293+0000) 2019-12-08T17:10:13.089 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:10:13.083+0000 1694f700 -1 osd.7 149 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:09:27.859195+0000 front 2019-12-08T17:09:27.857221+0000 (oldest deadline 2019-12-08T17:10:12.262866+0000) 2019-12-08T17:10:13.376 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:10:13.374+0000 1694f700 -1 osd.3 149 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:09:31.037128+0000 front 2019-12-08T17:09:29.418318+0000 (oldest deadline 2019-12-08T17:10:11.008508+0000) 2019-12-08T17:10:13.612 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:10:13.606+0000 1694f700 -1 osd.4 149 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:09:31.040458+0000 front 2019-12-08T17:09:30.107690+0000 (oldest deadline 2019-12-08T17:10:11.635468+0000) 2019-12-08T17:10:13.630 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:10:13.624+0000 1694f700 -1 osd.1 149 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:09:31.029640+0000 front 2019-12-08T17:09:29.893490+0000 (oldest deadline 2019-12-08T17:10:13.350803+0000) 2019-12-08T17:10:13.781 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:10:13.775+0000 1694f700 -1 osd.6 149 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:09:31.186870+0000 front 2019-12-08T17:09:26.478567+0000 (oldest deadline 2019-12-08T17:10:11.064293+0000) 2019-12-08T17:10:14.067 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:10:14.061+0000 1694f700 -1 osd.7 149 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:09:27.859195+0000 front 2019-12-08T17:09:27.857221+0000 (oldest deadline 2019-12-08T17:10:12.262866+0000) 2019-12-08T17:10:14.345 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:10:14.342+0000 1694f700 -1 osd.3 149 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:09:31.037128+0000 front 2019-12-08T17:09:29.418318+0000 (oldest deadline 2019-12-08T17:10:11.008508+0000) 2019-12-08T17:10:14.606 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:10:14.603+0000 1694f700 -1 osd.1 149 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:09:31.029640+0000 front 2019-12-08T17:09:29.893490+0000 (oldest deadline 2019-12-08T17:10:13.350803+0000) 2019-12-08T17:10:14.620 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:10:14.612+0000 1694f700 -1 osd.4 149 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:09:31.040458+0000 front 2019-12-08T17:09:30.107690+0000 (oldest deadline 2019-12-08T17:10:11.635468+0000) 2019-12-08T17:10:14.807 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:10:14.796+0000 1694f700 -1 osd.6 149 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:09:31.186870+0000 front 2019-12-08T17:09:26.478567+0000 (oldest deadline 2019-12-08T17:10:11.064293+0000) 2019-12-08T17:10:15.122 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:10:15.118+0000 1694f700 -1 osd.7 149 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:09:27.859195+0000 front 2019-12-08T17:09:27.857221+0000 (oldest deadline 2019-12-08T17:10:12.262866+0000) 2019-12-08T17:10:15.190 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:10:15.185+0000 1694f700 -1 osd.5 149 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:09:29.264667+0000 front 2019-12-08T17:09:29.281971+0000 (oldest deadline 2019-12-08T17:10:14.529035+0000) 2019-12-08T17:11:04.809 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:11:04.802+0000 1694f700 -1 osd.4 151 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:101522 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=250b] snapc 0=[] ondisk+write+known_if_redirected e151) 2019-12-08T17:11:05.831 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:11:05.828+0000 1694f700 -1 osd.4 151 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:101522 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=250b] snapc 0=[] ondisk+write+known_if_redirected e151) 2019-12-08T17:11:06.868 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:11:06.865+0000 1694f700 -1 osd.4 151 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:101522 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=250b] snapc 0=[] ondisk+write+known_if_redirected e151) 2019-12-08T17:11:07.841 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:11:07.838+0000 1694f700 -1 osd.4 151 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:101522 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=250b] snapc 0=[] ondisk+write+known_if_redirected e151) 2019-12-08T17:11:08.829 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:11:08.825+0000 1694f700 -1 osd.4 151 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:101522 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=250b] snapc 0=[] ondisk+write+known_if_redirected e151) 2019-12-08T17:11:09.803 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:11:09.799+0000 1694f700 -1 osd.4 151 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:101522 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=250b] snapc 0=[] ondisk+write+known_if_redirected e151) 2019-12-08T17:11:10.818 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:11:10.815+0000 1694f700 -1 osd.4 151 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:101522 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=250b] snapc 0=[] ondisk+write+known_if_redirected e151) 2019-12-08T17:11:11.782 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:11:11.778+0000 1694f700 -1 osd.4 151 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:101522 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=250b] snapc 0=[] ondisk+write+known_if_redirected e151) 2019-12-08T17:11:12.780 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:11:12.773+0000 1694f700 -1 osd.4 151 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:10:27.176493+0000 front 2019-12-08T17:10:28.137043+0000 (oldest deadline 2019-12-08T17:11:12.398617+0000) 2019-12-08T17:11:12.781 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:11:12.777+0000 1694f700 -1 osd.4 151 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4449.0:101522 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=250b] snapc 0=[] ondisk+write+known_if_redirected e151) 2019-12-08T17:11:13.779 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:11:13.772+0000 1694f700 -1 osd.4 151 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:10:27.176493+0000 front 2019-12-08T17:10:28.137043+0000 (oldest deadline 2019-12-08T17:11:12.398617+0000) 2019-12-08T17:11:13.779 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:11:13.775+0000 1694f700 -1 osd.4 151 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4449.0:101522 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=250b] snapc 0=[] ondisk+write+known_if_redirected e151) 2019-12-08T17:11:13.780 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:11:13.776+0000 1694f700 -1 osd.3 151 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:10:27.301115+0000 front 2019-12-08T17:10:28.172366+0000 (oldest deadline 2019-12-08T17:11:13.157747+0000) 2019-12-08T17:11:14.797 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:11:14.792+0000 1694f700 -1 osd.4 151 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:10:27.176493+0000 front 2019-12-08T17:10:28.137043+0000 (oldest deadline 2019-12-08T17:11:12.398617+0000) 2019-12-08T17:11:14.798 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:11:14.796+0000 1694f700 -1 osd.3 151 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:10:27.301115+0000 front 2019-12-08T17:10:28.172366+0000 (oldest deadline 2019-12-08T17:11:13.157747+0000) 2019-12-08T17:11:14.800 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:11:14.797+0000 1694f700 -1 osd.4 151 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4449.0:101522 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=250b] snapc 0=[] ondisk+write+known_if_redirected e151) 2019-12-08T17:11:15.646 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:11:15.641+0000 1694f700 -1 osd.5 151 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:10:31.982793+0000 front 2019-12-08T17:10:31.988428+0000 (oldest deadline 2019-12-08T17:11:15.609077+0000) 2019-12-08T17:11:15.753 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:11:15.751+0000 1694f700 -1 osd.3 151 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:10:27.301115+0000 front 2019-12-08T17:10:28.172366+0000 (oldest deadline 2019-12-08T17:11:13.157747+0000) 2019-12-08T17:11:15.767 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:11:15.761+0000 1694f700 -1 osd.4 151 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:10:27.176493+0000 front 2019-12-08T17:10:28.137043+0000 (oldest deadline 2019-12-08T17:11:12.398617+0000) 2019-12-08T17:11:15.772 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:11:15.767+0000 1694f700 -1 osd.4 151 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4449.0:101522 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=250b] snapc 0=[] ondisk+write+known_if_redirected e151) 2019-12-08T17:11:16.158 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:11:16.152+0000 1694f700 -1 osd.6 151 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:10:30.770274+0000 front 2019-12-08T17:10:31.021228+0000 (oldest deadline 2019-12-08T17:11:15.425106+0000) 2019-12-08T17:11:16.434 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:11:16.431+0000 1694f700 -1 osd.0 151 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:10:32.024943+0000 front 2019-12-08T17:10:31.992907+0000 (oldest deadline 2019-12-08T17:11:16.401089+0000) 2019-12-08T17:11:16.778 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:11:16.774+0000 1694f700 -1 osd.4 151 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:10:27.176493+0000 front 2019-12-08T17:10:28.137043+0000 (oldest deadline 2019-12-08T17:11:12.398617+0000) 2019-12-08T17:11:16.779 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:11:16.776+0000 1694f700 -1 osd.4 151 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4449.0:101522 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=250b] snapc 0=[] ondisk+write+known_if_redirected e151) 2019-12-08T17:11:17.803 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:11:17.796+0000 1694f700 -1 osd.4 152 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4449.0:101522 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=250b] snapc 0=[] ondisk+write+known_if_redirected e151) 2019-12-08T17:11:18.753 INFO:tasks.rgw.client.0.smithi079.stdout:2019-12-08T17:11:18.752+0000 20e25700 -1 RGWWatcher::handle_error cookie 384608992 err (107) Transport endpoint is not connected 2019-12-08T17:12:57.344 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:12:57.142+0000 1694f700 -1 osd.2 160 get_health_metrics reporting 9 slow ops, oldest is osd_op(client.4449.0:100686 7.1 7:8aaee6e1:::2019-12-08-17--xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx:head [append 0~812 in=812b] snapc 0=[] RETRY=6 ondisk+retry+write+known_if_redirected e159) 2019-12-08T17:13:00.720 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:05:10:25.422 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T17:13:00.727 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:05:10:25.362 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T17:13:00.730 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:05:10:25.365 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T17:13:00.731 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:05:10:25.365 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T17:13:00.734 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:05:10:25.369 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T17:13:00.740 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:05:10:25.443 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T17:13:00.999 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:05:10:25.633 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T17:13:01.024 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:05:10:25.658 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T17:13:01.060 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:05:10:25.763 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T17:13:15.808 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:05:10:40.441 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T17:13:15.816 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:05:10:40.519 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T17:13:15.832 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:05:10:40.465 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T17:13:15.840 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:05:10:40.540 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T17:13:15.862 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:05:10:40.496 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T17:13:15.864 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:05:10:40.567 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T17:13:15.874 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:05:10:40.508 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T17:13:15.884 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:05:10:40.519 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T17:13:15.904 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:05:10:40.538 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T17:13:29.905 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:13:29.898+0000 1694f700 -1 osd.5 160 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:101924 2.ds0 2:b0e9127c:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.646_beta%2f%ef%84%8f%e8%94%8b%ed%88%8d%eb%8c%8b%ce%a9%eb%8c%8c%e9%90%8c%ef%84%90%e0%a4%83%e5%98%86%e3%9c%85%e5%98%87%e3%9c%85%e8%94%88%e1%a0%81:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e160) 2019-12-08T17:13:30.862 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:13:30.859+0000 1694f700 -1 osd.5 160 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:101924 2.ds0 2:b0e9127c:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.646_beta%2f%ef%84%8f%e8%94%8b%ed%88%8d%eb%8c%8b%ce%a9%eb%8c%8c%e9%90%8c%ef%84%90%e0%a4%83%e5%98%86%e3%9c%85%e5%98%87%e3%9c%85%e8%94%88%e1%a0%81:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e160) 2019-12-08T17:13:31.861 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:13:31.857+0000 1694f700 -1 osd.5 160 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:101924 2.ds0 2:b0e9127c:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.646_beta%2f%ef%84%8f%e8%94%8b%ed%88%8d%eb%8c%8b%ce%a9%eb%8c%8c%e9%90%8c%ef%84%90%e0%a4%83%e5%98%86%e3%9c%85%e5%98%87%e3%9c%85%e8%94%88%e1%a0%81:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e160) 2019-12-08T17:13:32.905 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:13:32.901+0000 1694f700 -1 osd.5 160 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:101924 2.ds0 2:b0e9127c:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.646_beta%2f%ef%84%8f%e8%94%8b%ed%88%8d%eb%8c%8b%ce%a9%eb%8c%8c%e9%90%8c%ef%84%90%e0%a4%83%e5%98%86%e3%9c%85%e5%98%87%e3%9c%85%e8%94%88%e1%a0%81:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e160) 2019-12-08T17:13:33.869 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:13:33.865+0000 1694f700 -1 osd.5 160 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:101924 2.ds0 2:b0e9127c:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.646_beta%2f%ef%84%8f%e8%94%8b%ed%88%8d%eb%8c%8b%ce%a9%eb%8c%8c%e9%90%8c%ef%84%90%e0%a4%83%e5%98%86%e3%9c%85%e5%98%87%e3%9c%85%e8%94%88%e1%a0%81:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e160) 2019-12-08T17:13:34.879 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:13:34.875+0000 1694f700 -1 osd.5 160 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:101924 2.ds0 2:b0e9127c:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.646_beta%2f%ef%84%8f%e8%94%8b%ed%88%8d%eb%8c%8b%ce%a9%eb%8c%8c%e9%90%8c%ef%84%90%e0%a4%83%e5%98%86%e3%9c%85%e5%98%87%e3%9c%85%e8%94%88%e1%a0%81:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e160) 2019-12-08T17:13:35.842 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:13:35.839+0000 1694f700 -1 osd.5 160 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:101924 2.ds0 2:b0e9127c:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.646_beta%2f%ef%84%8f%e8%94%8b%ed%88%8d%eb%8c%8b%ce%a9%eb%8c%8c%e9%90%8c%ef%84%90%e0%a4%83%e5%98%86%e3%9c%85%e5%98%87%e3%9c%85%e8%94%88%e1%a0%81:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e160) 2019-12-08T17:13:36.818 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:13:36.815+0000 1694f700 -1 osd.5 160 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:101924 2.ds0 2:b0e9127c:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.646_beta%2f%ef%84%8f%e8%94%8b%ed%88%8d%eb%8c%8b%ce%a9%eb%8c%8c%e9%90%8c%ef%84%90%e0%a4%83%e5%98%86%e3%9c%85%e5%98%87%e3%9c%85%e8%94%88%e1%a0%81:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e160) 2019-12-08T17:13:37.778 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:13:37.775+0000 1694f700 -1 osd.5 160 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:101924 2.ds0 2:b0e9127c:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.646_beta%2f%ef%84%8f%e8%94%8b%ed%88%8d%eb%8c%8b%ce%a9%eb%8c%8c%e9%90%8c%ef%84%90%e0%a4%83%e5%98%86%e3%9c%85%e5%98%87%e3%9c%85%e8%94%88%e1%a0%81:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e160) 2019-12-08T17:13:38.761 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:13:38.757+0000 1694f700 -1 osd.5 160 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:101924 2.ds0 2:b0e9127c:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.646_beta%2f%ef%84%8f%e8%94%8b%ed%88%8d%eb%8c%8b%ce%a9%eb%8c%8c%e9%90%8c%ef%84%90%e0%a4%83%e5%98%86%e3%9c%85%e5%98%87%e3%9c%85%e8%94%88%e1%a0%81:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e160) 2019-12-08T17:13:39.754 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:13:39.750+0000 1694f700 -1 osd.5 160 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:101924 2.ds0 2:b0e9127c:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.646_beta%2f%ef%84%8f%e8%94%8b%ed%88%8d%eb%8c%8b%ce%a9%eb%8c%8c%e9%90%8c%ef%84%90%e0%a4%83%e5%98%86%e3%9c%85%e5%98%87%e3%9c%85%e8%94%88%e1%a0%81:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e160) 2019-12-08T17:13:40.769 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:13:40.766+0000 1694f700 -1 osd.5 160 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:101924 2.ds0 2:b0e9127c:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.646_beta%2f%ef%84%8f%e8%94%8b%ed%88%8d%eb%8c%8b%ce%a9%eb%8c%8c%e9%90%8c%ef%84%90%e0%a4%83%e5%98%86%e3%9c%85%e5%98%87%e3%9c%85%e8%94%88%e1%a0%81:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e160) 2019-12-08T17:13:41.740 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:13:41.736+0000 1694f700 -1 osd.5 160 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:101924 2.ds0 2:b0e9127c:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.646_beta%2f%ef%84%8f%e8%94%8b%ed%88%8d%eb%8c%8b%ce%a9%eb%8c%8c%e9%90%8c%ef%84%90%e0%a4%83%e5%98%86%e3%9c%85%e5%98%87%e3%9c%85%e8%94%88%e1%a0%81:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e160) 2019-12-08T17:13:42.771 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:13:42.767+0000 1694f700 -1 osd.5 160 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:101924 2.ds0 2:b0e9127c:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.646_beta%2f%ef%84%8f%e8%94%8b%ed%88%8d%eb%8c%8b%ce%a9%eb%8c%8c%e9%90%8c%ef%84%90%e0%a4%83%e5%98%86%e3%9c%85%e5%98%87%e3%9c%85%e8%94%88%e1%a0%81:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e160) 2019-12-08T17:13:43.804 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:13:43.801+0000 1694f700 -1 osd.5 160 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:101924 2.ds0 2:b0e9127c:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.646_beta%2f%ef%84%8f%e8%94%8b%ed%88%8d%eb%8c%8b%ce%a9%eb%8c%8c%e9%90%8c%ef%84%90%e0%a4%83%e5%98%86%e3%9c%85%e5%98%87%e3%9c%85%e8%94%88%e1%a0%81:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e160) 2019-12-08T17:13:44.845 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:13:44.841+0000 1694f700 -1 osd.5 160 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:101924 2.ds0 2:b0e9127c:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.646_beta%2f%ef%84%8f%e8%94%8b%ed%88%8d%eb%8c%8b%ce%a9%eb%8c%8c%e9%90%8c%ef%84%90%e0%a4%83%e5%98%86%e3%9c%85%e5%98%87%e3%9c%85%e8%94%88%e1%a0%81:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e160) 2019-12-08T17:13:45.861 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:13:45.857+0000 1694f700 -1 osd.5 160 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:101924 2.ds0 2:b0e9127c:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.646_beta%2f%ef%84%8f%e8%94%8b%ed%88%8d%eb%8c%8b%ce%a9%eb%8c%8c%e9%90%8c%ef%84%90%e0%a4%83%e5%98%86%e3%9c%85%e5%98%87%e3%9c%85%e8%94%88%e1%a0%81:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e160) 2019-12-08T17:13:46.913 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:13:46.908+0000 1694f700 -1 osd.5 160 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:101924 2.ds0 2:b0e9127c:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.646_beta%2f%ef%84%8f%e8%94%8b%ed%88%8d%eb%8c%8b%ce%a9%eb%8c%8c%e9%90%8c%ef%84%90%e0%a4%83%e5%98%86%e3%9c%85%e5%98%87%e3%9c%85%e8%94%88%e1%a0%81:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e160) 2019-12-08T17:13:47.873 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:13:47.869+0000 1694f700 -1 osd.5 160 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:101924 2.ds0 2:b0e9127c:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.646_beta%2f%ef%84%8f%e8%94%8b%ed%88%8d%eb%8c%8b%ce%a9%eb%8c%8c%e9%90%8c%ef%84%90%e0%a4%83%e5%98%86%e3%9c%85%e5%98%87%e3%9c%85%e8%94%88%e1%a0%81:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e160) 2019-12-08T17:13:48.462 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:13:48.458+0000 1694f700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:08.998538+0000 front 2019-12-08T17:13:06.498333+0000 (oldest deadline 2019-12-08T17:13:48.014769+0000) 2019-12-08T17:13:48.881 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:13:48.874+0000 1694f700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:06.552176+0000 front 2019-12-08T17:13:09.251009+0000 (oldest deadline 2019-12-08T17:13:48.727824+0000) 2019-12-08T17:13:48.883 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:13:48.878+0000 1694f700 -1 osd.5 160 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:101924 2.ds0 2:b0e9127c:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.646_beta%2f%ef%84%8f%e8%94%8b%ed%88%8d%eb%8c%8b%ce%a9%eb%8c%8c%e9%90%8c%ef%84%90%e0%a4%83%e5%98%86%e3%9c%85%e5%98%87%e3%9c%85%e8%94%88%e1%a0%81:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e160) 2019-12-08T17:13:49.342 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:13:49.336+0000 1694f700 -1 osd.4 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:08.646839+0000 front 2019-12-08T17:13:09.434988+0000 (oldest deadline 2019-12-08T17:13:49.275130+0000) 2019-12-08T17:13:49.433 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:13:49.429+0000 1694f700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:08.998538+0000 front 2019-12-08T17:13:06.498333+0000 (oldest deadline 2019-12-08T17:13:48.014769+0000) 2019-12-08T17:13:49.871 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:13:49.858+0000 1694f700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:06.552176+0000 front 2019-12-08T17:13:09.251009+0000 (oldest deadline 2019-12-08T17:13:48.727824+0000) 2019-12-08T17:13:49.872 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:13:49.863+0000 1694f700 -1 osd.5 160 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:101924 2.ds0 2:b0e9127c:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.646_beta%2f%ef%84%8f%e8%94%8b%ed%88%8d%eb%8c%8b%ce%a9%eb%8c%8c%e9%90%8c%ef%84%90%e0%a4%83%e5%98%86%e3%9c%85%e5%98%87%e3%9c%85%e8%94%88%e1%a0%81:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e160) 2019-12-08T17:13:50.084 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:13:50.080+0000 1694f700 -1 osd.3 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:04.188059+0000 front 2019-12-08T17:13:04.221100+0000 (oldest deadline 2019-12-08T17:13:49.301101+0000) 2019-12-08T17:13:50.336 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:13:50.331+0000 1694f700 -1 osd.4 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:08.646839+0000 front 2019-12-08T17:13:09.434988+0000 (oldest deadline 2019-12-08T17:13:49.275130+0000) 2019-12-08T17:13:50.404 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:13:50.398+0000 1694f700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:04.606573+0000 front 2019-12-08T17:13:04.608843+0000 (oldest deadline 2019-12-08T17:13:49.860635+0000) 2019-12-08T17:13:50.477 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:13:50.472+0000 1694f700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:08.998538+0000 front 2019-12-08T17:13:06.498333+0000 (oldest deadline 2019-12-08T17:13:48.014769+0000) 2019-12-08T17:13:50.608 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:13:50.605+0000 1694f700 -1 osd.0 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:07.940453+0000 front 2019-12-08T17:13:08.516532+0000 (oldest deadline 2019-12-08T17:13:49.759272+0000) 2019-12-08T17:13:50.888 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:13:50.883+0000 1694f700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:06.552176+0000 front 2019-12-08T17:13:09.251009+0000 (oldest deadline 2019-12-08T17:13:48.727824+0000) 2019-12-08T17:13:50.890 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:13:50.887+0000 1694f700 -1 osd.5 160 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:101924 2.ds0 2:b0e9127c:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.646_beta%2f%ef%84%8f%e8%94%8b%ed%88%8d%eb%8c%8b%ce%a9%eb%8c%8c%e9%90%8c%ef%84%90%e0%a4%83%e5%98%86%e3%9c%85%e5%98%87%e3%9c%85%e8%94%88%e1%a0%81:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e160) 2019-12-08T17:13:51.048 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:13:51.045+0000 1694f700 -1 osd.3 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:04.188059+0000 front 2019-12-08T17:13:04.221100+0000 (oldest deadline 2019-12-08T17:13:49.301101+0000) 2019-12-08T17:13:51.386 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:13:51.381+0000 1694f700 -1 osd.4 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:08.646839+0000 front 2019-12-08T17:13:09.434988+0000 (oldest deadline 2019-12-08T17:13:49.275130+0000) 2019-12-08T17:13:51.391 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:13:51.385+0000 1694f700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:04.606573+0000 front 2019-12-08T17:13:04.608843+0000 (oldest deadline 2019-12-08T17:13:49.860635+0000) 2019-12-08T17:13:51.482 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:13:51.476+0000 1694f700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:08.998538+0000 front 2019-12-08T17:13:06.498333+0000 (oldest deadline 2019-12-08T17:13:48.014769+0000) 2019-12-08T17:13:51.617 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:13:51.615+0000 1694f700 -1 osd.0 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:07.940453+0000 front 2019-12-08T17:13:08.516532+0000 (oldest deadline 2019-12-08T17:13:49.759272+0000) 2019-12-08T17:13:51.894 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:13:51.889+0000 1694f700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:06.552176+0000 front 2019-12-08T17:13:09.251009+0000 (oldest deadline 2019-12-08T17:13:48.727824+0000) 2019-12-08T17:13:51.897 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:13:51.893+0000 1694f700 -1 osd.5 160 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:101924 2.ds0 2:b0e9127c:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.646_beta%2f%ef%84%8f%e8%94%8b%ed%88%8d%eb%8c%8b%ce%a9%eb%8c%8c%e9%90%8c%ef%84%90%e0%a4%83%e5%98%86%e3%9c%85%e5%98%87%e3%9c%85%e8%94%88%e1%a0%81:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e160) 2019-12-08T17:13:52.093 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:13:52.091+0000 1694f700 -1 osd.3 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:04.188059+0000 front 2019-12-08T17:13:04.221100+0000 (oldest deadline 2019-12-08T17:13:49.301101+0000) 2019-12-08T17:13:52.352 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:13:52.347+0000 1694f700 -1 osd.4 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:08.646839+0000 front 2019-12-08T17:13:09.434988+0000 (oldest deadline 2019-12-08T17:13:49.275130+0000) 2019-12-08T17:13:52.382 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:13:52.377+0000 1694f700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:04.606573+0000 front 2019-12-08T17:13:04.608843+0000 (oldest deadline 2019-12-08T17:13:49.860635+0000) 2019-12-08T17:13:52.479 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:13:52.474+0000 1694f700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:08.998538+0000 front 2019-12-08T17:13:06.498333+0000 (oldest deadline 2019-12-08T17:13:48.014769+0000) 2019-12-08T17:13:52.536 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:13:52.534+0000 1694f700 -1 osd.1 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:06.619450+0000 front 2019-12-08T17:13:06.679978+0000 (oldest deadline 2019-12-08T17:13:51.788565+0000) 2019-12-08T17:13:52.586 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:13:52.585+0000 1694f700 -1 osd.0 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:07.940453+0000 front 2019-12-08T17:13:08.516532+0000 (oldest deadline 2019-12-08T17:13:49.759272+0000) 2019-12-08T17:13:52.893 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:13:52.887+0000 1694f700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:06.552176+0000 front 2019-12-08T17:13:09.251009+0000 (oldest deadline 2019-12-08T17:13:48.727824+0000) 2019-12-08T17:13:52.893 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:13:52.890+0000 1694f700 -1 osd.5 160 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:101924 2.ds0 2:b0e9127c:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.646_beta%2f%ef%84%8f%e8%94%8b%ed%88%8d%eb%8c%8b%ce%a9%eb%8c%8c%e9%90%8c%ef%84%90%e0%a4%83%e5%98%86%e3%9c%85%e5%98%87%e3%9c%85%e8%94%88%e1%a0%81:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e160) 2019-12-08T17:13:53.076 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:13:53.074+0000 1694f700 -1 osd.3 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:04.188059+0000 front 2019-12-08T17:13:04.221100+0000 (oldest deadline 2019-12-08T17:13:49.301101+0000) 2019-12-08T17:13:53.343 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:13:53.337+0000 1694f700 -1 osd.4 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:08.646839+0000 front 2019-12-08T17:13:09.434988+0000 (oldest deadline 2019-12-08T17:13:49.275130+0000) 2019-12-08T17:13:53.373 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:13:53.367+0000 1694f700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:04.606573+0000 front 2019-12-08T17:13:04.608843+0000 (oldest deadline 2019-12-08T17:13:49.860635+0000) 2019-12-08T17:13:53.522 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:13:53.517+0000 1694f700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:08.998538+0000 front 2019-12-08T17:13:06.498333+0000 (oldest deadline 2019-12-08T17:13:48.014769+0000) 2019-12-08T17:13:53.588 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:13:53.585+0000 1694f700 -1 osd.1 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:06.619450+0000 front 2019-12-08T17:13:06.679978+0000 (oldest deadline 2019-12-08T17:13:51.788565+0000) 2019-12-08T17:13:53.628 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:13:53.626+0000 1694f700 -1 osd.0 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:07.940453+0000 front 2019-12-08T17:13:08.516532+0000 (oldest deadline 2019-12-08T17:13:49.759272+0000) 2019-12-08T17:13:53.941 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:13:53.935+0000 1694f700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:06.552176+0000 front 2019-12-08T17:13:09.251009+0000 (oldest deadline 2019-12-08T17:13:48.727824+0000) 2019-12-08T17:13:53.944 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:13:53.941+0000 1694f700 -1 osd.5 160 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:101924 2.ds0 2:b0e9127c:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.646_beta%2f%ef%84%8f%e8%94%8b%ed%88%8d%eb%8c%8b%ce%a9%eb%8c%8c%e9%90%8c%ef%84%90%e0%a4%83%e5%98%86%e3%9c%85%e5%98%87%e3%9c%85%e8%94%88%e1%a0%81:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e160) 2019-12-08T17:13:54.042 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:13:54.040+0000 1694f700 -1 osd.3 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:04.188059+0000 front 2019-12-08T17:13:04.221100+0000 (oldest deadline 2019-12-08T17:13:49.301101+0000) 2019-12-08T17:13:54.385 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:13:54.381+0000 1694f700 -1 osd.4 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:08.646839+0000 front 2019-12-08T17:13:09.434988+0000 (oldest deadline 2019-12-08T17:13:49.275130+0000) 2019-12-08T17:13:54.409 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:13:54.404+0000 1694f700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:04.606573+0000 front 2019-12-08T17:13:04.608843+0000 (oldest deadline 2019-12-08T17:13:49.860635+0000) 2019-12-08T17:13:54.569 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:13:54.568+0000 1694f700 -1 osd.1 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:06.619450+0000 front 2019-12-08T17:13:06.679978+0000 (oldest deadline 2019-12-08T17:13:51.788565+0000) 2019-12-08T17:13:54.571 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:13:54.566+0000 1694f700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:08.998538+0000 front 2019-12-08T17:13:06.498333+0000 (oldest deadline 2019-12-08T17:13:48.014769+0000) 2019-12-08T17:13:54.631 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:13:54.630+0000 1694f700 -1 osd.0 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:07.940453+0000 front 2019-12-08T17:13:08.516532+0000 (oldest deadline 2019-12-08T17:13:49.759272+0000) 2019-12-08T17:13:54.973 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:13:54.967+0000 1694f700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:06.552176+0000 front 2019-12-08T17:13:09.251009+0000 (oldest deadline 2019-12-08T17:13:48.727824+0000) 2019-12-08T17:13:54.973 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:13:54.970+0000 1694f700 -1 osd.5 160 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:101924 2.ds0 2:b0e9127c:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.646_beta%2f%ef%84%8f%e8%94%8b%ed%88%8d%eb%8c%8b%ce%a9%eb%8c%8c%e9%90%8c%ef%84%90%e0%a4%83%e5%98%86%e3%9c%85%e5%98%87%e3%9c%85%e8%94%88%e1%a0%81:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e160) 2019-12-08T17:13:55.008 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:13:55.005+0000 1694f700 -1 osd.3 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:04.188059+0000 front 2019-12-08T17:13:04.221100+0000 (oldest deadline 2019-12-08T17:13:49.301101+0000) 2019-12-08T17:13:55.389 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:13:55.383+0000 1694f700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:04.606573+0000 front 2019-12-08T17:13:04.608843+0000 (oldest deadline 2019-12-08T17:13:49.860635+0000) 2019-12-08T17:13:55.442 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:13:55.437+0000 1694f700 -1 osd.4 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:08.646839+0000 front 2019-12-08T17:13:09.434988+0000 (oldest deadline 2019-12-08T17:13:49.275130+0000) 2019-12-08T17:13:55.540 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:13:55.537+0000 1694f700 -1 osd.1 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:06.619450+0000 front 2019-12-08T17:13:06.679978+0000 (oldest deadline 2019-12-08T17:13:51.788565+0000) 2019-12-08T17:13:55.555 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:13:55.550+0000 1694f700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:08.998538+0000 front 2019-12-08T17:13:06.498333+0000 (oldest deadline 2019-12-08T17:13:48.014769+0000) 2019-12-08T17:13:55.631 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:13:55.627+0000 1694f700 -1 osd.0 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:07.940453+0000 front 2019-12-08T17:13:08.516532+0000 (oldest deadline 2019-12-08T17:13:49.759272+0000) 2019-12-08T17:13:55.943 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:13:55.938+0000 1694f700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:06.552176+0000 front 2019-12-08T17:13:09.251009+0000 (oldest deadline 2019-12-08T17:13:48.727824+0000) 2019-12-08T17:13:55.944 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:13:55.940+0000 1694f700 -1 osd.5 160 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:101924 2.ds0 2:b0e9127c:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.646_beta%2f%ef%84%8f%e8%94%8b%ed%88%8d%eb%8c%8b%ce%a9%eb%8c%8c%e9%90%8c%ef%84%90%e0%a4%83%e5%98%86%e3%9c%85%e5%98%87%e3%9c%85%e8%94%88%e1%a0%81:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e160) 2019-12-08T17:13:56.053 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:13:56.049+0000 1694f700 -1 osd.3 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:04.188059+0000 front 2019-12-08T17:13:04.221100+0000 (oldest deadline 2019-12-08T17:13:49.301101+0000) 2019-12-08T17:13:56.368 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:13:56.360+0000 1694f700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:04.606573+0000 front 2019-12-08T17:13:04.608843+0000 (oldest deadline 2019-12-08T17:13:49.860635+0000) 2019-12-08T17:13:56.477 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:13:56.472+0000 1694f700 -1 osd.4 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:08.646839+0000 front 2019-12-08T17:13:09.434988+0000 (oldest deadline 2019-12-08T17:13:49.275130+0000) 2019-12-08T17:13:56.555 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:13:56.550+0000 1694f700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:08.998538+0000 front 2019-12-08T17:13:06.498333+0000 (oldest deadline 2019-12-08T17:13:48.014769+0000) 2019-12-08T17:13:56.570 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:13:56.568+0000 1694f700 -1 osd.1 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:06.619450+0000 front 2019-12-08T17:13:06.679978+0000 (oldest deadline 2019-12-08T17:13:51.788565+0000) 2019-12-08T17:13:56.603 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:13:56.602+0000 1694f700 -1 osd.0 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:07.940453+0000 front 2019-12-08T17:13:08.516532+0000 (oldest deadline 2019-12-08T17:13:49.759272+0000) 2019-12-08T17:13:56.908 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:13:56.903+0000 1694f700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:06.552176+0000 front 2019-12-08T17:13:09.251009+0000 (oldest deadline 2019-12-08T17:13:48.727824+0000) 2019-12-08T17:13:56.911 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:13:56.907+0000 1694f700 -1 osd.5 160 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:101924 2.ds0 2:b0e9127c:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.646_beta%2f%ef%84%8f%e8%94%8b%ed%88%8d%eb%8c%8b%ce%a9%eb%8c%8c%e9%90%8c%ef%84%90%e0%a4%83%e5%98%86%e3%9c%85%e5%98%87%e3%9c%85%e8%94%88%e1%a0%81:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e160) 2019-12-08T17:13:57.072 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:13:57.070+0000 1694f700 -1 osd.3 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:04.188059+0000 front 2019-12-08T17:13:04.221100+0000 (oldest deadline 2019-12-08T17:13:49.301101+0000) 2019-12-08T17:13:57.385 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:13:57.379+0000 1694f700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:04.606573+0000 front 2019-12-08T17:13:04.608843+0000 (oldest deadline 2019-12-08T17:13:49.860635+0000) 2019-12-08T17:13:57.503 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:13:57.496+0000 1694f700 -1 osd.4 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:08.646839+0000 front 2019-12-08T17:13:09.434988+0000 (oldest deadline 2019-12-08T17:13:49.275130+0000) 2019-12-08T17:13:57.566 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:13:57.564+0000 1694f700 -1 osd.0 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:07.940453+0000 front 2019-12-08T17:13:08.516532+0000 (oldest deadline 2019-12-08T17:13:49.759272+0000) 2019-12-08T17:13:57.571 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:13:57.569+0000 1694f700 -1 osd.1 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:06.619450+0000 front 2019-12-08T17:13:06.679978+0000 (oldest deadline 2019-12-08T17:13:51.788565+0000) 2019-12-08T17:13:57.611 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:13:57.605+0000 1694f700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:08.998538+0000 front 2019-12-08T17:13:06.498333+0000 (oldest deadline 2019-12-08T17:13:48.014769+0000) 2019-12-08T17:13:57.897 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:13:57.890+0000 1694f700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:06.552176+0000 front 2019-12-08T17:13:09.251009+0000 (oldest deadline 2019-12-08T17:13:48.727824+0000) 2019-12-08T17:13:57.898 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:13:57.893+0000 1694f700 -1 osd.5 160 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:101924 2.ds0 2:b0e9127c:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.646_beta%2f%ef%84%8f%e8%94%8b%ed%88%8d%eb%8c%8b%ce%a9%eb%8c%8c%e9%90%8c%ef%84%90%e0%a4%83%e5%98%86%e3%9c%85%e5%98%87%e3%9c%85%e8%94%88%e1%a0%81:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e160) 2019-12-08T17:13:58.054 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:13:58.052+0000 1694f700 -1 osd.3 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:04.188059+0000 front 2019-12-08T17:13:04.221100+0000 (oldest deadline 2019-12-08T17:13:49.301101+0000) 2019-12-08T17:13:58.401 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:13:58.395+0000 1694f700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:04.606573+0000 front 2019-12-08T17:13:04.608843+0000 (oldest deadline 2019-12-08T17:13:49.860635+0000) 2019-12-08T17:13:58.478 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:13:58.472+0000 1694f700 -1 osd.4 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:08.646839+0000 front 2019-12-08T17:13:09.434988+0000 (oldest deadline 2019-12-08T17:13:49.275130+0000) 2019-12-08T17:13:58.556 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:13:58.553+0000 1694f700 -1 osd.0 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:07.940453+0000 front 2019-12-08T17:13:08.516532+0000 (oldest deadline 2019-12-08T17:13:49.759272+0000) 2019-12-08T17:13:58.575 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:13:58.573+0000 1694f700 -1 osd.1 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:06.619450+0000 front 2019-12-08T17:13:06.679978+0000 (oldest deadline 2019-12-08T17:13:51.788565+0000) 2019-12-08T17:13:58.578 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:13:58.571+0000 1694f700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:08.998538+0000 front 2019-12-08T17:13:06.498333+0000 (oldest deadline 2019-12-08T17:13:48.014769+0000) 2019-12-08T17:13:58.893 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:13:58.888+0000 1694f700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:06.552176+0000 front 2019-12-08T17:13:09.251009+0000 (oldest deadline 2019-12-08T17:13:48.727824+0000) 2019-12-08T17:13:58.897 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:13:58.893+0000 1694f700 -1 osd.5 160 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:101924 2.ds0 2:b0e9127c:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.646_beta%2f%ef%84%8f%e8%94%8b%ed%88%8d%eb%8c%8b%ce%a9%eb%8c%8c%e9%90%8c%ef%84%90%e0%a4%83%e5%98%86%e3%9c%85%e5%98%87%e3%9c%85%e8%94%88%e1%a0%81:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e160) 2019-12-08T17:13:59.074 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:13:59.071+0000 1694f700 -1 osd.3 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:04.188059+0000 front 2019-12-08T17:13:04.221100+0000 (oldest deadline 2019-12-08T17:13:49.301101+0000) 2019-12-08T17:13:59.429 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:13:59.423+0000 1694f700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:04.606573+0000 front 2019-12-08T17:13:04.608843+0000 (oldest deadline 2019-12-08T17:13:49.860635+0000) 2019-12-08T17:13:59.491 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:13:59.485+0000 1694f700 -1 osd.4 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:08.646839+0000 front 2019-12-08T17:13:09.434988+0000 (oldest deadline 2019-12-08T17:13:49.275130+0000) 2019-12-08T17:13:59.555 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:13:59.549+0000 1694f700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:08.998538+0000 front 2019-12-08T17:13:06.498333+0000 (oldest deadline 2019-12-08T17:13:48.014769+0000) 2019-12-08T17:13:59.580 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:13:59.577+0000 1694f700 -1 osd.0 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:07.940453+0000 front 2019-12-08T17:13:08.516532+0000 (oldest deadline 2019-12-08T17:13:49.759272+0000) 2019-12-08T17:13:59.596 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:13:59.594+0000 1694f700 -1 osd.1 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:06.619450+0000 front 2019-12-08T17:13:06.679978+0000 (oldest deadline 2019-12-08T17:13:51.788565+0000) 2019-12-08T17:13:59.932 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:13:59.926+0000 1694f700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:06.552176+0000 front 2019-12-08T17:13:09.251009+0000 (oldest deadline 2019-12-08T17:13:48.727824+0000) 2019-12-08T17:13:59.933 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:13:59.929+0000 1694f700 -1 osd.5 160 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:101924 2.ds0 2:b0e9127c:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.646_beta%2f%ef%84%8f%e8%94%8b%ed%88%8d%eb%8c%8b%ce%a9%eb%8c%8c%e9%90%8c%ef%84%90%e0%a4%83%e5%98%86%e3%9c%85%e5%98%87%e3%9c%85%e8%94%88%e1%a0%81:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e160) 2019-12-08T17:14:00.113 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:14:00.109+0000 1694f700 -1 osd.3 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:04.188059+0000 front 2019-12-08T17:13:04.221100+0000 (oldest deadline 2019-12-08T17:13:49.301101+0000) 2019-12-08T17:14:00.469 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:14:00.464+0000 1694f700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:04.606573+0000 front 2019-12-08T17:13:04.608843+0000 (oldest deadline 2019-12-08T17:13:49.860635+0000) 2019-12-08T17:14:00.503 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:14:00.498+0000 1694f700 -1 osd.4 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:08.646839+0000 front 2019-12-08T17:13:09.434988+0000 (oldest deadline 2019-12-08T17:13:49.275130+0000) 2019-12-08T17:14:00.554 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:14:00.552+0000 1694f700 -1 osd.0 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:07.940453+0000 front 2019-12-08T17:13:08.516532+0000 (oldest deadline 2019-12-08T17:13:49.759272+0000) 2019-12-08T17:14:00.566 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:14:00.561+0000 1694f700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:08.998538+0000 front 2019-12-08T17:13:06.498333+0000 (oldest deadline 2019-12-08T17:13:48.014769+0000) 2019-12-08T17:14:00.573 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:14:00.570+0000 1694f700 -1 osd.1 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:06.619450+0000 front 2019-12-08T17:13:06.679978+0000 (oldest deadline 2019-12-08T17:13:51.788565+0000) 2019-12-08T17:14:00.937 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:14:00.930+0000 1694f700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:06.552176+0000 front 2019-12-08T17:13:09.251009+0000 (oldest deadline 2019-12-08T17:13:48.727824+0000) 2019-12-08T17:14:00.938 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:14:00.933+0000 1694f700 -1 osd.5 160 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:101924 2.ds0 2:b0e9127c:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.646_beta%2f%ef%84%8f%e8%94%8b%ed%88%8d%eb%8c%8b%ce%a9%eb%8c%8c%e9%90%8c%ef%84%90%e0%a4%83%e5%98%86%e3%9c%85%e5%98%87%e3%9c%85%e8%94%88%e1%a0%81:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e160) 2019-12-08T17:14:01.128 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:14:01.126+0000 1694f700 -1 osd.3 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:04.188059+0000 front 2019-12-08T17:13:04.221100+0000 (oldest deadline 2019-12-08T17:13:49.301101+0000) 2019-12-08T17:14:01.479 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:14:01.468+0000 1694f700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:04.606573+0000 front 2019-12-08T17:13:04.608843+0000 (oldest deadline 2019-12-08T17:13:49.860635+0000) 2019-12-08T17:14:01.481 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:14:01.476+0000 1694f700 -1 osd.4 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:08.646839+0000 front 2019-12-08T17:13:09.434988+0000 (oldest deadline 2019-12-08T17:13:49.275130+0000) 2019-12-08T17:14:01.594 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:14:01.591+0000 1694f700 -1 osd.1 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:06.619450+0000 front 2019-12-08T17:13:06.679978+0000 (oldest deadline 2019-12-08T17:13:51.788565+0000) 2019-12-08T17:14:01.602 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:14:01.600+0000 1694f700 -1 osd.0 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:07.940453+0000 front 2019-12-08T17:13:08.516532+0000 (oldest deadline 2019-12-08T17:13:49.759272+0000) 2019-12-08T17:14:01.605 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:14:01.598+0000 1694f700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:08.998538+0000 front 2019-12-08T17:13:06.498333+0000 (oldest deadline 2019-12-08T17:13:48.014769+0000) 2019-12-08T17:14:01.971 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:14:01.964+0000 1694f700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:06.552176+0000 front 2019-12-08T17:13:09.251009+0000 (oldest deadline 2019-12-08T17:13:48.727824+0000) 2019-12-08T17:14:01.971 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:14:01.967+0000 1694f700 -1 osd.5 160 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:101924 2.ds0 2:b0e9127c:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.646_beta%2f%ef%84%8f%e8%94%8b%ed%88%8d%eb%8c%8b%ce%a9%eb%8c%8c%e9%90%8c%ef%84%90%e0%a4%83%e5%98%86%e3%9c%85%e5%98%87%e3%9c%85%e8%94%88%e1%a0%81:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e160) 2019-12-08T17:14:02.110 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:14:02.107+0000 1694f700 -1 osd.3 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:04.188059+0000 front 2019-12-08T17:13:04.221100+0000 (oldest deadline 2019-12-08T17:13:49.301101+0000) 2019-12-08T17:14:02.442 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:14:02.436+0000 1694f700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:04.606573+0000 front 2019-12-08T17:13:04.608843+0000 (oldest deadline 2019-12-08T17:13:49.860635+0000) 2019-12-08T17:14:02.451 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:14:02.444+0000 1694f700 -1 osd.4 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:08.646839+0000 front 2019-12-08T17:13:09.434988+0000 (oldest deadline 2019-12-08T17:13:49.275130+0000) 2019-12-08T17:14:02.568 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:14:02.560+0000 1694f700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:08.998538+0000 front 2019-12-08T17:13:06.498333+0000 (oldest deadline 2019-12-08T17:13:48.014769+0000) 2019-12-08T17:14:02.597 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:14:02.593+0000 1694f700 -1 osd.1 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:06.619450+0000 front 2019-12-08T17:13:06.679978+0000 (oldest deadline 2019-12-08T17:13:51.788565+0000) 2019-12-08T17:14:02.650 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:14:02.647+0000 1694f700 -1 osd.0 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:07.940453+0000 front 2019-12-08T17:13:08.516532+0000 (oldest deadline 2019-12-08T17:13:49.759272+0000) 2019-12-08T17:14:02.956 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:14:02.950+0000 1694f700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:06.552176+0000 front 2019-12-08T17:13:09.251009+0000 (oldest deadline 2019-12-08T17:13:48.727824+0000) 2019-12-08T17:14:02.957 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:14:02.952+0000 1694f700 -1 osd.5 160 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:101924 2.ds0 2:b0e9127c:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.646_beta%2f%ef%84%8f%e8%94%8b%ed%88%8d%eb%8c%8b%ce%a9%eb%8c%8c%e9%90%8c%ef%84%90%e0%a4%83%e5%98%86%e3%9c%85%e5%98%87%e3%9c%85%e8%94%88%e1%a0%81:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e160) 2019-12-08T17:14:03.164 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:14:03.161+0000 1694f700 -1 osd.3 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:04.188059+0000 front 2019-12-08T17:13:04.221100+0000 (oldest deadline 2019-12-08T17:13:49.301101+0000) 2019-12-08T17:14:03.441 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:14:03.425+0000 1694f700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:04.606573+0000 front 2019-12-08T17:13:04.608843+0000 (oldest deadline 2019-12-08T17:13:49.860635+0000) 2019-12-08T17:14:03.462 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:14:03.457+0000 1694f700 -1 osd.4 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:08.646839+0000 front 2019-12-08T17:13:09.434988+0000 (oldest deadline 2019-12-08T17:13:49.275130+0000) 2019-12-08T17:14:03.609 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:14:03.602+0000 1694f700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:08.998538+0000 front 2019-12-08T17:13:06.498333+0000 (oldest deadline 2019-12-08T17:13:48.014769+0000) 2019-12-08T17:14:03.640 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:14:03.638+0000 1694f700 -1 osd.0 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:07.940453+0000 front 2019-12-08T17:13:08.516532+0000 (oldest deadline 2019-12-08T17:13:49.759272+0000) 2019-12-08T17:14:03.649 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:14:03.645+0000 1694f700 -1 osd.1 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:06.619450+0000 front 2019-12-08T17:13:06.679978+0000 (oldest deadline 2019-12-08T17:13:51.788565+0000) 2019-12-08T17:14:03.945 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:14:03.940+0000 1694f700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:06.552176+0000 front 2019-12-08T17:13:09.251009+0000 (oldest deadline 2019-12-08T17:13:48.727824+0000) 2019-12-08T17:14:03.948 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:14:03.944+0000 1694f700 -1 osd.5 160 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:101924 2.ds0 2:b0e9127c:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.646_beta%2f%ef%84%8f%e8%94%8b%ed%88%8d%eb%8c%8b%ce%a9%eb%8c%8c%e9%90%8c%ef%84%90%e0%a4%83%e5%98%86%e3%9c%85%e5%98%87%e3%9c%85%e8%94%88%e1%a0%81:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e160) 2019-12-08T17:14:04.154 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:14:04.153+0000 1694f700 -1 osd.3 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:04.188059+0000 front 2019-12-08T17:13:04.221100+0000 (oldest deadline 2019-12-08T17:13:49.301101+0000) 2019-12-08T17:14:04.430 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:14:04.425+0000 1694f700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:04.606573+0000 front 2019-12-08T17:13:04.608843+0000 (oldest deadline 2019-12-08T17:13:49.860635+0000) 2019-12-08T17:14:04.504 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:14:04.497+0000 1694f700 -1 osd.4 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:08.646839+0000 front 2019-12-08T17:13:09.434988+0000 (oldest deadline 2019-12-08T17:13:49.275130+0000) 2019-12-08T17:14:04.636 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:14:04.634+0000 1694f700 -1 osd.0 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:07.940453+0000 front 2019-12-08T17:13:08.516532+0000 (oldest deadline 2019-12-08T17:13:49.759272+0000) 2019-12-08T17:14:04.639 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:14:04.637+0000 1694f700 -1 osd.1 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:06.619450+0000 front 2019-12-08T17:13:06.679978+0000 (oldest deadline 2019-12-08T17:13:51.788565+0000) 2019-12-08T17:14:04.640 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:14:04.634+0000 1694f700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:08.998538+0000 front 2019-12-08T17:13:06.498333+0000 (oldest deadline 2019-12-08T17:13:48.014769+0000) 2019-12-08T17:14:04.954 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:14:04.946+0000 1694f700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:06.552176+0000 front 2019-12-08T17:13:09.251009+0000 (oldest deadline 2019-12-08T17:13:48.727824+0000) 2019-12-08T17:14:04.960 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:14:04.955+0000 1694f700 -1 osd.5 160 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:101924 2.ds0 2:b0e9127c:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.646_beta%2f%ef%84%8f%e8%94%8b%ed%88%8d%eb%8c%8b%ce%a9%eb%8c%8c%e9%90%8c%ef%84%90%e0%a4%83%e5%98%86%e3%9c%85%e5%98%87%e3%9c%85%e8%94%88%e1%a0%81:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e160) 2019-12-08T17:14:05.126 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:14:05.123+0000 1694f700 -1 osd.3 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:04.188059+0000 front 2019-12-08T17:13:04.221100+0000 (oldest deadline 2019-12-08T17:13:49.301101+0000) 2019-12-08T17:14:05.391 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:14:05.386+0000 1694f700 -1 osd.7 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:04.606573+0000 front 2019-12-08T17:13:04.608843+0000 (oldest deadline 2019-12-08T17:13:49.860635+0000) 2019-12-08T17:14:05.502 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:14:05.495+0000 1694f700 -1 osd.4 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:08.646839+0000 front 2019-12-08T17:13:09.434988+0000 (oldest deadline 2019-12-08T17:13:49.275130+0000) 2019-12-08T17:14:05.588 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:14:05.586+0000 1694f700 -1 osd.0 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:07.940453+0000 front 2019-12-08T17:13:08.516532+0000 (oldest deadline 2019-12-08T17:13:49.759272+0000) 2019-12-08T17:14:05.640 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:14:05.637+0000 1694f700 -1 osd.1 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:06.619450+0000 front 2019-12-08T17:13:06.679978+0000 (oldest deadline 2019-12-08T17:13:51.788565+0000) 2019-12-08T17:14:05.662 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:14:05.655+0000 1694f700 -1 osd.6 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:08.998538+0000 front 2019-12-08T17:13:06.498333+0000 (oldest deadline 2019-12-08T17:13:48.014769+0000) 2019-12-08T17:14:05.996 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:14:05.989+0000 1694f700 -1 osd.5 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:06.552176+0000 front 2019-12-08T17:13:09.251009+0000 (oldest deadline 2019-12-08T17:13:48.727824+0000) 2019-12-08T17:14:05.997 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:14:05.992+0000 1694f700 -1 osd.5 160 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:101924 2.ds0 2:b0e9127c:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.646_beta%2f%ef%84%8f%e8%94%8b%ed%88%8d%eb%8c%8b%ce%a9%eb%8c%8c%e9%90%8c%ef%84%90%e0%a4%83%e5%98%86%e3%9c%85%e5%98%87%e3%9c%85%e8%94%88%e1%a0%81:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e160) 2019-12-08T17:14:06.085 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:14:06.083+0000 1694f700 -1 osd.3 160 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:13:04.188059+0000 front 2019-12-08T17:13:04.221100+0000 (oldest deadline 2019-12-08T17:13:49.301101+0000) 2019-12-08T17:14:07.002 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:14:06.997+0000 1694f700 -1 osd.5 161 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:101924 2.ds0 2:b0e9127c:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.646_beta%2f%ef%84%8f%e8%94%8b%ed%88%8d%eb%8c%8b%ce%a9%eb%8c%8c%e9%90%8c%ef%84%90%e0%a4%83%e5%98%86%e3%9c%85%e5%98%87%e3%9c%85%e8%94%88%e1%a0%81:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e160) 2019-12-08T17:14:08.102 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:14:08.098+0000 1694f700 -1 osd.5 162 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:101924 2.ds0 2:b0e9127c:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.646_beta%2f%ef%84%8f%e8%94%8b%ed%88%8d%eb%8c%8b%ce%a9%eb%8c%8c%e9%90%8c%ef%84%90%e0%a4%83%e5%98%86%e3%9c%85%e5%98%87%e3%9c%85%e8%94%88%e1%a0%81:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e160) 2019-12-08T17:14:09.127 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:14:09.122+0000 1694f700 -1 osd.5 162 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:101924 2.ds0 2:b0e9127c:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.646_beta%2f%ef%84%8f%e8%94%8b%ed%88%8d%eb%8c%8b%ce%a9%eb%8c%8c%e9%90%8c%ef%84%90%e0%a4%83%e5%98%86%e3%9c%85%e5%98%87%e3%9c%85%e8%94%88%e1%a0%81:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e160) 2019-12-08T17:14:10.096 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:14:10.091+0000 1694f700 -1 osd.5 162 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:101924 2.ds0 2:b0e9127c:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.646_beta%2f%ef%84%8f%e8%94%8b%ed%88%8d%eb%8c%8b%ce%a9%eb%8c%8c%e9%90%8c%ef%84%90%e0%a4%83%e5%98%86%e3%9c%85%e5%98%87%e3%9c%85%e8%94%88%e1%a0%81:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e160) 2019-12-08T17:14:11.132 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:14:11.127+0000 1694f700 -1 osd.5 162 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:101924 2.ds0 2:b0e9127c:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.646_beta%2f%ef%84%8f%e8%94%8b%ed%88%8d%eb%8c%8b%ce%a9%eb%8c%8c%e9%90%8c%ef%84%90%e0%a4%83%e5%98%86%e3%9c%85%e5%98%87%e3%9c%85%e8%94%88%e1%a0%81:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e160) 2019-12-08T17:14:12.089 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:14:12.084+0000 1694f700 -1 osd.5 162 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:101924 2.ds0 2:b0e9127c:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.646_beta%2f%ef%84%8f%e8%94%8b%ed%88%8d%eb%8c%8b%ce%a9%eb%8c%8c%e9%90%8c%ef%84%90%e0%a4%83%e5%98%86%e3%9c%85%e5%98%87%e3%9c%85%e8%94%88%e1%a0%81:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e160) 2019-12-08T17:14:13.083 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:14:13.079+0000 1694f700 -1 osd.5 162 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:101924 2.ds0 2:b0e9127c:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.646_beta%2f%ef%84%8f%e8%94%8b%ed%88%8d%eb%8c%8b%ce%a9%eb%8c%8c%e9%90%8c%ef%84%90%e0%a4%83%e5%98%86%e3%9c%85%e5%98%87%e3%9c%85%e8%94%88%e1%a0%81:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e160) 2019-12-08T17:14:14.102 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:14:14.097+0000 1694f700 -1 osd.5 162 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:101924 2.ds0 2:b0e9127c:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.646_beta%2f%ef%84%8f%e8%94%8b%ed%88%8d%eb%8c%8b%ce%a9%eb%8c%8c%e9%90%8c%ef%84%90%e0%a4%83%e5%98%86%e3%9c%85%e5%98%87%e3%9c%85%e8%94%88%e1%a0%81:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e160) 2019-12-08T17:14:15.101 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:14:15.097+0000 1694f700 -1 osd.5 162 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:101924 2.ds0 2:b0e9127c:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.646_beta%2f%ef%84%8f%e8%94%8b%ed%88%8d%eb%8c%8b%ce%a9%eb%8c%8c%e9%90%8c%ef%84%90%e0%a4%83%e5%98%86%e3%9c%85%e5%98%87%e3%9c%85%e8%94%88%e1%a0%81:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e160) 2019-12-08T17:14:16.143 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:14:16.138+0000 1694f700 -1 osd.5 162 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:101924 2.ds0 2:b0e9127c:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.646_beta%2f%ef%84%8f%e8%94%8b%ed%88%8d%eb%8c%8b%ce%a9%eb%8c%8c%e9%90%8c%ef%84%90%e0%a4%83%e5%98%86%e3%9c%85%e5%98%87%e3%9c%85%e8%94%88%e1%a0%81:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e160) 2019-12-08T17:14:17.136 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:14:17.131+0000 1694f700 -1 osd.5 162 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:101924 2.ds0 2:b0e9127c:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.646_beta%2f%ef%84%8f%e8%94%8b%ed%88%8d%eb%8c%8b%ce%a9%eb%8c%8c%e9%90%8c%ef%84%90%e0%a4%83%e5%98%86%e3%9c%85%e5%98%87%e3%9c%85%e8%94%88%e1%a0%81:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e160) 2019-12-08T17:14:18.172 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:14:18.168+0000 1694f700 -1 osd.5 162 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:101924 2.ds0 2:b0e9127c:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.646_beta%2f%ef%84%8f%e8%94%8b%ed%88%8d%eb%8c%8b%ce%a9%eb%8c%8c%e9%90%8c%ef%84%90%e0%a4%83%e5%98%86%e3%9c%85%e5%98%87%e3%9c%85%e8%94%88%e1%a0%81:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e160) 2019-12-08T17:14:19.165 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:14:19.160+0000 1694f700 -1 osd.5 162 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:101924 2.ds0 2:b0e9127c:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.646_beta%2f%ef%84%8f%e8%94%8b%ed%88%8d%eb%8c%8b%ce%a9%eb%8c%8c%e9%90%8c%ef%84%90%e0%a4%83%e5%98%86%e3%9c%85%e5%98%87%e3%9c%85%e8%94%88%e1%a0%81:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e160) 2019-12-08T17:14:20.215 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:14:20.211+0000 1694f700 -1 osd.5 162 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:101924 2.ds0 2:b0e9127c:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.646_beta%2f%ef%84%8f%e8%94%8b%ed%88%8d%eb%8c%8b%ce%a9%eb%8c%8c%e9%90%8c%ef%84%90%e0%a4%83%e5%98%86%e3%9c%85%e5%98%87%e3%9c%85%e8%94%88%e1%a0%81:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e160) 2019-12-08T17:14:21.226 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:14:21.223+0000 1694f700 -1 osd.5 162 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:101924 2.ds0 2:b0e9127c:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.646_beta%2f%ef%84%8f%e8%94%8b%ed%88%8d%eb%8c%8b%ce%a9%eb%8c%8c%e9%90%8c%ef%84%90%e0%a4%83%e5%98%86%e3%9c%85%e5%98%87%e3%9c%85%e8%94%88%e1%a0%81:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e160) 2019-12-08T17:14:22.260 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:14:22.256+0000 1694f700 -1 osd.5 162 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:101924 2.ds0 2:b0e9127c:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.646_beta%2f%ef%84%8f%e8%94%8b%ed%88%8d%eb%8c%8b%ce%a9%eb%8c%8c%e9%90%8c%ef%84%90%e0%a4%83%e5%98%86%e3%9c%85%e5%98%87%e3%9c%85%e8%94%88%e1%a0%81:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e160) 2019-12-08T17:14:23.221 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:14:23.215+0000 1694f700 -1 osd.5 162 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:101924 2.ds0 2:b0e9127c:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.646_beta%2f%ef%84%8f%e8%94%8b%ed%88%8d%eb%8c%8b%ce%a9%eb%8c%8c%e9%90%8c%ef%84%90%e0%a4%83%e5%98%86%e3%9c%85%e5%98%87%e3%9c%85%e8%94%88%e1%a0%81:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e160) 2019-12-08T17:14:24.273 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:14:24.265+0000 1694f700 -1 osd.5 162 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:101924 2.ds0 2:b0e9127c:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.646_beta%2f%ef%84%8f%e8%94%8b%ed%88%8d%eb%8c%8b%ce%a9%eb%8c%8c%e9%90%8c%ef%84%90%e0%a4%83%e5%98%86%e3%9c%85%e5%98%87%e3%9c%85%e8%94%88%e1%a0%81:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e160) 2019-12-08T17:14:25.277 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:14:25.272+0000 1694f700 -1 osd.5 162 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:101924 2.ds0 2:b0e9127c:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.646_beta%2f%ef%84%8f%e8%94%8b%ed%88%8d%eb%8c%8b%ce%a9%eb%8c%8c%e9%90%8c%ef%84%90%e0%a4%83%e5%98%86%e3%9c%85%e5%98%87%e3%9c%85%e8%94%88%e1%a0%81:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e160) 2019-12-08T17:14:26.279 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:14:26.275+0000 1694f700 -1 osd.5 162 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:101924 2.ds0 2:b0e9127c:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.646_beta%2f%ef%84%8f%e8%94%8b%ed%88%8d%eb%8c%8b%ce%a9%eb%8c%8c%e9%90%8c%ef%84%90%e0%a4%83%e5%98%86%e3%9c%85%e5%98%87%e3%9c%85%e8%94%88%e1%a0%81:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e160) 2019-12-08T17:14:27.329 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:14:27.324+0000 1694f700 -1 osd.5 162 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:101924 2.ds0 2:b0e9127c:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.646_beta%2f%ef%84%8f%e8%94%8b%ed%88%8d%eb%8c%8b%ce%a9%eb%8c%8c%e9%90%8c%ef%84%90%e0%a4%83%e5%98%86%e3%9c%85%e5%98%87%e3%9c%85%e8%94%88%e1%a0%81:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e160) 2019-12-08T17:14:28.304 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:14:28.300+0000 1694f700 -1 osd.5 162 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:101924 2.ds0 2:b0e9127c:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.646_beta%2f%ef%84%8f%e8%94%8b%ed%88%8d%eb%8c%8b%ce%a9%eb%8c%8c%e9%90%8c%ef%84%90%e0%a4%83%e5%98%86%e3%9c%85%e5%98%87%e3%9c%85%e8%94%88%e1%a0%81:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e160) 2019-12-08T17:14:29.351 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:14:29.347+0000 1694f700 -1 osd.5 162 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:101924 2.ds0 2:b0e9127c:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.646_beta%2f%ef%84%8f%e8%94%8b%ed%88%8d%eb%8c%8b%ce%a9%eb%8c%8c%e9%90%8c%ef%84%90%e0%a4%83%e5%98%86%e3%9c%85%e5%98%87%e3%9c%85%e8%94%88%e1%a0%81:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e160) 2019-12-08T17:14:30.378 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:14:30.374+0000 1694f700 -1 osd.5 162 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:101924 2.ds0 2:b0e9127c:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.646_beta%2f%ef%84%8f%e8%94%8b%ed%88%8d%eb%8c%8b%ce%a9%eb%8c%8c%e9%90%8c%ef%84%90%e0%a4%83%e5%98%86%e3%9c%85%e5%98%87%e3%9c%85%e8%94%88%e1%a0%81:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e160) 2019-12-08T17:14:31.359 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:14:31.356+0000 1694f700 -1 osd.5 162 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:101924 2.ds0 2:b0e9127c:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.646_beta%2f%ef%84%8f%e8%94%8b%ed%88%8d%eb%8c%8b%ce%a9%eb%8c%8c%e9%90%8c%ef%84%90%e0%a4%83%e5%98%86%e3%9c%85%e5%98%87%e3%9c%85%e8%94%88%e1%a0%81:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e160) 2019-12-08T17:14:32.341 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:14:32.338+0000 1694f700 -1 osd.5 162 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:101924 2.ds0 2:b0e9127c:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.646_beta%2f%ef%84%8f%e8%94%8b%ed%88%8d%eb%8c%8b%ce%a9%eb%8c%8c%e9%90%8c%ef%84%90%e0%a4%83%e5%98%86%e3%9c%85%e5%98%87%e3%9c%85%e8%94%88%e1%a0%81:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e160) 2019-12-08T17:14:33.356 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:14:33.352+0000 1694f700 -1 osd.5 162 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:101924 2.ds0 2:b0e9127c:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.646_beta%2f%ef%84%8f%e8%94%8b%ed%88%8d%eb%8c%8b%ce%a9%eb%8c%8c%e9%90%8c%ef%84%90%e0%a4%83%e5%98%86%e3%9c%85%e5%98%87%e3%9c%85%e8%94%88%e1%a0%81:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e160) 2019-12-08T17:14:34.367 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:14:34.363+0000 1694f700 -1 osd.5 162 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:101924 2.ds0 2:b0e9127c:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.646_beta%2f%ef%84%8f%e8%94%8b%ed%88%8d%eb%8c%8b%ce%a9%eb%8c%8c%e9%90%8c%ef%84%90%e0%a4%83%e5%98%86%e3%9c%85%e5%98%87%e3%9c%85%e8%94%88%e1%a0%81:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e160) 2019-12-08T17:14:35.381 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:14:35.377+0000 1694f700 -1 osd.5 162 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:101924 2.ds0 2:b0e9127c:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.646_beta%2f%ef%84%8f%e8%94%8b%ed%88%8d%eb%8c%8b%ce%a9%eb%8c%8c%e9%90%8c%ef%84%90%e0%a4%83%e5%98%86%e3%9c%85%e5%98%87%e3%9c%85%e8%94%88%e1%a0%81:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e160) 2019-12-08T17:14:51.047 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:14:51.044+0000 1694f700 -1 osd.4 162 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:102056 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-12-08T17:14:52.049 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:14:52.046+0000 1694f700 -1 osd.4 162 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:102056 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-12-08T17:14:53.070 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:14:53.066+0000 1694f700 -1 osd.4 162 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:102056 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-12-08T17:14:54.043 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:14:54.039+0000 1694f700 -1 osd.4 162 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:102056 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-12-08T17:14:55.086 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:14:55.083+0000 1694f700 -1 osd.4 162 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:102056 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-12-08T17:14:56.122 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:14:56.118+0000 1694f700 -1 osd.4 162 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:102056 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-12-08T17:14:57.146 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:14:57.143+0000 1694f700 -1 osd.4 162 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:102056 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-12-08T17:14:58.267 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:14:58.238+0000 1694f700 -1 osd.4 163 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:102056 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-12-08T17:14:59.257 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:14:59.254+0000 1694f700 -1 osd.4 163 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:102056 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-12-08T17:15:00.220 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:15:00.217+0000 1694f700 -1 osd.4 164 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:102056 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-12-08T17:15:01.173 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:15:01.171+0000 1694f700 -1 osd.4 165 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:102056 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-12-08T17:15:02.269 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:15:02.217+0000 1694f700 -1 osd.4 166 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:102056 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-12-08T17:15:03.251 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:15:03.247+0000 1694f700 -1 osd.4 166 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:102056 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-12-08T17:15:04.239 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:15:04.232+0000 1694f700 -1 osd.4 166 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:14:21.691669+0000 front 2019-12-08T17:14:21.666972+0000 (oldest deadline 2019-12-08T17:15:03.880984+0000) 2019-12-08T17:15:04.239 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:15:04.236+0000 1694f700 -1 osd.4 166 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:102056 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-12-08T17:15:04.573 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:15:04.567+0000 1694f700 -1 osd.6 166 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:14:19.131954+0000 front 2019-12-08T17:14:19.235402+0000 (oldest deadline 2019-12-08T17:15:04.245378+0000) 2019-12-08T17:15:05.070 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:15:05.068+0000 1694f700 -1 osd.3 166 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:14:21.013175+0000 front 2019-12-08T17:14:21.012267+0000 (oldest deadline 2019-12-08T17:15:05.001081+0000) 2019-12-08T17:15:05.217 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:15:05.212+0000 1694f700 -1 osd.4 166 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:14:21.691669+0000 front 2019-12-08T17:14:21.666972+0000 (oldest deadline 2019-12-08T17:15:03.880984+0000) 2019-12-08T17:15:05.220 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:15:05.217+0000 1694f700 -1 osd.4 166 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:102056 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-12-08T17:15:05.558 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:15:05.553+0000 1694f700 -1 osd.6 166 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:14:19.131954+0000 front 2019-12-08T17:14:19.235402+0000 (oldest deadline 2019-12-08T17:15:04.245378+0000) 2019-12-08T17:15:06.035 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:15:06.032+0000 1694f700 -1 osd.3 166 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:14:21.013175+0000 front 2019-12-08T17:14:21.012267+0000 (oldest deadline 2019-12-08T17:15:05.001081+0000) 2019-12-08T17:15:06.223 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:15:06.217+0000 1694f700 -1 osd.4 166 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:14:21.691669+0000 front 2019-12-08T17:14:21.666972+0000 (oldest deadline 2019-12-08T17:15:03.880984+0000) 2019-12-08T17:15:06.224 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:15:06.220+0000 1694f700 -1 osd.4 166 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:102056 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-12-08T17:15:06.595 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:15:06.589+0000 1694f700 -1 osd.5 166 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:14:20.985028+0000 front 2019-12-08T17:14:20.981618+0000 (oldest deadline 2019-12-08T17:15:06.010071+0000) 2019-12-08T17:15:06.601 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:15:06.596+0000 1694f700 -1 osd.6 166 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:14:19.131954+0000 front 2019-12-08T17:14:19.235402+0000 (oldest deadline 2019-12-08T17:15:04.245378+0000) 2019-12-08T17:15:07.011 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:15:07.008+0000 1694f700 -1 osd.3 166 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:14:21.013175+0000 front 2019-12-08T17:14:21.012267+0000 (oldest deadline 2019-12-08T17:15:05.001081+0000) 2019-12-08T17:15:07.142 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:15:07.137+0000 1694f700 -1 osd.7 166 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:14:20.463475+0000 front 2019-12-08T17:14:20.534816+0000 (oldest deadline 2019-12-08T17:15:06.311490+0000) 2019-12-08T17:15:07.230 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:15:07.225+0000 1694f700 -1 osd.4 166 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:14:21.691669+0000 front 2019-12-08T17:14:21.666972+0000 (oldest deadline 2019-12-08T17:15:03.880984+0000) 2019-12-08T17:15:07.232 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:15:07.229+0000 1694f700 -1 osd.4 166 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:102056 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-12-08T17:15:07.566 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:15:07.561+0000 1694f700 -1 osd.5 166 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:14:20.985028+0000 front 2019-12-08T17:14:20.981618+0000 (oldest deadline 2019-12-08T17:15:06.010071+0000) 2019-12-08T17:15:07.639 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:15:07.631+0000 1694f700 -1 osd.6 166 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:14:19.131954+0000 front 2019-12-08T17:14:19.235402+0000 (oldest deadline 2019-12-08T17:15:04.245378+0000) 2019-12-08T17:15:07.970 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:15:07.967+0000 1694f700 -1 osd.3 166 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:14:21.013175+0000 front 2019-12-08T17:14:21.012267+0000 (oldest deadline 2019-12-08T17:15:05.001081+0000) 2019-12-08T17:15:08.181 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:15:08.176+0000 1694f700 -1 osd.7 166 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:14:20.463475+0000 front 2019-12-08T17:14:20.534816+0000 (oldest deadline 2019-12-08T17:15:06.311490+0000) 2019-12-08T17:15:08.201 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:15:08.190+0000 1694f700 -1 osd.4 166 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:14:21.691669+0000 front 2019-12-08T17:14:21.666972+0000 (oldest deadline 2019-12-08T17:15:03.880984+0000) 2019-12-08T17:15:08.205 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:15:08.195+0000 1694f700 -1 osd.4 166 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:102056 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-12-08T17:15:08.562 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:15:08.557+0000 1694f700 -1 osd.5 166 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:14:20.985028+0000 front 2019-12-08T17:14:20.981618+0000 (oldest deadline 2019-12-08T17:15:06.010071+0000) 2019-12-08T17:15:08.633 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:15:08.628+0000 1694f700 -1 osd.6 166 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:14:19.131954+0000 front 2019-12-08T17:14:19.235402+0000 (oldest deadline 2019-12-08T17:15:04.245378+0000) 2019-12-08T17:15:09.002 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:15:08.999+0000 1694f700 -1 osd.3 166 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:14:21.013175+0000 front 2019-12-08T17:14:21.012267+0000 (oldest deadline 2019-12-08T17:15:05.001081+0000) 2019-12-08T17:15:09.212 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:15:09.204+0000 1694f700 -1 osd.7 166 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:14:20.463475+0000 front 2019-12-08T17:14:20.534816+0000 (oldest deadline 2019-12-08T17:15:06.311490+0000) 2019-12-08T17:15:09.249 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:15:09.243+0000 1694f700 -1 osd.4 166 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:14:21.691669+0000 front 2019-12-08T17:14:21.666972+0000 (oldest deadline 2019-12-08T17:15:03.880984+0000) 2019-12-08T17:15:09.249 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:15:09.246+0000 1694f700 -1 osd.4 166 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:102056 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-12-08T17:15:09.535 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:15:09.529+0000 1694f700 -1 osd.5 166 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:14:20.985028+0000 front 2019-12-08T17:14:20.981618+0000 (oldest deadline 2019-12-08T17:15:06.010071+0000) 2019-12-08T17:15:09.653 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:15:09.647+0000 1694f700 -1 osd.6 166 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:14:19.131954+0000 front 2019-12-08T17:14:19.235402+0000 (oldest deadline 2019-12-08T17:15:04.245378+0000) 2019-12-08T17:15:10.041 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:15:10.039+0000 1694f700 -1 osd.3 166 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:14:21.013175+0000 front 2019-12-08T17:14:21.012267+0000 (oldest deadline 2019-12-08T17:15:05.001081+0000) 2019-12-08T17:15:10.210 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:15:10.204+0000 1694f700 -1 osd.7 166 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:14:20.463475+0000 front 2019-12-08T17:14:20.534816+0000 (oldest deadline 2019-12-08T17:15:06.311490+0000) 2019-12-08T17:15:10.264 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:15:10.259+0000 1694f700 -1 osd.4 166 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:14:21.691669+0000 front 2019-12-08T17:14:21.666972+0000 (oldest deadline 2019-12-08T17:15:03.880984+0000) 2019-12-08T17:15:10.264 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:15:10.261+0000 1694f700 -1 osd.4 166 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:102056 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-12-08T17:15:10.567 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:15:10.561+0000 1694f700 -1 osd.5 166 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:14:20.985028+0000 front 2019-12-08T17:14:20.981618+0000 (oldest deadline 2019-12-08T17:15:06.010071+0000) 2019-12-08T17:15:10.697 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:15:10.692+0000 1694f700 -1 osd.6 166 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:14:19.131954+0000 front 2019-12-08T17:14:19.235402+0000 (oldest deadline 2019-12-08T17:15:04.245378+0000) 2019-12-08T17:15:11.050 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:15:11.048+0000 1694f700 -1 osd.3 166 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:14:21.013175+0000 front 2019-12-08T17:14:21.012267+0000 (oldest deadline 2019-12-08T17:15:05.001081+0000) 2019-12-08T17:15:11.173 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:15:11.167+0000 1694f700 -1 osd.7 166 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:14:20.463475+0000 front 2019-12-08T17:14:20.534816+0000 (oldest deadline 2019-12-08T17:15:06.311490+0000) 2019-12-08T17:15:11.222 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:15:11.217+0000 1694f700 -1 osd.4 166 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:14:21.691669+0000 front 2019-12-08T17:14:21.666972+0000 (oldest deadline 2019-12-08T17:15:03.880984+0000) 2019-12-08T17:15:11.223 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:15:11.220+0000 1694f700 -1 osd.4 166 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:102056 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-12-08T17:15:11.539 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:15:11.536+0000 1694f700 -1 osd.5 166 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:14:20.985028+0000 front 2019-12-08T17:14:20.981618+0000 (oldest deadline 2019-12-08T17:15:06.010071+0000) 2019-12-08T17:15:11.736 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:15:11.730+0000 1694f700 -1 osd.6 166 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:14:19.131954+0000 front 2019-12-08T17:14:19.235402+0000 (oldest deadline 2019-12-08T17:15:04.245378+0000) 2019-12-08T17:15:12.068 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:15:12.067+0000 1694f700 -1 osd.3 166 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:14:21.013175+0000 front 2019-12-08T17:14:21.012267+0000 (oldest deadline 2019-12-08T17:15:05.001081+0000) 2019-12-08T17:15:12.191 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:15:12.185+0000 1694f700 -1 osd.7 166 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:14:20.463475+0000 front 2019-12-08T17:14:20.534816+0000 (oldest deadline 2019-12-08T17:15:06.311490+0000) 2019-12-08T17:15:12.264 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:15:12.258+0000 1694f700 -1 osd.4 166 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:14:21.691669+0000 front 2019-12-08T17:14:21.666972+0000 (oldest deadline 2019-12-08T17:15:03.880984+0000) 2019-12-08T17:15:12.265 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:15:12.261+0000 1694f700 -1 osd.4 166 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:102056 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-12-08T17:15:12.580 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:15:12.575+0000 1694f700 -1 osd.5 166 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:14:20.985028+0000 front 2019-12-08T17:14:20.981618+0000 (oldest deadline 2019-12-08T17:15:06.010071+0000) 2019-12-08T17:15:12.771 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:15:12.766+0000 1694f700 -1 osd.6 166 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:14:19.131954+0000 front 2019-12-08T17:14:19.235402+0000 (oldest deadline 2019-12-08T17:15:04.245378+0000) 2019-12-08T17:15:13.105 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:15:13.104+0000 1694f700 -1 osd.3 166 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:14:21.013175+0000 front 2019-12-08T17:14:21.012267+0000 (oldest deadline 2019-12-08T17:15:05.001081+0000) 2019-12-08T17:15:13.152 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:15:13.146+0000 1694f700 -1 osd.7 166 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:14:20.463475+0000 front 2019-12-08T17:14:20.534816+0000 (oldest deadline 2019-12-08T17:15:06.311490+0000) 2019-12-08T17:15:13.227 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:15:13.221+0000 1694f700 -1 osd.4 166 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:14:21.691669+0000 front 2019-12-08T17:14:21.666972+0000 (oldest deadline 2019-12-08T17:15:03.880984+0000) 2019-12-08T17:15:13.228 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:15:13.224+0000 1694f700 -1 osd.4 166 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:102056 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-12-08T17:15:13.306 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:15:13.304+0000 1694f700 -1 osd.0 166 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:102119 2.1ds0 2.bbc7ff1d (undecoded) ondisk+read+known_if_redirected e162) 2019-12-08T17:15:13.551 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:15:13.546+0000 1694f700 -1 osd.5 166 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:14:20.985028+0000 front 2019-12-08T17:14:20.981618+0000 (oldest deadline 2019-12-08T17:15:06.010071+0000) 2019-12-08T17:15:13.823 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:15:13.818+0000 1694f700 -1 osd.6 166 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:14:19.131954+0000 front 2019-12-08T17:14:19.235402+0000 (oldest deadline 2019-12-08T17:15:04.245378+0000) 2019-12-08T17:15:14.122 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:15:14.117+0000 1694f700 -1 osd.7 166 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:14:20.463475+0000 front 2019-12-08T17:14:20.534816+0000 (oldest deadline 2019-12-08T17:15:06.311490+0000) 2019-12-08T17:15:14.156 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:15:14.154+0000 1694f700 -1 osd.3 166 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:14:21.013175+0000 front 2019-12-08T17:14:21.012267+0000 (oldest deadline 2019-12-08T17:15:05.001081+0000) 2019-12-08T17:15:14.234 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:15:14.228+0000 1694f700 -1 osd.4 166 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:14:21.691669+0000 front 2019-12-08T17:14:21.666972+0000 (oldest deadline 2019-12-08T17:15:03.880984+0000) 2019-12-08T17:15:14.235 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:15:14.231+0000 1694f700 -1 osd.4 166 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:102056 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-12-08T17:15:14.307 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:15:14.306+0000 1694f700 -1 osd.0 166 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:102119 2.1ds0 2.bbc7ff1d (undecoded) ondisk+read+known_if_redirected e162) 2019-12-08T17:15:14.585 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:15:14.580+0000 1694f700 -1 osd.5 166 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:14:20.985028+0000 front 2019-12-08T17:14:20.981618+0000 (oldest deadline 2019-12-08T17:15:06.010071+0000) 2019-12-08T17:15:14.792 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:15:14.786+0000 1694f700 -1 osd.6 166 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:14:19.131954+0000 front 2019-12-08T17:14:19.235402+0000 (oldest deadline 2019-12-08T17:15:04.245378+0000) 2019-12-08T17:15:15.091 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:15:15.086+0000 1694f700 -1 osd.7 166 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:14:20.463475+0000 front 2019-12-08T17:14:20.534816+0000 (oldest deadline 2019-12-08T17:15:06.311490+0000) 2019-12-08T17:15:15.184 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:15:15.181+0000 1694f700 -1 osd.3 166 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:14:21.013175+0000 front 2019-12-08T17:14:21.012267+0000 (oldest deadline 2019-12-08T17:15:05.001081+0000) 2019-12-08T17:15:15.262 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:15:15.257+0000 1694f700 -1 osd.4 166 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:14:21.691669+0000 front 2019-12-08T17:14:21.666972+0000 (oldest deadline 2019-12-08T17:15:03.880984+0000) 2019-12-08T17:15:15.265 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:15:15.262+0000 1694f700 -1 osd.4 166 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:102056 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-12-08T17:15:15.304 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:15:15.303+0000 1694f700 -1 osd.0 166 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:102119 2.1ds0 2.bbc7ff1d (undecoded) ondisk+read+known_if_redirected e162) 2019-12-08T17:15:15.560 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:15:15.555+0000 1694f700 -1 osd.5 166 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:14:20.985028+0000 front 2019-12-08T17:14:20.981618+0000 (oldest deadline 2019-12-08T17:15:06.010071+0000) 2019-12-08T17:15:15.793 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:15:15.789+0000 1694f700 -1 osd.6 166 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:14:19.131954+0000 front 2019-12-08T17:14:19.235402+0000 (oldest deadline 2019-12-08T17:15:04.245378+0000) 2019-12-08T17:15:16.138 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:15:16.132+0000 1694f700 -1 osd.7 166 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:14:20.463475+0000 front 2019-12-08T17:14:20.534816+0000 (oldest deadline 2019-12-08T17:15:06.311490+0000) 2019-12-08T17:15:16.139 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:15:16.137+0000 1694f700 -1 osd.3 166 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:14:21.013175+0000 front 2019-12-08T17:14:21.012267+0000 (oldest deadline 2019-12-08T17:15:05.001081+0000) 2019-12-08T17:15:16.308 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:15:16.301+0000 1694f700 -1 osd.4 166 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:14:21.691669+0000 front 2019-12-08T17:14:21.666972+0000 (oldest deadline 2019-12-08T17:15:03.880984+0000) 2019-12-08T17:15:16.309 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:15:16.303+0000 1694f700 -1 osd.4 166 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:102056 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-12-08T17:15:16.353 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:15:16.352+0000 1694f700 -1 osd.0 166 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:102119 2.1ds0 2.bbc7ff1d (undecoded) ondisk+read+known_if_redirected e162) 2019-12-08T17:15:16.579 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:15:16.573+0000 1694f700 -1 osd.5 166 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:14:20.985028+0000 front 2019-12-08T17:14:20.981618+0000 (oldest deadline 2019-12-08T17:15:06.010071+0000) 2019-12-08T17:15:16.843 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:15:16.836+0000 1694f700 -1 osd.6 166 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:14:19.131954+0000 front 2019-12-08T17:14:19.235402+0000 (oldest deadline 2019-12-08T17:15:04.245378+0000) 2019-12-08T17:15:17.102 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:15:17.097+0000 1694f700 -1 osd.7 166 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:14:20.463475+0000 front 2019-12-08T17:14:20.534816+0000 (oldest deadline 2019-12-08T17:15:06.311490+0000) 2019-12-08T17:15:17.189 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:15:17.188+0000 1694f700 -1 osd.3 166 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:14:21.013175+0000 front 2019-12-08T17:14:21.012267+0000 (oldest deadline 2019-12-08T17:15:05.001081+0000) 2019-12-08T17:15:17.293 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:15:17.287+0000 1694f700 -1 osd.4 166 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:14:21.691669+0000 front 2019-12-08T17:14:21.666972+0000 (oldest deadline 2019-12-08T17:15:03.880984+0000) 2019-12-08T17:15:17.296 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:15:17.292+0000 1694f700 -1 osd.4 166 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:102056 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-12-08T17:15:17.341 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:15:17.341+0000 1694f700 -1 osd.0 166 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:102119 2.1ds0 2.bbc7ff1d (undecoded) ondisk+read+known_if_redirected e162) 2019-12-08T17:15:17.586 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:15:17.579+0000 1694f700 -1 osd.5 166 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:14:20.985028+0000 front 2019-12-08T17:14:20.981618+0000 (oldest deadline 2019-12-08T17:15:06.010071+0000) 2019-12-08T17:15:17.847 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:15:17.842+0000 1694f700 -1 osd.6 166 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:14:19.131954+0000 front 2019-12-08T17:14:19.235402+0000 (oldest deadline 2019-12-08T17:15:04.245378+0000) 2019-12-08T17:15:18.060 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:15:18.055+0000 1694f700 -1 osd.7 166 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:14:20.463475+0000 front 2019-12-08T17:14:20.534816+0000 (oldest deadline 2019-12-08T17:15:06.311490+0000) 2019-12-08T17:15:18.183 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:15:18.181+0000 1694f700 -1 osd.3 166 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:14:21.013175+0000 front 2019-12-08T17:14:21.012267+0000 (oldest deadline 2019-12-08T17:15:05.001081+0000) 2019-12-08T17:15:18.332 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:15:18.323+0000 1694f700 -1 osd.4 166 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:14:21.691669+0000 front 2019-12-08T17:14:21.666972+0000 (oldest deadline 2019-12-08T17:15:03.880984+0000) 2019-12-08T17:15:18.336 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:15:18.330+0000 1694f700 -1 osd.4 166 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:102056 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-12-08T17:15:18.376 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:15:18.375+0000 1694f700 -1 osd.0 166 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:102119 2.1ds0 2.bbc7ff1d (undecoded) ondisk+read+known_if_redirected e162) 2019-12-08T17:15:18.563 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:15:18.556+0000 1694f700 -1 osd.5 166 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:14:20.985028+0000 front 2019-12-08T17:14:20.981618+0000 (oldest deadline 2019-12-08T17:15:06.010071+0000) 2019-12-08T17:15:18.874 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:15:18.869+0000 1694f700 -1 osd.6 166 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:14:19.131954+0000 front 2019-12-08T17:14:19.235402+0000 (oldest deadline 2019-12-08T17:15:04.245378+0000) 2019-12-08T17:15:19.053 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:15:19.047+0000 1694f700 -1 osd.7 166 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:14:20.463475+0000 front 2019-12-08T17:14:20.534816+0000 (oldest deadline 2019-12-08T17:15:06.311490+0000) 2019-12-08T17:15:19.228 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:15:19.226+0000 1694f700 -1 osd.3 166 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:14:21.013175+0000 front 2019-12-08T17:14:21.012267+0000 (oldest deadline 2019-12-08T17:15:05.001081+0000) 2019-12-08T17:15:19.366 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:15:19.366+0000 1694f700 -1 osd.0 166 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:102119 2.1ds0 2.bbc7ff1d (undecoded) ondisk+read+known_if_redirected e162) 2019-12-08T17:15:19.383 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:15:19.376+0000 1694f700 -1 osd.4 166 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:14:21.691669+0000 front 2019-12-08T17:14:21.666972+0000 (oldest deadline 2019-12-08T17:15:03.880984+0000) 2019-12-08T17:15:19.384 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:15:19.380+0000 1694f700 -1 osd.4 166 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:102056 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-12-08T17:15:19.607 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:15:19.600+0000 1694f700 -1 osd.5 166 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:14:20.985028+0000 front 2019-12-08T17:14:20.981618+0000 (oldest deadline 2019-12-08T17:15:06.010071+0000) 2019-12-08T17:15:19.912 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:15:19.908+0000 1694f700 -1 osd.6 166 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:14:19.131954+0000 front 2019-12-08T17:14:19.235402+0000 (oldest deadline 2019-12-08T17:15:04.245378+0000) 2019-12-08T17:15:20.018 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:15:20.011+0000 1694f700 -1 osd.7 166 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:14:20.463475+0000 front 2019-12-08T17:14:20.534816+0000 (oldest deadline 2019-12-08T17:15:06.311490+0000) 2019-12-08T17:15:20.253 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:15:20.250+0000 1694f700 -1 osd.3 166 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:14:21.013175+0000 front 2019-12-08T17:14:21.012267+0000 (oldest deadline 2019-12-08T17:15:05.001081+0000) 2019-12-08T17:15:20.401 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:15:20.400+0000 1694f700 -1 osd.0 166 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:102119 2.1ds0 2.bbc7ff1d (undecoded) ondisk+read+known_if_redirected e162) 2019-12-08T17:15:20.419 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:15:20.412+0000 1694f700 -1 osd.4 166 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:14:21.691669+0000 front 2019-12-08T17:14:21.666972+0000 (oldest deadline 2019-12-08T17:15:03.880984+0000) 2019-12-08T17:15:20.420 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:15:20.415+0000 1694f700 -1 osd.4 166 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:102056 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-12-08T17:15:20.630 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:15:20.624+0000 1694f700 -1 osd.5 166 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:14:20.985028+0000 front 2019-12-08T17:14:20.981618+0000 (oldest deadline 2019-12-08T17:15:06.010071+0000) 2019-12-08T17:15:20.928 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:15:20.922+0000 1694f700 -1 osd.6 166 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:14:19.131954+0000 front 2019-12-08T17:14:19.235402+0000 (oldest deadline 2019-12-08T17:15:04.245378+0000) 2019-12-08T17:15:20.971 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:15:20.966+0000 1694f700 -1 osd.7 166 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:14:20.463475+0000 front 2019-12-08T17:14:20.534816+0000 (oldest deadline 2019-12-08T17:15:06.311490+0000) 2019-12-08T17:15:21.299 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:15:21.298+0000 1694f700 -1 osd.3 166 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:14:21.013175+0000 front 2019-12-08T17:14:21.012267+0000 (oldest deadline 2019-12-08T17:15:05.001081+0000) 2019-12-08T17:15:21.375 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:15:21.374+0000 1694f700 -1 osd.0 166 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:102119 2.1ds0 2.bbc7ff1d (undecoded) ondisk+read+known_if_redirected e162) 2019-12-08T17:15:21.433 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:15:21.428+0000 1694f700 -1 osd.4 166 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:14:21.691669+0000 front 2019-12-08T17:14:21.666972+0000 (oldest deadline 2019-12-08T17:15:03.880984+0000) 2019-12-08T17:15:21.441 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:15:21.432+0000 1694f700 -1 osd.4 166 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:102056 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-12-08T17:15:21.605 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:15:21.600+0000 1694f700 -1 osd.5 166 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:14:20.985028+0000 front 2019-12-08T17:14:20.981618+0000 (oldest deadline 2019-12-08T17:15:06.010071+0000) 2019-12-08T17:15:21.995 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:15:21.990+0000 1694f700 -1 osd.7 166 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:14:20.463475+0000 front 2019-12-08T17:14:20.534816+0000 (oldest deadline 2019-12-08T17:15:06.311490+0000) 2019-12-08T17:15:22.587 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:15:22.549+0000 1694f700 -1 osd.4 167 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:102056 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-12-08T17:15:23.653 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:15:23.644+0000 1694f700 -1 osd.4 168 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:102056 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e162) 2019-12-08T17:15:23.835 INFO:tasks.rgw.client.0.smithi079.stdout:2019-12-08T17:15:23.829+0000 20e25700 -1 RGWWatcher::handle_error cookie 820710784 err (107) Transport endpoint is not connected 2019-12-08T17:16:15.278 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:16:15.218+0000 1694f700 -1 osd.1 164 get_health_metrics reporting 10 slow ops, oldest is osd_op(client.4449.0:102147 5.f 5.4322fa9f (undecoded) ondisk+write+known_if_redirected e164) 2019-12-08T17:16:16.282 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:16:16.272+0000 1694f700 -1 osd.1 166 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4449.0:102155 5.f 5.4322fa9f (undecoded) ondisk+write+known_if_redirected e166) 2019-12-08T17:16:26.556 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:16:26.480+0000 34274700 -1 osd.1 172 build_incremental_map_msg missing incremental map 171 2019-12-08T17:16:56.217 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:05:14:20.920 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T17:16:56.220 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:05:14:20.855 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T17:16:56.226 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:05:14:20.860 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T17:16:56.230 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:05:14:20.933 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T17:16:56.238 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:05:14:20.873 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T17:16:56.244 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:05:14:20.879 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T17:16:56.489 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:05:14:21.123 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T17:16:56.553 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:05:14:21.188 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T17:16:56.575 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:05:14:21.278 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T17:17:41.543 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:17:41.537+0000 1694f700 -1 osd.1 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:16:56.737639+0000 front 2019-12-08T17:16:56.788279+0000 (oldest deadline 2019-12-08T17:17:41.420608+0000) 2019-12-08T17:17:41.553 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:17:41.551+0000 1694f700 -1 osd.0 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.452344+0000 front 2019-12-08T17:17:00.508161+0000 (oldest deadline 2019-12-08T17:17:41.529182+0000) 2019-12-08T17:17:42.494 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:17:42.488+0000 1694f700 -1 osd.5 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.948949+0000 front 2019-12-08T17:17:00.934791+0000 (oldest deadline 2019-12-08T17:17:42.003561+0000) 2019-12-08T17:17:42.522 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:17:42.520+0000 1694f700 -1 osd.0 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.452344+0000 front 2019-12-08T17:17:00.508161+0000 (oldest deadline 2019-12-08T17:17:41.529182+0000) 2019-12-08T17:17:42.529 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:17:42.515+0000 1694f700 -1 osd.4 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:16:58.531643+0000 front 2019-12-08T17:16:59.521254+0000 (oldest deadline 2019-12-08T17:17:41.979075+0000) 2019-12-08T17:17:42.574 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:17:42.572+0000 1694f700 -1 osd.1 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:16:56.737639+0000 front 2019-12-08T17:16:56.788279+0000 (oldest deadline 2019-12-08T17:17:41.420608+0000) 2019-12-08T17:17:42.631 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:17:42.630+0000 1694f700 -1 osd.3 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:16:59.531163+0000 front 2019-12-08T17:16:58.555196+0000 (oldest deadline 2019-12-08T17:17:42.625044+0000) 2019-12-08T17:17:43.465 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:17:43.460+0000 1694f700 -1 osd.5 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.948949+0000 front 2019-12-08T17:17:00.934791+0000 (oldest deadline 2019-12-08T17:17:42.003561+0000) 2019-12-08T17:17:43.539 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:17:43.481+0000 1694f700 -1 osd.0 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.452344+0000 front 2019-12-08T17:17:00.508161+0000 (oldest deadline 2019-12-08T17:17:41.529182+0000) 2019-12-08T17:17:43.539 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:17:43.533+0000 1694f700 -1 osd.1 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:16:56.737639+0000 front 2019-12-08T17:16:56.788279+0000 (oldest deadline 2019-12-08T17:17:41.420608+0000) 2019-12-08T17:17:43.539 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:17:43.519+0000 1694f700 -1 osd.4 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:16:58.531643+0000 front 2019-12-08T17:16:59.521254+0000 (oldest deadline 2019-12-08T17:17:41.979075+0000) 2019-12-08T17:17:43.645 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:17:43.642+0000 1694f700 -1 osd.3 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:16:59.531163+0000 front 2019-12-08T17:16:58.555196+0000 (oldest deadline 2019-12-08T17:17:42.625044+0000) 2019-12-08T17:17:44.427 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:17:44.423+0000 1694f700 -1 osd.5 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.948949+0000 front 2019-12-08T17:17:00.934791+0000 (oldest deadline 2019-12-08T17:17:42.003561+0000) 2019-12-08T17:17:44.464 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:17:44.461+0000 1694f700 -1 osd.0 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.452344+0000 front 2019-12-08T17:17:00.508161+0000 (oldest deadline 2019-12-08T17:17:41.529182+0000) 2019-12-08T17:17:44.516 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:17:44.513+0000 1694f700 -1 osd.1 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:16:56.737639+0000 front 2019-12-08T17:16:56.788279+0000 (oldest deadline 2019-12-08T17:17:41.420608+0000) 2019-12-08T17:17:44.582 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:17:44.568+0000 1694f700 -1 osd.4 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:16:58.531643+0000 front 2019-12-08T17:16:59.521254+0000 (oldest deadline 2019-12-08T17:17:41.979075+0000) 2019-12-08T17:17:44.666 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:17:44.664+0000 1694f700 -1 osd.3 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:16:59.531163+0000 front 2019-12-08T17:16:58.555196+0000 (oldest deadline 2019-12-08T17:17:42.625044+0000) 2019-12-08T17:17:45.344 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:17:45.340+0000 1694f700 -1 osd.7 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.061227+0000 front 2019-12-08T17:16:59.801021+0000 (oldest deadline 2019-12-08T17:17:44.381179+0000) 2019-12-08T17:17:45.388 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:17:45.383+0000 1694f700 -1 osd.5 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.948949+0000 front 2019-12-08T17:17:00.934791+0000 (oldest deadline 2019-12-08T17:17:42.003561+0000) 2019-12-08T17:17:45.462 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:17:45.459+0000 1694f700 -1 osd.0 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.452344+0000 front 2019-12-08T17:17:00.508161+0000 (oldest deadline 2019-12-08T17:17:41.529182+0000) 2019-12-08T17:17:45.502 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:17:45.499+0000 1694f700 -1 osd.1 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:16:56.737639+0000 front 2019-12-08T17:16:56.788279+0000 (oldest deadline 2019-12-08T17:17:41.420608+0000) 2019-12-08T17:17:45.585 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:17:45.581+0000 1694f700 -1 osd.4 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:16:58.531643+0000 front 2019-12-08T17:16:59.521254+0000 (oldest deadline 2019-12-08T17:17:41.979075+0000) 2019-12-08T17:17:45.662 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:17:45.659+0000 1694f700 -1 osd.3 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:16:59.531163+0000 front 2019-12-08T17:16:58.555196+0000 (oldest deadline 2019-12-08T17:17:42.625044+0000) 2019-12-08T17:17:46.341 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:17:46.336+0000 1694f700 -1 osd.7 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.061227+0000 front 2019-12-08T17:16:59.801021+0000 (oldest deadline 2019-12-08T17:17:44.381179+0000) 2019-12-08T17:17:46.392 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:17:46.387+0000 1694f700 -1 osd.5 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.948949+0000 front 2019-12-08T17:17:00.934791+0000 (oldest deadline 2019-12-08T17:17:42.003561+0000) 2019-12-08T17:17:46.439 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:17:46.430+0000 1694f700 -1 osd.0 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.452344+0000 front 2019-12-08T17:17:00.508161+0000 (oldest deadline 2019-12-08T17:17:41.529182+0000) 2019-12-08T17:17:46.518 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:17:46.516+0000 1694f700 -1 osd.1 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:16:56.737639+0000 front 2019-12-08T17:16:56.788279+0000 (oldest deadline 2019-12-08T17:17:41.420608+0000) 2019-12-08T17:17:46.556 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:17:46.551+0000 1694f700 -1 osd.4 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:16:58.531643+0000 front 2019-12-08T17:16:59.521254+0000 (oldest deadline 2019-12-08T17:17:41.979075+0000) 2019-12-08T17:17:46.700 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:17:46.698+0000 1694f700 -1 osd.3 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:16:59.531163+0000 front 2019-12-08T17:16:58.555196+0000 (oldest deadline 2019-12-08T17:17:42.625044+0000) 2019-12-08T17:17:46.939 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:17:46.935+0000 1694f700 -1 osd.6 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.149784+0000 front 2019-12-08T17:17:00.134930+0000 (oldest deadline 2019-12-08T17:17:46.017452+0000) 2019-12-08T17:17:47.311 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:17:47.306+0000 1694f700 -1 osd.7 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.061227+0000 front 2019-12-08T17:16:59.801021+0000 (oldest deadline 2019-12-08T17:17:44.381179+0000) 2019-12-08T17:17:47.360 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:17:47.355+0000 1694f700 -1 osd.5 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.948949+0000 front 2019-12-08T17:17:00.934791+0000 (oldest deadline 2019-12-08T17:17:42.003561+0000) 2019-12-08T17:17:47.400 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:17:47.397+0000 1694f700 -1 osd.0 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.452344+0000 front 2019-12-08T17:17:00.508161+0000 (oldest deadline 2019-12-08T17:17:41.529182+0000) 2019-12-08T17:17:47.497 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:17:47.494+0000 1694f700 -1 osd.1 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:16:56.737639+0000 front 2019-12-08T17:16:56.788279+0000 (oldest deadline 2019-12-08T17:17:41.420608+0000) 2019-12-08T17:17:47.580 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:17:47.569+0000 1694f700 -1 osd.4 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:16:58.531643+0000 front 2019-12-08T17:16:59.521254+0000 (oldest deadline 2019-12-08T17:17:41.979075+0000) 2019-12-08T17:17:47.703 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:17:47.700+0000 1694f700 -1 osd.3 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:16:59.531163+0000 front 2019-12-08T17:16:58.555196+0000 (oldest deadline 2019-12-08T17:17:42.625044+0000) 2019-12-08T17:17:47.991 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:17:47.986+0000 1694f700 -1 osd.6 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.149784+0000 front 2019-12-08T17:17:00.134930+0000 (oldest deadline 2019-12-08T17:17:46.017452+0000) 2019-12-08T17:17:48.284 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:17:48.279+0000 1694f700 -1 osd.7 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.061227+0000 front 2019-12-08T17:16:59.801021+0000 (oldest deadline 2019-12-08T17:17:44.381179+0000) 2019-12-08T17:17:48.381 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:17:48.372+0000 1694f700 -1 osd.5 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.948949+0000 front 2019-12-08T17:17:00.934791+0000 (oldest deadline 2019-12-08T17:17:42.003561+0000) 2019-12-08T17:17:48.396 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:17:48.394+0000 1694f700 -1 osd.0 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.452344+0000 front 2019-12-08T17:17:00.508161+0000 (oldest deadline 2019-12-08T17:17:41.529182+0000) 2019-12-08T17:17:48.484 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:17:48.482+0000 1694f700 -1 osd.1 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:16:56.737639+0000 front 2019-12-08T17:16:56.788279+0000 (oldest deadline 2019-12-08T17:17:41.420608+0000) 2019-12-08T17:17:48.589 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:17:48.582+0000 1694f700 -1 osd.4 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:16:58.531643+0000 front 2019-12-08T17:16:59.521254+0000 (oldest deadline 2019-12-08T17:17:41.979075+0000) 2019-12-08T17:17:48.664 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:17:48.659+0000 1694f700 -1 osd.3 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:16:59.531163+0000 front 2019-12-08T17:16:58.555196+0000 (oldest deadline 2019-12-08T17:17:42.625044+0000) 2019-12-08T17:17:49.021 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:17:49.016+0000 1694f700 -1 osd.6 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.149784+0000 front 2019-12-08T17:17:00.134930+0000 (oldest deadline 2019-12-08T17:17:46.017452+0000) 2019-12-08T17:17:49.291 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:17:49.286+0000 1694f700 -1 osd.7 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.061227+0000 front 2019-12-08T17:16:59.801021+0000 (oldest deadline 2019-12-08T17:17:44.381179+0000) 2019-12-08T17:17:49.381 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:17:49.378+0000 1694f700 -1 osd.0 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.452344+0000 front 2019-12-08T17:17:00.508161+0000 (oldest deadline 2019-12-08T17:17:41.529182+0000) 2019-12-08T17:17:49.415 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:17:49.411+0000 1694f700 -1 osd.5 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.948949+0000 front 2019-12-08T17:17:00.934791+0000 (oldest deadline 2019-12-08T17:17:42.003561+0000) 2019-12-08T17:17:49.454 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:17:49.453+0000 1694f700 -1 osd.1 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:16:56.737639+0000 front 2019-12-08T17:16:56.788279+0000 (oldest deadline 2019-12-08T17:17:41.420608+0000) 2019-12-08T17:17:49.576 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:17:49.569+0000 1694f700 -1 osd.4 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:16:58.531643+0000 front 2019-12-08T17:16:59.521254+0000 (oldest deadline 2019-12-08T17:17:41.979075+0000) 2019-12-08T17:17:49.682 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:17:49.680+0000 1694f700 -1 osd.3 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:16:59.531163+0000 front 2019-12-08T17:16:58.555196+0000 (oldest deadline 2019-12-08T17:17:42.625044+0000) 2019-12-08T17:17:50.076 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:17:50.070+0000 1694f700 -1 osd.6 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.149784+0000 front 2019-12-08T17:17:00.134930+0000 (oldest deadline 2019-12-08T17:17:46.017452+0000) 2019-12-08T17:17:50.330 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:17:50.326+0000 1694f700 -1 osd.7 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.061227+0000 front 2019-12-08T17:16:59.801021+0000 (oldest deadline 2019-12-08T17:17:44.381179+0000) 2019-12-08T17:17:50.402 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:17:50.397+0000 1694f700 -1 osd.5 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.948949+0000 front 2019-12-08T17:17:00.934791+0000 (oldest deadline 2019-12-08T17:17:42.003561+0000) 2019-12-08T17:17:50.404 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:17:50.402+0000 1694f700 -1 osd.0 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.452344+0000 front 2019-12-08T17:17:00.508161+0000 (oldest deadline 2019-12-08T17:17:41.529182+0000) 2019-12-08T17:17:50.473 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:17:50.472+0000 1694f700 -1 osd.1 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:16:56.737639+0000 front 2019-12-08T17:16:56.788279+0000 (oldest deadline 2019-12-08T17:17:41.420608+0000) 2019-12-08T17:17:50.596 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:17:50.590+0000 1694f700 -1 osd.4 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:16:58.531643+0000 front 2019-12-08T17:16:59.521254+0000 (oldest deadline 2019-12-08T17:17:41.979075+0000) 2019-12-08T17:17:50.654 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:17:50.652+0000 1694f700 -1 osd.3 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:16:59.531163+0000 front 2019-12-08T17:16:58.555196+0000 (oldest deadline 2019-12-08T17:17:42.625044+0000) 2019-12-08T17:17:51.049 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:17:51.042+0000 1694f700 -1 osd.6 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.149784+0000 front 2019-12-08T17:17:00.134930+0000 (oldest deadline 2019-12-08T17:17:46.017452+0000) 2019-12-08T17:17:51.293 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:17:51.287+0000 1694f700 -1 osd.7 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.061227+0000 front 2019-12-08T17:16:59.801021+0000 (oldest deadline 2019-12-08T17:17:44.381179+0000) 2019-12-08T17:17:51.414 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:17:51.411+0000 1694f700 -1 osd.0 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.452344+0000 front 2019-12-08T17:17:00.508161+0000 (oldest deadline 2019-12-08T17:17:41.529182+0000) 2019-12-08T17:17:51.448 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:17:51.444+0000 1694f700 -1 osd.5 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.948949+0000 front 2019-12-08T17:17:00.934791+0000 (oldest deadline 2019-12-08T17:17:42.003561+0000) 2019-12-08T17:17:51.454 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:17:51.452+0000 1694f700 -1 osd.1 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:16:56.737639+0000 front 2019-12-08T17:16:56.788279+0000 (oldest deadline 2019-12-08T17:17:41.420608+0000) 2019-12-08T17:17:51.582 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:17:51.575+0000 1694f700 -1 osd.4 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:16:58.531643+0000 front 2019-12-08T17:16:59.521254+0000 (oldest deadline 2019-12-08T17:17:41.979075+0000) 2019-12-08T17:17:51.685 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:17:51.684+0000 1694f700 -1 osd.3 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:16:59.531163+0000 front 2019-12-08T17:16:58.555196+0000 (oldest deadline 2019-12-08T17:17:42.625044+0000) 2019-12-08T17:17:52.013 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:17:52.008+0000 1694f700 -1 osd.6 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.149784+0000 front 2019-12-08T17:17:00.134930+0000 (oldest deadline 2019-12-08T17:17:46.017452+0000) 2019-12-08T17:17:52.254 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:17:52.249+0000 1694f700 -1 osd.7 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.061227+0000 front 2019-12-08T17:16:59.801021+0000 (oldest deadline 2019-12-08T17:17:44.381179+0000) 2019-12-08T17:17:52.447 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:17:52.444+0000 1694f700 -1 osd.0 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.452344+0000 front 2019-12-08T17:17:00.508161+0000 (oldest deadline 2019-12-08T17:17:41.529182+0000) 2019-12-08T17:17:52.488 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:17:52.486+0000 1694f700 -1 osd.1 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:16:56.737639+0000 front 2019-12-08T17:16:56.788279+0000 (oldest deadline 2019-12-08T17:17:41.420608+0000) 2019-12-08T17:17:52.497 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:17:52.488+0000 1694f700 -1 osd.5 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.948949+0000 front 2019-12-08T17:17:00.934791+0000 (oldest deadline 2019-12-08T17:17:42.003561+0000) 2019-12-08T17:17:52.575 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:17:52.561+0000 1694f700 -1 osd.4 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:16:58.531643+0000 front 2019-12-08T17:16:59.521254+0000 (oldest deadline 2019-12-08T17:17:41.979075+0000) 2019-12-08T17:17:52.738 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:17:52.735+0000 1694f700 -1 osd.3 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:16:59.531163+0000 front 2019-12-08T17:16:58.555196+0000 (oldest deadline 2019-12-08T17:17:42.625044+0000) 2019-12-08T17:17:53.045 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:17:53.039+0000 1694f700 -1 osd.6 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.149784+0000 front 2019-12-08T17:17:00.134930+0000 (oldest deadline 2019-12-08T17:17:46.017452+0000) 2019-12-08T17:17:53.266 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:17:53.261+0000 1694f700 -1 osd.7 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.061227+0000 front 2019-12-08T17:16:59.801021+0000 (oldest deadline 2019-12-08T17:17:44.381179+0000) 2019-12-08T17:17:53.468 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:17:53.465+0000 1694f700 -1 osd.0 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.452344+0000 front 2019-12-08T17:17:00.508161+0000 (oldest deadline 2019-12-08T17:17:41.529182+0000) 2019-12-08T17:17:53.530 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:17:53.525+0000 1694f700 -1 osd.5 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.948949+0000 front 2019-12-08T17:17:00.934791+0000 (oldest deadline 2019-12-08T17:17:42.003561+0000) 2019-12-08T17:17:53.540 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:17:53.537+0000 1694f700 -1 osd.1 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:16:56.737639+0000 front 2019-12-08T17:16:56.788279+0000 (oldest deadline 2019-12-08T17:17:41.420608+0000) 2019-12-08T17:17:53.588 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:17:53.581+0000 1694f700 -1 osd.4 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:16:58.531643+0000 front 2019-12-08T17:16:59.521254+0000 (oldest deadline 2019-12-08T17:17:41.979075+0000) 2019-12-08T17:17:53.723 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:17:53.721+0000 1694f700 -1 osd.3 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:16:59.531163+0000 front 2019-12-08T17:16:58.555196+0000 (oldest deadline 2019-12-08T17:17:42.625044+0000) 2019-12-08T17:17:54.013 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:17:54.009+0000 1694f700 -1 osd.6 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.149784+0000 front 2019-12-08T17:17:00.134930+0000 (oldest deadline 2019-12-08T17:17:46.017452+0000) 2019-12-08T17:17:54.250 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:17:54.244+0000 1694f700 -1 osd.7 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.061227+0000 front 2019-12-08T17:16:59.801021+0000 (oldest deadline 2019-12-08T17:17:44.381179+0000) 2019-12-08T17:17:54.485 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:17:54.481+0000 1694f700 -1 osd.0 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.452344+0000 front 2019-12-08T17:17:00.508161+0000 (oldest deadline 2019-12-08T17:17:41.529182+0000) 2019-12-08T17:17:54.532 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:17:54.528+0000 1694f700 -1 osd.1 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:16:56.737639+0000 front 2019-12-08T17:16:56.788279+0000 (oldest deadline 2019-12-08T17:17:41.420608+0000) 2019-12-08T17:17:54.533 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:17:54.528+0000 1694f700 -1 osd.5 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.948949+0000 front 2019-12-08T17:17:00.934791+0000 (oldest deadline 2019-12-08T17:17:42.003561+0000) 2019-12-08T17:17:54.620 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:17:54.616+0000 1694f700 -1 osd.4 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:16:58.531643+0000 front 2019-12-08T17:16:59.521254+0000 (oldest deadline 2019-12-08T17:17:41.979075+0000) 2019-12-08T17:17:54.741 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:17:54.739+0000 1694f700 -1 osd.3 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:16:59.531163+0000 front 2019-12-08T17:16:58.555196+0000 (oldest deadline 2019-12-08T17:17:42.625044+0000) 2019-12-08T17:17:55.058 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:17:55.053+0000 1694f700 -1 osd.6 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.149784+0000 front 2019-12-08T17:17:00.134930+0000 (oldest deadline 2019-12-08T17:17:46.017452+0000) 2019-12-08T17:17:55.248 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:17:55.243+0000 1694f700 -1 osd.7 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.061227+0000 front 2019-12-08T17:16:59.801021+0000 (oldest deadline 2019-12-08T17:17:44.381179+0000) 2019-12-08T17:17:55.520 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:17:55.518+0000 1694f700 -1 osd.0 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.452344+0000 front 2019-12-08T17:17:00.508161+0000 (oldest deadline 2019-12-08T17:17:41.529182+0000) 2019-12-08T17:17:55.523 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:17:55.518+0000 1694f700 -1 osd.5 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.948949+0000 front 2019-12-08T17:17:00.934791+0000 (oldest deadline 2019-12-08T17:17:42.003561+0000) 2019-12-08T17:17:55.576 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:17:55.573+0000 1694f700 -1 osd.1 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:16:56.737639+0000 front 2019-12-08T17:16:56.788279+0000 (oldest deadline 2019-12-08T17:17:41.420608+0000) 2019-12-08T17:17:55.671 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:17:55.665+0000 1694f700 -1 osd.4 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:16:58.531643+0000 front 2019-12-08T17:16:59.521254+0000 (oldest deadline 2019-12-08T17:17:41.979075+0000) 2019-12-08T17:17:55.727 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:17:55.725+0000 1694f700 -1 osd.3 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:16:59.531163+0000 front 2019-12-08T17:16:58.555196+0000 (oldest deadline 2019-12-08T17:17:42.625044+0000) 2019-12-08T17:17:56.065 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:17:56.060+0000 1694f700 -1 osd.6 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.149784+0000 front 2019-12-08T17:17:00.134930+0000 (oldest deadline 2019-12-08T17:17:46.017452+0000) 2019-12-08T17:17:56.253 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:17:56.247+0000 1694f700 -1 osd.7 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.061227+0000 front 2019-12-08T17:16:59.801021+0000 (oldest deadline 2019-12-08T17:17:44.381179+0000) 2019-12-08T17:17:56.498 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:17:56.492+0000 1694f700 -1 osd.5 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.948949+0000 front 2019-12-08T17:17:00.934791+0000 (oldest deadline 2019-12-08T17:17:42.003561+0000) 2019-12-08T17:17:56.538 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:17:56.534+0000 1694f700 -1 osd.0 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.452344+0000 front 2019-12-08T17:17:00.508161+0000 (oldest deadline 2019-12-08T17:17:41.529182+0000) 2019-12-08T17:17:56.584 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:17:56.582+0000 1694f700 -1 osd.1 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:16:56.737639+0000 front 2019-12-08T17:16:56.788279+0000 (oldest deadline 2019-12-08T17:17:41.420608+0000) 2019-12-08T17:17:56.721 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:17:56.719+0000 1694f700 -1 osd.3 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:16:59.531163+0000 front 2019-12-08T17:16:58.555196+0000 (oldest deadline 2019-12-08T17:17:42.625044+0000) 2019-12-08T17:17:56.722 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:17:56.713+0000 1694f700 -1 osd.4 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:16:58.531643+0000 front 2019-12-08T17:16:59.521254+0000 (oldest deadline 2019-12-08T17:17:41.979075+0000) 2019-12-08T17:17:57.038 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:17:57.032+0000 1694f700 -1 osd.6 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.149784+0000 front 2019-12-08T17:17:00.134930+0000 (oldest deadline 2019-12-08T17:17:46.017452+0000) 2019-12-08T17:17:57.301 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:17:57.296+0000 1694f700 -1 osd.7 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.061227+0000 front 2019-12-08T17:16:59.801021+0000 (oldest deadline 2019-12-08T17:17:44.381179+0000) 2019-12-08T17:17:57.486 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:17:57.481+0000 1694f700 -1 osd.5 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.948949+0000 front 2019-12-08T17:17:00.934791+0000 (oldest deadline 2019-12-08T17:17:42.003561+0000) 2019-12-08T17:17:57.520 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:17:57.519+0000 1694f700 -1 osd.0 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.452344+0000 front 2019-12-08T17:17:00.508161+0000 (oldest deadline 2019-12-08T17:17:41.529182+0000) 2019-12-08T17:17:57.600 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:17:57.599+0000 1694f700 -1 osd.1 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:16:56.737639+0000 front 2019-12-08T17:16:56.788279+0000 (oldest deadline 2019-12-08T17:17:41.420608+0000) 2019-12-08T17:17:57.721 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:17:57.716+0000 1694f700 -1 osd.4 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:16:58.531643+0000 front 2019-12-08T17:16:59.521254+0000 (oldest deadline 2019-12-08T17:17:41.979075+0000) 2019-12-08T17:17:57.769 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:17:57.766+0000 1694f700 -1 osd.3 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:16:59.531163+0000 front 2019-12-08T17:16:58.555196+0000 (oldest deadline 2019-12-08T17:17:42.625044+0000) 2019-12-08T17:17:58.059 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:17:58.052+0000 1694f700 -1 osd.6 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.149784+0000 front 2019-12-08T17:17:00.134930+0000 (oldest deadline 2019-12-08T17:17:46.017452+0000) 2019-12-08T17:17:58.290 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:17:58.284+0000 1694f700 -1 osd.7 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.061227+0000 front 2019-12-08T17:16:59.801021+0000 (oldest deadline 2019-12-08T17:17:44.381179+0000) 2019-12-08T17:17:58.507 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:17:58.503+0000 1694f700 -1 osd.5 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.948949+0000 front 2019-12-08T17:17:00.934791+0000 (oldest deadline 2019-12-08T17:17:42.003561+0000) 2019-12-08T17:17:58.555 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:17:58.553+0000 1694f700 -1 osd.0 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.452344+0000 front 2019-12-08T17:17:00.508161+0000 (oldest deadline 2019-12-08T17:17:41.529182+0000) 2019-12-08T17:17:58.618 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:17:58.616+0000 1694f700 -1 osd.1 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:16:56.737639+0000 front 2019-12-08T17:16:56.788279+0000 (oldest deadline 2019-12-08T17:17:41.420608+0000) 2019-12-08T17:17:58.719 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:17:58.708+0000 1694f700 -1 osd.4 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:16:58.531643+0000 front 2019-12-08T17:16:59.521254+0000 (oldest deadline 2019-12-08T17:17:41.979075+0000) 2019-12-08T17:17:58.747 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:17:58.746+0000 1694f700 -1 osd.3 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:16:59.531163+0000 front 2019-12-08T17:16:58.555196+0000 (oldest deadline 2019-12-08T17:17:42.625044+0000) 2019-12-08T17:17:59.039 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:17:59.030+0000 1694f700 -1 osd.6 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.149784+0000 front 2019-12-08T17:17:00.134930+0000 (oldest deadline 2019-12-08T17:17:46.017452+0000) 2019-12-08T17:17:59.250 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:17:59.244+0000 1694f700 -1 osd.7 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.061227+0000 front 2019-12-08T17:16:59.801021+0000 (oldest deadline 2019-12-08T17:17:44.381179+0000) 2019-12-08T17:17:59.516 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:17:59.513+0000 1694f700 -1 osd.0 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.452344+0000 front 2019-12-08T17:17:00.508161+0000 (oldest deadline 2019-12-08T17:17:41.529182+0000) 2019-12-08T17:17:59.541 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:17:59.536+0000 1694f700 -1 osd.5 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.948949+0000 front 2019-12-08T17:17:00.934791+0000 (oldest deadline 2019-12-08T17:17:42.003561+0000) 2019-12-08T17:17:59.664 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:17:59.663+0000 1694f700 -1 osd.1 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:16:56.737639+0000 front 2019-12-08T17:16:56.788279+0000 (oldest deadline 2019-12-08T17:17:41.420608+0000) 2019-12-08T17:17:59.731 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:17:59.730+0000 1694f700 -1 osd.3 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:16:59.531163+0000 front 2019-12-08T17:16:58.555196+0000 (oldest deadline 2019-12-08T17:17:42.625044+0000) 2019-12-08T17:17:59.736 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:17:59.730+0000 1694f700 -1 osd.4 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:16:58.531643+0000 front 2019-12-08T17:16:59.521254+0000 (oldest deadline 2019-12-08T17:17:41.979075+0000) 2019-12-08T17:18:00.079 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:18:00.073+0000 1694f700 -1 osd.6 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.149784+0000 front 2019-12-08T17:17:00.134930+0000 (oldest deadline 2019-12-08T17:17:46.017452+0000) 2019-12-08T17:18:00.220 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:18:00.214+0000 1694f700 -1 osd.7 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.061227+0000 front 2019-12-08T17:16:59.801021+0000 (oldest deadline 2019-12-08T17:17:44.381179+0000) 2019-12-08T17:18:00.509 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:18:00.502+0000 1694f700 -1 osd.5 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.948949+0000 front 2019-12-08T17:17:00.934791+0000 (oldest deadline 2019-12-08T17:17:42.003561+0000) 2019-12-08T17:18:00.513 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:18:00.510+0000 1694f700 -1 osd.0 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.452344+0000 front 2019-12-08T17:17:00.508161+0000 (oldest deadline 2019-12-08T17:17:41.529182+0000) 2019-12-08T17:18:00.683 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:18:00.681+0000 1694f700 -1 osd.1 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:16:56.737639+0000 front 2019-12-08T17:16:56.788279+0000 (oldest deadline 2019-12-08T17:17:41.420608+0000) 2019-12-08T17:18:00.719 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:18:00.715+0000 1694f700 -1 osd.3 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:16:59.531163+0000 front 2019-12-08T17:16:58.555196+0000 (oldest deadline 2019-12-08T17:17:42.625044+0000) 2019-12-08T17:18:00.726 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:18:00.720+0000 1694f700 -1 osd.4 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:16:58.531643+0000 front 2019-12-08T17:16:59.521254+0000 (oldest deadline 2019-12-08T17:17:41.979075+0000) 2019-12-08T17:18:01.037 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:18:01.031+0000 1694f700 -1 osd.6 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.149784+0000 front 2019-12-08T17:17:00.134930+0000 (oldest deadline 2019-12-08T17:17:46.017452+0000) 2019-12-08T17:18:01.244 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:18:01.238+0000 1694f700 -1 osd.7 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.061227+0000 front 2019-12-08T17:16:59.801021+0000 (oldest deadline 2019-12-08T17:17:44.381179+0000) 2019-12-08T17:18:01.498 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:18:01.495+0000 1694f700 -1 osd.0 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.452344+0000 front 2019-12-08T17:17:00.508161+0000 (oldest deadline 2019-12-08T17:17:41.529182+0000) 2019-12-08T17:18:01.529 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:18:01.523+0000 1694f700 -1 osd.5 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.948949+0000 front 2019-12-08T17:17:00.934791+0000 (oldest deadline 2019-12-08T17:17:42.003561+0000) 2019-12-08T17:18:01.657 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:18:01.655+0000 1694f700 -1 osd.1 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:16:56.737639+0000 front 2019-12-08T17:16:56.788279+0000 (oldest deadline 2019-12-08T17:17:41.420608+0000) 2019-12-08T17:18:01.693 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:18:01.691+0000 1694f700 -1 osd.3 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:16:59.531163+0000 front 2019-12-08T17:16:58.555196+0000 (oldest deadline 2019-12-08T17:17:42.625044+0000) 2019-12-08T17:18:01.760 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:18:01.754+0000 1694f700 -1 osd.4 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:16:58.531643+0000 front 2019-12-08T17:16:59.521254+0000 (oldest deadline 2019-12-08T17:17:41.979075+0000) 2019-12-08T17:18:02.076 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:18:02.069+0000 1694f700 -1 osd.6 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.149784+0000 front 2019-12-08T17:17:00.134930+0000 (oldest deadline 2019-12-08T17:17:46.017452+0000) 2019-12-08T17:18:02.250 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:18:02.245+0000 1694f700 -1 osd.7 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.061227+0000 front 2019-12-08T17:16:59.801021+0000 (oldest deadline 2019-12-08T17:17:44.381179+0000) 2019-12-08T17:18:02.485 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:18:02.483+0000 1694f700 -1 osd.0 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.452344+0000 front 2019-12-08T17:17:00.508161+0000 (oldest deadline 2019-12-08T17:17:41.529182+0000) 2019-12-08T17:18:02.503 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:18:02.498+0000 1694f700 -1 osd.5 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.948949+0000 front 2019-12-08T17:17:00.934791+0000 (oldest deadline 2019-12-08T17:17:42.003561+0000) 2019-12-08T17:18:02.630 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:18:02.627+0000 1694f700 -1 osd.1 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:16:56.737639+0000 front 2019-12-08T17:16:56.788279+0000 (oldest deadline 2019-12-08T17:17:41.420608+0000) 2019-12-08T17:18:02.712 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:18:02.710+0000 1694f700 -1 osd.3 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:16:59.531163+0000 front 2019-12-08T17:16:58.555196+0000 (oldest deadline 2019-12-08T17:17:42.625044+0000) 2019-12-08T17:18:02.810 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:18:02.804+0000 1694f700 -1 osd.4 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:16:58.531643+0000 front 2019-12-08T17:16:59.521254+0000 (oldest deadline 2019-12-08T17:17:41.979075+0000) 2019-12-08T17:18:03.128 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:18:03.122+0000 1694f700 -1 osd.6 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.149784+0000 front 2019-12-08T17:17:00.134930+0000 (oldest deadline 2019-12-08T17:17:46.017452+0000) 2019-12-08T17:18:03.248 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:18:03.242+0000 1694f700 -1 osd.7 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.061227+0000 front 2019-12-08T17:16:59.801021+0000 (oldest deadline 2019-12-08T17:17:44.381179+0000) 2019-12-08T17:18:03.490 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:18:03.486+0000 1694f700 -1 osd.0 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.452344+0000 front 2019-12-08T17:17:00.508161+0000 (oldest deadline 2019-12-08T17:17:41.529182+0000) 2019-12-08T17:18:03.508 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:18:03.503+0000 1694f700 -1 osd.5 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.948949+0000 front 2019-12-08T17:17:00.934791+0000 (oldest deadline 2019-12-08T17:17:42.003561+0000) 2019-12-08T17:18:03.597 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:18:03.592+0000 1694f700 -1 osd.1 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:16:56.737639+0000 front 2019-12-08T17:16:56.788279+0000 (oldest deadline 2019-12-08T17:17:41.420608+0000) 2019-12-08T17:18:03.696 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:18:03.694+0000 1694f700 -1 osd.3 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:16:59.531163+0000 front 2019-12-08T17:16:58.555196+0000 (oldest deadline 2019-12-08T17:17:42.625044+0000) 2019-12-08T17:18:03.864 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:18:03.859+0000 1694f700 -1 osd.4 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:16:58.531643+0000 front 2019-12-08T17:16:59.521254+0000 (oldest deadline 2019-12-08T17:17:41.979075+0000) 2019-12-08T17:18:04.151 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:18:04.146+0000 1694f700 -1 osd.6 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.149784+0000 front 2019-12-08T17:17:00.134930+0000 (oldest deadline 2019-12-08T17:17:46.017452+0000) 2019-12-08T17:18:04.290 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:18:04.285+0000 1694f700 -1 osd.7 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.061227+0000 front 2019-12-08T17:16:59.801021+0000 (oldest deadline 2019-12-08T17:17:44.381179+0000) 2019-12-08T17:18:04.481 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:18:04.480+0000 1694f700 -1 osd.0 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.452344+0000 front 2019-12-08T17:17:00.508161+0000 (oldest deadline 2019-12-08T17:17:41.529182+0000) 2019-12-08T17:18:04.516 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:18:04.510+0000 1694f700 -1 osd.5 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.948949+0000 front 2019-12-08T17:17:00.934791+0000 (oldest deadline 2019-12-08T17:17:42.003561+0000) 2019-12-08T17:18:04.640 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:18:04.638+0000 1694f700 -1 osd.1 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:16:56.737639+0000 front 2019-12-08T17:16:56.788279+0000 (oldest deadline 2019-12-08T17:17:41.420608+0000) 2019-12-08T17:18:04.656 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:18:04.655+0000 1694f700 -1 osd.3 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:16:59.531163+0000 front 2019-12-08T17:16:58.555196+0000 (oldest deadline 2019-12-08T17:17:42.625044+0000) 2019-12-08T17:18:04.873 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:18:04.866+0000 1694f700 -1 osd.4 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:16:58.531643+0000 front 2019-12-08T17:16:59.521254+0000 (oldest deadline 2019-12-08T17:17:41.979075+0000) 2019-12-08T17:18:05.204 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:18:05.198+0000 1694f700 -1 osd.6 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.149784+0000 front 2019-12-08T17:17:00.134930+0000 (oldest deadline 2019-12-08T17:17:46.017452+0000) 2019-12-08T17:18:05.337 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:18:05.330+0000 1694f700 -1 osd.7 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.061227+0000 front 2019-12-08T17:16:59.801021+0000 (oldest deadline 2019-12-08T17:17:44.381179+0000) 2019-12-08T17:18:05.466 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:18:05.465+0000 1694f700 -1 osd.0 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.452344+0000 front 2019-12-08T17:17:00.508161+0000 (oldest deadline 2019-12-08T17:17:41.529182+0000) 2019-12-08T17:18:05.550 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:18:05.544+0000 1694f700 -1 osd.5 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.948949+0000 front 2019-12-08T17:17:00.934791+0000 (oldest deadline 2019-12-08T17:17:42.003561+0000) 2019-12-08T17:18:05.640 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:18:05.638+0000 1694f700 -1 osd.3 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:16:59.531163+0000 front 2019-12-08T17:16:58.555196+0000 (oldest deadline 2019-12-08T17:17:42.625044+0000) 2019-12-08T17:18:05.664 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:18:05.663+0000 1694f700 -1 osd.1 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:16:56.737639+0000 front 2019-12-08T17:16:56.788279+0000 (oldest deadline 2019-12-08T17:17:41.420608+0000) 2019-12-08T17:18:05.927 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:18:05.921+0000 1694f700 -1 osd.4 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:16:58.531643+0000 front 2019-12-08T17:16:59.521254+0000 (oldest deadline 2019-12-08T17:17:41.979075+0000) 2019-12-08T17:18:06.225 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:18:06.215+0000 1694f700 -1 osd.6 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.149784+0000 front 2019-12-08T17:17:00.134930+0000 (oldest deadline 2019-12-08T17:17:46.017452+0000) 2019-12-08T17:18:06.356 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:18:06.351+0000 1694f700 -1 osd.7 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.061227+0000 front 2019-12-08T17:16:59.801021+0000 (oldest deadline 2019-12-08T17:17:44.381179+0000) 2019-12-08T17:18:06.438 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:18:06.436+0000 1694f700 -1 osd.0 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.452344+0000 front 2019-12-08T17:17:00.508161+0000 (oldest deadline 2019-12-08T17:17:41.529182+0000) 2019-12-08T17:18:06.545 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:18:06.539+0000 1694f700 -1 osd.5 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.948949+0000 front 2019-12-08T17:17:00.934791+0000 (oldest deadline 2019-12-08T17:17:42.003561+0000) 2019-12-08T17:18:06.634 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:18:06.632+0000 1694f700 -1 osd.1 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:16:56.737639+0000 front 2019-12-08T17:16:56.788279+0000 (oldest deadline 2019-12-08T17:17:41.420608+0000) 2019-12-08T17:18:06.692 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:18:06.691+0000 1694f700 -1 osd.3 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:16:59.531163+0000 front 2019-12-08T17:16:58.555196+0000 (oldest deadline 2019-12-08T17:17:42.625044+0000) 2019-12-08T17:18:06.953 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:18:06.947+0000 1694f700 -1 osd.4 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:16:58.531643+0000 front 2019-12-08T17:16:59.521254+0000 (oldest deadline 2019-12-08T17:17:41.979075+0000) 2019-12-08T17:18:07.233 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:18:07.226+0000 1694f700 -1 osd.6 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.149784+0000 front 2019-12-08T17:17:00.134930+0000 (oldest deadline 2019-12-08T17:17:46.017452+0000) 2019-12-08T17:18:07.333 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:18:07.328+0000 1694f700 -1 osd.7 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.061227+0000 front 2019-12-08T17:16:59.801021+0000 (oldest deadline 2019-12-08T17:17:44.381179+0000) 2019-12-08T17:18:07.463 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:18:07.462+0000 1694f700 -1 osd.0 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.452344+0000 front 2019-12-08T17:17:00.508161+0000 (oldest deadline 2019-12-08T17:17:41.529182+0000) 2019-12-08T17:18:07.518 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:18:07.512+0000 1694f700 -1 osd.5 172 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:17:00.948949+0000 front 2019-12-08T17:17:00.934791+0000 (oldest deadline 2019-12-08T17:17:42.003561+0000) 2019-12-08T17:18:59.996 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:18:59.993+0000 1694f700 -1 osd.4 178 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:102753 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-12-08T17:19:00.985 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:19:00.981+0000 1694f700 -1 osd.4 178 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4449.0:102753 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-12-08T17:19:01.972 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:19:01.969+0000 1694f700 -1 osd.4 178 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4449.0:102753 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-12-08T17:19:02.968 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:19:02.965+0000 1694f700 -1 osd.4 178 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4449.0:102753 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-12-08T17:19:03.987 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:19:03.983+0000 1694f700 -1 osd.4 178 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4449.0:102753 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-12-08T17:19:04.969 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:19:04.966+0000 1694f700 -1 osd.4 178 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4449.0:102753 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-12-08T17:19:05.972 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:19:05.969+0000 1694f700 -1 osd.4 178 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4449.0:102753 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-12-08T17:19:06.990 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:19:06.987+0000 1694f700 -1 osd.4 178 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4449.0:102753 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-12-08T17:19:08.046 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:19:08.042+0000 1694f700 -1 osd.4 178 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4449.0:102753 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-12-08T17:19:09.049 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:19:09.042+0000 1694f700 -1 osd.4 178 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4449.0:102753 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-12-08T17:19:10.079 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:19:10.075+0000 1694f700 -1 osd.4 178 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4449.0:102753 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-12-08T17:19:11.115 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:19:11.111+0000 1694f700 -1 osd.4 178 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4449.0:102753 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-12-08T17:19:12.121 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:19:12.117+0000 1694f700 -1 osd.4 178 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4449.0:102753 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-12-08T17:19:13.085 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:19:13.082+0000 1694f700 -1 osd.4 178 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4449.0:102753 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-12-08T17:19:14.063 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:19:14.060+0000 1694f700 -1 osd.4 178 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4449.0:102753 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-12-08T17:19:15.039 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:19:15.035+0000 1694f700 -1 osd.4 178 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4449.0:102753 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-12-08T17:19:16.008 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:19:16.003+0000 1694f700 -1 osd.4 178 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4449.0:102753 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-12-08T17:19:16.968 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:19:16.963+0000 1694f700 -1 osd.4 178 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4449.0:102753 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-12-08T17:19:17.940 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:19:17.936+0000 1694f700 -1 osd.4 178 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4449.0:102753 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-12-08T17:19:18.965 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:19:18.960+0000 1694f700 -1 osd.4 178 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4449.0:102753 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-12-08T17:19:20.014 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:19:20.007+0000 1694f700 -1 osd.4 178 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4449.0:102753 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-12-08T17:19:20.967 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:19:20.963+0000 1694f700 -1 osd.4 178 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4449.0:102753 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-12-08T17:19:21.945 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:19:21.940+0000 1694f700 -1 osd.4 178 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4449.0:102753 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-12-08T17:19:22.995 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:19:22.990+0000 1694f700 -1 osd.4 178 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4449.0:102753 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-12-08T17:19:24.010 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:19:24.005+0000 1694f700 -1 osd.4 178 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4449.0:102753 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-12-08T17:19:25.030 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:19:25.026+0000 1694f700 -1 osd.4 178 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4449.0:102753 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-12-08T17:19:26.010 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:19:26.005+0000 1694f700 -1 osd.4 178 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4449.0:102753 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-12-08T17:19:27.000 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:19:26.992+0000 1694f700 -1 osd.4 178 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4449.0:102753 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-12-08T17:19:27.979 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:19:27.975+0000 1694f700 -1 osd.4 178 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4449.0:102753 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-12-08T17:19:29.033 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:19:29.028+0000 1694f700 -1 osd.4 178 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4449.0:102753 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-12-08T17:19:29.985 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:19:29.980+0000 1694f700 -1 osd.2 178 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-12-08T17:19:30.055 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:19:30.051+0000 1694f700 -1 osd.4 178 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4449.0:102753 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-12-08T17:19:30.936 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:19:30.935+0000 1694f700 -1 osd.2 178 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-12-08T17:19:31.047 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:19:31.042+0000 1694f700 -1 osd.4 178 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4449.0:102753 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-12-08T17:19:31.961 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:19:31.959+0000 1694f700 -1 osd.2 178 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-12-08T17:19:32.049 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:19:32.045+0000 1694f700 -1 osd.4 178 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4449.0:102753 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-12-08T17:19:32.968 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:19:32.965+0000 1694f700 -1 osd.2 178 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-12-08T17:19:33.090 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:19:33.085+0000 1694f700 -1 osd.4 178 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4449.0:102753 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-12-08T17:19:34.008 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:19:34.005+0000 1694f700 -1 osd.2 178 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-12-08T17:19:34.080 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:19:34.076+0000 1694f700 -1 osd.4 178 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4449.0:102753 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-12-08T17:19:34.980 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:19:34.978+0000 1694f700 -1 osd.2 178 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-12-08T17:19:35.060 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:19:35.055+0000 1694f700 -1 osd.4 178 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4449.0:102753 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-12-08T17:19:35.994 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:19:35.994+0000 1694f700 -1 osd.2 178 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-12-08T17:19:36.077 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:19:36.072+0000 1694f700 -1 osd.4 178 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4449.0:102753 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-12-08T17:19:36.985 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:19:36.984+0000 1694f700 -1 osd.2 178 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-12-08T17:19:37.116 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:19:37.112+0000 1694f700 -1 osd.4 178 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4449.0:102753 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-12-08T17:19:38.012 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:19:38.011+0000 1694f700 -1 osd.2 178 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-12-08T17:19:38.168 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:19:38.159+0000 1694f700 -1 osd.4 178 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4449.0:102753 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-12-08T17:19:39.034 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:19:39.033+0000 1694f700 -1 osd.2 178 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-12-08T17:19:39.216 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:19:39.211+0000 1694f700 -1 osd.4 178 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4449.0:102753 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-12-08T17:19:40.060 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:19:40.058+0000 1694f700 -1 osd.2 178 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-12-08T17:19:40.218 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:19:40.213+0000 1694f700 -1 osd.4 178 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4449.0:102753 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-12-08T17:19:41.072 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:19:41.070+0000 1694f700 -1 osd.2 178 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-12-08T17:19:41.174 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:19:41.169+0000 1694f700 -1 osd.4 178 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4449.0:102753 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-12-08T17:19:42.100 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:19:42.100+0000 1694f700 -1 osd.2 178 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-12-08T17:19:42.214 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:19:42.210+0000 1694f700 -1 osd.4 178 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4449.0:102753 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-12-08T17:19:43.107 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:19:43.107+0000 1694f700 -1 osd.2 178 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-12-08T17:19:43.186 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:19:43.182+0000 1694f700 -1 osd.4 178 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4449.0:102753 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-12-08T17:19:44.095 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:19:44.094+0000 1694f700 -1 osd.2 178 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-12-08T17:19:44.186 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:19:44.182+0000 1694f700 -1 osd.4 178 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4449.0:102753 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-12-08T17:19:45.141 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:19:45.139+0000 1694f700 -1 osd.2 178 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-12-08T17:19:45.147 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:19:45.143+0000 1694f700 -1 osd.4 178 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4449.0:102753 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-12-08T17:19:46.142 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:19:46.142+0000 1694f700 -1 osd.2 178 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-12-08T17:19:46.156 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:19:46.151+0000 1694f700 -1 osd.4 178 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4449.0:102753 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-12-08T17:19:47.109 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:19:47.107+0000 1694f700 -1 osd.2 178 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-12-08T17:19:47.134 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:19:47.130+0000 1694f700 -1 osd.4 178 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4449.0:102753 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-12-08T17:19:48.143 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:19:48.136+0000 1694f700 -1 osd.4 178 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4449.0:102753 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-12-08T17:19:48.150 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:19:48.149+0000 1694f700 -1 osd.2 178 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-12-08T17:19:49.160 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:19:49.157+0000 1694f700 -1 osd.4 178 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4449.0:102753 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-12-08T17:19:49.178 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:19:49.178+0000 1694f700 -1 osd.2 178 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-12-08T17:19:49.941 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:19:49.936+0000 1694f700 -1 osd.5 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:06.002138+0000 front 2019-12-08T17:19:06.008519+0000 (oldest deadline 2019-12-08T17:19:49.645733+0000) 2019-12-08T17:19:50.183 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:19:50.177+0000 1694f700 -1 osd.4 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:09.330627+0000 front 2019-12-08T17:19:09.332338+0000 (oldest deadline 2019-12-08T17:19:50.126517+0000) 2019-12-08T17:19:50.184 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:19:50.181+0000 1694f700 -1 osd.4 178 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4449.0:102753 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-12-08T17:19:50.191 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:19:50.190+0000 1694f700 -1 osd.2 178 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-12-08T17:19:50.915 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:19:50.909+0000 1694f700 -1 osd.5 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:06.002138+0000 front 2019-12-08T17:19:06.008519+0000 (oldest deadline 2019-12-08T17:19:49.645733+0000) 2019-12-08T17:19:51.101 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:19:51.098+0000 1694f700 -1 osd.0 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:07.749231+0000 front 2019-12-08T17:19:08.281067+0000 (oldest deadline 2019-12-08T17:19:51.038952+0000) 2019-12-08T17:19:51.151 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:19:51.145+0000 1694f700 -1 osd.4 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:09.330627+0000 front 2019-12-08T17:19:09.332338+0000 (oldest deadline 2019-12-08T17:19:50.126517+0000) 2019-12-08T17:19:51.152 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:19:51.148+0000 1694f700 -1 osd.4 178 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4449.0:102753 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-12-08T17:19:51.210 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:19:51.209+0000 1694f700 -1 osd.2 178 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-12-08T17:19:51.899 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:19:51.893+0000 1694f700 -1 osd.5 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:06.002138+0000 front 2019-12-08T17:19:06.008519+0000 (oldest deadline 2019-12-08T17:19:49.645733+0000) 2019-12-08T17:19:52.061 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:19:52.059+0000 1694f700 -1 osd.0 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:07.749231+0000 front 2019-12-08T17:19:08.281067+0000 (oldest deadline 2019-12-08T17:19:51.038952+0000) 2019-12-08T17:19:52.184 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:19:52.178+0000 1694f700 -1 osd.4 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:09.330627+0000 front 2019-12-08T17:19:09.332338+0000 (oldest deadline 2019-12-08T17:19:50.126517+0000) 2019-12-08T17:19:52.185 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:19:52.181+0000 1694f700 -1 osd.4 178 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4449.0:102753 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-12-08T17:19:52.238 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:19:52.238+0000 1694f700 -1 osd.2 178 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-12-08T17:19:52.859 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:19:52.854+0000 1694f700 -1 osd.5 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:06.002138+0000 front 2019-12-08T17:19:06.008519+0000 (oldest deadline 2019-12-08T17:19:49.645733+0000) 2019-12-08T17:19:52.950 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:19:52.950+0000 1694f700 -1 osd.3 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:08.278004+0000 front 2019-12-08T17:19:07.848150+0000 (oldest deadline 2019-12-08T17:19:52.281086+0000) 2019-12-08T17:19:53.088 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:19:53.086+0000 1694f700 -1 osd.0 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:07.749231+0000 front 2019-12-08T17:19:08.281067+0000 (oldest deadline 2019-12-08T17:19:51.038952+0000) 2019-12-08T17:19:53.205 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:19:53.200+0000 1694f700 -1 osd.4 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:09.330627+0000 front 2019-12-08T17:19:09.332338+0000 (oldest deadline 2019-12-08T17:19:50.126517+0000) 2019-12-08T17:19:53.206 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:19:53.203+0000 1694f700 -1 osd.4 178 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4449.0:102753 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-12-08T17:19:53.294 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:19:53.284+0000 1694f700 -1 osd.2 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:08.718627+0000 front 2019-12-08T17:19:09.047557+0000 (oldest deadline 2019-12-08T17:19:52.800690+0000) 2019-12-08T17:19:53.295 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:19:53.294+0000 1694f700 -1 osd.2 178 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-12-08T17:19:53.900 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:19:53.895+0000 1694f700 -1 osd.5 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:06.002138+0000 front 2019-12-08T17:19:06.008519+0000 (oldest deadline 2019-12-08T17:19:49.645733+0000) 2019-12-08T17:19:53.977 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:19:53.976+0000 1694f700 -1 osd.3 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:08.278004+0000 front 2019-12-08T17:19:07.848150+0000 (oldest deadline 2019-12-08T17:19:52.281086+0000) 2019-12-08T17:19:54.043 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:19:54.042+0000 1694f700 -1 osd.0 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:07.749231+0000 front 2019-12-08T17:19:08.281067+0000 (oldest deadline 2019-12-08T17:19:51.038952+0000) 2019-12-08T17:19:54.211 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:19:54.205+0000 1694f700 -1 osd.4 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:09.330627+0000 front 2019-12-08T17:19:09.332338+0000 (oldest deadline 2019-12-08T17:19:50.126517+0000) 2019-12-08T17:19:54.212 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:19:54.208+0000 1694f700 -1 osd.4 178 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4449.0:102753 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-12-08T17:19:54.305 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:19:54.302+0000 1694f700 -1 osd.2 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:08.718627+0000 front 2019-12-08T17:19:09.047557+0000 (oldest deadline 2019-12-08T17:19:52.800690+0000) 2019-12-08T17:19:54.306 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:19:54.305+0000 1694f700 -1 osd.2 178 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-12-08T17:19:54.893 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:19:54.886+0000 1694f700 -1 osd.7 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:08.294450+0000 front 2019-12-08T17:19:08.528884+0000 (oldest deadline 2019-12-08T17:19:54.050442+0000) 2019-12-08T17:19:54.951 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:19:54.946+0000 1694f700 -1 osd.5 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:06.002138+0000 front 2019-12-08T17:19:06.008519+0000 (oldest deadline 2019-12-08T17:19:49.645733+0000) 2019-12-08T17:19:55.004 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:19:55.002+0000 1694f700 -1 osd.0 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:07.749231+0000 front 2019-12-08T17:19:08.281067+0000 (oldest deadline 2019-12-08T17:19:51.038952+0000) 2019-12-08T17:19:55.014 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:19:55.012+0000 1694f700 -1 osd.3 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:08.278004+0000 front 2019-12-08T17:19:07.848150+0000 (oldest deadline 2019-12-08T17:19:52.281086+0000) 2019-12-08T17:19:55.222 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:19:55.215+0000 1694f700 -1 osd.4 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:09.330627+0000 front 2019-12-08T17:19:09.332338+0000 (oldest deadline 2019-12-08T17:19:50.126517+0000) 2019-12-08T17:19:55.222 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:19:55.219+0000 1694f700 -1 osd.4 178 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4449.0:102753 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-12-08T17:19:55.357 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:19:55.353+0000 1694f700 -1 osd.2 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:08.718627+0000 front 2019-12-08T17:19:09.047557+0000 (oldest deadline 2019-12-08T17:19:52.800690+0000) 2019-12-08T17:19:55.358 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:19:55.356+0000 1694f700 -1 osd.2 178 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-12-08T17:19:55.937 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:19:55.932+0000 1694f700 -1 osd.7 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:08.294450+0000 front 2019-12-08T17:19:08.528884+0000 (oldest deadline 2019-12-08T17:19:54.050442+0000) 2019-12-08T17:19:55.940 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:19:55.935+0000 1694f700 -1 osd.5 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:06.002138+0000 front 2019-12-08T17:19:06.008519+0000 (oldest deadline 2019-12-08T17:19:49.645733+0000) 2019-12-08T17:19:56.020 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:19:56.017+0000 1694f700 -1 osd.3 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:08.278004+0000 front 2019-12-08T17:19:07.848150+0000 (oldest deadline 2019-12-08T17:19:52.281086+0000) 2019-12-08T17:19:56.023 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:19:56.021+0000 1694f700 -1 osd.0 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:07.749231+0000 front 2019-12-08T17:19:08.281067+0000 (oldest deadline 2019-12-08T17:19:51.038952+0000) 2019-12-08T17:19:56.228 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:19:56.222+0000 1694f700 -1 osd.4 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:09.330627+0000 front 2019-12-08T17:19:09.332338+0000 (oldest deadline 2019-12-08T17:19:50.126517+0000) 2019-12-08T17:19:56.229 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:19:56.225+0000 1694f700 -1 osd.4 178 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4449.0:102753 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-12-08T17:19:56.386 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:19:56.384+0000 1694f700 -1 osd.2 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:08.718627+0000 front 2019-12-08T17:19:09.047557+0000 (oldest deadline 2019-12-08T17:19:52.800690+0000) 2019-12-08T17:19:56.387 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:19:56.385+0000 1694f700 -1 osd.2 178 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-12-08T17:19:56.406 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:19:56.400+0000 1694f700 -1 osd.6 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:09.602959+0000 front 2019-12-08T17:19:09.624129+0000 (oldest deadline 2019-12-08T17:19:55.466324+0000) 2019-12-08T17:19:56.900 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:19:56.895+0000 1694f700 -1 osd.5 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:06.002138+0000 front 2019-12-08T17:19:06.008519+0000 (oldest deadline 2019-12-08T17:19:49.645733+0000) 2019-12-08T17:19:56.967 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:19:56.961+0000 1694f700 -1 osd.7 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:08.294450+0000 front 2019-12-08T17:19:08.528884+0000 (oldest deadline 2019-12-08T17:19:54.050442+0000) 2019-12-08T17:19:57.031 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:19:57.028+0000 1694f700 -1 osd.3 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:08.278004+0000 front 2019-12-08T17:19:07.848150+0000 (oldest deadline 2019-12-08T17:19:52.281086+0000) 2019-12-08T17:19:57.044 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:19:57.041+0000 1694f700 -1 osd.0 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:07.749231+0000 front 2019-12-08T17:19:08.281067+0000 (oldest deadline 2019-12-08T17:19:51.038952+0000) 2019-12-08T17:19:57.283 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:19:57.276+0000 1694f700 -1 osd.4 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:09.330627+0000 front 2019-12-08T17:19:09.332338+0000 (oldest deadline 2019-12-08T17:19:50.126517+0000) 2019-12-08T17:19:57.284 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:19:57.280+0000 1694f700 -1 osd.4 178 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4449.0:102753 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-12-08T17:19:57.397 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:19:57.390+0000 1694f700 -1 osd.6 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:09.602959+0000 front 2019-12-08T17:19:09.624129+0000 (oldest deadline 2019-12-08T17:19:55.466324+0000) 2019-12-08T17:19:57.452 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:19:57.433+0000 1694f700 -1 osd.2 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:08.718627+0000 front 2019-12-08T17:19:09.047557+0000 (oldest deadline 2019-12-08T17:19:52.800690+0000) 2019-12-08T17:19:57.454 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:19:57.444+0000 1694f700 -1 osd.2 178 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-12-08T17:19:57.881 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:19:57.876+0000 1694f700 -1 osd.5 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:06.002138+0000 front 2019-12-08T17:19:06.008519+0000 (oldest deadline 2019-12-08T17:19:49.645733+0000) 2019-12-08T17:19:57.996 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:19:57.991+0000 1694f700 -1 osd.7 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:08.294450+0000 front 2019-12-08T17:19:08.528884+0000 (oldest deadline 2019-12-08T17:19:54.050442+0000) 2019-12-08T17:19:58.025 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:19:58.019+0000 1694f700 -1 osd.0 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:07.749231+0000 front 2019-12-08T17:19:08.281067+0000 (oldest deadline 2019-12-08T17:19:51.038952+0000) 2019-12-08T17:19:58.065 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:19:58.063+0000 1694f700 -1 osd.3 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:08.278004+0000 front 2019-12-08T17:19:07.848150+0000 (oldest deadline 2019-12-08T17:19:52.281086+0000) 2019-12-08T17:19:58.332 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:19:58.325+0000 1694f700 -1 osd.4 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:09.330627+0000 front 2019-12-08T17:19:09.332338+0000 (oldest deadline 2019-12-08T17:19:50.126517+0000) 2019-12-08T17:19:58.340 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:19:58.328+0000 1694f700 -1 osd.4 178 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4449.0:102753 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-12-08T17:19:58.383 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:19:58.377+0000 1694f700 -1 osd.6 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:09.602959+0000 front 2019-12-08T17:19:09.624129+0000 (oldest deadline 2019-12-08T17:19:55.466324+0000) 2019-12-08T17:19:58.439 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:19:58.436+0000 1694f700 -1 osd.2 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:08.718627+0000 front 2019-12-08T17:19:09.047557+0000 (oldest deadline 2019-12-08T17:19:52.800690+0000) 2019-12-08T17:19:58.443 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:19:58.442+0000 1694f700 -1 osd.2 178 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-12-08T17:19:58.926 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:19:58.921+0000 1694f700 -1 osd.5 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:06.002138+0000 front 2019-12-08T17:19:06.008519+0000 (oldest deadline 2019-12-08T17:19:49.645733+0000) 2019-12-08T17:19:59.013 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:19:59.010+0000 1694f700 -1 osd.0 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:07.749231+0000 front 2019-12-08T17:19:08.281067+0000 (oldest deadline 2019-12-08T17:19:51.038952+0000) 2019-12-08T17:19:59.031 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:19:59.027+0000 1694f700 -1 osd.7 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:08.294450+0000 front 2019-12-08T17:19:08.528884+0000 (oldest deadline 2019-12-08T17:19:54.050442+0000) 2019-12-08T17:19:59.118 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:19:59.115+0000 1694f700 -1 osd.3 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:08.278004+0000 front 2019-12-08T17:19:07.848150+0000 (oldest deadline 2019-12-08T17:19:52.281086+0000) 2019-12-08T17:19:59.333 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:19:59.327+0000 1694f700 -1 osd.4 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:09.330627+0000 front 2019-12-08T17:19:09.332338+0000 (oldest deadline 2019-12-08T17:19:50.126517+0000) 2019-12-08T17:19:59.334 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:19:59.330+0000 1694f700 -1 osd.4 178 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4449.0:102753 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-12-08T17:19:59.393 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:19:59.388+0000 1694f700 -1 osd.6 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:09.602959+0000 front 2019-12-08T17:19:09.624129+0000 (oldest deadline 2019-12-08T17:19:55.466324+0000) 2019-12-08T17:19:59.416 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:19:59.413+0000 1694f700 -1 osd.2 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:08.718627+0000 front 2019-12-08T17:19:09.047557+0000 (oldest deadline 2019-12-08T17:19:52.800690+0000) 2019-12-08T17:19:59.419 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:19:59.418+0000 1694f700 -1 osd.2 178 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-12-08T17:19:59.927 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:19:59.921+0000 1694f700 -1 osd.5 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:06.002138+0000 front 2019-12-08T17:19:06.008519+0000 (oldest deadline 2019-12-08T17:19:49.645733+0000) 2019-12-08T17:19:59.991 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:19:59.984+0000 1694f700 -1 osd.7 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:08.294450+0000 front 2019-12-08T17:19:08.528884+0000 (oldest deadline 2019-12-08T17:19:54.050442+0000) 2019-12-08T17:20:00.020 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:20:00.017+0000 1694f700 -1 osd.0 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:07.749231+0000 front 2019-12-08T17:19:08.281067+0000 (oldest deadline 2019-12-08T17:19:51.038952+0000) 2019-12-08T17:20:00.171 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:20:00.168+0000 1694f700 -1 osd.3 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:08.278004+0000 front 2019-12-08T17:19:07.848150+0000 (oldest deadline 2019-12-08T17:19:52.281086+0000) 2019-12-08T17:20:00.300 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:20:00.295+0000 1694f700 -1 osd.4 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:09.330627+0000 front 2019-12-08T17:19:09.332338+0000 (oldest deadline 2019-12-08T17:19:50.126517+0000) 2019-12-08T17:20:00.304 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:20:00.301+0000 1694f700 -1 osd.4 178 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4449.0:102753 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-12-08T17:20:00.355 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:20:00.350+0000 1694f700 -1 osd.6 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:09.602959+0000 front 2019-12-08T17:19:09.624129+0000 (oldest deadline 2019-12-08T17:19:55.466324+0000) 2019-12-08T17:20:00.375 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:20:00.373+0000 1694f700 -1 osd.2 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:08.718627+0000 front 2019-12-08T17:19:09.047557+0000 (oldest deadline 2019-12-08T17:19:52.800690+0000) 2019-12-08T17:20:00.378 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:20:00.377+0000 1694f700 -1 osd.2 178 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-12-08T17:20:00.928 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:20:00.922+0000 1694f700 -1 osd.5 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:06.002138+0000 front 2019-12-08T17:19:06.008519+0000 (oldest deadline 2019-12-08T17:19:49.645733+0000) 2019-12-08T17:20:00.979 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:20:00.974+0000 1694f700 -1 osd.7 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:08.294450+0000 front 2019-12-08T17:19:08.528884+0000 (oldest deadline 2019-12-08T17:19:54.050442+0000) 2019-12-08T17:20:00.982 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:20:00.980+0000 1694f700 -1 osd.0 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:07.749231+0000 front 2019-12-08T17:19:08.281067+0000 (oldest deadline 2019-12-08T17:19:51.038952+0000) 2019-12-08T17:20:01.131 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:20:01.128+0000 1694f700 -1 osd.3 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:08.278004+0000 front 2019-12-08T17:19:07.848150+0000 (oldest deadline 2019-12-08T17:19:52.281086+0000) 2019-12-08T17:20:01.271 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:20:01.266+0000 1694f700 -1 osd.4 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:09.330627+0000 front 2019-12-08T17:19:09.332338+0000 (oldest deadline 2019-12-08T17:19:50.126517+0000) 2019-12-08T17:20:01.274 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:20:01.271+0000 1694f700 -1 osd.4 178 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4449.0:102753 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-12-08T17:20:01.320 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:20:01.315+0000 1694f700 -1 osd.6 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:09.602959+0000 front 2019-12-08T17:19:09.624129+0000 (oldest deadline 2019-12-08T17:19:55.466324+0000) 2019-12-08T17:20:01.341 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:20:01.338+0000 1694f700 -1 osd.2 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:08.718627+0000 front 2019-12-08T17:19:09.047557+0000 (oldest deadline 2019-12-08T17:19:52.800690+0000) 2019-12-08T17:20:01.345 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:20:01.344+0000 1694f700 -1 osd.2 178 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-12-08T17:20:01.890 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:20:01.885+0000 1694f700 -1 osd.5 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:06.002138+0000 front 2019-12-08T17:19:06.008519+0000 (oldest deadline 2019-12-08T17:19:49.645733+0000) 2019-12-08T17:20:01.986 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:20:01.982+0000 1694f700 -1 osd.7 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:08.294450+0000 front 2019-12-08T17:19:08.528884+0000 (oldest deadline 2019-12-08T17:19:54.050442+0000) 2019-12-08T17:20:02.003 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:20:02.001+0000 1694f700 -1 osd.0 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:07.749231+0000 front 2019-12-08T17:19:08.281067+0000 (oldest deadline 2019-12-08T17:19:51.038952+0000) 2019-12-08T17:20:02.179 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:20:02.176+0000 1694f700 -1 osd.3 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:08.278004+0000 front 2019-12-08T17:19:07.848150+0000 (oldest deadline 2019-12-08T17:19:52.281086+0000) 2019-12-08T17:20:02.281 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:20:02.277+0000 1694f700 -1 osd.6 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:09.602959+0000 front 2019-12-08T17:19:09.624129+0000 (oldest deadline 2019-12-08T17:19:55.466324+0000) 2019-12-08T17:20:02.293 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:20:02.288+0000 1694f700 -1 osd.4 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:09.330627+0000 front 2019-12-08T17:19:09.332338+0000 (oldest deadline 2019-12-08T17:19:50.126517+0000) 2019-12-08T17:20:02.295 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:20:02.291+0000 1694f700 -1 osd.4 178 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4449.0:102753 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-12-08T17:20:02.333 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:20:02.331+0000 1694f700 -1 osd.2 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:08.718627+0000 front 2019-12-08T17:19:09.047557+0000 (oldest deadline 2019-12-08T17:19:52.800690+0000) 2019-12-08T17:20:02.336 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:20:02.335+0000 1694f700 -1 osd.2 178 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-12-08T17:20:02.923 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:20:02.918+0000 1694f700 -1 osd.5 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:06.002138+0000 front 2019-12-08T17:19:06.008519+0000 (oldest deadline 2019-12-08T17:19:49.645733+0000) 2019-12-08T17:20:02.986 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:20:02.984+0000 1694f700 -1 osd.0 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:07.749231+0000 front 2019-12-08T17:19:08.281067+0000 (oldest deadline 2019-12-08T17:19:51.038952+0000) 2019-12-08T17:20:03.007 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:20:03.002+0000 1694f700 -1 osd.7 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:08.294450+0000 front 2019-12-08T17:19:08.528884+0000 (oldest deadline 2019-12-08T17:19:54.050442+0000) 2019-12-08T17:20:03.185 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:20:03.182+0000 1694f700 -1 osd.3 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:08.278004+0000 front 2019-12-08T17:19:07.848150+0000 (oldest deadline 2019-12-08T17:19:52.281086+0000) 2019-12-08T17:20:03.262 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:20:03.258+0000 1694f700 -1 osd.4 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:09.330627+0000 front 2019-12-08T17:19:09.332338+0000 (oldest deadline 2019-12-08T17:19:50.126517+0000) 2019-12-08T17:20:03.265 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:20:03.262+0000 1694f700 -1 osd.4 178 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4449.0:102753 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-12-08T17:20:03.339 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:20:03.333+0000 1694f700 -1 osd.6 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:09.602959+0000 front 2019-12-08T17:19:09.624129+0000 (oldest deadline 2019-12-08T17:19:55.466324+0000) 2019-12-08T17:20:03.390 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:20:03.386+0000 1694f700 -1 osd.2 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:08.718627+0000 front 2019-12-08T17:19:09.047557+0000 (oldest deadline 2019-12-08T17:19:52.800690+0000) 2019-12-08T17:20:03.392 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:20:03.389+0000 1694f700 -1 osd.2 178 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-12-08T17:20:03.903 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:20:03.898+0000 1694f700 -1 osd.5 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:06.002138+0000 front 2019-12-08T17:19:06.008519+0000 (oldest deadline 2019-12-08T17:19:49.645733+0000) 2019-12-08T17:20:03.942 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:20:03.938+0000 1694f700 -1 osd.0 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:07.749231+0000 front 2019-12-08T17:19:08.281067+0000 (oldest deadline 2019-12-08T17:19:51.038952+0000) 2019-12-08T17:20:04.045 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:20:04.040+0000 1694f700 -1 osd.7 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:08.294450+0000 front 2019-12-08T17:19:08.528884+0000 (oldest deadline 2019-12-08T17:19:54.050442+0000) 2019-12-08T17:20:04.209 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:20:04.207+0000 1694f700 -1 osd.3 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:08.278004+0000 front 2019-12-08T17:19:07.848150+0000 (oldest deadline 2019-12-08T17:19:52.281086+0000) 2019-12-08T17:20:04.269 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:20:04.265+0000 1694f700 -1 osd.4 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:09.330627+0000 front 2019-12-08T17:19:09.332338+0000 (oldest deadline 2019-12-08T17:19:50.126517+0000) 2019-12-08T17:20:04.275 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:20:04.271+0000 1694f700 -1 osd.4 178 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4449.0:102753 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-12-08T17:20:04.343 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:20:04.334+0000 1694f700 -1 osd.6 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:09.602959+0000 front 2019-12-08T17:19:09.624129+0000 (oldest deadline 2019-12-08T17:19:55.466324+0000) 2019-12-08T17:20:04.408 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:20:04.406+0000 1694f700 -1 osd.2 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:08.718627+0000 front 2019-12-08T17:19:09.047557+0000 (oldest deadline 2019-12-08T17:19:52.800690+0000) 2019-12-08T17:20:04.411 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:20:04.409+0000 1694f700 -1 osd.2 178 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-12-08T17:20:04.895 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:20:04.891+0000 1694f700 -1 osd.5 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:06.002138+0000 front 2019-12-08T17:19:06.008519+0000 (oldest deadline 2019-12-08T17:19:49.645733+0000) 2019-12-08T17:20:04.963 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:20:04.959+0000 1694f700 -1 osd.0 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:07.749231+0000 front 2019-12-08T17:19:08.281067+0000 (oldest deadline 2019-12-08T17:19:51.038952+0000) 2019-12-08T17:20:05.069 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:20:05.062+0000 1694f700 -1 osd.7 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:08.294450+0000 front 2019-12-08T17:19:08.528884+0000 (oldest deadline 2019-12-08T17:19:54.050442+0000) 2019-12-08T17:20:05.256 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:20:05.254+0000 1694f700 -1 osd.3 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:08.278004+0000 front 2019-12-08T17:19:07.848150+0000 (oldest deadline 2019-12-08T17:19:52.281086+0000) 2019-12-08T17:20:05.291 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:20:05.286+0000 1694f700 -1 osd.4 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:09.330627+0000 front 2019-12-08T17:19:09.332338+0000 (oldest deadline 2019-12-08T17:19:50.126517+0000) 2019-12-08T17:20:05.295 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:20:05.292+0000 1694f700 -1 osd.4 178 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4449.0:102753 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-12-08T17:20:05.362 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:20:05.357+0000 1694f700 -1 osd.6 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:09.602959+0000 front 2019-12-08T17:19:09.624129+0000 (oldest deadline 2019-12-08T17:19:55.466324+0000) 2019-12-08T17:20:05.418 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:20:05.414+0000 1694f700 -1 osd.2 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:08.718627+0000 front 2019-12-08T17:19:09.047557+0000 (oldest deadline 2019-12-08T17:19:52.800690+0000) 2019-12-08T17:20:05.421 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:20:05.417+0000 1694f700 -1 osd.2 178 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-12-08T17:20:05.898 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:20:05.892+0000 1694f700 -1 osd.5 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:06.002138+0000 front 2019-12-08T17:19:06.008519+0000 (oldest deadline 2019-12-08T17:19:49.645733+0000) 2019-12-08T17:20:05.989 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:20:05.986+0000 1694f700 -1 osd.0 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:07.749231+0000 front 2019-12-08T17:19:08.281067+0000 (oldest deadline 2019-12-08T17:19:51.038952+0000) 2019-12-08T17:20:06.117 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:20:06.112+0000 1694f700 -1 osd.7 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:08.294450+0000 front 2019-12-08T17:19:08.528884+0000 (oldest deadline 2019-12-08T17:19:54.050442+0000) 2019-12-08T17:20:06.222 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:20:06.221+0000 1694f700 -1 osd.3 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:08.278004+0000 front 2019-12-08T17:19:07.848150+0000 (oldest deadline 2019-12-08T17:19:52.281086+0000) 2019-12-08T17:20:06.324 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:20:06.319+0000 1694f700 -1 osd.4 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:09.330627+0000 front 2019-12-08T17:19:09.332338+0000 (oldest deadline 2019-12-08T17:19:50.126517+0000) 2019-12-08T17:20:06.329 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:20:06.325+0000 1694f700 -1 osd.4 178 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4449.0:102753 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-12-08T17:20:06.388 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:20:06.383+0000 1694f700 -1 osd.6 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:09.602959+0000 front 2019-12-08T17:19:09.624129+0000 (oldest deadline 2019-12-08T17:19:55.466324+0000) 2019-12-08T17:20:06.431 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:20:06.429+0000 1694f700 -1 osd.2 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:08.718627+0000 front 2019-12-08T17:19:09.047557+0000 (oldest deadline 2019-12-08T17:19:52.800690+0000) 2019-12-08T17:20:06.437 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:20:06.434+0000 1694f700 -1 osd.2 178 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-12-08T17:20:06.878 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:20:06.874+0000 1694f700 -1 osd.5 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:06.002138+0000 front 2019-12-08T17:19:06.008519+0000 (oldest deadline 2019-12-08T17:19:49.645733+0000) 2019-12-08T17:20:07.033 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:20:07.030+0000 1694f700 -1 osd.0 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:07.749231+0000 front 2019-12-08T17:19:08.281067+0000 (oldest deadline 2019-12-08T17:19:51.038952+0000) 2019-12-08T17:20:07.144 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:20:07.139+0000 1694f700 -1 osd.7 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:08.294450+0000 front 2019-12-08T17:19:08.528884+0000 (oldest deadline 2019-12-08T17:19:54.050442+0000) 2019-12-08T17:20:07.250 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:20:07.247+0000 1694f700 -1 osd.3 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:08.278004+0000 front 2019-12-08T17:19:07.848150+0000 (oldest deadline 2019-12-08T17:19:52.281086+0000) 2019-12-08T17:20:07.335 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:20:07.330+0000 1694f700 -1 osd.4 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:09.330627+0000 front 2019-12-08T17:19:09.332338+0000 (oldest deadline 2019-12-08T17:19:50.126517+0000) 2019-12-08T17:20:07.339 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:20:07.335+0000 1694f700 -1 osd.4 178 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4449.0:102753 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-12-08T17:20:07.413 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:20:07.408+0000 1694f700 -1 osd.6 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:09.602959+0000 front 2019-12-08T17:19:09.624129+0000 (oldest deadline 2019-12-08T17:19:55.466324+0000) 2019-12-08T17:20:07.461 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:20:07.455+0000 1694f700 -1 osd.2 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:08.718627+0000 front 2019-12-08T17:19:09.047557+0000 (oldest deadline 2019-12-08T17:19:52.800690+0000) 2019-12-08T17:20:07.461 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:20:07.458+0000 1694f700 -1 osd.2 178 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-12-08T17:20:07.873 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:20:07.867+0000 1694f700 -1 osd.5 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:06.002138+0000 front 2019-12-08T17:19:06.008519+0000 (oldest deadline 2019-12-08T17:19:49.645733+0000) 2019-12-08T17:20:08.036 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:20:08.033+0000 1694f700 -1 osd.0 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:07.749231+0000 front 2019-12-08T17:19:08.281067+0000 (oldest deadline 2019-12-08T17:19:51.038952+0000) 2019-12-08T17:20:08.155 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:20:08.150+0000 1694f700 -1 osd.7 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:08.294450+0000 front 2019-12-08T17:19:08.528884+0000 (oldest deadline 2019-12-08T17:19:54.050442+0000) 2019-12-08T17:20:08.266 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:20:08.264+0000 1694f700 -1 osd.3 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:08.278004+0000 front 2019-12-08T17:19:07.848150+0000 (oldest deadline 2019-12-08T17:19:52.281086+0000) 2019-12-08T17:20:08.375 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:20:08.370+0000 1694f700 -1 osd.4 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:09.330627+0000 front 2019-12-08T17:19:09.332338+0000 (oldest deadline 2019-12-08T17:19:50.126517+0000) 2019-12-08T17:20:08.379 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:20:08.376+0000 1694f700 -1 osd.4 178 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4449.0:102753 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-12-08T17:20:08.399 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:20:08.394+0000 1694f700 -1 osd.6 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:09.602959+0000 front 2019-12-08T17:19:09.624129+0000 (oldest deadline 2019-12-08T17:19:55.466324+0000) 2019-12-08T17:20:08.420 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:20:08.418+0000 1694f700 -1 osd.2 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:08.718627+0000 front 2019-12-08T17:19:09.047557+0000 (oldest deadline 2019-12-08T17:19:52.800690+0000) 2019-12-08T17:20:08.421 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:20:08.420+0000 1694f700 -1 osd.2 178 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-12-08T17:20:08.893 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:20:08.888+0000 1694f700 -1 osd.5 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:06.002138+0000 front 2019-12-08T17:19:06.008519+0000 (oldest deadline 2019-12-08T17:19:49.645733+0000) 2019-12-08T17:20:09.024 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:20:09.022+0000 1694f700 -1 osd.0 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:07.749231+0000 front 2019-12-08T17:19:08.281067+0000 (oldest deadline 2019-12-08T17:19:51.038952+0000) 2019-12-08T17:20:09.146 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:20:09.140+0000 1694f700 -1 osd.7 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:08.294450+0000 front 2019-12-08T17:19:08.528884+0000 (oldest deadline 2019-12-08T17:19:54.050442+0000) 2019-12-08T17:20:09.230 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:20:09.227+0000 1694f700 -1 osd.3 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:08.278004+0000 front 2019-12-08T17:19:07.848150+0000 (oldest deadline 2019-12-08T17:19:52.281086+0000) 2019-12-08T17:20:09.386 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:20:09.380+0000 1694f700 -1 osd.6 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:09.602959+0000 front 2019-12-08T17:19:09.624129+0000 (oldest deadline 2019-12-08T17:19:55.466324+0000) 2019-12-08T17:20:09.386 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:20:09.383+0000 1694f700 -1 osd.2 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:08.718627+0000 front 2019-12-08T17:19:09.047557+0000 (oldest deadline 2019-12-08T17:19:52.800690+0000) 2019-12-08T17:20:09.390 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:20:09.389+0000 1694f700 -1 osd.2 178 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-12-08T17:20:09.414 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:20:09.409+0000 1694f700 -1 osd.4 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:09.330627+0000 front 2019-12-08T17:19:09.332338+0000 (oldest deadline 2019-12-08T17:19:50.126517+0000) 2019-12-08T17:20:09.418 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:20:09.414+0000 1694f700 -1 osd.4 178 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4449.0:102753 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-12-08T17:20:09.892 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:20:09.887+0000 1694f700 -1 osd.5 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:06.002138+0000 front 2019-12-08T17:19:06.008519+0000 (oldest deadline 2019-12-08T17:19:49.645733+0000) 2019-12-08T17:20:10.035 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:20:10.032+0000 1694f700 -1 osd.0 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:07.749231+0000 front 2019-12-08T17:19:08.281067+0000 (oldest deadline 2019-12-08T17:19:51.038952+0000) 2019-12-08T17:20:10.158 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:20:10.152+0000 1694f700 -1 osd.7 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:08.294450+0000 front 2019-12-08T17:19:08.528884+0000 (oldest deadline 2019-12-08T17:19:54.050442+0000) 2019-12-08T17:20:10.236 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:20:10.234+0000 1694f700 -1 osd.3 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:08.278004+0000 front 2019-12-08T17:19:07.848150+0000 (oldest deadline 2019-12-08T17:19:52.281086+0000) 2019-12-08T17:20:10.387 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:20:10.385+0000 1694f700 -1 osd.2 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:08.718627+0000 front 2019-12-08T17:19:09.047557+0000 (oldest deadline 2019-12-08T17:19:52.800690+0000) 2019-12-08T17:20:10.390 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:20:10.389+0000 1694f700 -1 osd.2 178 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-12-08T17:20:10.435 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:20:10.430+0000 1694f700 -1 osd.6 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:09.602959+0000 front 2019-12-08T17:19:09.624129+0000 (oldest deadline 2019-12-08T17:19:55.466324+0000) 2019-12-08T17:20:10.457 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:20:10.451+0000 1694f700 -1 osd.4 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:09.330627+0000 front 2019-12-08T17:19:09.332338+0000 (oldest deadline 2019-12-08T17:19:50.126517+0000) 2019-12-08T17:20:10.458 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:20:10.454+0000 1694f700 -1 osd.4 178 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4449.0:102753 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-12-08T17:20:10.872 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:20:10.867+0000 1694f700 -1 osd.5 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:06.002138+0000 front 2019-12-08T17:19:06.008519+0000 (oldest deadline 2019-12-08T17:19:49.645733+0000) 2019-12-08T17:20:11.062 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:20:11.060+0000 1694f700 -1 osd.0 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:07.749231+0000 front 2019-12-08T17:19:08.281067+0000 (oldest deadline 2019-12-08T17:19:51.038952+0000) 2019-12-08T17:20:11.119 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:20:11.113+0000 1694f700 -1 osd.7 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:08.294450+0000 front 2019-12-08T17:19:08.528884+0000 (oldest deadline 2019-12-08T17:19:54.050442+0000) 2019-12-08T17:20:11.256 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:20:11.253+0000 1694f700 -1 osd.3 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:08.278004+0000 front 2019-12-08T17:19:07.848150+0000 (oldest deadline 2019-12-08T17:19:52.281086+0000) 2019-12-08T17:20:11.394 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:20:11.388+0000 1694f700 -1 osd.6 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:09.602959+0000 front 2019-12-08T17:19:09.624129+0000 (oldest deadline 2019-12-08T17:19:55.466324+0000) 2019-12-08T17:20:11.434 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:20:11.430+0000 1694f700 -1 osd.2 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:08.718627+0000 front 2019-12-08T17:19:09.047557+0000 (oldest deadline 2019-12-08T17:19:52.800690+0000) 2019-12-08T17:20:11.435 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:20:11.433+0000 1694f700 -1 osd.2 178 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-12-08T17:20:11.499 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:20:11.493+0000 1694f700 -1 osd.4 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:09.330627+0000 front 2019-12-08T17:19:09.332338+0000 (oldest deadline 2019-12-08T17:19:50.126517+0000) 2019-12-08T17:20:11.500 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:20:11.496+0000 1694f700 -1 osd.4 178 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4449.0:102753 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-12-08T17:20:11.850 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:20:11.845+0000 1694f700 -1 osd.5 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:06.002138+0000 front 2019-12-08T17:19:06.008519+0000 (oldest deadline 2019-12-08T17:19:49.645733+0000) 2019-12-08T17:20:12.043 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:20:12.040+0000 1694f700 -1 osd.0 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:07.749231+0000 front 2019-12-08T17:19:08.281067+0000 (oldest deadline 2019-12-08T17:19:51.038952+0000) 2019-12-08T17:20:12.144 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:20:12.138+0000 1694f700 -1 osd.7 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:08.294450+0000 front 2019-12-08T17:19:08.528884+0000 (oldest deadline 2019-12-08T17:19:54.050442+0000) 2019-12-08T17:20:12.264 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:20:12.262+0000 1694f700 -1 osd.3 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:08.278004+0000 front 2019-12-08T17:19:07.848150+0000 (oldest deadline 2019-12-08T17:19:52.281086+0000) 2019-12-08T17:20:12.391 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:20:12.388+0000 1694f700 -1 osd.2 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:08.718627+0000 front 2019-12-08T17:19:09.047557+0000 (oldest deadline 2019-12-08T17:19:52.800690+0000) 2019-12-08T17:20:12.391 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:20:12.390+0000 1694f700 -1 osd.2 178 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-12-08T17:20:12.410 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:20:12.406+0000 1694f700 -1 osd.6 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:09.602959+0000 front 2019-12-08T17:19:09.624129+0000 (oldest deadline 2019-12-08T17:19:55.466324+0000) 2019-12-08T17:20:12.547 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:20:12.543+0000 1694f700 -1 osd.4 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:09.330627+0000 front 2019-12-08T17:19:09.332338+0000 (oldest deadline 2019-12-08T17:19:50.126517+0000) 2019-12-08T17:20:12.550 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:20:12.547+0000 1694f700 -1 osd.4 178 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4449.0:102753 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-12-08T17:20:12.888 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:20:12.883+0000 1694f700 -1 osd.5 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:06.002138+0000 front 2019-12-08T17:19:06.008519+0000 (oldest deadline 2019-12-08T17:19:49.645733+0000) 2019-12-08T17:20:13.065 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:20:13.063+0000 1694f700 -1 osd.0 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:07.749231+0000 front 2019-12-08T17:19:08.281067+0000 (oldest deadline 2019-12-08T17:19:51.038952+0000) 2019-12-08T17:20:13.172 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:20:13.167+0000 1694f700 -1 osd.7 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:08.294450+0000 front 2019-12-08T17:19:08.528884+0000 (oldest deadline 2019-12-08T17:19:54.050442+0000) 2019-12-08T17:20:13.255 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:20:13.254+0000 1694f700 -1 osd.3 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:08.278004+0000 front 2019-12-08T17:19:07.848150+0000 (oldest deadline 2019-12-08T17:19:52.281086+0000) 2019-12-08T17:20:13.419 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:20:13.415+0000 1694f700 -1 osd.2 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:08.718627+0000 front 2019-12-08T17:19:09.047557+0000 (oldest deadline 2019-12-08T17:19:52.800690+0000) 2019-12-08T17:20:13.421 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:20:13.418+0000 1694f700 -1 osd.2 178 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-12-08T17:20:13.444 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:20:13.440+0000 1694f700 -1 osd.6 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:09.602959+0000 front 2019-12-08T17:19:09.624129+0000 (oldest deadline 2019-12-08T17:19:55.466324+0000) 2019-12-08T17:20:13.554 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:20:13.548+0000 1694f700 -1 osd.4 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:09.330627+0000 front 2019-12-08T17:19:09.332338+0000 (oldest deadline 2019-12-08T17:19:50.126517+0000) 2019-12-08T17:20:13.555 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:20:13.551+0000 1694f700 -1 osd.4 178 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4449.0:102753 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-12-08T17:20:13.928 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:20:13.923+0000 1694f700 -1 osd.5 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:06.002138+0000 front 2019-12-08T17:19:06.008519+0000 (oldest deadline 2019-12-08T17:19:49.645733+0000) 2019-12-08T17:20:14.111 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:20:14.110+0000 1694f700 -1 osd.0 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:07.749231+0000 front 2019-12-08T17:19:08.281067+0000 (oldest deadline 2019-12-08T17:19:51.038952+0000) 2019-12-08T17:20:14.168 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:20:14.162+0000 1694f700 -1 osd.7 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:08.294450+0000 front 2019-12-08T17:19:08.528884+0000 (oldest deadline 2019-12-08T17:19:54.050442+0000) 2019-12-08T17:20:14.287 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:20:14.285+0000 1694f700 -1 osd.3 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:08.278004+0000 front 2019-12-08T17:19:07.848150+0000 (oldest deadline 2019-12-08T17:19:52.281086+0000) 2019-12-08T17:20:14.380 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:20:14.377+0000 1694f700 -1 osd.2 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:08.718627+0000 front 2019-12-08T17:19:09.047557+0000 (oldest deadline 2019-12-08T17:19:52.800690+0000) 2019-12-08T17:20:14.384 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:20:14.382+0000 1694f700 -1 osd.2 178 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-12-08T17:20:14.419 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:20:14.415+0000 1694f700 -1 osd.6 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:09.602959+0000 front 2019-12-08T17:19:09.624129+0000 (oldest deadline 2019-12-08T17:19:55.466324+0000) 2019-12-08T17:20:14.525 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:20:14.519+0000 1694f700 -1 osd.4 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:09.330627+0000 front 2019-12-08T17:19:09.332338+0000 (oldest deadline 2019-12-08T17:19:50.126517+0000) 2019-12-08T17:20:14.526 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:20:14.522+0000 1694f700 -1 osd.4 178 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4449.0:102753 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-12-08T17:20:14.964 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:20:14.959+0000 1694f700 -1 osd.5 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:06.002138+0000 front 2019-12-08T17:19:06.008519+0000 (oldest deadline 2019-12-08T17:19:49.645733+0000) 2019-12-08T17:20:15.129 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:20:15.127+0000 1694f700 -1 osd.0 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:07.749231+0000 front 2019-12-08T17:19:08.281067+0000 (oldest deadline 2019-12-08T17:19:51.038952+0000) 2019-12-08T17:20:15.193 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:20:15.188+0000 1694f700 -1 osd.7 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:08.294450+0000 front 2019-12-08T17:19:08.528884+0000 (oldest deadline 2019-12-08T17:19:54.050442+0000) 2019-12-08T17:20:15.273 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:20:15.271+0000 1694f700 -1 osd.3 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:08.278004+0000 front 2019-12-08T17:19:07.848150+0000 (oldest deadline 2019-12-08T17:19:52.281086+0000) 2019-12-08T17:20:15.381 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:20:15.377+0000 1694f700 -1 osd.2 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:08.718627+0000 front 2019-12-08T17:19:09.047557+0000 (oldest deadline 2019-12-08T17:19:52.800690+0000) 2019-12-08T17:20:15.382 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:20:15.380+0000 1694f700 -1 osd.2 178 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-12-08T17:20:15.446 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:20:15.441+0000 1694f700 -1 osd.6 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:09.602959+0000 front 2019-12-08T17:19:09.624129+0000 (oldest deadline 2019-12-08T17:19:55.466324+0000) 2019-12-08T17:20:15.540 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:20:15.535+0000 1694f700 -1 osd.4 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:09.330627+0000 front 2019-12-08T17:19:09.332338+0000 (oldest deadline 2019-12-08T17:19:50.126517+0000) 2019-12-08T17:20:15.544 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:20:15.541+0000 1694f700 -1 osd.4 178 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4449.0:102753 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-12-08T17:20:16.020 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:20:16.014+0000 1694f700 -1 osd.5 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:06.002138+0000 front 2019-12-08T17:19:06.008519+0000 (oldest deadline 2019-12-08T17:19:49.645733+0000) 2019-12-08T17:20:16.133 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:20:16.129+0000 1694f700 -1 osd.0 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:07.749231+0000 front 2019-12-08T17:19:08.281067+0000 (oldest deadline 2019-12-08T17:19:51.038952+0000) 2019-12-08T17:20:16.230 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:20:16.225+0000 1694f700 -1 osd.7 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:08.294450+0000 front 2019-12-08T17:19:08.528884+0000 (oldest deadline 2019-12-08T17:19:54.050442+0000) 2019-12-08T17:20:16.320 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:20:16.317+0000 1694f700 -1 osd.3 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:08.278004+0000 front 2019-12-08T17:19:07.848150+0000 (oldest deadline 2019-12-08T17:19:52.281086+0000) 2019-12-08T17:20:16.402 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:20:16.400+0000 1694f700 -1 osd.2 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:08.718627+0000 front 2019-12-08T17:19:09.047557+0000 (oldest deadline 2019-12-08T17:19:52.800690+0000) 2019-12-08T17:20:16.405 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:20:16.404+0000 1694f700 -1 osd.2 178 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-12-08T17:20:16.456 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:20:16.450+0000 1694f700 -1 osd.6 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:09.602959+0000 front 2019-12-08T17:19:09.624129+0000 (oldest deadline 2019-12-08T17:19:55.466324+0000) 2019-12-08T17:20:16.597 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:20:16.591+0000 1694f700 -1 osd.4 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:09.330627+0000 front 2019-12-08T17:19:09.332338+0000 (oldest deadline 2019-12-08T17:19:50.126517+0000) 2019-12-08T17:20:16.598 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:20:16.594+0000 1694f700 -1 osd.4 178 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4449.0:102753 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-12-08T17:20:17.065 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:20:17.060+0000 1694f700 -1 osd.5 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:06.002138+0000 front 2019-12-08T17:19:06.008519+0000 (oldest deadline 2019-12-08T17:19:49.645733+0000) 2019-12-08T17:20:17.154 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:20:17.152+0000 1694f700 -1 osd.0 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:07.749231+0000 front 2019-12-08T17:19:08.281067+0000 (oldest deadline 2019-12-08T17:19:51.038952+0000) 2019-12-08T17:20:17.210 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:20:17.205+0000 1694f700 -1 osd.7 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:08.294450+0000 front 2019-12-08T17:19:08.528884+0000 (oldest deadline 2019-12-08T17:19:54.050442+0000) 2019-12-08T17:20:17.355 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:20:17.351+0000 1694f700 -1 osd.3 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:08.278004+0000 front 2019-12-08T17:19:07.848150+0000 (oldest deadline 2019-12-08T17:19:52.281086+0000) 2019-12-08T17:20:17.395 INFO:tasks.rgw.client.0.smithi079.stdout:2019-12-08T17:20:17.319+0000 20e25700 -1 RGWWatcher::handle_error cookie 5416991024 err (107) Transport endpoint is not connected 2019-12-08T17:20:17.421 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:20:17.418+0000 1694f700 -1 osd.2 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:08.718627+0000 front 2019-12-08T17:19:09.047557+0000 (oldest deadline 2019-12-08T17:19:52.800690+0000) 2019-12-08T17:20:17.424 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:20:17.423+0000 1694f700 -1 osd.2 178 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-12-08T17:20:17.438 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:20:17.433+0000 1694f700 -1 osd.6 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:09.602959+0000 front 2019-12-08T17:19:09.624129+0000 (oldest deadline 2019-12-08T17:19:55.466324+0000) 2019-12-08T17:20:17.581 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:20:17.574+0000 1694f700 -1 osd.4 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:09.330627+0000 front 2019-12-08T17:19:09.332338+0000 (oldest deadline 2019-12-08T17:19:50.126517+0000) 2019-12-08T17:20:17.582 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:20:17.578+0000 1694f700 -1 osd.4 178 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4449.0:102753 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-12-08T17:20:18.107 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:20:18.102+0000 1694f700 -1 osd.5 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:06.002138+0000 front 2019-12-08T17:19:06.008519+0000 (oldest deadline 2019-12-08T17:19:49.645733+0000) 2019-12-08T17:20:18.126 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:20:18.125+0000 1694f700 -1 osd.0 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:07.749231+0000 front 2019-12-08T17:19:08.281067+0000 (oldest deadline 2019-12-08T17:19:51.038952+0000) 2019-12-08T17:20:18.214 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:20:18.210+0000 1694f700 -1 osd.7 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:08.294450+0000 front 2019-12-08T17:19:08.528884+0000 (oldest deadline 2019-12-08T17:19:54.050442+0000) 2019-12-08T17:20:18.382 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:20:18.379+0000 1694f700 -1 osd.3 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:08.278004+0000 front 2019-12-08T17:19:07.848150+0000 (oldest deadline 2019-12-08T17:19:52.281086+0000) 2019-12-08T17:20:18.450 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:20:18.446+0000 1694f700 -1 osd.6 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:09.602959+0000 front 2019-12-08T17:20:18.022650+0000 (oldest deadline 2019-12-08T17:19:55.466324+0000) 2019-12-08T17:20:18.470 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:20:18.468+0000 1694f700 -1 osd.2 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:08.718627+0000 front 2019-12-08T17:19:09.047557+0000 (oldest deadline 2019-12-08T17:19:52.800690+0000) 2019-12-08T17:20:18.472 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:20:18.471+0000 1694f700 -1 osd.2 178 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-12-08T17:20:18.605 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:20:18.595+0000 1694f700 -1 osd.4 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:09.330627+0000 front 2019-12-08T17:19:09.332338+0000 (oldest deadline 2019-12-08T17:19:50.126517+0000) 2019-12-08T17:20:18.609 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:20:18.598+0000 1694f700 -1 osd.4 178 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4449.0:102753 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-12-08T17:20:18.610 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:20:18.540+0000 1694f700 -1 osd.1 175 get_health_metrics reporting 45 slow ops, oldest is osd_op(client.4449.0:101476 7.1 7:8bea0b29:::2019-12-08-17-f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.636-%e1%a0%83%ed%88%8f%ef%84%92%ce%a9%e5%98%88%e5%98%87%e0%a4%81%e0%a4%82%e1%a0%84%e3%9c%85%eb%8c%8c%e0%a4%82%e9%90%8c%ed%88%8d%e8%94%8b:head [append 0~499 in=499b] snapc 0=[] RETRY=7 ondisk+retry+write+known_if_redirected e173) 2019-12-08T17:20:19.071 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:20:19.066+0000 1694f700 -1 osd.5 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:06.002138+0000 front 2019-12-08T17:19:06.008519+0000 (oldest deadline 2019-12-08T17:19:49.645733+0000) 2019-12-08T17:20:19.156 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:20:19.151+0000 1694f700 -1 osd.0 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:20:18.924401+0000 front 2019-12-08T17:19:08.281067+0000 (oldest deadline 2019-12-08T17:19:51.038952+0000) 2019-12-08T17:20:19.189 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:20:19.184+0000 1694f700 -1 osd.7 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:08.294450+0000 front 2019-12-08T17:19:08.528884+0000 (oldest deadline 2019-12-08T17:19:54.050442+0000) 2019-12-08T17:20:19.360 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:20:19.352+0000 1694f700 -1 osd.3 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:08.278004+0000 front 2019-12-08T17:20:18.896703+0000 (oldest deadline 2019-12-08T17:19:52.281086+0000) 2019-12-08T17:20:19.485 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:20:19.480+0000 1694f700 -1 osd.6 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:09.602959+0000 front 2019-12-08T17:20:18.022650+0000 (oldest deadline 2019-12-08T17:19:55.466324+0000) 2019-12-08T17:20:19.518 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:20:19.515+0000 1694f700 -1 osd.2 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:08.718627+0000 front 2019-12-08T17:19:09.047557+0000 (oldest deadline 2019-12-08T17:19:52.800690+0000) 2019-12-08T17:20:19.521 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:20:19.518+0000 1694f700 -1 osd.2 178 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-12-08T17:20:19.636 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:20:19.631+0000 1694f700 -1 osd.4 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:09.330627+0000 front 2019-12-08T17:19:09.332338+0000 (oldest deadline 2019-12-08T17:19:50.126517+0000) 2019-12-08T17:20:19.639 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:20:19.636+0000 1694f700 -1 osd.4 178 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4449.0:102753 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-12-08T17:20:19.750 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:20:19.638+0000 1694f700 -1 osd.1 177 get_health_metrics reporting 41 slow ops, oldest is osd_op(client.4449.0:101476 7.1 7:8bea0b29:::2019-12-08-17-f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.636-%e1%a0%83%ed%88%8f%ef%84%92%ce%a9%e5%98%88%e5%98%87%e0%a4%81%e0%a4%82%e1%a0%84%e3%9c%85%eb%8c%8c%e0%a4%82%e9%90%8c%ed%88%8d%e8%94%8b:head [append 0~499 in=499b] snapc 0=[] RETRY=7 ondisk+retry+write+known_if_redirected e173) 2019-12-08T17:20:20.034 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:20:20.027+0000 1694f700 -1 osd.5 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:06.002138+0000 front 2019-12-08T17:19:06.008519+0000 (oldest deadline 2019-12-08T17:19:49.645733+0000) 2019-12-08T17:20:20.158 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:20:20.158+0000 1694f700 -1 osd.0 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:20:18.924401+0000 front 2019-12-08T17:19:08.281067+0000 (oldest deadline 2019-12-08T17:19:51.038952+0000) 2019-12-08T17:20:20.342 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:20:20.340+0000 1694f700 -1 osd.3 178 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:08.278004+0000 front 2019-12-08T17:20:18.896703+0000 (oldest deadline 2019-12-08T17:19:52.281086+0000) 2019-12-08T17:20:20.543 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:20:20.541+0000 1694f700 -1 osd.2 179 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:08.718627+0000 front 2019-12-08T17:19:09.047557+0000 (oldest deadline 2019-12-08T17:19:52.800690+0000) 2019-12-08T17:20:20.543 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:20:20.543+0000 1694f700 -1 osd.2 179 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-12-08T17:20:20.676 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:20:20.671+0000 1694f700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:09.330627+0000 front 2019-12-08T17:19:09.332338+0000 (oldest deadline 2019-12-08T17:19:50.126517+0000) 2019-12-08T17:20:20.678 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:20:20.674+0000 1694f700 -1 osd.4 179 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4449.0:102753 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-12-08T17:20:20.995 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:20:20.990+0000 1694f700 -1 osd.5 179 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:06.002138+0000 front 2019-12-08T17:19:06.008519+0000 (oldest deadline 2019-12-08T17:19:49.645733+0000) 2019-12-08T17:20:21.148 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:20:21.147+0000 1694f700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:20:18.924401+0000 front 2019-12-08T17:19:08.281067+0000 (oldest deadline 2019-12-08T17:19:51.038952+0000) 2019-12-08T17:20:21.320 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:20:21.319+0000 1694f700 -1 osd.1 178 get_health_metrics reporting 21 slow ops, oldest is osd_op(client.4449.0:102718 5.9 5:93e5b521:::notify.7:head [watch ping cookie 5416991024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-12-08T17:20:21.350 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:20:21.349+0000 1694f700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:08.278004+0000 front 2019-12-08T17:20:18.896703+0000 (oldest deadline 2019-12-08T17:19:52.281086+0000) 2019-12-08T17:20:21.594 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:20:21.592+0000 1694f700 -1 osd.2 179 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:20:21.462271+0000 front 2019-12-08T17:19:09.047557+0000 (oldest deadline 2019-12-08T17:19:52.800690+0000) 2019-12-08T17:20:21.596 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:20:21.593+0000 1694f700 -1 osd.2 179 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e178) 2019-12-08T17:20:21.686 INFO:tasks.rgw.client.0.smithi079.stdout:2019-12-08T17:20:21.674+0000 20e25700 -1 RGWWatcher::handle_error cookie 5474892400 err (107) Transport endpoint is not connected 2019-12-08T17:20:21.709 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:20:21.706+0000 1694f700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:09.330627+0000 front 2019-12-08T17:19:09.332338+0000 (oldest deadline 2019-12-08T17:19:50.126517+0000) 2019-12-08T17:20:21.710 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:20:21.707+0000 1694f700 -1 osd.4 179 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:102758 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e175) 2019-12-08T17:20:21.952 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:20:21.949+0000 1694f700 -1 osd.5 179 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:19:06.002138+0000 front 2019-12-08T17:19:06.008519+0000 (oldest deadline 2019-12-08T17:19:49.645733+0000) 2019-12-08T17:20:22.117 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:20:22.116+0000 1694f700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:20:21.658043+0000 front 2019-12-08T17:19:08.281067+0000 (oldest deadline 2019-12-08T17:19:51.038952+0000) 2019-12-08T17:20:22.361 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:20:22.358+0000 1694f700 -1 osd.1 179 get_health_metrics reporting 20 slow ops, oldest is osd_op(client.4449.0:102718 5.9 5:93e5b521:::notify.7:head [watch ping cookie 5416991024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-12-08T17:20:22.561 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:20:22.560+0000 1694f700 -1 osd.2 179 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] RETRY=12 ondisk+retry+read+known_if_redirected e178) 2019-12-08T17:20:22.678 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:20:22.672+0000 1694f700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:20:22.557887+0000 front 2019-12-08T17:19:09.332338+0000 (oldest deadline 2019-12-08T17:19:50.126517+0000) 2019-12-08T17:20:23.378 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:20:23.377+0000 1694f700 -1 osd.1 179 get_health_metrics reporting 20 slow ops, oldest is osd_op(client.4449.0:102718 5.9 5:93e5b521:::notify.7:head [watch ping cookie 5416991024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-12-08T17:20:23.565 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:20:23.564+0000 1694f700 -1 osd.2 179 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] RETRY=12 ondisk+retry+read+known_if_redirected e178) 2019-12-08T17:20:24.346 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:20:24.345+0000 1694f700 -1 osd.1 179 get_health_metrics reporting 20 slow ops, oldest is osd_op(client.4449.0:102718 5.9 5:93e5b521:::notify.7:head [watch ping cookie 5416991024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-12-08T17:20:24.553 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:20:24.552+0000 1694f700 -1 osd.2 179 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] RETRY=12 ondisk+retry+read+known_if_redirected e178) 2019-12-08T17:20:25.366 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:20:25.364+0000 1694f700 -1 osd.1 179 get_health_metrics reporting 21 slow ops, oldest is osd_op(client.4449.0:102718 5.9 5:93e5b521:::notify.7:head [watch ping cookie 5416991024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-12-08T17:20:25.596 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:20:25.595+0000 1694f700 -1 osd.2 179 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] RETRY=12 ondisk+retry+read+known_if_redirected e178) 2019-12-08T17:20:26.406 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:20:26.405+0000 1694f700 -1 osd.1 179 get_health_metrics reporting 21 slow ops, oldest is osd_op(client.4449.0:102718 5.9 5:93e5b521:::notify.7:head [watch ping cookie 5416991024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-12-08T17:20:26.605 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:20:26.604+0000 1694f700 -1 osd.2 179 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] RETRY=12 ondisk+retry+read+known_if_redirected e178) 2019-12-08T17:20:27.423 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:20:27.421+0000 1694f700 -1 osd.1 179 get_health_metrics reporting 21 slow ops, oldest is osd_op(client.4449.0:102718 5.9 5:93e5b521:::notify.7:head [watch ping cookie 5416991024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-12-08T17:20:27.647 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:20:27.647+0000 1694f700 -1 osd.2 179 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] RETRY=12 ondisk+retry+read+known_if_redirected e178) 2019-12-08T17:20:28.418 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:20:28.418+0000 1694f700 -1 osd.1 179 get_health_metrics reporting 21 slow ops, oldest is osd_op(client.4449.0:102718 5.9 5:93e5b521:::notify.7:head [watch ping cookie 5416991024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-12-08T17:20:28.638 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:20:28.636+0000 1694f700 -1 osd.2 179 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] RETRY=12 ondisk+retry+read+known_if_redirected e178) 2019-12-08T17:20:29.425 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:20:29.418+0000 1694f700 -1 osd.1 179 get_health_metrics reporting 21 slow ops, oldest is osd_op(client.4449.0:102718 5.9 5:93e5b521:::notify.7:head [watch ping cookie 5416991024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-12-08T17:20:29.638 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:20:29.637+0000 1694f700 -1 osd.2 179 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] RETRY=12 ondisk+retry+read+known_if_redirected e178) 2019-12-08T17:20:30.476 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:20:30.474+0000 1694f700 -1 osd.1 179 get_health_metrics reporting 22 slow ops, oldest is osd_op(client.4449.0:102718 5.9 5:93e5b521:::notify.7:head [watch ping cookie 5416991024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-12-08T17:20:30.641 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:20:30.639+0000 1694f700 -1 osd.2 179 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] RETRY=12 ondisk+retry+read+known_if_redirected e178) 2019-12-08T17:20:31.443 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:20:31.442+0000 1694f700 -1 osd.1 179 get_health_metrics reporting 22 slow ops, oldest is osd_op(client.4449.0:102718 5.9 5:93e5b521:::notify.7:head [watch ping cookie 5416991024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-12-08T17:20:31.642 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:20:31.641+0000 1694f700 -1 osd.2 179 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] RETRY=12 ondisk+retry+read+known_if_redirected e178) 2019-12-08T17:20:32.497 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:20:32.495+0000 1694f700 -1 osd.1 179 get_health_metrics reporting 22 slow ops, oldest is osd_op(client.4449.0:102718 5.9 5:93e5b521:::notify.7:head [watch ping cookie 5416991024 gen 1] snapc 0=[] ondisk+write+known_if_redirected e174) 2019-12-08T17:20:32.674 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:20:32.673+0000 1694f700 -1 osd.2 179 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] RETRY=12 ondisk+retry+read+known_if_redirected e178) 2019-12-08T17:20:33.410 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:05:17:58.113 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T17:20:33.415 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:05:17:58.118 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T17:20:33.491 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:05:17:58.126 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T17:20:33.511 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:05:17:58.146 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T17:20:33.515 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:05:17:58.149 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T17:20:33.518 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:05:17:58.152 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T17:20:33.652 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:20:33.651+0000 1694f700 -1 osd.2 179 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] RETRY=12 ondisk+retry+read+known_if_redirected e178) 2019-12-08T17:20:33.713 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:05:17:58.416 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T17:20:33.716 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:05:17:58.351 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T17:20:33.729 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:05:17:58.364 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T17:20:34.677 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:20:34.677+0000 1694f700 -1 osd.2 179 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] RETRY=12 ondisk+retry+read+known_if_redirected e178) 2019-12-08T17:20:35.670 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:20:35.669+0000 1694f700 -1 osd.2 179 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] RETRY=12 ondisk+retry+read+known_if_redirected e178) 2019-12-08T17:20:36.708 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:20:36.708+0000 1694f700 -1 osd.2 179 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] RETRY=12 ondisk+retry+read+known_if_redirected e178) 2019-12-08T17:20:37.752 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:20:37.751+0000 1694f700 -1 osd.2 179 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] RETRY=12 ondisk+retry+read+known_if_redirected e178) 2019-12-08T17:20:38.722 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:20:38.721+0000 1694f700 -1 osd.2 179 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] RETRY=12 ondisk+retry+read+known_if_redirected e178) 2019-12-08T17:20:39.695 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:20:39.694+0000 1694f700 -1 osd.2 179 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] RETRY=12 ondisk+retry+read+known_if_redirected e178) 2019-12-08T17:20:40.704 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:20:40.703+0000 1694f700 -1 osd.2 179 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] RETRY=12 ondisk+retry+read+known_if_redirected e178) 2019-12-08T17:20:41.680 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:20:41.679+0000 1694f700 -1 osd.2 179 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] RETRY=12 ondisk+retry+read+known_if_redirected e178) 2019-12-08T17:20:42.724 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:20:42.721+0000 1694f700 -1 osd.2 179 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] RETRY=12 ondisk+retry+read+known_if_redirected e178) 2019-12-08T17:20:43.740 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:20:43.738+0000 1694f700 -1 osd.2 179 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] RETRY=12 ondisk+retry+read+known_if_redirected e178) 2019-12-08T17:20:44.752 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:20:44.751+0000 1694f700 -1 osd.2 179 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] RETRY=12 ondisk+retry+read+known_if_redirected e178) 2019-12-08T17:20:45.799 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:20:45.798+0000 1694f700 -1 osd.2 179 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] RETRY=12 ondisk+retry+read+known_if_redirected e178) 2019-12-08T17:20:46.778 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:20:46.775+0000 1694f700 -1 osd.2 179 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] RETRY=12 ondisk+retry+read+known_if_redirected e178) 2019-12-08T17:20:47.798 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:20:47.795+0000 1694f700 -1 osd.2 179 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] RETRY=12 ondisk+retry+read+known_if_redirected e178) 2019-12-08T17:20:48.769 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:20:48.761+0000 1694f700 -1 osd.2 179 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] RETRY=12 ondisk+retry+read+known_if_redirected e178) 2019-12-08T17:20:50.186 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:20:49.869+0000 1694f700 -1 osd.2 179 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] RETRY=12 ondisk+retry+read+known_if_redirected e178) 2019-12-08T17:20:50.921 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:20:50.861+0000 1694f700 -1 osd.2 179 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] RETRY=12 ondisk+retry+read+known_if_redirected e178) 2019-12-08T17:20:52.132 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:20:52.106+0000 1694f700 -1 osd.2 179 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] RETRY=12 ondisk+retry+read+known_if_redirected e178) 2019-12-08T17:20:53.347 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:20:53.311+0000 1694f700 -1 osd.2 179 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] RETRY=12 ondisk+retry+read+known_if_redirected e178) 2019-12-08T17:20:54.411 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:20:54.333+0000 1694f700 -1 osd.2 179 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] RETRY=12 ondisk+retry+read+known_if_redirected e178) 2019-12-08T17:20:58.638 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:05:18:23.341 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T17:20:58.647 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:05:18:23.350 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T17:20:58.650 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:05:18:23.284 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T17:20:58.652 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:05:18:23.286 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T17:20:58.655 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:05:18:23.289 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T17:20:58.664 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:05:18:23.293 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T17:20:58.699 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:05:18:23.334 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T17:20:58.720 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:05:18:23.355 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T17:20:58.731 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:05:18:23.434 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T17:21:36.221 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:21:36.216+0000 1694f700 -1 osd.6 179 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103177 2.31s0 2:8edd5fee:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.647_kappa%2f%e2%98%83%e0%a4%81%e2%98%83%ed%88%8d%e3%9c%86%e8%94%8b%e9%90%8a%eb%8c%8c%e9%90%8a%e8%94%8b%e5%98%87%e1%a0%84%ef%84%90%e9%90%89%e5%98%86:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-12-08T17:21:37.211 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:21:37.207+0000 1694f700 -1 osd.6 179 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103177 2.31s0 2:8edd5fee:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.647_kappa%2f%e2%98%83%e0%a4%81%e2%98%83%ed%88%8d%e3%9c%86%e8%94%8b%e9%90%8a%eb%8c%8c%e9%90%8a%e8%94%8b%e5%98%87%e1%a0%84%ef%84%90%e9%90%89%e5%98%86:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-12-08T17:21:38.175 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:21:38.172+0000 1694f700 -1 osd.6 179 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103177 2.31s0 2:8edd5fee:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.647_kappa%2f%e2%98%83%e0%a4%81%e2%98%83%ed%88%8d%e3%9c%86%e8%94%8b%e9%90%8a%eb%8c%8c%e9%90%8a%e8%94%8b%e5%98%87%e1%a0%84%ef%84%90%e9%90%89%e5%98%86:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-12-08T17:21:38.751 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:05:19:03.453 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T17:21:38.814 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:05:19:03.517 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T17:21:38.838 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:05:19:03.473 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T17:21:38.864 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:05:19:03.499 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T17:21:38.893 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:05:19:03.528 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T17:21:38.896 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:05:19:03.530 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T17:21:38.896 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:05:19:03.599 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T17:21:38.949 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:05:19:03.583 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T17:21:38.956 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:05:19:03.591 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T17:21:39.209 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:21:39.206+0000 1694f700 -1 osd.6 179 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103177 2.31s0 2:8edd5fee:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.647_kappa%2f%e2%98%83%e0%a4%81%e2%98%83%ed%88%8d%e3%9c%86%e8%94%8b%e9%90%8a%eb%8c%8c%e9%90%8a%e8%94%8b%e5%98%87%e1%a0%84%ef%84%90%e9%90%89%e5%98%86:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-12-08T17:21:40.199 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:21:40.195+0000 1694f700 -1 osd.6 179 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103177 2.31s0 2:8edd5fee:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.647_kappa%2f%e2%98%83%e0%a4%81%e2%98%83%ed%88%8d%e3%9c%86%e8%94%8b%e9%90%8a%eb%8c%8c%e9%90%8a%e8%94%8b%e5%98%87%e1%a0%84%ef%84%90%e9%90%89%e5%98%86:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-12-08T17:21:41.255 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:21:41.252+0000 1694f700 -1 osd.6 179 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103177 2.31s0 2:8edd5fee:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.647_kappa%2f%e2%98%83%e0%a4%81%e2%98%83%ed%88%8d%e3%9c%86%e8%94%8b%e9%90%8a%eb%8c%8c%e9%90%8a%e8%94%8b%e5%98%87%e1%a0%84%ef%84%90%e9%90%89%e5%98%86:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-12-08T17:21:42.287 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:21:42.283+0000 1694f700 -1 osd.6 179 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103177 2.31s0 2:8edd5fee:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.647_kappa%2f%e2%98%83%e0%a4%81%e2%98%83%ed%88%8d%e3%9c%86%e8%94%8b%e9%90%8a%eb%8c%8c%e9%90%8a%e8%94%8b%e5%98%87%e1%a0%84%ef%84%90%e9%90%89%e5%98%86:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-12-08T17:21:43.256 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:21:43.252+0000 1694f700 -1 osd.6 179 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103177 2.31s0 2:8edd5fee:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.647_kappa%2f%e2%98%83%e0%a4%81%e2%98%83%ed%88%8d%e3%9c%86%e8%94%8b%e9%90%8a%eb%8c%8c%e9%90%8a%e8%94%8b%e5%98%87%e1%a0%84%ef%84%90%e9%90%89%e5%98%86:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-12-08T17:21:44.271 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:21:44.268+0000 1694f700 -1 osd.6 179 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103177 2.31s0 2:8edd5fee:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.647_kappa%2f%e2%98%83%e0%a4%81%e2%98%83%ed%88%8d%e3%9c%86%e8%94%8b%e9%90%8a%eb%8c%8c%e9%90%8a%e8%94%8b%e5%98%87%e1%a0%84%ef%84%90%e9%90%89%e5%98%86:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-12-08T17:21:45.307 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:21:45.303+0000 1694f700 -1 osd.6 179 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103177 2.31s0 2:8edd5fee:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.647_kappa%2f%e2%98%83%e0%a4%81%e2%98%83%ed%88%8d%e3%9c%86%e8%94%8b%e9%90%8a%eb%8c%8c%e9%90%8a%e8%94%8b%e5%98%87%e1%a0%84%ef%84%90%e9%90%89%e5%98%86:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-12-08T17:21:45.980 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:21:45.971+0000 1694f700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:03.548175+0000 front 2019-12-08T17:21:05.058138+0000 (oldest deadline 2019-12-08T17:21:44.998684+0000) 2019-12-08T17:21:46.353 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:21:46.348+0000 1694f700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:01.008366+0000 front 2019-12-08T17:21:00.994698+0000 (oldest deadline 2019-12-08T17:21:46.271730+0000) 2019-12-08T17:21:46.354 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:21:46.351+0000 1694f700 -1 osd.6 179 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103177 2.31s0 2:8edd5fee:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.647_kappa%2f%e2%98%83%e0%a4%81%e2%98%83%ed%88%8d%e3%9c%86%e8%94%8b%e9%90%8a%eb%8c%8c%e9%90%8a%e8%94%8b%e5%98%87%e1%a0%84%ef%84%90%e9%90%89%e5%98%86:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-12-08T17:21:46.485 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:21:46.482+0000 1694f700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:02.448331+0000 front 2019-12-08T17:21:02.390601+0000 (oldest deadline 2019-12-08T17:21:45.759557+0000) 2019-12-08T17:21:46.852 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:21:46.847+0000 1694f700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:00.368663+0000 front 2019-12-08T17:21:00.299898+0000 (oldest deadline 2019-12-08T17:21:46.178352+0000) 2019-12-08T17:21:46.991 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:21:46.987+0000 1694f700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:03.548175+0000 front 2019-12-08T17:21:05.058138+0000 (oldest deadline 2019-12-08T17:21:44.998684+0000) 2019-12-08T17:21:47.319 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:21:47.312+0000 1694f700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:01.008366+0000 front 2019-12-08T17:21:00.994698+0000 (oldest deadline 2019-12-08T17:21:46.271730+0000) 2019-12-08T17:21:47.320 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:21:47.316+0000 1694f700 -1 osd.6 179 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103177 2.31s0 2:8edd5fee:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.647_kappa%2f%e2%98%83%e0%a4%81%e2%98%83%ed%88%8d%e3%9c%86%e8%94%8b%e9%90%8a%eb%8c%8c%e9%90%8a%e8%94%8b%e5%98%87%e1%a0%84%ef%84%90%e9%90%89%e5%98%86:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-12-08T17:21:47.363 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:21:47.357+0000 1694f700 -1 osd.5 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:02.906939+0000 front 2019-12-08T17:21:02.939525+0000 (oldest deadline 2019-12-08T17:21:46.933760+0000) 2019-12-08T17:21:47.387 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:21:47.382+0000 1694f700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:04.589792+0000 front 2019-12-08T17:21:04.602210+0000 (oldest deadline 2019-12-08T17:21:46.813403+0000) 2019-12-08T17:21:47.504 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:21:47.503+0000 1694f700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:02.448331+0000 front 2019-12-08T17:21:02.390601+0000 (oldest deadline 2019-12-08T17:21:45.759557+0000) 2019-12-08T17:21:47.898 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:21:47.896+0000 1694f700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:00.368663+0000 front 2019-12-08T17:21:00.299898+0000 (oldest deadline 2019-12-08T17:21:46.178352+0000) 2019-12-08T17:21:47.997 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:21:47.993+0000 1694f700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:03.548175+0000 front 2019-12-08T17:21:05.058138+0000 (oldest deadline 2019-12-08T17:21:44.998684+0000) 2019-12-08T17:21:48.354 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:21:48.350+0000 1694f700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:01.008366+0000 front 2019-12-08T17:21:00.994698+0000 (oldest deadline 2019-12-08T17:21:46.271730+0000) 2019-12-08T17:21:48.357 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:21:48.354+0000 1694f700 -1 osd.6 179 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103177 2.31s0 2:8edd5fee:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.647_kappa%2f%e2%98%83%e0%a4%81%e2%98%83%ed%88%8d%e3%9c%86%e8%94%8b%e9%90%8a%eb%8c%8c%e9%90%8a%e8%94%8b%e5%98%87%e1%a0%84%ef%84%90%e9%90%89%e5%98%86:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-12-08T17:21:48.376 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:21:48.369+0000 1694f700 -1 osd.5 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:02.906939+0000 front 2019-12-08T17:21:02.939525+0000 (oldest deadline 2019-12-08T17:21:46.933760+0000) 2019-12-08T17:21:48.394 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:21:48.389+0000 1694f700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:04.589792+0000 front 2019-12-08T17:21:04.602210+0000 (oldest deadline 2019-12-08T17:21:46.813403+0000) 2019-12-08T17:21:48.512 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:21:48.510+0000 1694f700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:03.708995+0000 front 2019-12-08T17:21:03.977183+0000 (oldest deadline 2019-12-08T17:21:48.326828+0000) 2019-12-08T17:21:48.522 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:21:48.521+0000 1694f700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:02.448331+0000 front 2019-12-08T17:21:02.390601+0000 (oldest deadline 2019-12-08T17:21:45.759557+0000) 2019-12-08T17:21:48.860 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:21:48.857+0000 1694f700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:00.368663+0000 front 2019-12-08T17:21:00.299898+0000 (oldest deadline 2019-12-08T17:21:46.178352+0000) 2019-12-08T17:21:48.996 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:21:48.991+0000 1694f700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:03.548175+0000 front 2019-12-08T17:21:05.058138+0000 (oldest deadline 2019-12-08T17:21:44.998684+0000) 2019-12-08T17:21:49.318 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:21:49.313+0000 1694f700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:01.008366+0000 front 2019-12-08T17:21:00.994698+0000 (oldest deadline 2019-12-08T17:21:46.271730+0000) 2019-12-08T17:21:49.321 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:21:49.318+0000 1694f700 -1 osd.6 179 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103177 2.31s0 2:8edd5fee:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.647_kappa%2f%e2%98%83%e0%a4%81%e2%98%83%ed%88%8d%e3%9c%86%e8%94%8b%e9%90%8a%eb%8c%8c%e9%90%8a%e8%94%8b%e5%98%87%e1%a0%84%ef%84%90%e9%90%89%e5%98%86:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-12-08T17:21:49.389 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:21:49.384+0000 1694f700 -1 osd.5 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:02.906939+0000 front 2019-12-08T17:21:02.939525+0000 (oldest deadline 2019-12-08T17:21:46.933760+0000) 2019-12-08T17:21:49.404 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:21:49.400+0000 1694f700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:04.589792+0000 front 2019-12-08T17:21:04.602210+0000 (oldest deadline 2019-12-08T17:21:46.813403+0000) 2019-12-08T17:21:49.525 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:21:49.524+0000 1694f700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:03.708995+0000 front 2019-12-08T17:21:03.977183+0000 (oldest deadline 2019-12-08T17:21:48.326828+0000) 2019-12-08T17:21:49.545 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:21:49.543+0000 1694f700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:02.448331+0000 front 2019-12-08T17:21:02.390601+0000 (oldest deadline 2019-12-08T17:21:45.759557+0000) 2019-12-08T17:21:49.903 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:21:49.902+0000 1694f700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:00.368663+0000 front 2019-12-08T17:21:00.299898+0000 (oldest deadline 2019-12-08T17:21:46.178352+0000) 2019-12-08T17:21:50.050 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:21:50.045+0000 1694f700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:03.548175+0000 front 2019-12-08T17:21:05.058138+0000 (oldest deadline 2019-12-08T17:21:44.998684+0000) 2019-12-08T17:21:50.339 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:21:50.334+0000 1694f700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:01.008366+0000 front 2019-12-08T17:21:00.994698+0000 (oldest deadline 2019-12-08T17:21:46.271730+0000) 2019-12-08T17:21:50.344 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:21:50.336+0000 1694f700 -1 osd.6 179 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103177 2.31s0 2:8edd5fee:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.647_kappa%2f%e2%98%83%e0%a4%81%e2%98%83%ed%88%8d%e3%9c%86%e8%94%8b%e9%90%8a%eb%8c%8c%e9%90%8a%e8%94%8b%e5%98%87%e1%a0%84%ef%84%90%e9%90%89%e5%98%86:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-12-08T17:21:50.373 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:21:50.369+0000 1694f700 -1 osd.5 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:02.906939+0000 front 2019-12-08T17:21:02.939525+0000 (oldest deadline 2019-12-08T17:21:46.933760+0000) 2019-12-08T17:21:50.395 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:21:50.391+0000 1694f700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:04.589792+0000 front 2019-12-08T17:21:04.602210+0000 (oldest deadline 2019-12-08T17:21:46.813403+0000) 2019-12-08T17:21:50.521 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:21:50.519+0000 1694f700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:03.708995+0000 front 2019-12-08T17:21:03.977183+0000 (oldest deadline 2019-12-08T17:21:48.326828+0000) 2019-12-08T17:21:50.582 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:21:50.581+0000 1694f700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:02.448331+0000 front 2019-12-08T17:21:02.390601+0000 (oldest deadline 2019-12-08T17:21:45.759557+0000) 2019-12-08T17:21:50.894 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:21:50.891+0000 1694f700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:00.368663+0000 front 2019-12-08T17:21:00.299898+0000 (oldest deadline 2019-12-08T17:21:46.178352+0000) 2019-12-08T17:21:51.072 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:21:51.067+0000 1694f700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:03.548175+0000 front 2019-12-08T17:21:05.058138+0000 (oldest deadline 2019-12-08T17:21:44.998684+0000) 2019-12-08T17:21:51.339 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:21:51.334+0000 1694f700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:01.008366+0000 front 2019-12-08T17:21:00.994698+0000 (oldest deadline 2019-12-08T17:21:46.271730+0000) 2019-12-08T17:21:51.340 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:21:51.336+0000 1694f700 -1 osd.6 179 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103177 2.31s0 2:8edd5fee:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.647_kappa%2f%e2%98%83%e0%a4%81%e2%98%83%ed%88%8d%e3%9c%86%e8%94%8b%e9%90%8a%eb%8c%8c%e9%90%8a%e8%94%8b%e5%98%87%e1%a0%84%ef%84%90%e9%90%89%e5%98%86:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-12-08T17:21:51.346 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:21:51.341+0000 1694f700 -1 osd.5 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:02.906939+0000 front 2019-12-08T17:21:02.939525+0000 (oldest deadline 2019-12-08T17:21:46.933760+0000) 2019-12-08T17:21:51.427 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:21:51.422+0000 1694f700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:04.589792+0000 front 2019-12-08T17:21:04.602210+0000 (oldest deadline 2019-12-08T17:21:46.813403+0000) 2019-12-08T17:21:51.485 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:21:51.483+0000 1694f700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:03.708995+0000 front 2019-12-08T17:21:03.977183+0000 (oldest deadline 2019-12-08T17:21:48.326828+0000) 2019-12-08T17:21:51.622 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:21:51.622+0000 1694f700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:02.448331+0000 front 2019-12-08T17:21:02.390601+0000 (oldest deadline 2019-12-08T17:21:45.759557+0000) 2019-12-08T17:21:51.938 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:21:51.936+0000 1694f700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:00.368663+0000 front 2019-12-08T17:21:00.299898+0000 (oldest deadline 2019-12-08T17:21:46.178352+0000) 2019-12-08T17:21:52.089 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:21:52.084+0000 1694f700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:03.548175+0000 front 2019-12-08T17:21:05.058138+0000 (oldest deadline 2019-12-08T17:21:44.998684+0000) 2019-12-08T17:21:52.320 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:21:52.314+0000 1694f700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:01.008366+0000 front 2019-12-08T17:21:00.994698+0000 (oldest deadline 2019-12-08T17:21:46.271730+0000) 2019-12-08T17:21:52.320 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:21:52.317+0000 1694f700 -1 osd.6 179 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103177 2.31s0 2:8edd5fee:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.647_kappa%2f%e2%98%83%e0%a4%81%e2%98%83%ed%88%8d%e3%9c%86%e8%94%8b%e9%90%8a%eb%8c%8c%e9%90%8a%e8%94%8b%e5%98%87%e1%a0%84%ef%84%90%e9%90%89%e5%98%86:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-12-08T17:21:52.342 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:21:52.337+0000 1694f700 -1 osd.5 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:02.906939+0000 front 2019-12-08T17:21:02.939525+0000 (oldest deadline 2019-12-08T17:21:46.933760+0000) 2019-12-08T17:21:52.478 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:21:52.473+0000 1694f700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:04.589792+0000 front 2019-12-08T17:21:04.602210+0000 (oldest deadline 2019-12-08T17:21:46.813403+0000) 2019-12-08T17:21:52.517 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:21:52.516+0000 1694f700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:03.708995+0000 front 2019-12-08T17:21:03.977183+0000 (oldest deadline 2019-12-08T17:21:48.326828+0000) 2019-12-08T17:21:52.654 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:21:52.652+0000 1694f700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:02.448331+0000 front 2019-12-08T17:21:02.390601+0000 (oldest deadline 2019-12-08T17:21:45.759557+0000) 2019-12-08T17:21:52.946 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:21:52.945+0000 1694f700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:00.368663+0000 front 2019-12-08T17:21:00.299898+0000 (oldest deadline 2019-12-08T17:21:46.178352+0000) 2019-12-08T17:21:53.049 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:21:53.044+0000 1694f700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:03.548175+0000 front 2019-12-08T17:21:05.058138+0000 (oldest deadline 2019-12-08T17:21:44.998684+0000) 2019-12-08T17:21:53.281 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:21:53.276+0000 1694f700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:01.008366+0000 front 2019-12-08T17:21:00.994698+0000 (oldest deadline 2019-12-08T17:21:46.271730+0000) 2019-12-08T17:21:53.283 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:21:53.279+0000 1694f700 -1 osd.6 179 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103177 2.31s0 2:8edd5fee:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.647_kappa%2f%e2%98%83%e0%a4%81%e2%98%83%ed%88%8d%e3%9c%86%e8%94%8b%e9%90%8a%eb%8c%8c%e9%90%8a%e8%94%8b%e5%98%87%e1%a0%84%ef%84%90%e9%90%89%e5%98%86:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-12-08T17:21:53.308 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:21:53.303+0000 1694f700 -1 osd.5 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:02.906939+0000 front 2019-12-08T17:21:02.939525+0000 (oldest deadline 2019-12-08T17:21:46.933760+0000) 2019-12-08T17:21:53.487 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:21:53.485+0000 1694f700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:03.708995+0000 front 2019-12-08T17:21:03.977183+0000 (oldest deadline 2019-12-08T17:21:48.326828+0000) 2019-12-08T17:21:53.492 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:21:53.487+0000 1694f700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:04.589792+0000 front 2019-12-08T17:21:04.602210+0000 (oldest deadline 2019-12-08T17:21:46.813403+0000) 2019-12-08T17:21:53.701 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:21:53.698+0000 1694f700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:02.448331+0000 front 2019-12-08T17:21:02.390601+0000 (oldest deadline 2019-12-08T17:21:45.759557+0000) 2019-12-08T17:21:53.995 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:21:53.994+0000 1694f700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:00.368663+0000 front 2019-12-08T17:21:00.299898+0000 (oldest deadline 2019-12-08T17:21:46.178352+0000) 2019-12-08T17:21:54.068 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:21:54.064+0000 1694f700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:03.548175+0000 front 2019-12-08T17:21:05.058138+0000 (oldest deadline 2019-12-08T17:21:44.998684+0000) 2019-12-08T17:21:54.239 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:21:54.234+0000 1694f700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:01.008366+0000 front 2019-12-08T17:21:00.994698+0000 (oldest deadline 2019-12-08T17:21:46.271730+0000) 2019-12-08T17:21:54.240 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:21:54.236+0000 1694f700 -1 osd.6 179 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103177 2.31s0 2:8edd5fee:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.647_kappa%2f%e2%98%83%e0%a4%81%e2%98%83%ed%88%8d%e3%9c%86%e8%94%8b%e9%90%8a%eb%8c%8c%e9%90%8a%e8%94%8b%e5%98%87%e1%a0%84%ef%84%90%e9%90%89%e5%98%86:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-12-08T17:21:54.327 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:21:54.322+0000 1694f700 -1 osd.5 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:02.906939+0000 front 2019-12-08T17:21:02.939525+0000 (oldest deadline 2019-12-08T17:21:46.933760+0000) 2019-12-08T17:21:54.458 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:21:54.453+0000 1694f700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:04.589792+0000 front 2019-12-08T17:21:04.602210+0000 (oldest deadline 2019-12-08T17:21:46.813403+0000) 2019-12-08T17:21:54.493 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:21:54.493+0000 1694f700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:03.708995+0000 front 2019-12-08T17:21:03.977183+0000 (oldest deadline 2019-12-08T17:21:48.326828+0000) 2019-12-08T17:21:54.681 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:21:54.679+0000 1694f700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:02.448331+0000 front 2019-12-08T17:21:02.390601+0000 (oldest deadline 2019-12-08T17:21:45.759557+0000) 2019-12-08T17:21:55.014 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:21:55.009+0000 1694f700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:00.368663+0000 front 2019-12-08T17:21:00.299898+0000 (oldest deadline 2019-12-08T17:21:46.178352+0000) 2019-12-08T17:21:55.077 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:21:55.072+0000 1694f700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:03.548175+0000 front 2019-12-08T17:21:05.058138+0000 (oldest deadline 2019-12-08T17:21:44.998684+0000) 2019-12-08T17:21:55.206 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:21:55.200+0000 1694f700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:01.008366+0000 front 2019-12-08T17:21:00.994698+0000 (oldest deadline 2019-12-08T17:21:46.271730+0000) 2019-12-08T17:21:55.207 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:21:55.203+0000 1694f700 -1 osd.6 179 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103177 2.31s0 2:8edd5fee:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.647_kappa%2f%e2%98%83%e0%a4%81%e2%98%83%ed%88%8d%e3%9c%86%e8%94%8b%e9%90%8a%eb%8c%8c%e9%90%8a%e8%94%8b%e5%98%87%e1%a0%84%ef%84%90%e9%90%89%e5%98%86:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-12-08T17:21:55.380 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:21:55.377+0000 1694f700 -1 osd.5 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:02.906939+0000 front 2019-12-08T17:21:02.939525+0000 (oldest deadline 2019-12-08T17:21:46.933760+0000) 2019-12-08T17:21:55.468 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:21:55.462+0000 1694f700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:04.589792+0000 front 2019-12-08T17:21:04.602210+0000 (oldest deadline 2019-12-08T17:21:46.813403+0000) 2019-12-08T17:21:55.495 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:21:55.492+0000 1694f700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:03.708995+0000 front 2019-12-08T17:21:03.977183+0000 (oldest deadline 2019-12-08T17:21:48.326828+0000) 2019-12-08T17:21:55.645 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:21:55.633+0000 1694f700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:02.448331+0000 front 2019-12-08T17:21:02.390601+0000 (oldest deadline 2019-12-08T17:21:45.759557+0000) 2019-12-08T17:21:56.009 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:21:56.007+0000 1694f700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:00.368663+0000 front 2019-12-08T17:21:00.299898+0000 (oldest deadline 2019-12-08T17:21:46.178352+0000) 2019-12-08T17:21:56.087 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:21:56.082+0000 1694f700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:03.548175+0000 front 2019-12-08T17:21:05.058138+0000 (oldest deadline 2019-12-08T17:21:44.998684+0000) 2019-12-08T17:21:56.163 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:21:56.157+0000 1694f700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:01.008366+0000 front 2019-12-08T17:21:00.994698+0000 (oldest deadline 2019-12-08T17:21:46.271730+0000) 2019-12-08T17:21:56.164 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:21:56.159+0000 1694f700 -1 osd.6 179 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103177 2.31s0 2:8edd5fee:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.647_kappa%2f%e2%98%83%e0%a4%81%e2%98%83%ed%88%8d%e3%9c%86%e8%94%8b%e9%90%8a%eb%8c%8c%e9%90%8a%e8%94%8b%e5%98%87%e1%a0%84%ef%84%90%e9%90%89%e5%98%86:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-12-08T17:21:56.359 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:21:56.352+0000 1694f700 -1 osd.5 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:02.906939+0000 front 2019-12-08T17:21:02.939525+0000 (oldest deadline 2019-12-08T17:21:46.933760+0000) 2019-12-08T17:21:56.425 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:21:56.419+0000 1694f700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:04.589792+0000 front 2019-12-08T17:21:04.602210+0000 (oldest deadline 2019-12-08T17:21:46.813403+0000) 2019-12-08T17:21:56.518 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:21:56.518+0000 1694f700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:03.708995+0000 front 2019-12-08T17:21:03.977183+0000 (oldest deadline 2019-12-08T17:21:48.326828+0000) 2019-12-08T17:21:56.598 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:21:56.595+0000 1694f700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:02.448331+0000 front 2019-12-08T17:21:02.390601+0000 (oldest deadline 2019-12-08T17:21:45.759557+0000) 2019-12-08T17:21:57.017 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:21:57.013+0000 1694f700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:00.368663+0000 front 2019-12-08T17:21:00.299898+0000 (oldest deadline 2019-12-08T17:21:46.178352+0000) 2019-12-08T17:21:57.050 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:21:57.044+0000 1694f700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:03.548175+0000 front 2019-12-08T17:21:05.058138+0000 (oldest deadline 2019-12-08T17:21:44.998684+0000) 2019-12-08T17:21:57.183 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:21:57.176+0000 1694f700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:01.008366+0000 front 2019-12-08T17:21:00.994698+0000 (oldest deadline 2019-12-08T17:21:46.271730+0000) 2019-12-08T17:21:57.183 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:21:57.179+0000 1694f700 -1 osd.6 179 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103177 2.31s0 2:8edd5fee:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.647_kappa%2f%e2%98%83%e0%a4%81%e2%98%83%ed%88%8d%e3%9c%86%e8%94%8b%e9%90%8a%eb%8c%8c%e9%90%8a%e8%94%8b%e5%98%87%e1%a0%84%ef%84%90%e9%90%89%e5%98%86:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-12-08T17:21:57.379 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:21:57.373+0000 1694f700 -1 osd.5 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:02.906939+0000 front 2019-12-08T17:21:02.939525+0000 (oldest deadline 2019-12-08T17:21:46.933760+0000) 2019-12-08T17:21:57.470 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:21:57.465+0000 1694f700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:04.589792+0000 front 2019-12-08T17:21:04.602210+0000 (oldest deadline 2019-12-08T17:21:46.813403+0000) 2019-12-08T17:21:57.520 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:21:57.517+0000 1694f700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:03.708995+0000 front 2019-12-08T17:21:03.977183+0000 (oldest deadline 2019-12-08T17:21:48.326828+0000) 2019-12-08T17:21:57.643 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:21:57.642+0000 1694f700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:02.448331+0000 front 2019-12-08T17:21:02.390601+0000 (oldest deadline 2019-12-08T17:21:45.759557+0000) 2019-12-08T17:21:57.974 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:21:57.968+0000 1694f700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:00.368663+0000 front 2019-12-08T17:21:00.299898+0000 (oldest deadline 2019-12-08T17:21:46.178352+0000) 2019-12-08T17:21:58.094 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:21:58.089+0000 1694f700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:03.548175+0000 front 2019-12-08T17:21:05.058138+0000 (oldest deadline 2019-12-08T17:21:44.998684+0000) 2019-12-08T17:21:58.222 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:21:58.217+0000 1694f700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:01.008366+0000 front 2019-12-08T17:21:00.994698+0000 (oldest deadline 2019-12-08T17:21:46.271730+0000) 2019-12-08T17:21:58.224 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:21:58.220+0000 1694f700 -1 osd.6 179 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103177 2.31s0 2:8edd5fee:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.647_kappa%2f%e2%98%83%e0%a4%81%e2%98%83%ed%88%8d%e3%9c%86%e8%94%8b%e9%90%8a%eb%8c%8c%e9%90%8a%e8%94%8b%e5%98%87%e1%a0%84%ef%84%90%e9%90%89%e5%98%86:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-12-08T17:21:58.429 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:21:58.422+0000 1694f700 -1 osd.5 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:02.906939+0000 front 2019-12-08T17:21:02.939525+0000 (oldest deadline 2019-12-08T17:21:46.933760+0000) 2019-12-08T17:21:58.477 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:21:58.471+0000 1694f700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:04.589792+0000 front 2019-12-08T17:21:04.602210+0000 (oldest deadline 2019-12-08T17:21:46.813403+0000) 2019-12-08T17:21:58.577 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:21:58.576+0000 1694f700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:03.708995+0000 front 2019-12-08T17:21:03.977183+0000 (oldest deadline 2019-12-08T17:21:48.326828+0000) 2019-12-08T17:21:58.689 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:21:58.688+0000 1694f700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:02.448331+0000 front 2019-12-08T17:21:02.390601+0000 (oldest deadline 2019-12-08T17:21:45.759557+0000) 2019-12-08T17:21:58.985 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:21:58.984+0000 1694f700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:00.368663+0000 front 2019-12-08T17:21:00.299898+0000 (oldest deadline 2019-12-08T17:21:46.178352+0000) 2019-12-08T17:21:59.103 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:21:59.097+0000 1694f700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:03.548175+0000 front 2019-12-08T17:21:05.058138+0000 (oldest deadline 2019-12-08T17:21:44.998684+0000) 2019-12-08T17:21:59.181 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:21:59.175+0000 1694f700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:01.008366+0000 front 2019-12-08T17:21:00.994698+0000 (oldest deadline 2019-12-08T17:21:46.271730+0000) 2019-12-08T17:21:59.182 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:21:59.177+0000 1694f700 -1 osd.6 179 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103177 2.31s0 2:8edd5fee:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.647_kappa%2f%e2%98%83%e0%a4%81%e2%98%83%ed%88%8d%e3%9c%86%e8%94%8b%e9%90%8a%eb%8c%8c%e9%90%8a%e8%94%8b%e5%98%87%e1%a0%84%ef%84%90%e9%90%89%e5%98%86:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-12-08T17:21:59.441 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:21:59.435+0000 1694f700 -1 osd.5 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:02.906939+0000 front 2019-12-08T17:21:02.939525+0000 (oldest deadline 2019-12-08T17:21:46.933760+0000) 2019-12-08T17:21:59.488 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:21:59.482+0000 1694f700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:04.589792+0000 front 2019-12-08T17:21:04.602210+0000 (oldest deadline 2019-12-08T17:21:46.813403+0000) 2019-12-08T17:21:59.591 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:21:59.590+0000 1694f700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:03.708995+0000 front 2019-12-08T17:21:03.977183+0000 (oldest deadline 2019-12-08T17:21:48.326828+0000) 2019-12-08T17:21:59.656 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:21:59.654+0000 1694f700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:02.448331+0000 front 2019-12-08T17:21:02.390601+0000 (oldest deadline 2019-12-08T17:21:45.759557+0000) 2019-12-08T17:22:00.018 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:22:00.017+0000 1694f700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:00.368663+0000 front 2019-12-08T17:21:00.299898+0000 (oldest deadline 2019-12-08T17:21:46.178352+0000) 2019-12-08T17:22:00.082 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:22:00.076+0000 1694f700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:03.548175+0000 front 2019-12-08T17:21:05.058138+0000 (oldest deadline 2019-12-08T17:21:44.998684+0000) 2019-12-08T17:22:00.156 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:22:00.149+0000 1694f700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:01.008366+0000 front 2019-12-08T17:21:00.994698+0000 (oldest deadline 2019-12-08T17:21:46.271730+0000) 2019-12-08T17:22:00.156 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:22:00.152+0000 1694f700 -1 osd.6 179 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103177 2.31s0 2:8edd5fee:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.647_kappa%2f%e2%98%83%e0%a4%81%e2%98%83%ed%88%8d%e3%9c%86%e8%94%8b%e9%90%8a%eb%8c%8c%e9%90%8a%e8%94%8b%e5%98%87%e1%a0%84%ef%84%90%e9%90%89%e5%98%86:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-12-08T17:22:00.439 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:22:00.433+0000 1694f700 -1 osd.5 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:02.906939+0000 front 2019-12-08T17:21:02.939525+0000 (oldest deadline 2019-12-08T17:21:46.933760+0000) 2019-12-08T17:22:00.500 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:22:00.493+0000 1694f700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:04.589792+0000 front 2019-12-08T17:21:04.602210+0000 (oldest deadline 2019-12-08T17:21:46.813403+0000) 2019-12-08T17:22:00.616 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:22:00.615+0000 1694f700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:03.708995+0000 front 2019-12-08T17:21:03.977183+0000 (oldest deadline 2019-12-08T17:21:48.326828+0000) 2019-12-08T17:22:00.643 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:22:00.642+0000 1694f700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:02.448331+0000 front 2019-12-08T17:21:02.390601+0000 (oldest deadline 2019-12-08T17:21:45.759557+0000) 2019-12-08T17:22:00.991 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:22:00.990+0000 1694f700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:00.368663+0000 front 2019-12-08T17:21:00.299898+0000 (oldest deadline 2019-12-08T17:21:46.178352+0000) 2019-12-08T17:22:01.098 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:22:01.092+0000 1694f700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:03.548175+0000 front 2019-12-08T17:21:05.058138+0000 (oldest deadline 2019-12-08T17:21:44.998684+0000) 2019-12-08T17:22:01.191 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:22:01.186+0000 1694f700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:01.008366+0000 front 2019-12-08T17:21:00.994698+0000 (oldest deadline 2019-12-08T17:21:46.271730+0000) 2019-12-08T17:22:01.194 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:22:01.190+0000 1694f700 -1 osd.6 179 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103177 2.31s0 2:8edd5fee:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.647_kappa%2f%e2%98%83%e0%a4%81%e2%98%83%ed%88%8d%e3%9c%86%e8%94%8b%e9%90%8a%eb%8c%8c%e9%90%8a%e8%94%8b%e5%98%87%e1%a0%84%ef%84%90%e9%90%89%e5%98%86:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-12-08T17:22:01.459 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:22:01.452+0000 1694f700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:04.589792+0000 front 2019-12-08T17:21:04.602210+0000 (oldest deadline 2019-12-08T17:21:46.813403+0000) 2019-12-08T17:22:01.469 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:22:01.463+0000 1694f700 -1 osd.5 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:02.906939+0000 front 2019-12-08T17:21:02.939525+0000 (oldest deadline 2019-12-08T17:21:46.933760+0000) 2019-12-08T17:22:01.622 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:22:01.619+0000 1694f700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:03.708995+0000 front 2019-12-08T17:21:03.977183+0000 (oldest deadline 2019-12-08T17:21:48.326828+0000) 2019-12-08T17:22:01.679 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:22:01.677+0000 1694f700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:02.448331+0000 front 2019-12-08T17:21:02.390601+0000 (oldest deadline 2019-12-08T17:21:45.759557+0000) 2019-12-08T17:22:01.983 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:22:01.981+0000 1694f700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:00.368663+0000 front 2019-12-08T17:21:00.299898+0000 (oldest deadline 2019-12-08T17:21:46.178352+0000) 2019-12-08T17:22:02.095 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:22:02.089+0000 1694f700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:03.548175+0000 front 2019-12-08T17:21:05.058138+0000 (oldest deadline 2019-12-08T17:21:44.998684+0000) 2019-12-08T17:22:02.223 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:22:02.217+0000 1694f700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:01.008366+0000 front 2019-12-08T17:21:00.994698+0000 (oldest deadline 2019-12-08T17:21:46.271730+0000) 2019-12-08T17:22:02.226 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:22:02.222+0000 1694f700 -1 osd.6 179 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103177 2.31s0 2:8edd5fee:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.647_kappa%2f%e2%98%83%e0%a4%81%e2%98%83%ed%88%8d%e3%9c%86%e8%94%8b%e9%90%8a%eb%8c%8c%e9%90%8a%e8%94%8b%e5%98%87%e1%a0%84%ef%84%90%e9%90%89%e5%98%86:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-12-08T17:22:02.476 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:22:02.470+0000 1694f700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:04.589792+0000 front 2019-12-08T17:21:04.602210+0000 (oldest deadline 2019-12-08T17:21:46.813403+0000) 2019-12-08T17:22:02.513 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:22:02.507+0000 1694f700 -1 osd.5 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:02.906939+0000 front 2019-12-08T17:21:02.939525+0000 (oldest deadline 2019-12-08T17:21:46.933760+0000) 2019-12-08T17:22:02.590 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:22:02.588+0000 1694f700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:03.708995+0000 front 2019-12-08T17:21:03.977183+0000 (oldest deadline 2019-12-08T17:21:48.326828+0000) 2019-12-08T17:22:02.705 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:22:02.702+0000 1694f700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:02.448331+0000 front 2019-12-08T17:21:02.390601+0000 (oldest deadline 2019-12-08T17:21:45.759557+0000) 2019-12-08T17:22:03.016 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:22:03.015+0000 1694f700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:00.368663+0000 front 2019-12-08T17:21:00.299898+0000 (oldest deadline 2019-12-08T17:21:46.178352+0000) 2019-12-08T17:22:03.094 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:22:03.086+0000 1694f700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:03.548175+0000 front 2019-12-08T17:21:05.058138+0000 (oldest deadline 2019-12-08T17:21:44.998684+0000) 2019-12-08T17:22:03.270 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:22:03.264+0000 1694f700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:01.008366+0000 front 2019-12-08T17:21:00.994698+0000 (oldest deadline 2019-12-08T17:21:46.271730+0000) 2019-12-08T17:22:03.274 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:22:03.269+0000 1694f700 -1 osd.6 179 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103177 2.31s0 2:8edd5fee:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.647_kappa%2f%e2%98%83%e0%a4%81%e2%98%83%ed%88%8d%e3%9c%86%e8%94%8b%e9%90%8a%eb%8c%8c%e9%90%8a%e8%94%8b%e5%98%87%e1%a0%84%ef%84%90%e9%90%89%e5%98%86:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-12-08T17:22:03.473 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:22:03.467+0000 1694f700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:04.589792+0000 front 2019-12-08T17:21:04.602210+0000 (oldest deadline 2019-12-08T17:21:46.813403+0000) 2019-12-08T17:22:03.529 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:22:03.517+0000 1694f700 -1 osd.5 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:02.906939+0000 front 2019-12-08T17:21:02.939525+0000 (oldest deadline 2019-12-08T17:21:46.933760+0000) 2019-12-08T17:22:03.567 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:22:03.561+0000 1694f700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:03.708995+0000 front 2019-12-08T17:21:03.977183+0000 (oldest deadline 2019-12-08T17:21:48.326828+0000) 2019-12-08T17:22:03.715 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:22:03.714+0000 1694f700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:02.448331+0000 front 2019-12-08T17:21:02.390601+0000 (oldest deadline 2019-12-08T17:21:45.759557+0000) 2019-12-08T17:22:04.061 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:22:04.058+0000 1694f700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:00.368663+0000 front 2019-12-08T17:21:00.299898+0000 (oldest deadline 2019-12-08T17:21:46.178352+0000) 2019-12-08T17:22:04.071 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:22:04.064+0000 1694f700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:03.548175+0000 front 2019-12-08T17:21:05.058138+0000 (oldest deadline 2019-12-08T17:21:44.998684+0000) 2019-12-08T17:22:04.271 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:22:04.264+0000 1694f700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:01.008366+0000 front 2019-12-08T17:21:00.994698+0000 (oldest deadline 2019-12-08T17:21:46.271730+0000) 2019-12-08T17:22:04.271 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:22:04.267+0000 1694f700 -1 osd.6 179 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103177 2.31s0 2:8edd5fee:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.647_kappa%2f%e2%98%83%e0%a4%81%e2%98%83%ed%88%8d%e3%9c%86%e8%94%8b%e9%90%8a%eb%8c%8c%e9%90%8a%e8%94%8b%e5%98%87%e1%a0%84%ef%84%90%e9%90%89%e5%98%86:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-12-08T17:22:04.517 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:22:04.512+0000 1694f700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:04.589792+0000 front 2019-12-08T17:21:04.602210+0000 (oldest deadline 2019-12-08T17:21:46.813403+0000) 2019-12-08T17:22:04.548 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:22:04.543+0000 1694f700 -1 osd.5 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:02.906939+0000 front 2019-12-08T17:21:02.939525+0000 (oldest deadline 2019-12-08T17:21:46.933760+0000) 2019-12-08T17:22:04.591 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:22:04.590+0000 1694f700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:03.708995+0000 front 2019-12-08T17:21:03.977183+0000 (oldest deadline 2019-12-08T17:21:48.326828+0000) 2019-12-08T17:22:04.672 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:22:04.671+0000 1694f700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:02.448331+0000 front 2019-12-08T17:21:02.390601+0000 (oldest deadline 2019-12-08T17:21:45.759557+0000) 2019-12-08T17:22:05.038 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:22:05.036+0000 1694f700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:00.368663+0000 front 2019-12-08T17:21:00.299898+0000 (oldest deadline 2019-12-08T17:21:46.178352+0000) 2019-12-08T17:22:05.097 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:22:05.090+0000 1694f700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:03.548175+0000 front 2019-12-08T17:21:05.058138+0000 (oldest deadline 2019-12-08T17:21:44.998684+0000) 2019-12-08T17:22:05.241 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:22:05.236+0000 1694f700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:01.008366+0000 front 2019-12-08T17:21:00.994698+0000 (oldest deadline 2019-12-08T17:21:46.271730+0000) 2019-12-08T17:22:05.242 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:22:05.238+0000 1694f700 -1 osd.6 179 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103177 2.31s0 2:8edd5fee:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.647_kappa%2f%e2%98%83%e0%a4%81%e2%98%83%ed%88%8d%e3%9c%86%e8%94%8b%e9%90%8a%eb%8c%8c%e9%90%8a%e8%94%8b%e5%98%87%e1%a0%84%ef%84%90%e9%90%89%e5%98%86:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-12-08T17:22:05.475 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:22:05.469+0000 1694f700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:04.589792+0000 front 2019-12-08T17:21:04.602210+0000 (oldest deadline 2019-12-08T17:21:46.813403+0000) 2019-12-08T17:22:05.550 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:22:05.548+0000 1694f700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:03.708995+0000 front 2019-12-08T17:21:03.977183+0000 (oldest deadline 2019-12-08T17:21:48.326828+0000) 2019-12-08T17:22:05.592 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:22:05.587+0000 1694f700 -1 osd.5 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:02.906939+0000 front 2019-12-08T17:21:02.939525+0000 (oldest deadline 2019-12-08T17:21:46.933760+0000) 2019-12-08T17:22:05.644 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:22:05.644+0000 1694f700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:02.448331+0000 front 2019-12-08T17:21:02.390601+0000 (oldest deadline 2019-12-08T17:21:45.759557+0000) 2019-12-08T17:22:06.048 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:22:06.046+0000 1694f700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:00.368663+0000 front 2019-12-08T17:21:00.299898+0000 (oldest deadline 2019-12-08T17:21:46.178352+0000) 2019-12-08T17:22:06.073 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:22:06.067+0000 1694f700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:03.548175+0000 front 2019-12-08T17:21:05.058138+0000 (oldest deadline 2019-12-08T17:21:44.998684+0000) 2019-12-08T17:22:06.207 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:22:06.201+0000 1694f700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:01.008366+0000 front 2019-12-08T17:21:00.994698+0000 (oldest deadline 2019-12-08T17:21:46.271730+0000) 2019-12-08T17:22:06.210 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:22:06.206+0000 1694f700 -1 osd.6 179 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103177 2.31s0 2:8edd5fee:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.647_kappa%2f%e2%98%83%e0%a4%81%e2%98%83%ed%88%8d%e3%9c%86%e8%94%8b%e9%90%8a%eb%8c%8c%e9%90%8a%e8%94%8b%e5%98%87%e1%a0%84%ef%84%90%e9%90%89%e5%98%86:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-12-08T17:22:06.455 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:22:06.450+0000 1694f700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:04.589792+0000 front 2019-12-08T17:21:04.602210+0000 (oldest deadline 2019-12-08T17:21:46.813403+0000) 2019-12-08T17:22:06.576 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:22:06.576+0000 1694f700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:03.708995+0000 front 2019-12-08T17:21:03.977183+0000 (oldest deadline 2019-12-08T17:21:48.326828+0000) 2019-12-08T17:22:06.595 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:22:06.589+0000 1694f700 -1 osd.5 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:02.906939+0000 front 2019-12-08T17:21:02.939525+0000 (oldest deadline 2019-12-08T17:21:46.933760+0000) 2019-12-08T17:22:06.669 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:22:06.667+0000 1694f700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:02.448331+0000 front 2019-12-08T17:21:02.390601+0000 (oldest deadline 2019-12-08T17:21:45.759557+0000) 2019-12-08T17:22:07.056 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:22:07.047+0000 1694f700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:03.548175+0000 front 2019-12-08T17:21:05.058138+0000 (oldest deadline 2019-12-08T17:21:44.998684+0000) 2019-12-08T17:22:07.097 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:22:07.095+0000 1694f700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:00.368663+0000 front 2019-12-08T17:21:00.299898+0000 (oldest deadline 2019-12-08T17:21:46.178352+0000) 2019-12-08T17:22:07.241 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:22:07.235+0000 1694f700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:01.008366+0000 front 2019-12-08T17:21:00.994698+0000 (oldest deadline 2019-12-08T17:21:46.271730+0000) 2019-12-08T17:22:07.244 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:22:07.237+0000 1694f700 -1 osd.6 179 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103177 2.31s0 2:8edd5fee:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.647_kappa%2f%e2%98%83%e0%a4%81%e2%98%83%ed%88%8d%e3%9c%86%e8%94%8b%e9%90%8a%eb%8c%8c%e9%90%8a%e8%94%8b%e5%98%87%e1%a0%84%ef%84%90%e9%90%89%e5%98%86:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-12-08T17:22:07.467 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:22:07.461+0000 1694f700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:04.589792+0000 front 2019-12-08T17:21:04.602210+0000 (oldest deadline 2019-12-08T17:21:46.813403+0000) 2019-12-08T17:22:07.590 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:22:07.583+0000 1694f700 -1 osd.5 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:02.906939+0000 front 2019-12-08T17:21:02.939525+0000 (oldest deadline 2019-12-08T17:21:46.933760+0000) 2019-12-08T17:22:07.622 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:22:07.621+0000 1694f700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:03.708995+0000 front 2019-12-08T17:21:03.977183+0000 (oldest deadline 2019-12-08T17:21:48.326828+0000) 2019-12-08T17:22:07.648 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:22:07.646+0000 1694f700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:02.448331+0000 front 2019-12-08T17:21:02.390601+0000 (oldest deadline 2019-12-08T17:21:45.759557+0000) 2019-12-08T17:22:08.045 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:22:08.039+0000 1694f700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:03.548175+0000 front 2019-12-08T17:21:05.058138+0000 (oldest deadline 2019-12-08T17:21:44.998684+0000) 2019-12-08T17:22:08.120 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:22:08.119+0000 1694f700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:00.368663+0000 front 2019-12-08T17:21:00.299898+0000 (oldest deadline 2019-12-08T17:21:46.178352+0000) 2019-12-08T17:22:08.266 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:22:08.259+0000 1694f700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:01.008366+0000 front 2019-12-08T17:21:00.994698+0000 (oldest deadline 2019-12-08T17:21:46.271730+0000) 2019-12-08T17:22:08.267 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:22:08.262+0000 1694f700 -1 osd.6 179 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103177 2.31s0 2:8edd5fee:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.647_kappa%2f%e2%98%83%e0%a4%81%e2%98%83%ed%88%8d%e3%9c%86%e8%94%8b%e9%90%8a%eb%8c%8c%e9%90%8a%e8%94%8b%e5%98%87%e1%a0%84%ef%84%90%e9%90%89%e5%98%86:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-12-08T17:22:08.440 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:22:08.431+0000 1694f700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:04.589792+0000 front 2019-12-08T17:21:04.602210+0000 (oldest deadline 2019-12-08T17:21:46.813403+0000) 2019-12-08T17:22:08.606 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:22:08.605+0000 1694f700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:03.708995+0000 front 2019-12-08T17:21:03.977183+0000 (oldest deadline 2019-12-08T17:21:48.326828+0000) 2019-12-08T17:22:08.620 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:22:08.615+0000 1694f700 -1 osd.5 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:02.906939+0000 front 2019-12-08T17:21:02.939525+0000 (oldest deadline 2019-12-08T17:21:46.933760+0000) 2019-12-08T17:22:08.667 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:22:08.666+0000 1694f700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:02.448331+0000 front 2019-12-08T17:21:02.390601+0000 (oldest deadline 2019-12-08T17:21:45.759557+0000) 2019-12-08T17:22:09.100 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:22:09.093+0000 1694f700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:03.548175+0000 front 2019-12-08T17:21:05.058138+0000 (oldest deadline 2019-12-08T17:21:44.998684+0000) 2019-12-08T17:22:09.146 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:22:09.144+0000 1694f700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:00.368663+0000 front 2019-12-08T17:21:00.299898+0000 (oldest deadline 2019-12-08T17:21:46.178352+0000) 2019-12-08T17:22:09.284 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:22:09.278+0000 1694f700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:01.008366+0000 front 2019-12-08T17:21:00.994698+0000 (oldest deadline 2019-12-08T17:21:46.271730+0000) 2019-12-08T17:22:09.287 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:22:09.283+0000 1694f700 -1 osd.6 179 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103177 2.31s0 2:8edd5fee:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.647_kappa%2f%e2%98%83%e0%a4%81%e2%98%83%ed%88%8d%e3%9c%86%e8%94%8b%e9%90%8a%eb%8c%8c%e9%90%8a%e8%94%8b%e5%98%87%e1%a0%84%ef%84%90%e9%90%89%e5%98%86:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-12-08T17:22:09.475 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:22:09.467+0000 1694f700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:04.589792+0000 front 2019-12-08T17:21:04.602210+0000 (oldest deadline 2019-12-08T17:21:46.813403+0000) 2019-12-08T17:22:09.608 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:22:09.606+0000 1694f700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:03.708995+0000 front 2019-12-08T17:21:03.977183+0000 (oldest deadline 2019-12-08T17:21:48.326828+0000) 2019-12-08T17:22:09.648 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:22:09.642+0000 1694f700 -1 osd.5 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:02.906939+0000 front 2019-12-08T17:21:02.939525+0000 (oldest deadline 2019-12-08T17:21:46.933760+0000) 2019-12-08T17:22:09.708 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:22:09.706+0000 1694f700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:02.448331+0000 front 2019-12-08T17:21:02.390601+0000 (oldest deadline 2019-12-08T17:21:45.759557+0000) 2019-12-08T17:22:10.097 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:22:10.085+0000 1694f700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:03.548175+0000 front 2019-12-08T17:21:05.058138+0000 (oldest deadline 2019-12-08T17:21:44.998684+0000) 2019-12-08T17:22:10.155 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:22:10.153+0000 1694f700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:00.368663+0000 front 2019-12-08T17:21:00.299898+0000 (oldest deadline 2019-12-08T17:21:46.178352+0000) 2019-12-08T17:22:10.281 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:22:10.276+0000 1694f700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:01.008366+0000 front 2019-12-08T17:21:00.994698+0000 (oldest deadline 2019-12-08T17:21:46.271730+0000) 2019-12-08T17:22:10.283 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:22:10.280+0000 1694f700 -1 osd.6 179 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103177 2.31s0 2:8edd5fee:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.647_kappa%2f%e2%98%83%e0%a4%81%e2%98%83%ed%88%8d%e3%9c%86%e8%94%8b%e9%90%8a%eb%8c%8c%e9%90%8a%e8%94%8b%e5%98%87%e1%a0%84%ef%84%90%e9%90%89%e5%98%86:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-12-08T17:22:10.493 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:22:10.486+0000 1694f700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:04.589792+0000 front 2019-12-08T17:21:04.602210+0000 (oldest deadline 2019-12-08T17:21:46.813403+0000) 2019-12-08T17:22:10.627 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:22:10.626+0000 1694f700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:03.708995+0000 front 2019-12-08T17:21:03.977183+0000 (oldest deadline 2019-12-08T17:21:48.326828+0000) 2019-12-08T17:22:10.640 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:22:10.634+0000 1694f700 -1 osd.5 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:02.906939+0000 front 2019-12-08T17:21:02.939525+0000 (oldest deadline 2019-12-08T17:21:46.933760+0000) 2019-12-08T17:22:10.751 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:22:10.747+0000 1694f700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:02.448331+0000 front 2019-12-08T17:21:02.390601+0000 (oldest deadline 2019-12-08T17:21:45.759557+0000) 2019-12-08T17:22:11.117 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:22:11.112+0000 1694f700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:03.548175+0000 front 2019-12-08T17:21:05.058138+0000 (oldest deadline 2019-12-08T17:21:44.998684+0000) 2019-12-08T17:22:11.189 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:22:11.187+0000 1694f700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:00.368663+0000 front 2019-12-08T17:21:00.299898+0000 (oldest deadline 2019-12-08T17:21:46.178352+0000) 2019-12-08T17:22:11.318 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:22:11.313+0000 1694f700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:01.008366+0000 front 2019-12-08T17:21:00.994698+0000 (oldest deadline 2019-12-08T17:21:46.271730+0000) 2019-12-08T17:22:11.322 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:22:11.318+0000 1694f700 -1 osd.6 179 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103177 2.31s0 2:8edd5fee:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.647_kappa%2f%e2%98%83%e0%a4%81%e2%98%83%ed%88%8d%e3%9c%86%e8%94%8b%e9%90%8a%eb%8c%8c%e9%90%8a%e8%94%8b%e5%98%87%e1%a0%84%ef%84%90%e9%90%89%e5%98%86:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-12-08T17:22:11.486 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:22:11.480+0000 1694f700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:04.589792+0000 front 2019-12-08T17:21:04.602210+0000 (oldest deadline 2019-12-08T17:21:46.813403+0000) 2019-12-08T17:22:11.587 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:22:11.583+0000 1694f700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:03.708995+0000 front 2019-12-08T17:21:03.977183+0000 (oldest deadline 2019-12-08T17:21:48.326828+0000) 2019-12-08T17:22:11.693 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:22:11.688+0000 1694f700 -1 osd.5 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:02.906939+0000 front 2019-12-08T17:21:02.939525+0000 (oldest deadline 2019-12-08T17:21:46.933760+0000) 2019-12-08T17:22:11.796 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:22:11.791+0000 1694f700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:02.448331+0000 front 2019-12-08T17:21:02.390601+0000 (oldest deadline 2019-12-08T17:21:45.759557+0000) 2019-12-08T17:22:12.161 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:22:12.155+0000 1694f700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:03.548175+0000 front 2019-12-08T17:21:05.058138+0000 (oldest deadline 2019-12-08T17:21:44.998684+0000) 2019-12-08T17:22:12.233 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:22:12.231+0000 1694f700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:00.368663+0000 front 2019-12-08T17:21:00.299898+0000 (oldest deadline 2019-12-08T17:21:46.178352+0000) 2019-12-08T17:22:12.286 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:22:12.281+0000 1694f700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:01.008366+0000 front 2019-12-08T17:21:00.994698+0000 (oldest deadline 2019-12-08T17:21:46.271730+0000) 2019-12-08T17:22:12.286 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:22:12.282+0000 1694f700 -1 osd.6 179 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103177 2.31s0 2:8edd5fee:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.647_kappa%2f%e2%98%83%e0%a4%81%e2%98%83%ed%88%8d%e3%9c%86%e8%94%8b%e9%90%8a%eb%8c%8c%e9%90%8a%e8%94%8b%e5%98%87%e1%a0%84%ef%84%90%e9%90%89%e5%98%86:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-12-08T17:22:12.527 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:22:12.521+0000 1694f700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:04.589792+0000 front 2019-12-08T17:21:04.602210+0000 (oldest deadline 2019-12-08T17:21:46.813403+0000) 2019-12-08T17:22:12.585 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:22:12.581+0000 1694f700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:03.708995+0000 front 2019-12-08T17:21:03.977183+0000 (oldest deadline 2019-12-08T17:21:48.326828+0000) 2019-12-08T17:22:12.664 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:22:12.658+0000 1694f700 -1 osd.5 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:02.906939+0000 front 2019-12-08T17:21:02.939525+0000 (oldest deadline 2019-12-08T17:21:46.933760+0000) 2019-12-08T17:22:12.787 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:22:12.785+0000 1694f700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:02.448331+0000 front 2019-12-08T17:21:02.390601+0000 (oldest deadline 2019-12-08T17:21:45.759557+0000) 2019-12-08T17:22:13.214 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:22:13.208+0000 1694f700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:03.548175+0000 front 2019-12-08T17:21:05.058138+0000 (oldest deadline 2019-12-08T17:21:44.998684+0000) 2019-12-08T17:22:13.241 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:22:13.236+0000 1694f700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:01.008366+0000 front 2019-12-08T17:21:00.994698+0000 (oldest deadline 2019-12-08T17:21:46.271730+0000) 2019-12-08T17:22:13.244 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:22:13.240+0000 1694f700 -1 osd.6 179 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103177 2.31s0 2:8edd5fee:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.647_kappa%2f%e2%98%83%e0%a4%81%e2%98%83%ed%88%8d%e3%9c%86%e8%94%8b%e9%90%8a%eb%8c%8c%e9%90%8a%e8%94%8b%e5%98%87%e1%a0%84%ef%84%90%e9%90%89%e5%98%86:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-12-08T17:22:13.263 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:22:13.261+0000 1694f700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:00.368663+0000 front 2019-12-08T17:21:00.299898+0000 (oldest deadline 2019-12-08T17:21:46.178352+0000) 2019-12-08T17:22:13.510 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:22:13.502+0000 1694f700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:04.589792+0000 front 2019-12-08T17:21:04.602210+0000 (oldest deadline 2019-12-08T17:21:46.813403+0000) 2019-12-08T17:22:13.612 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:22:13.610+0000 1694f700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:03.708995+0000 front 2019-12-08T17:21:03.977183+0000 (oldest deadline 2019-12-08T17:21:48.326828+0000) 2019-12-08T17:22:13.658 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:22:13.652+0000 1694f700 -1 osd.5 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:02.906939+0000 front 2019-12-08T17:21:02.939525+0000 (oldest deadline 2019-12-08T17:21:46.933760+0000) 2019-12-08T17:22:13.761 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:22:13.759+0000 1694f700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:02.448331+0000 front 2019-12-08T17:21:02.390601+0000 (oldest deadline 2019-12-08T17:21:45.759557+0000) 2019-12-08T17:22:14.248 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:22:14.243+0000 1694f700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:03.548175+0000 front 2019-12-08T17:21:05.058138+0000 (oldest deadline 2019-12-08T17:21:44.998684+0000) 2019-12-08T17:22:14.255 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:22:14.249+0000 1694f700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:01.008366+0000 front 2019-12-08T17:21:00.994698+0000 (oldest deadline 2019-12-08T17:21:46.271730+0000) 2019-12-08T17:22:14.255 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:22:14.251+0000 1694f700 -1 osd.6 179 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103177 2.31s0 2:8edd5fee:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.647_kappa%2f%e2%98%83%e0%a4%81%e2%98%83%ed%88%8d%e3%9c%86%e8%94%8b%e9%90%8a%eb%8c%8c%e9%90%8a%e8%94%8b%e5%98%87%e1%a0%84%ef%84%90%e9%90%89%e5%98%86:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-12-08T17:22:14.295 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:22:14.292+0000 1694f700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:00.368663+0000 front 2019-12-08T17:21:00.299898+0000 (oldest deadline 2019-12-08T17:21:46.178352+0000) 2019-12-08T17:22:14.485 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:22:14.479+0000 1694f700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:04.589792+0000 front 2019-12-08T17:21:04.602210+0000 (oldest deadline 2019-12-08T17:21:46.813403+0000) 2019-12-08T17:22:14.656 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:22:14.654+0000 1694f700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:03.708995+0000 front 2019-12-08T17:21:03.977183+0000 (oldest deadline 2019-12-08T17:21:48.326828+0000) 2019-12-08T17:22:14.671 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:22:14.666+0000 1694f700 -1 osd.5 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:02.906939+0000 front 2019-12-08T17:21:02.939525+0000 (oldest deadline 2019-12-08T17:21:46.933760+0000) 2019-12-08T17:22:14.737 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:22:14.735+0000 1694f700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:02.448331+0000 front 2019-12-08T17:21:02.390601+0000 (oldest deadline 2019-12-08T17:21:45.759557+0000) 2019-12-08T17:22:15.289 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:22:15.282+0000 1694f700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:01.008366+0000 front 2019-12-08T17:21:00.994698+0000 (oldest deadline 2019-12-08T17:21:46.271730+0000) 2019-12-08T17:22:15.290 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:22:15.285+0000 1694f700 -1 osd.6 179 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103177 2.31s0 2:8edd5fee:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.647_kappa%2f%e2%98%83%e0%a4%81%e2%98%83%ed%88%8d%e3%9c%86%e8%94%8b%e9%90%8a%eb%8c%8c%e9%90%8a%e8%94%8b%e5%98%87%e1%a0%84%ef%84%90%e9%90%89%e5%98%86:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-12-08T17:22:15.290 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:22:15.284+0000 1694f700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:03.548175+0000 front 2019-12-08T17:21:05.058138+0000 (oldest deadline 2019-12-08T17:21:44.998684+0000) 2019-12-08T17:22:15.314 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:22:15.311+0000 1694f700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:00.368663+0000 front 2019-12-08T17:21:00.299898+0000 (oldest deadline 2019-12-08T17:21:46.178352+0000) 2019-12-08T17:22:15.518 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:22:15.512+0000 1694f700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:04.589792+0000 front 2019-12-08T17:21:04.602210+0000 (oldest deadline 2019-12-08T17:21:46.813403+0000) 2019-12-08T17:22:15.622 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:22:15.620+0000 1694f700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:03.708995+0000 front 2019-12-08T17:21:03.977183+0000 (oldest deadline 2019-12-08T17:21:48.326828+0000) 2019-12-08T17:22:15.644 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:22:15.637+0000 1694f700 -1 osd.5 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:02.906939+0000 front 2019-12-08T17:21:02.939525+0000 (oldest deadline 2019-12-08T17:21:46.933760+0000) 2019-12-08T17:22:15.758 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:22:15.755+0000 1694f700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:02.448331+0000 front 2019-12-08T17:21:02.390601+0000 (oldest deadline 2019-12-08T17:21:45.759557+0000) 2019-12-08T17:22:16.265 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:22:16.259+0000 1694f700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:03.548175+0000 front 2019-12-08T17:21:05.058138+0000 (oldest deadline 2019-12-08T17:21:44.998684+0000) 2019-12-08T17:22:16.297 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:22:16.294+0000 1694f700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:00.368663+0000 front 2019-12-08T17:21:00.299898+0000 (oldest deadline 2019-12-08T17:21:46.178352+0000) 2019-12-08T17:22:16.340 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:22:16.333+0000 1694f700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:01.008366+0000 front 2019-12-08T17:21:00.994698+0000 (oldest deadline 2019-12-08T17:21:46.271730+0000) 2019-12-08T17:22:16.344 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:22:16.336+0000 1694f700 -1 osd.6 179 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103177 2.31s0 2:8edd5fee:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.647_kappa%2f%e2%98%83%e0%a4%81%e2%98%83%ed%88%8d%e3%9c%86%e8%94%8b%e9%90%8a%eb%8c%8c%e9%90%8a%e8%94%8b%e5%98%87%e1%a0%84%ef%84%90%e9%90%89%e5%98%86:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-12-08T17:22:16.503 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:22:16.497+0000 1694f700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:04.589792+0000 front 2019-12-08T17:21:04.602210+0000 (oldest deadline 2019-12-08T17:21:46.813403+0000) 2019-12-08T17:22:16.630 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:22:16.624+0000 1694f700 -1 osd.5 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:02.906939+0000 front 2019-12-08T17:21:02.939525+0000 (oldest deadline 2019-12-08T17:21:46.933760+0000) 2019-12-08T17:22:16.636 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:22:16.634+0000 1694f700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:03.708995+0000 front 2019-12-08T17:21:03.977183+0000 (oldest deadline 2019-12-08T17:21:48.326828+0000) 2019-12-08T17:22:16.796 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:22:16.793+0000 1694f700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:02.448331+0000 front 2019-12-08T17:21:02.390601+0000 (oldest deadline 2019-12-08T17:21:45.759557+0000) 2019-12-08T17:22:17.307 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:22:17.300+0000 1694f700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:01.008366+0000 front 2019-12-08T17:21:00.994698+0000 (oldest deadline 2019-12-08T17:21:46.271730+0000) 2019-12-08T17:22:17.308 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:22:17.303+0000 1694f700 -1 osd.6 179 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103177 2.31s0 2:8edd5fee:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.647_kappa%2f%e2%98%83%e0%a4%81%e2%98%83%ed%88%8d%e3%9c%86%e8%94%8b%e9%90%8a%eb%8c%8c%e9%90%8a%e8%94%8b%e5%98%87%e1%a0%84%ef%84%90%e9%90%89%e5%98%86:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-12-08T17:22:17.313 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:22:17.307+0000 1694f700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:03.548175+0000 front 2019-12-08T17:21:05.058138+0000 (oldest deadline 2019-12-08T17:21:44.998684+0000) 2019-12-08T17:22:17.325 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:22:17.323+0000 1694f700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:00.368663+0000 front 2019-12-08T17:21:00.299898+0000 (oldest deadline 2019-12-08T17:21:46.178352+0000) 2019-12-08T17:22:17.487 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:22:17.481+0000 1694f700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:04.589792+0000 front 2019-12-08T17:21:04.602210+0000 (oldest deadline 2019-12-08T17:21:46.813403+0000) 2019-12-08T17:22:17.589 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:22:17.583+0000 1694f700 -1 osd.5 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:02.906939+0000 front 2019-12-08T17:21:02.939525+0000 (oldest deadline 2019-12-08T17:21:46.933760+0000) 2019-12-08T17:22:17.605 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:22:17.603+0000 1694f700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:03.708995+0000 front 2019-12-08T17:21:03.977183+0000 (oldest deadline 2019-12-08T17:21:48.326828+0000) 2019-12-08T17:22:17.800 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:22:17.797+0000 1694f700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:02.448331+0000 front 2019-12-08T17:21:02.390601+0000 (oldest deadline 2019-12-08T17:21:45.759557+0000) 2019-12-08T17:22:18.293 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:22:18.288+0000 1694f700 -1 osd.7 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:03.548175+0000 front 2019-12-08T17:21:05.058138+0000 (oldest deadline 2019-12-08T17:21:44.998684+0000) 2019-12-08T17:22:18.304 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:22:18.301+0000 1694f700 -1 osd.1 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:00.368663+0000 front 2019-12-08T17:21:00.299898+0000 (oldest deadline 2019-12-08T17:21:46.178352+0000) 2019-12-08T17:22:18.358 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:22:18.352+0000 1694f700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:01.008366+0000 front 2019-12-08T17:21:00.994698+0000 (oldest deadline 2019-12-08T17:21:46.271730+0000) 2019-12-08T17:22:18.358 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:22:18.354+0000 1694f700 -1 osd.6 179 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103177 2.31s0 2:8edd5fee:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.647_kappa%2f%e2%98%83%e0%a4%81%e2%98%83%ed%88%8d%e3%9c%86%e8%94%8b%e9%90%8a%eb%8c%8c%e9%90%8a%e8%94%8b%e5%98%87%e1%a0%84%ef%84%90%e9%90%89%e5%98%86:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-12-08T17:22:18.456 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:22:18.450+0000 1694f700 -1 osd.4 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:04.589792+0000 front 2019-12-08T17:21:04.602210+0000 (oldest deadline 2019-12-08T17:21:46.813403+0000) 2019-12-08T17:22:18.616 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:22:18.610+0000 1694f700 -1 osd.5 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:02.906939+0000 front 2019-12-08T17:21:02.939525+0000 (oldest deadline 2019-12-08T17:21:46.933760+0000) 2019-12-08T17:22:18.654 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:22:18.652+0000 1694f700 -1 osd.3 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:03.708995+0000 front 2019-12-08T17:21:03.977183+0000 (oldest deadline 2019-12-08T17:21:48.326828+0000) 2019-12-08T17:22:18.792 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:22:18.788+0000 1694f700 -1 osd.0 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:02.448331+0000 front 2019-12-08T17:21:02.390601+0000 (oldest deadline 2019-12-08T17:21:45.759557+0000) 2019-12-08T17:22:18.988 INFO:tasks.ceph.mon.b.smithi013.stderr:2019-12-08T17:22:18.966+0000 1a89c700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.2 [v2:172.21.15.79:6802/10448,v1:172.21.15.79:6803/10448] for 42sec e179 v179) 2019-12-08T17:22:19.319 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:22:19.314+0000 1694f700 -1 osd.6 179 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:21:01.008366+0000 front 2019-12-08T17:21:00.994698+0000 (oldest deadline 2019-12-08T17:21:46.271730+0000) 2019-12-08T17:22:19.319 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:22:19.316+0000 1694f700 -1 osd.6 179 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103177 2.31s0 2:8edd5fee:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.647_kappa%2f%e2%98%83%e0%a4%81%e2%98%83%ed%88%8d%e3%9c%86%e8%94%8b%e9%90%8a%eb%8c%8c%e9%90%8a%e8%94%8b%e5%98%87%e1%a0%84%ef%84%90%e9%90%89%e5%98%86:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-12-08T17:22:20.304 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:22:20.300+0000 1694f700 -1 osd.6 180 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103177 2.31s0 2:8edd5fee:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.647_kappa%2f%e2%98%83%e0%a4%81%e2%98%83%ed%88%8d%e3%9c%86%e8%94%8b%e9%90%8a%eb%8c%8c%e9%90%8a%e8%94%8b%e5%98%87%e1%a0%84%ef%84%90%e9%90%89%e5%98%86:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-12-08T17:22:21.325 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:22:21.320+0000 1694f700 -1 osd.6 181 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103177 2.31s0 2:8edd5fee:::f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.647_kappa%2f%e2%98%83%e0%a4%81%e2%98%83%ed%88%8d%e3%9c%86%e8%94%8b%e9%90%8a%eb%8c%8c%e9%90%8a%e8%94%8b%e5%98%87%e1%a0%84%ef%84%90%e9%90%89%e5%98%86:head [cmpxattr user.rgw.idtag (48) op 1 mode 1 in=62b,call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected e179) 2019-12-08T17:23:16.119 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:23:16.110+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:33.016580+0000 front 2019-12-08T17:22:36.103432+0000 (oldest deadline 2019-12-08T17:23:15.824948+0000) 2019-12-08T17:23:17.096 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:23:17.089+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:33.016580+0000 front 2019-12-08T17:22:36.103432+0000 (oldest deadline 2019-12-08T17:23:15.824948+0000) 2019-12-08T17:23:17.353 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:23:17.350+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.904359+0000 front 2019-12-08T17:22:35.608077+0000 (oldest deadline 2019-12-08T17:23:17.244215+0000) 2019-12-08T17:23:17.764 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:23:17.760+0000 1694f700 -1 osd.0 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:34.230982+0000 front 2019-12-08T17:22:33.660719+0000 (oldest deadline 2019-12-08T17:23:16.799108+0000) 2019-12-08T17:23:17.788 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:23:17.777+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:36.170816+0000 front 2019-12-08T17:22:36.183121+0000 (oldest deadline 2019-12-08T17:23:17.046659+0000) 2019-12-08T17:23:18.131 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:23:18.124+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:33.016580+0000 front 2019-12-08T17:22:36.103432+0000 (oldest deadline 2019-12-08T17:23:15.824948+0000) 2019-12-08T17:23:18.320 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:23:18.317+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.904359+0000 front 2019-12-08T17:22:35.608077+0000 (oldest deadline 2019-12-08T17:23:17.244215+0000) 2019-12-08T17:23:18.597 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:23:18.590+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:32.740891+0000 front 2019-12-08T17:22:32.759324+0000 (oldest deadline 2019-12-08T17:23:18.447847+0000) 2019-12-08T17:23:18.764 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:23:18.758+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:36.170816+0000 front 2019-12-08T17:22:36.183121+0000 (oldest deadline 2019-12-08T17:23:17.046659+0000) 2019-12-08T17:23:18.792 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:23:18.789+0000 1694f700 -1 osd.0 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:34.230982+0000 front 2019-12-08T17:22:33.660719+0000 (oldest deadline 2019-12-08T17:23:16.799108+0000) 2019-12-08T17:23:19.150 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:23:19.144+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:33.016580+0000 front 2019-12-08T17:22:36.103432+0000 (oldest deadline 2019-12-08T17:23:15.824948+0000) 2019-12-08T17:23:19.368 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:23:19.367+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.904359+0000 front 2019-12-08T17:22:35.608077+0000 (oldest deadline 2019-12-08T17:23:17.244215+0000) 2019-12-08T17:23:19.647 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:23:19.641+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:32.740891+0000 front 2019-12-08T17:22:32.759324+0000 (oldest deadline 2019-12-08T17:23:18.447847+0000) 2019-12-08T17:23:19.738 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:23:19.731+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:36.170816+0000 front 2019-12-08T17:22:36.183121+0000 (oldest deadline 2019-12-08T17:23:17.046659+0000) 2019-12-08T17:23:19.820 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:23:19.816+0000 1694f700 -1 osd.0 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:34.230982+0000 front 2019-12-08T17:22:33.660719+0000 (oldest deadline 2019-12-08T17:23:16.799108+0000) 2019-12-08T17:23:19.840 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:23:19.835+0000 1694f700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.809017+0000 front 2019-12-08T17:22:36.091153+0000 (oldest deadline 2019-12-08T17:23:19.280706+0000) 2019-12-08T17:23:20.139 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:23:20.133+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:33.016580+0000 front 2019-12-08T17:22:36.103432+0000 (oldest deadline 2019-12-08T17:23:15.824948+0000) 2019-12-08T17:23:20.338 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:23:20.336+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.904359+0000 front 2019-12-08T17:22:35.608077+0000 (oldest deadline 2019-12-08T17:23:17.244215+0000) 2019-12-08T17:23:20.664 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:23:20.658+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:32.740891+0000 front 2019-12-08T17:22:32.759324+0000 (oldest deadline 2019-12-08T17:23:18.447847+0000) 2019-12-08T17:23:20.779 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:23:20.773+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:36.170816+0000 front 2019-12-08T17:22:36.183121+0000 (oldest deadline 2019-12-08T17:23:17.046659+0000) 2019-12-08T17:23:20.784 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:23:20.781+0000 1694f700 -1 osd.0 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:34.230982+0000 front 2019-12-08T17:22:33.660719+0000 (oldest deadline 2019-12-08T17:23:16.799108+0000) 2019-12-08T17:23:20.870 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:23:20.860+0000 1694f700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.809017+0000 front 2019-12-08T17:22:36.091153+0000 (oldest deadline 2019-12-08T17:23:19.280706+0000) 2019-12-08T17:23:21.146 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:23:21.140+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:33.016580+0000 front 2019-12-08T17:22:36.103432+0000 (oldest deadline 2019-12-08T17:23:15.824948+0000) 2019-12-08T17:23:21.336 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:23:21.334+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.904359+0000 front 2019-12-08T17:22:35.608077+0000 (oldest deadline 2019-12-08T17:23:17.244215+0000) 2019-12-08T17:23:21.689 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:23:21.683+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:32.740891+0000 front 2019-12-08T17:22:32.759324+0000 (oldest deadline 2019-12-08T17:23:18.447847+0000) 2019-12-08T17:23:21.793 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:23:21.787+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:36.170816+0000 front 2019-12-08T17:22:36.183121+0000 (oldest deadline 2019-12-08T17:23:17.046659+0000) 2019-12-08T17:23:21.809 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:23:21.808+0000 1694f700 -1 osd.0 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:34.230982+0000 front 2019-12-08T17:22:33.660719+0000 (oldest deadline 2019-12-08T17:23:16.799108+0000) 2019-12-08T17:23:21.879 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:23:21.874+0000 1694f700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.809017+0000 front 2019-12-08T17:22:36.091153+0000 (oldest deadline 2019-12-08T17:23:19.280706+0000) 2019-12-08T17:23:22.202 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:23:22.196+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:33.016580+0000 front 2019-12-08T17:22:36.103432+0000 (oldest deadline 2019-12-08T17:23:15.824948+0000) 2019-12-08T17:23:22.331 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:23:22.330+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.904359+0000 front 2019-12-08T17:22:35.608077+0000 (oldest deadline 2019-12-08T17:23:17.244215+0000) 2019-12-08T17:23:22.742 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:23:22.735+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:32.740891+0000 front 2019-12-08T17:22:32.759324+0000 (oldest deadline 2019-12-08T17:23:18.447847+0000) 2019-12-08T17:23:22.809 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:23:22.801+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:36.170816+0000 front 2019-12-08T17:22:36.183121+0000 (oldest deadline 2019-12-08T17:23:17.046659+0000) 2019-12-08T17:23:22.823 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:23:22.821+0000 1694f700 -1 osd.0 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:34.230982+0000 front 2019-12-08T17:22:33.660719+0000 (oldest deadline 2019-12-08T17:23:16.799108+0000) 2019-12-08T17:23:22.889 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:23:22.883+0000 1694f700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.809017+0000 front 2019-12-08T17:22:36.091153+0000 (oldest deadline 2019-12-08T17:23:19.280706+0000) 2019-12-08T17:23:23.158 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:23:23.152+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:33.016580+0000 front 2019-12-08T17:22:36.103432+0000 (oldest deadline 2019-12-08T17:23:15.824948+0000) 2019-12-08T17:23:23.321 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:23:23.319+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.904359+0000 front 2019-12-08T17:22:35.608077+0000 (oldest deadline 2019-12-08T17:23:17.244215+0000) 2019-12-08T17:23:23.766 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:23:23.759+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:32.740891+0000 front 2019-12-08T17:22:32.759324+0000 (oldest deadline 2019-12-08T17:23:18.447847+0000) 2019-12-08T17:23:23.812 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:23:23.805+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:36.170816+0000 front 2019-12-08T17:22:36.183121+0000 (oldest deadline 2019-12-08T17:23:17.046659+0000) 2019-12-08T17:23:23.843 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:23:23.842+0000 1694f700 -1 osd.0 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:34.230982+0000 front 2019-12-08T17:22:33.660719+0000 (oldest deadline 2019-12-08T17:23:16.799108+0000) 2019-12-08T17:23:23.879 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:23:23.871+0000 1694f700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.809017+0000 front 2019-12-08T17:22:36.091153+0000 (oldest deadline 2019-12-08T17:23:19.280706+0000) 2019-12-08T17:23:24.123 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:23:24.117+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:33.016580+0000 front 2019-12-08T17:22:36.103432+0000 (oldest deadline 2019-12-08T17:23:15.824948+0000) 2019-12-08T17:23:24.274 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:23:24.273+0000 1694f700 -1 osd.2 184 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e183) 2019-12-08T17:23:24.283 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:23:24.281+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.904359+0000 front 2019-12-08T17:22:35.608077+0000 (oldest deadline 2019-12-08T17:23:17.244215+0000) 2019-12-08T17:23:24.740 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:23:24.726+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:32.740891+0000 front 2019-12-08T17:22:32.759324+0000 (oldest deadline 2019-12-08T17:23:18.447847+0000) 2019-12-08T17:23:24.770 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:23:24.763+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:36.170816+0000 front 2019-12-08T17:22:36.183121+0000 (oldest deadline 2019-12-08T17:23:17.046659+0000) 2019-12-08T17:23:24.866 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:23:24.865+0000 1694f700 -1 osd.0 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:34.230982+0000 front 2019-12-08T17:22:33.660719+0000 (oldest deadline 2019-12-08T17:23:16.799108+0000) 2019-12-08T17:23:24.887 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:23:24.882+0000 1694f700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.809017+0000 front 2019-12-08T17:22:36.091153+0000 (oldest deadline 2019-12-08T17:23:19.280706+0000) 2019-12-08T17:23:25.101 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:23:25.095+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:33.016580+0000 front 2019-12-08T17:22:36.103432+0000 (oldest deadline 2019-12-08T17:23:15.824948+0000) 2019-12-08T17:23:25.270 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:23:25.268+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.904359+0000 front 2019-12-08T17:22:35.608077+0000 (oldest deadline 2019-12-08T17:23:17.244215+0000) 2019-12-08T17:23:25.285 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:23:25.284+0000 1694f700 -1 osd.2 184 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e183) 2019-12-08T17:23:25.735 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:23:25.729+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:32.740891+0000 front 2019-12-08T17:22:32.759324+0000 (oldest deadline 2019-12-08T17:23:18.447847+0000) 2019-12-08T17:23:25.740 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:23:25.735+0000 1694f700 -1 osd.4 184 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103421 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e184) 2019-12-08T17:23:25.773 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:23:25.766+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:36.170816+0000 front 2019-12-08T17:22:36.183121+0000 (oldest deadline 2019-12-08T17:23:17.046659+0000) 2019-12-08T17:23:25.860 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:23:25.853+0000 1694f700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.809017+0000 front 2019-12-08T17:22:36.091153+0000 (oldest deadline 2019-12-08T17:23:19.280706+0000) 2019-12-08T17:23:25.913 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:23:25.911+0000 1694f700 -1 osd.0 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:34.230982+0000 front 2019-12-08T17:22:33.660719+0000 (oldest deadline 2019-12-08T17:23:16.799108+0000) 2019-12-08T17:23:26.136 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:23:26.130+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:33.016580+0000 front 2019-12-08T17:22:36.103432+0000 (oldest deadline 2019-12-08T17:23:15.824948+0000) 2019-12-08T17:23:26.300 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:23:26.298+0000 1694f700 -1 osd.2 184 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e183) 2019-12-08T17:23:26.305 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:23:26.303+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.904359+0000 front 2019-12-08T17:22:35.608077+0000 (oldest deadline 2019-12-08T17:23:17.244215+0000) 2019-12-08T17:23:26.789 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:23:26.782+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:32.740891+0000 front 2019-12-08T17:22:32.759324+0000 (oldest deadline 2019-12-08T17:23:18.447847+0000) 2019-12-08T17:23:26.796 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:23:26.790+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:36.170816+0000 front 2019-12-08T17:22:36.183121+0000 (oldest deadline 2019-12-08T17:23:17.046659+0000) 2019-12-08T17:23:26.797 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:23:26.784+0000 1694f700 -1 osd.4 184 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103421 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e184) 2019-12-08T17:23:26.883 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:23:26.877+0000 1694f700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.809017+0000 front 2019-12-08T17:22:36.091153+0000 (oldest deadline 2019-12-08T17:23:19.280706+0000) 2019-12-08T17:23:26.902 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:23:26.899+0000 1694f700 -1 osd.0 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:34.230982+0000 front 2019-12-08T17:22:33.660719+0000 (oldest deadline 2019-12-08T17:23:16.799108+0000) 2019-12-08T17:23:27.181 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:23:27.176+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:33.016580+0000 front 2019-12-08T17:22:36.103432+0000 (oldest deadline 2019-12-08T17:23:15.824948+0000) 2019-12-08T17:23:27.263 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:23:27.263+0000 1694f700 -1 osd.2 184 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e183) 2019-12-08T17:23:27.284 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:23:27.282+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.904359+0000 front 2019-12-08T17:22:35.608077+0000 (oldest deadline 2019-12-08T17:23:17.244215+0000) 2019-12-08T17:23:27.776 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:23:27.770+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:32.740891+0000 front 2019-12-08T17:22:32.759324+0000 (oldest deadline 2019-12-08T17:23:18.447847+0000) 2019-12-08T17:23:27.779 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:23:27.775+0000 1694f700 -1 osd.4 184 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103421 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e184) 2019-12-08T17:23:27.783 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:23:27.768+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:36.170816+0000 front 2019-12-08T17:22:36.183121+0000 (oldest deadline 2019-12-08T17:23:17.046659+0000) 2019-12-08T17:23:27.897 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:23:27.891+0000 1694f700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.809017+0000 front 2019-12-08T17:22:36.091153+0000 (oldest deadline 2019-12-08T17:23:19.280706+0000) 2019-12-08T17:23:27.903 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:23:27.902+0000 1694f700 -1 osd.0 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:34.230982+0000 front 2019-12-08T17:22:33.660719+0000 (oldest deadline 2019-12-08T17:23:16.799108+0000) 2019-12-08T17:23:28.136 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:23:28.130+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:33.016580+0000 front 2019-12-08T17:22:36.103432+0000 (oldest deadline 2019-12-08T17:23:15.824948+0000) 2019-12-08T17:23:28.260 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:23:28.258+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.904359+0000 front 2019-12-08T17:22:35.608077+0000 (oldest deadline 2019-12-08T17:23:17.244215+0000) 2019-12-08T17:23:28.270 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:23:28.268+0000 1694f700 -1 osd.2 184 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e183) 2019-12-08T17:23:28.787 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:23:28.782+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:32.740891+0000 front 2019-12-08T17:22:32.759324+0000 (oldest deadline 2019-12-08T17:23:18.447847+0000) 2019-12-08T17:23:28.791 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:23:28.787+0000 1694f700 -1 osd.4 184 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103421 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e184) 2019-12-08T17:23:28.817 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:23:28.811+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:36.170816+0000 front 2019-12-08T17:22:36.183121+0000 (oldest deadline 2019-12-08T17:23:17.046659+0000) 2019-12-08T17:23:28.883 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:23:28.877+0000 1694f700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.809017+0000 front 2019-12-08T17:22:36.091153+0000 (oldest deadline 2019-12-08T17:23:19.280706+0000) 2019-12-08T17:23:28.954 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:23:28.952+0000 1694f700 -1 osd.0 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:34.230982+0000 front 2019-12-08T17:22:33.660719+0000 (oldest deadline 2019-12-08T17:23:16.799108+0000) 2019-12-08T17:23:29.173 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:23:29.166+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:33.016580+0000 front 2019-12-08T17:22:36.103432+0000 (oldest deadline 2019-12-08T17:23:15.824948+0000) 2019-12-08T17:23:29.230 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:23:29.229+0000 1694f700 -1 osd.2 184 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e183) 2019-12-08T17:23:29.257 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:23:29.256+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.904359+0000 front 2019-12-08T17:22:35.608077+0000 (oldest deadline 2019-12-08T17:23:17.244215+0000) 2019-12-08T17:23:29.780 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:23:29.774+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:32.740891+0000 front 2019-12-08T17:22:32.759324+0000 (oldest deadline 2019-12-08T17:23:18.447847+0000) 2019-12-08T17:23:29.784 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:23:29.780+0000 1694f700 -1 osd.4 184 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103421 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e184) 2019-12-08T17:23:29.846 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:23:29.839+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:36.170816+0000 front 2019-12-08T17:22:36.183121+0000 (oldest deadline 2019-12-08T17:23:17.046659+0000) 2019-12-08T17:23:29.892 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:23:29.887+0000 1694f700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.809017+0000 front 2019-12-08T17:22:36.091153+0000 (oldest deadline 2019-12-08T17:23:19.280706+0000) 2019-12-08T17:23:29.982 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:23:29.980+0000 1694f700 -1 osd.0 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:34.230982+0000 front 2019-12-08T17:22:33.660719+0000 (oldest deadline 2019-12-08T17:23:16.799108+0000) 2019-12-08T17:23:30.135 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:23:30.129+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:33.016580+0000 front 2019-12-08T17:22:36.103432+0000 (oldest deadline 2019-12-08T17:23:15.824948+0000) 2019-12-08T17:23:30.237 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:23:30.235+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.904359+0000 front 2019-12-08T17:22:35.608077+0000 (oldest deadline 2019-12-08T17:23:17.244215+0000) 2019-12-08T17:23:30.255 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:23:30.254+0000 1694f700 -1 osd.2 184 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e183) 2019-12-08T17:23:30.805 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:23:30.798+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:36.170816+0000 front 2019-12-08T17:22:36.183121+0000 (oldest deadline 2019-12-08T17:23:17.046659+0000) 2019-12-08T17:23:30.828 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:23:30.821+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:32.740891+0000 front 2019-12-08T17:22:32.759324+0000 (oldest deadline 2019-12-08T17:23:18.447847+0000) 2019-12-08T17:23:30.829 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:23:30.824+0000 1694f700 -1 osd.4 184 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103421 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e184) 2019-12-08T17:23:30.856 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:23:30.849+0000 1694f700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.809017+0000 front 2019-12-08T17:22:36.091153+0000 (oldest deadline 2019-12-08T17:23:19.280706+0000) 2019-12-08T17:23:31.019 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:23:31.016+0000 1694f700 -1 osd.0 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:34.230982+0000 front 2019-12-08T17:22:33.660719+0000 (oldest deadline 2019-12-08T17:23:16.799108+0000) 2019-12-08T17:23:31.094 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:23:31.087+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:33.016580+0000 front 2019-12-08T17:22:36.103432+0000 (oldest deadline 2019-12-08T17:23:15.824948+0000) 2019-12-08T17:23:31.217 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:23:31.210+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:22:50.520368+0000 (oldest deadline 2019-12-08T17:23:30.520368+0000) 2019-12-08T17:23:31.221 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:23:31.221+0000 1694f700 -1 osd.2 184 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e183) 2019-12-08T17:23:31.269 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:23:31.268+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.904359+0000 front 2019-12-08T17:22:35.608077+0000 (oldest deadline 2019-12-08T17:23:17.244215+0000) 2019-12-08T17:23:31.789 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:23:31.782+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:32.740891+0000 front 2019-12-08T17:22:32.759324+0000 (oldest deadline 2019-12-08T17:23:18.447847+0000) 2019-12-08T17:23:31.790 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:23:31.785+0000 1694f700 -1 osd.4 184 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103421 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e184) 2019-12-08T17:23:31.812 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:23:31.806+0000 1694f700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.809017+0000 front 2019-12-08T17:22:36.091153+0000 (oldest deadline 2019-12-08T17:23:19.280706+0000) 2019-12-08T17:23:31.843 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:23:31.837+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:36.170816+0000 front 2019-12-08T17:22:36.183121+0000 (oldest deadline 2019-12-08T17:23:17.046659+0000) 2019-12-08T17:23:32.068 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:23:32.066+0000 1694f700 -1 osd.0 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:34.230982+0000 front 2019-12-08T17:22:33.660719+0000 (oldest deadline 2019-12-08T17:23:16.799108+0000) 2019-12-08T17:23:32.074 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:23:32.069+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:33.016580+0000 front 2019-12-08T17:22:36.103432+0000 (oldest deadline 2019-12-08T17:23:15.824948+0000) 2019-12-08T17:23:32.175 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:23:32.173+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:22:50.520368+0000 (oldest deadline 2019-12-08T17:23:30.520368+0000) 2019-12-08T17:23:32.176 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:23:32.175+0000 1694f700 -1 osd.2 184 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e183) 2019-12-08T17:23:32.242 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:23:32.240+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.904359+0000 front 2019-12-08T17:22:35.608077+0000 (oldest deadline 2019-12-08T17:23:17.244215+0000) 2019-12-08T17:23:32.775 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:23:32.769+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:32.740891+0000 front 2019-12-08T17:22:32.759324+0000 (oldest deadline 2019-12-08T17:23:18.447847+0000) 2019-12-08T17:23:32.779 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:23:32.775+0000 1694f700 -1 osd.4 184 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103421 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e184) 2019-12-08T17:23:32.847 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:23:32.840+0000 1694f700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.809017+0000 front 2019-12-08T17:22:36.091153+0000 (oldest deadline 2019-12-08T17:23:19.280706+0000) 2019-12-08T17:23:32.883 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:23:32.876+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:36.170816+0000 front 2019-12-08T17:22:36.183121+0000 (oldest deadline 2019-12-08T17:23:17.046659+0000) 2019-12-08T17:23:33.041 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:23:33.039+0000 1694f700 -1 osd.0 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:34.230982+0000 front 2019-12-08T17:22:33.660719+0000 (oldest deadline 2019-12-08T17:23:16.799108+0000) 2019-12-08T17:23:33.108 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:23:33.102+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:33.016580+0000 front 2019-12-08T17:22:36.103432+0000 (oldest deadline 2019-12-08T17:23:15.824948+0000) 2019-12-08T17:23:33.138 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:23:33.136+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:22:50.520368+0000 (oldest deadline 2019-12-08T17:23:30.520368+0000) 2019-12-08T17:23:33.142 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:23:33.141+0000 1694f700 -1 osd.2 184 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e183) 2019-12-08T17:23:33.219 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:23:33.218+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.904359+0000 front 2019-12-08T17:22:35.608077+0000 (oldest deadline 2019-12-08T17:23:17.244215+0000) 2019-12-08T17:23:33.773 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:23:33.762+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:32.740891+0000 front 2019-12-08T17:22:32.759324+0000 (oldest deadline 2019-12-08T17:23:18.447847+0000) 2019-12-08T17:23:33.773 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:23:33.765+0000 1694f700 -1 osd.4 184 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103421 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e184) 2019-12-08T17:23:33.884 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:23:33.877+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:36.170816+0000 front 2019-12-08T17:22:36.183121+0000 (oldest deadline 2019-12-08T17:23:17.046659+0000) 2019-12-08T17:23:33.891 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:23:33.884+0000 1694f700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.809017+0000 front 2019-12-08T17:22:36.091153+0000 (oldest deadline 2019-12-08T17:23:19.280706+0000) 2019-12-08T17:23:34.043 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:23:34.042+0000 1694f700 -1 osd.0 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:34.230982+0000 front 2019-12-08T17:22:33.660719+0000 (oldest deadline 2019-12-08T17:23:16.799108+0000) 2019-12-08T17:23:34.132 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:23:34.130+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:22:50.520368+0000 (oldest deadline 2019-12-08T17:23:30.520368+0000) 2019-12-08T17:23:34.136 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:23:34.136+0000 1694f700 -1 osd.2 184 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e183) 2019-12-08T17:23:34.142 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:23:34.135+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:33.016580+0000 front 2019-12-08T17:22:36.103432+0000 (oldest deadline 2019-12-08T17:23:15.824948+0000) 2019-12-08T17:23:34.264 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:23:34.263+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.904359+0000 front 2019-12-08T17:22:35.608077+0000 (oldest deadline 2019-12-08T17:23:17.244215+0000) 2019-12-08T17:23:34.794 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:23:34.787+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:32.740891+0000 front 2019-12-08T17:22:32.759324+0000 (oldest deadline 2019-12-08T17:23:18.447847+0000) 2019-12-08T17:23:34.794 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:23:34.790+0000 1694f700 -1 osd.4 184 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103421 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e184) 2019-12-08T17:23:34.841 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:23:34.835+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:36.170816+0000 front 2019-12-08T17:22:36.183121+0000 (oldest deadline 2019-12-08T17:23:17.046659+0000) 2019-12-08T17:23:34.929 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:23:34.922+0000 1694f700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.809017+0000 front 2019-12-08T17:22:36.091153+0000 (oldest deadline 2019-12-08T17:23:19.280706+0000) 2019-12-08T17:23:35.051 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:23:35.048+0000 1694f700 -1 osd.0 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:34.230982+0000 front 2019-12-08T17:22:33.660719+0000 (oldest deadline 2019-12-08T17:23:16.799108+0000) 2019-12-08T17:23:35.109 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:23:35.098+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:33.016580+0000 front 2019-12-08T17:22:36.103432+0000 (oldest deadline 2019-12-08T17:23:15.824948+0000) 2019-12-08T17:23:35.144 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:23:35.142+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:22:50.520368+0000 (oldest deadline 2019-12-08T17:23:30.520368+0000) 2019-12-08T17:23:35.145 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:23:35.144+0000 1694f700 -1 osd.2 184 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e183) 2019-12-08T17:23:35.262 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:23:35.260+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.904359+0000 front 2019-12-08T17:22:35.608077+0000 (oldest deadline 2019-12-08T17:23:17.244215+0000) 2019-12-08T17:23:35.749 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:23:35.742+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:32.740891+0000 front 2019-12-08T17:22:32.759324+0000 (oldest deadline 2019-12-08T17:23:18.447847+0000) 2019-12-08T17:23:35.750 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:23:35.745+0000 1694f700 -1 osd.4 184 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103421 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e184) 2019-12-08T17:23:35.894 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:23:35.887+0000 1694f700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.809017+0000 front 2019-12-08T17:22:36.091153+0000 (oldest deadline 2019-12-08T17:23:19.280706+0000) 2019-12-08T17:23:35.895 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:23:35.888+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:36.170816+0000 front 2019-12-08T17:22:36.183121+0000 (oldest deadline 2019-12-08T17:23:17.046659+0000) 2019-12-08T17:23:36.050 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:23:36.049+0000 1694f700 -1 osd.0 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:34.230982+0000 front 2019-12-08T17:22:33.660719+0000 (oldest deadline 2019-12-08T17:23:16.799108+0000) 2019-12-08T17:23:36.121 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:23:36.115+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:33.016580+0000 front 2019-12-08T17:22:36.103432+0000 (oldest deadline 2019-12-08T17:23:15.824948+0000) 2019-12-08T17:23:36.136 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:23:36.135+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:22:50.520368+0000 (oldest deadline 2019-12-08T17:23:30.520368+0000) 2019-12-08T17:23:36.137 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:23:36.137+0000 1694f700 -1 osd.2 184 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e183) 2019-12-08T17:23:36.311 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:23:36.310+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.904359+0000 front 2019-12-08T17:22:35.608077+0000 (oldest deadline 2019-12-08T17:23:17.244215+0000) 2019-12-08T17:23:36.758 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:23:36.752+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:32.740891+0000 front 2019-12-08T17:22:32.759324+0000 (oldest deadline 2019-12-08T17:23:18.447847+0000) 2019-12-08T17:23:36.762 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:23:36.757+0000 1694f700 -1 osd.4 184 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103421 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e184) 2019-12-08T17:23:36.853 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:23:36.847+0000 1694f700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.809017+0000 front 2019-12-08T17:22:36.091153+0000 (oldest deadline 2019-12-08T17:23:19.280706+0000) 2019-12-08T17:23:36.885 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:23:36.878+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:36.170816+0000 front 2019-12-08T17:22:36.183121+0000 (oldest deadline 2019-12-08T17:23:17.046659+0000) 2019-12-08T17:23:37.024 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:23:37.023+0000 1694f700 -1 osd.0 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:34.230982+0000 front 2019-12-08T17:22:33.660719+0000 (oldest deadline 2019-12-08T17:23:16.799108+0000) 2019-12-08T17:23:37.107 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:23:37.105+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:22:50.520368+0000 (oldest deadline 2019-12-08T17:23:30.520368+0000) 2019-12-08T17:23:37.110 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:23:37.107+0000 1694f700 -1 osd.2 184 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e183) 2019-12-08T17:23:37.162 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:23:37.155+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:33.016580+0000 front 2019-12-08T17:22:36.103432+0000 (oldest deadline 2019-12-08T17:23:15.824948+0000) 2019-12-08T17:23:37.309 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:23:37.306+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.904359+0000 front 2019-12-08T17:22:35.608077+0000 (oldest deadline 2019-12-08T17:23:17.244215+0000) 2019-12-08T17:23:37.746 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:23:37.741+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:32.740891+0000 front 2019-12-08T17:22:32.759324+0000 (oldest deadline 2019-12-08T17:23:18.447847+0000) 2019-12-08T17:23:37.750 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:23:37.746+0000 1694f700 -1 osd.4 184 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103421 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e184) 2019-12-08T17:23:37.851 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:23:37.845+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:36.170816+0000 front 2019-12-08T17:22:36.183121+0000 (oldest deadline 2019-12-08T17:23:17.046659+0000) 2019-12-08T17:23:37.855 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:23:37.849+0000 1694f700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.809017+0000 front 2019-12-08T17:22:36.091153+0000 (oldest deadline 2019-12-08T17:23:19.280706+0000) 2019-12-08T17:23:37.978 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:23:37.977+0000 1694f700 -1 osd.0 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:34.230982+0000 front 2019-12-08T17:22:33.660719+0000 (oldest deadline 2019-12-08T17:23:16.799108+0000) 2019-12-08T17:23:38.125 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:23:38.123+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:22:50.520368+0000 (oldest deadline 2019-12-08T17:23:30.520368+0000) 2019-12-08T17:23:38.127 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:23:38.125+0000 1694f700 -1 osd.2 184 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e183) 2019-12-08T17:23:38.152 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:23:38.145+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:33.016580+0000 front 2019-12-08T17:22:36.103432+0000 (oldest deadline 2019-12-08T17:23:15.824948+0000) 2019-12-08T17:23:38.303 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:23:38.301+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.904359+0000 front 2019-12-08T17:22:35.608077+0000 (oldest deadline 2019-12-08T17:23:17.244215+0000) 2019-12-08T17:23:38.717 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:23:38.710+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:32.740891+0000 front 2019-12-08T17:22:32.759324+0000 (oldest deadline 2019-12-08T17:23:18.447847+0000) 2019-12-08T17:23:38.717 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:23:38.713+0000 1694f700 -1 osd.4 184 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103421 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e184) 2019-12-08T17:23:38.817 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:23:38.811+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:36.170816+0000 front 2019-12-08T17:22:36.183121+0000 (oldest deadline 2019-12-08T17:23:17.046659+0000) 2019-12-08T17:23:38.874 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:23:38.868+0000 1694f700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.809017+0000 front 2019-12-08T17:22:36.091153+0000 (oldest deadline 2019-12-08T17:23:19.280706+0000) 2019-12-08T17:23:38.976 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:23:38.973+0000 1694f700 -1 osd.0 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:34.230982+0000 front 2019-12-08T17:22:33.660719+0000 (oldest deadline 2019-12-08T17:23:16.799108+0000) 2019-12-08T17:23:39.144 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:23:39.141+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:22:50.520368+0000 (oldest deadline 2019-12-08T17:23:30.520368+0000) 2019-12-08T17:23:39.145 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:23:39.144+0000 1694f700 -1 osd.2 184 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e183) 2019-12-08T17:23:39.194 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:23:39.187+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:33.016580+0000 front 2019-12-08T17:22:36.103432+0000 (oldest deadline 2019-12-08T17:23:15.824948+0000) 2019-12-08T17:23:39.345 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:23:39.343+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.904359+0000 front 2019-12-08T17:22:35.608077+0000 (oldest deadline 2019-12-08T17:23:17.244215+0000) 2019-12-08T17:23:39.737 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:23:39.729+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:32.740891+0000 front 2019-12-08T17:22:32.759324+0000 (oldest deadline 2019-12-08T17:23:18.447847+0000) 2019-12-08T17:23:39.737 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:23:39.733+0000 1694f700 -1 osd.4 184 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103421 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e184) 2019-12-08T17:23:39.830 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:23:39.824+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:36.170816+0000 front 2019-12-08T17:22:36.183121+0000 (oldest deadline 2019-12-08T17:23:17.046659+0000) 2019-12-08T17:23:39.849 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:23:39.843+0000 1694f700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.809017+0000 front 2019-12-08T17:22:36.091153+0000 (oldest deadline 2019-12-08T17:23:19.280706+0000) 2019-12-08T17:23:39.975 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:23:39.974+0000 1694f700 -1 osd.0 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:34.230982+0000 front 2019-12-08T17:22:33.660719+0000 (oldest deadline 2019-12-08T17:23:16.799108+0000) 2019-12-08T17:23:40.119 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:23:40.118+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:22:50.520368+0000 (oldest deadline 2019-12-08T17:23:30.520368+0000) 2019-12-08T17:23:40.121 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:23:40.121+0000 1694f700 -1 osd.2 184 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e183) 2019-12-08T17:23:40.221 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:23:40.215+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:33.016580+0000 front 2019-12-08T17:22:36.103432+0000 (oldest deadline 2019-12-08T17:23:15.824948+0000) 2019-12-08T17:23:40.357 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:23:40.356+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.904359+0000 front 2019-12-08T17:22:35.608077+0000 (oldest deadline 2019-12-08T17:23:17.244215+0000) 2019-12-08T17:23:40.744 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:23:40.740+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:32.740891+0000 front 2019-12-08T17:22:32.759324+0000 (oldest deadline 2019-12-08T17:23:18.447847+0000) 2019-12-08T17:23:40.745 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:23:40.741+0000 1694f700 -1 osd.4 184 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103421 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e184) 2019-12-08T17:23:40.790 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:23:40.785+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:36.170816+0000 front 2019-12-08T17:22:36.183121+0000 (oldest deadline 2019-12-08T17:23:17.046659+0000) 2019-12-08T17:23:40.900 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:23:40.893+0000 1694f700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.809017+0000 front 2019-12-08T17:22:36.091153+0000 (oldest deadline 2019-12-08T17:23:19.280706+0000) 2019-12-08T17:23:40.954 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:23:40.951+0000 1694f700 -1 osd.0 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:34.230982+0000 front 2019-12-08T17:22:33.660719+0000 (oldest deadline 2019-12-08T17:23:16.799108+0000) 2019-12-08T17:23:41.115 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:23:41.111+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:22:50.520368+0000 (oldest deadline 2019-12-08T17:23:30.520368+0000) 2019-12-08T17:23:41.117 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:23:41.114+0000 1694f700 -1 osd.2 184 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e183) 2019-12-08T17:23:41.235 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:23:41.230+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:33.016580+0000 front 2019-12-08T17:22:36.103432+0000 (oldest deadline 2019-12-08T17:23:15.824948+0000) 2019-12-08T17:23:41.387 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:23:41.386+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.904359+0000 front 2019-12-08T17:22:35.608077+0000 (oldest deadline 2019-12-08T17:23:17.244215+0000) 2019-12-08T17:23:41.712 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:23:41.704+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:32.740891+0000 front 2019-12-08T17:22:32.759324+0000 (oldest deadline 2019-12-08T17:23:18.447847+0000) 2019-12-08T17:23:41.713 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:23:41.708+0000 1694f700 -1 osd.4 184 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103421 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e184) 2019-12-08T17:23:41.821 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:23:41.816+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:36.170816+0000 front 2019-12-08T17:22:36.183121+0000 (oldest deadline 2019-12-08T17:23:17.046659+0000) 2019-12-08T17:23:41.869 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:23:41.863+0000 1694f700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.809017+0000 front 2019-12-08T17:22:36.091153+0000 (oldest deadline 2019-12-08T17:23:19.280706+0000) 2019-12-08T17:23:41.944 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:23:41.942+0000 1694f700 -1 osd.0 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:34.230982+0000 front 2019-12-08T17:22:33.660719+0000 (oldest deadline 2019-12-08T17:23:16.799108+0000) 2019-12-08T17:23:42.131 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:23:42.129+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:22:50.520368+0000 (oldest deadline 2019-12-08T17:23:30.520368+0000) 2019-12-08T17:23:42.134 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:23:42.133+0000 1694f700 -1 osd.2 184 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e183) 2019-12-08T17:23:42.260 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:23:42.254+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:33.016580+0000 front 2019-12-08T17:22:36.103432+0000 (oldest deadline 2019-12-08T17:23:15.824948+0000) 2019-12-08T17:23:42.382 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:23:42.379+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.904359+0000 front 2019-12-08T17:22:35.608077+0000 (oldest deadline 2019-12-08T17:23:17.244215+0000) 2019-12-08T17:23:42.719 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:23:42.713+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:32.740891+0000 front 2019-12-08T17:22:32.759324+0000 (oldest deadline 2019-12-08T17:23:18.447847+0000) 2019-12-08T17:23:42.723 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:23:42.719+0000 1694f700 -1 osd.4 184 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103421 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e184) 2019-12-08T17:23:42.806 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:23:42.801+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:36.170816+0000 front 2019-12-08T17:22:36.183121+0000 (oldest deadline 2019-12-08T17:23:17.046659+0000) 2019-12-08T17:23:42.860 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:23:42.855+0000 1694f700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.809017+0000 front 2019-12-08T17:22:36.091153+0000 (oldest deadline 2019-12-08T17:23:19.280706+0000) 2019-12-08T17:23:42.958 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:23:42.956+0000 1694f700 -1 osd.0 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:34.230982+0000 front 2019-12-08T17:22:33.660719+0000 (oldest deadline 2019-12-08T17:23:16.799108+0000) 2019-12-08T17:23:43.123 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:23:43.121+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:22:50.520368+0000 (oldest deadline 2019-12-08T17:23:30.520368+0000) 2019-12-08T17:23:43.126 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:23:43.125+0000 1694f700 -1 osd.2 184 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e183) 2019-12-08T17:23:43.240 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:23:43.234+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:33.016580+0000 front 2019-12-08T17:22:36.103432+0000 (oldest deadline 2019-12-08T17:23:15.824948+0000) 2019-12-08T17:23:43.360 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:23:43.356+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.904359+0000 front 2019-12-08T17:22:35.608077+0000 (oldest deadline 2019-12-08T17:23:17.244215+0000) 2019-12-08T17:23:43.694 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:23:43.688+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:32.740891+0000 front 2019-12-08T17:22:32.759324+0000 (oldest deadline 2019-12-08T17:23:18.447847+0000) 2019-12-08T17:23:43.695 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:23:43.691+0000 1694f700 -1 osd.4 184 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103421 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e184) 2019-12-08T17:23:43.821 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:23:43.815+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:36.170816+0000 front 2019-12-08T17:22:36.183121+0000 (oldest deadline 2019-12-08T17:23:17.046659+0000) 2019-12-08T17:23:43.823 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:23:43.817+0000 1694f700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.809017+0000 front 2019-12-08T17:22:36.091153+0000 (oldest deadline 2019-12-08T17:23:19.280706+0000) 2019-12-08T17:23:44.002 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:23:43.999+0000 1694f700 -1 osd.0 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:34.230982+0000 front 2019-12-08T17:22:33.660719+0000 (oldest deadline 2019-12-08T17:23:16.799108+0000) 2019-12-08T17:23:44.178 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:23:44.175+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:22:50.520368+0000 (oldest deadline 2019-12-08T17:23:30.520368+0000) 2019-12-08T17:23:44.179 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:23:44.177+0000 1694f700 -1 osd.2 184 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e183) 2019-12-08T17:23:44.210 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:23:44.205+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:33.016580+0000 front 2019-12-08T17:22:36.103432+0000 (oldest deadline 2019-12-08T17:23:15.824948+0000) 2019-12-08T17:23:44.318 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:23:44.316+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.904359+0000 front 2019-12-08T17:22:35.608077+0000 (oldest deadline 2019-12-08T17:23:17.244215+0000) 2019-12-08T17:23:44.737 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:23:44.731+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:32.740891+0000 front 2019-12-08T17:22:32.759324+0000 (oldest deadline 2019-12-08T17:23:18.447847+0000) 2019-12-08T17:23:44.740 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:23:44.736+0000 1694f700 -1 osd.4 184 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103421 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e184) 2019-12-08T17:23:44.832 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:23:44.826+0000 1694f700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.809017+0000 front 2019-12-08T17:22:36.091153+0000 (oldest deadline 2019-12-08T17:23:19.280706+0000) 2019-12-08T17:23:44.856 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:23:44.850+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:36.170816+0000 front 2019-12-08T17:22:36.183121+0000 (oldest deadline 2019-12-08T17:23:17.046659+0000) 2019-12-08T17:23:45.001 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:23:44.997+0000 1694f700 -1 osd.0 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:34.230982+0000 front 2019-12-08T17:22:33.660719+0000 (oldest deadline 2019-12-08T17:23:16.799108+0000) 2019-12-08T17:23:45.215 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:23:45.209+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:33.016580+0000 front 2019-12-08T17:22:36.103432+0000 (oldest deadline 2019-12-08T17:23:15.824948+0000) 2019-12-08T17:23:45.225 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:23:45.222+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:22:50.520368+0000 (oldest deadline 2019-12-08T17:23:30.520368+0000) 2019-12-08T17:23:45.226 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:23:45.224+0000 1694f700 -1 osd.2 184 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e183) 2019-12-08T17:23:45.279 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:23:45.277+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.904359+0000 front 2019-12-08T17:22:35.608077+0000 (oldest deadline 2019-12-08T17:23:17.244215+0000) 2019-12-08T17:23:45.745 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:23:45.739+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:32.740891+0000 front 2019-12-08T17:22:32.759324+0000 (oldest deadline 2019-12-08T17:23:18.447847+0000) 2019-12-08T17:23:45.746 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:23:45.742+0000 1694f700 -1 osd.4 184 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103421 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e184) 2019-12-08T17:23:45.833 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:23:45.827+0000 1694f700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.809017+0000 front 2019-12-08T17:22:36.091153+0000 (oldest deadline 2019-12-08T17:23:19.280706+0000) 2019-12-08T17:23:45.883 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:23:45.876+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:36.170816+0000 front 2019-12-08T17:22:36.183121+0000 (oldest deadline 2019-12-08T17:23:17.046659+0000) 2019-12-08T17:23:45.962 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:23:45.958+0000 1694f700 -1 osd.0 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:34.230982+0000 front 2019-12-08T17:22:33.660719+0000 (oldest deadline 2019-12-08T17:23:16.799108+0000) 2019-12-08T17:23:46.193 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:23:46.187+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:33.016580+0000 front 2019-12-08T17:22:36.103432+0000 (oldest deadline 2019-12-08T17:23:15.824948+0000) 2019-12-08T17:23:46.244 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:23:46.239+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:22:50.520368+0000 (oldest deadline 2019-12-08T17:23:30.520368+0000) 2019-12-08T17:23:46.252 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:23:46.245+0000 1694f700 -1 osd.2 184 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e183) 2019-12-08T17:23:46.286 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:23:46.282+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.904359+0000 front 2019-12-08T17:22:35.608077+0000 (oldest deadline 2019-12-08T17:23:17.244215+0000) 2019-12-08T17:23:46.771 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:23:46.764+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:32.740891+0000 front 2019-12-08T17:22:32.759324+0000 (oldest deadline 2019-12-08T17:23:18.447847+0000) 2019-12-08T17:23:46.772 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:23:46.767+0000 1694f700 -1 osd.4 184 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103421 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e184) 2019-12-08T17:23:46.792 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:23:46.785+0000 1694f700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.809017+0000 front 2019-12-08T17:22:36.091153+0000 (oldest deadline 2019-12-08T17:23:19.280706+0000) 2019-12-08T17:23:46.874 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:23:46.869+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:36.170816+0000 front 2019-12-08T17:22:36.183121+0000 (oldest deadline 2019-12-08T17:23:17.046659+0000) 2019-12-08T17:23:46.961 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:23:46.958+0000 1694f700 -1 osd.0 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:34.230982+0000 front 2019-12-08T17:22:33.660719+0000 (oldest deadline 2019-12-08T17:23:16.799108+0000) 2019-12-08T17:23:47.229 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:23:47.225+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:22:50.520368+0000 (oldest deadline 2019-12-08T17:23:30.520368+0000) 2019-12-08T17:23:47.230 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:23:47.228+0000 1694f700 -1 osd.2 184 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e183) 2019-12-08T17:23:47.238 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:23:47.232+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:33.016580+0000 front 2019-12-08T17:22:36.103432+0000 (oldest deadline 2019-12-08T17:23:15.824948+0000) 2019-12-08T17:23:47.250 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:23:47.248+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.904359+0000 front 2019-12-08T17:22:35.608077+0000 (oldest deadline 2019-12-08T17:23:17.244215+0000) 2019-12-08T17:23:47.795 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:23:47.788+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:32.740891+0000 front 2019-12-08T17:22:32.759324+0000 (oldest deadline 2019-12-08T17:23:18.447847+0000) 2019-12-08T17:23:47.795 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:23:47.791+0000 1694f700 -1 osd.4 184 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103421 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e184) 2019-12-08T17:23:47.812 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:23:47.806+0000 1694f700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.809017+0000 front 2019-12-08T17:22:36.091153+0000 (oldest deadline 2019-12-08T17:23:19.280706+0000) 2019-12-08T17:23:47.885 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:23:47.878+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:36.170816+0000 front 2019-12-08T17:22:36.183121+0000 (oldest deadline 2019-12-08T17:23:17.046659+0000) 2019-12-08T17:23:47.927 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:23:47.925+0000 1694f700 -1 osd.0 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:34.230982+0000 front 2019-12-08T17:22:33.660719+0000 (oldest deadline 2019-12-08T17:23:16.799108+0000) 2019-12-08T17:23:48.237 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:23:48.233+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.904359+0000 front 2019-12-08T17:22:35.608077+0000 (oldest deadline 2019-12-08T17:23:17.244215+0000) 2019-12-08T17:23:48.278 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:23:48.273+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:33.016580+0000 front 2019-12-08T17:22:36.103432+0000 (oldest deadline 2019-12-08T17:23:15.824948+0000) 2019-12-08T17:23:48.278 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:23:48.272+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:22:50.520368+0000 (oldest deadline 2019-12-08T17:23:30.520368+0000) 2019-12-08T17:23:48.279 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:23:48.277+0000 1694f700 -1 osd.2 184 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e183) 2019-12-08T17:23:48.829 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:23:48.824+0000 1694f700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.809017+0000 front 2019-12-08T17:22:36.091153+0000 (oldest deadline 2019-12-08T17:23:19.280706+0000) 2019-12-08T17:23:48.844 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:23:48.836+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:32.740891+0000 front 2019-12-08T17:22:32.759324+0000 (oldest deadline 2019-12-08T17:23:18.447847+0000) 2019-12-08T17:23:48.849 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:23:48.839+0000 1694f700 -1 osd.4 184 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103421 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e184) 2019-12-08T17:23:48.912 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:23:48.906+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:36.170816+0000 front 2019-12-08T17:22:36.183121+0000 (oldest deadline 2019-12-08T17:23:17.046659+0000) 2019-12-08T17:23:48.965 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:23:48.963+0000 1694f700 -1 osd.0 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:34.230982+0000 front 2019-12-08T17:22:33.660719+0000 (oldest deadline 2019-12-08T17:23:16.799108+0000) 2019-12-08T17:23:49.238 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:23:49.234+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.904359+0000 front 2019-12-08T17:22:35.608077+0000 (oldest deadline 2019-12-08T17:23:17.244215+0000) 2019-12-08T17:23:49.252 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:23:49.246+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:33.016580+0000 front 2019-12-08T17:22:36.103432+0000 (oldest deadline 2019-12-08T17:23:15.824948+0000) 2019-12-08T17:23:49.284 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:23:49.281+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:22:50.520368+0000 (oldest deadline 2019-12-08T17:23:30.520368+0000) 2019-12-08T17:23:49.285 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:23:49.283+0000 1694f700 -1 osd.2 184 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e183) 2019-12-08T17:23:49.486 INFO:tasks.ceph.mon.b.smithi013.stderr:2019-12-08T17:23:49.479+0000 1a89c700 -1 mon.b@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.1 [v2:172.21.15.79:6810/10449,v1:172.21.15.79:6811/10449] for 43sec e184 v184) 2019-12-08T17:23:49.801 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:23:49.795+0000 1694f700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.809017+0000 front 2019-12-08T17:22:36.091153+0000 (oldest deadline 2019-12-08T17:23:19.280706+0000) 2019-12-08T17:23:49.812 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:23:49.806+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:32.740891+0000 front 2019-12-08T17:22:32.759324+0000 (oldest deadline 2019-12-08T17:23:18.447847+0000) 2019-12-08T17:23:49.813 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:23:49.809+0000 1694f700 -1 osd.4 184 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103421 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e184) 2019-12-08T17:23:49.957 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:23:49.954+0000 1694f700 -1 osd.0 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:34.230982+0000 front 2019-12-08T17:22:33.660719+0000 (oldest deadline 2019-12-08T17:23:16.799108+0000) 2019-12-08T17:23:49.965 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:23:49.960+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:36.170816+0000 front 2019-12-08T17:22:36.183121+0000 (oldest deadline 2019-12-08T17:23:17.046659+0000) 2019-12-08T17:23:50.190 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:23:50.189+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.904359+0000 front 2019-12-08T17:22:35.608077+0000 (oldest deadline 2019-12-08T17:23:17.244215+0000) 2019-12-08T17:23:50.212 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:23:50.207+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:33.016580+0000 front 2019-12-08T17:22:36.103432+0000 (oldest deadline 2019-12-08T17:23:15.824948+0000) 2019-12-08T17:23:50.320 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:23:50.317+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:22:50.520368+0000 (oldest deadline 2019-12-08T17:23:30.520368+0000) 2019-12-08T17:23:50.325 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:23:50.324+0000 1694f700 -1 osd.2 184 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e183) 2019-12-08T17:23:50.765 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:23:50.760+0000 1694f700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.809017+0000 front 2019-12-08T17:22:36.091153+0000 (oldest deadline 2019-12-08T17:23:19.280706+0000) 2019-12-08T17:23:50.784 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:23:50.779+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:32.740891+0000 front 2019-12-08T17:22:32.759324+0000 (oldest deadline 2019-12-08T17:23:18.447847+0000) 2019-12-08T17:23:50.787 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:23:50.784+0000 1694f700 -1 osd.4 184 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103421 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e184) 2019-12-08T17:23:50.931 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:23:50.929+0000 1694f700 -1 osd.0 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:34.230982+0000 front 2019-12-08T17:22:33.660719+0000 (oldest deadline 2019-12-08T17:23:16.799108+0000) 2019-12-08T17:23:50.950 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:23:50.945+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:36.170816+0000 front 2019-12-08T17:22:36.183121+0000 (oldest deadline 2019-12-08T17:23:17.046659+0000) 2019-12-08T17:23:51.178 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:23:51.176+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.904359+0000 front 2019-12-08T17:22:35.608077+0000 (oldest deadline 2019-12-08T17:23:17.244215+0000) 2019-12-08T17:23:51.237 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:23:51.232+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:33.016580+0000 front 2019-12-08T17:22:36.103432+0000 (oldest deadline 2019-12-08T17:23:15.824948+0000) 2019-12-08T17:23:51.282 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:23:51.279+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:22:50.520368+0000 (oldest deadline 2019-12-08T17:23:30.520368+0000) 2019-12-08T17:23:51.284 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:23:51.282+0000 1694f700 -1 osd.2 184 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e183) 2019-12-08T17:23:51.745 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:23:51.740+0000 1694f700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.809017+0000 front 2019-12-08T17:22:36.091153+0000 (oldest deadline 2019-12-08T17:23:19.280706+0000) 2019-12-08T17:23:51.831 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:23:51.826+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:32.740891+0000 front 2019-12-08T17:22:32.759324+0000 (oldest deadline 2019-12-08T17:23:18.447847+0000) 2019-12-08T17:23:51.831 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:23:51.828+0000 1694f700 -1 osd.4 184 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103421 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e184) 2019-12-08T17:23:51.907 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:23:51.902+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:36.170816+0000 front 2019-12-08T17:22:36.183121+0000 (oldest deadline 2019-12-08T17:23:17.046659+0000) 2019-12-08T17:23:51.983 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:23:51.980+0000 1694f700 -1 osd.0 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:34.230982+0000 front 2019-12-08T17:22:33.660719+0000 (oldest deadline 2019-12-08T17:23:16.799108+0000) 2019-12-08T17:23:52.158 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:23:52.153+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.904359+0000 front 2019-12-08T17:22:35.608077+0000 (oldest deadline 2019-12-08T17:23:17.244215+0000) 2019-12-08T17:23:52.245 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:23:52.240+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:33.016580+0000 front 2019-12-08T17:22:36.103432+0000 (oldest deadline 2019-12-08T17:23:15.824948+0000) 2019-12-08T17:23:52.313 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:23:52.303+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:22:50.520368+0000 (oldest deadline 2019-12-08T17:23:30.520368+0000) 2019-12-08T17:23:52.313 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:23:52.306+0000 1694f700 -1 osd.2 184 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e183) 2019-12-08T17:23:52.721 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:23:52.715+0000 1694f700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.809017+0000 front 2019-12-08T17:22:36.091153+0000 (oldest deadline 2019-12-08T17:23:19.280706+0000) 2019-12-08T17:23:52.796 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:23:52.788+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:32.740891+0000 front 2019-12-08T17:22:32.759324+0000 (oldest deadline 2019-12-08T17:23:18.447847+0000) 2019-12-08T17:23:52.798 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:23:52.793+0000 1694f700 -1 osd.4 184 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4449.0:103421 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e184) 2019-12-08T17:23:52.905 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:23:52.902+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:36.170816+0000 front 2019-12-08T17:22:36.183121+0000 (oldest deadline 2019-12-08T17:23:17.046659+0000) 2019-12-08T17:23:52.949 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:23:52.947+0000 1694f700 -1 osd.0 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:34.230982+0000 front 2019-12-08T17:22:33.660719+0000 (oldest deadline 2019-12-08T17:23:16.799108+0000) 2019-12-08T17:23:53.124 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:23:53.122+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.904359+0000 front 2019-12-08T17:22:35.608077+0000 (oldest deadline 2019-12-08T17:23:17.244215+0000) 2019-12-08T17:23:53.221 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:23:53.216+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:33.016580+0000 front 2019-12-08T17:22:36.103432+0000 (oldest deadline 2019-12-08T17:23:15.824948+0000) 2019-12-08T17:23:53.277 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:23:53.275+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:22:50.520368+0000 (oldest deadline 2019-12-08T17:23:30.520368+0000) 2019-12-08T17:23:53.281 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:23:53.279+0000 1694f700 -1 osd.2 184 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e183) 2019-12-08T17:23:53.765 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:23:53.759+0000 1694f700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.809017+0000 front 2019-12-08T17:22:36.091153+0000 (oldest deadline 2019-12-08T17:23:19.280706+0000) 2019-12-08T17:23:53.827 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:23:53.822+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:32.740891+0000 front 2019-12-08T17:22:32.759324+0000 (oldest deadline 2019-12-08T17:23:18.447847+0000) 2019-12-08T17:23:53.830 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:23:53.827+0000 1694f700 -1 osd.4 184 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4449.0:103421 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e184) 2019-12-08T17:23:53.937 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:23:53.932+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:36.170816+0000 front 2019-12-08T17:22:36.183121+0000 (oldest deadline 2019-12-08T17:23:17.046659+0000) 2019-12-08T17:23:53.939 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:23:53.937+0000 1694f700 -1 osd.0 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:34.230982+0000 front 2019-12-08T17:22:33.660719+0000 (oldest deadline 2019-12-08T17:23:16.799108+0000) 2019-12-08T17:23:54.153 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:23:54.150+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.904359+0000 front 2019-12-08T17:22:35.608077+0000 (oldest deadline 2019-12-08T17:23:17.244215+0000) 2019-12-08T17:23:54.180 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:23:54.175+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:33.016580+0000 front 2019-12-08T17:22:36.103432+0000 (oldest deadline 2019-12-08T17:23:15.824948+0000) 2019-12-08T17:23:54.307 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:23:54.304+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:22:50.520368+0000 (oldest deadline 2019-12-08T17:23:30.520368+0000) 2019-12-08T17:23:54.309 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:23:54.307+0000 1694f700 -1 osd.2 184 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e183) 2019-12-08T17:23:54.535 INFO:tasks.ceph.mon.b.smithi013.stderr:2019-12-08T17:23:54.526+0000 1a89c700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.1 [v2:172.21.15.79:6810/10449,v1:172.21.15.79:6811/10449] for 43sec e184 v184) 2019-12-08T17:23:54.794 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:23:54.789+0000 1694f700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.809017+0000 front 2019-12-08T17:22:36.091153+0000 (oldest deadline 2019-12-08T17:23:19.280706+0000) 2019-12-08T17:23:54.802 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:23:54.797+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:32.740891+0000 front 2019-12-08T17:22:32.759324+0000 (oldest deadline 2019-12-08T17:23:18.447847+0000) 2019-12-08T17:23:54.804 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:23:54.800+0000 1694f700 -1 osd.4 184 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4449.0:103421 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e184) 2019-12-08T17:23:54.928 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:23:54.924+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:36.170816+0000 front 2019-12-08T17:22:36.183121+0000 (oldest deadline 2019-12-08T17:23:17.046659+0000) 2019-12-08T17:23:54.979 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:23:54.975+0000 1694f700 -1 osd.0 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:34.230982+0000 front 2019-12-08T17:22:33.660719+0000 (oldest deadline 2019-12-08T17:23:16.799108+0000) 2019-12-08T17:23:55.119 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:23:55.116+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.904359+0000 front 2019-12-08T17:22:35.608077+0000 (oldest deadline 2019-12-08T17:23:17.244215+0000) 2019-12-08T17:23:55.227 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:23:55.223+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:33.016580+0000 front 2019-12-08T17:22:36.103432+0000 (oldest deadline 2019-12-08T17:23:15.824948+0000) 2019-12-08T17:23:55.334 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:23:55.330+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:22:50.520368+0000 (oldest deadline 2019-12-08T17:23:30.520368+0000) 2019-12-08T17:23:55.335 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:23:55.333+0000 1694f700 -1 osd.2 184 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e183) 2019-12-08T17:23:55.765 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:23:55.760+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:32.740891+0000 front 2019-12-08T17:22:32.759324+0000 (oldest deadline 2019-12-08T17:23:18.447847+0000) 2019-12-08T17:23:55.768 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:23:55.765+0000 1694f700 -1 osd.4 184 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4449.0:103421 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e184) 2019-12-08T17:23:55.815 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:23:55.810+0000 1694f700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.809017+0000 front 2019-12-08T17:22:36.091153+0000 (oldest deadline 2019-12-08T17:23:19.280706+0000) 2019-12-08T17:23:55.933 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:23:55.928+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:36.170816+0000 front 2019-12-08T17:22:36.183121+0000 (oldest deadline 2019-12-08T17:23:17.046659+0000) 2019-12-08T17:23:56.030 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:23:56.028+0000 1694f700 -1 osd.0 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:34.230982+0000 front 2019-12-08T17:22:33.660719+0000 (oldest deadline 2019-12-08T17:23:16.799108+0000) 2019-12-08T17:23:56.079 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:23:56.075+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.904359+0000 front 2019-12-08T17:22:35.608077+0000 (oldest deadline 2019-12-08T17:23:17.244215+0000) 2019-12-08T17:23:56.206 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:23:56.202+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:33.016580+0000 front 2019-12-08T17:22:36.103432+0000 (oldest deadline 2019-12-08T17:23:15.824948+0000) 2019-12-08T17:23:56.309 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:23:56.306+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:22:50.520368+0000 (oldest deadline 2019-12-08T17:23:30.520368+0000) 2019-12-08T17:23:56.310 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:23:56.308+0000 1694f700 -1 osd.2 184 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e183) 2019-12-08T17:23:56.793 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:23:56.788+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:32.740891+0000 front 2019-12-08T17:22:32.759324+0000 (oldest deadline 2019-12-08T17:23:18.447847+0000) 2019-12-08T17:23:56.796 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:23:56.793+0000 1694f700 -1 osd.4 184 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4449.0:103421 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e184) 2019-12-08T17:23:56.842 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:23:56.837+0000 1694f700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.809017+0000 front 2019-12-08T17:22:36.091153+0000 (oldest deadline 2019-12-08T17:23:19.280706+0000) 2019-12-08T17:23:56.985 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:23:56.972+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:36.170816+0000 front 2019-12-08T17:22:36.183121+0000 (oldest deadline 2019-12-08T17:23:17.046659+0000) 2019-12-08T17:23:57.051 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:23:57.048+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.904359+0000 front 2019-12-08T17:22:35.608077+0000 (oldest deadline 2019-12-08T17:23:17.244215+0000) 2019-12-08T17:23:57.084 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:23:57.082+0000 1694f700 -1 osd.0 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:34.230982+0000 front 2019-12-08T17:22:33.660719+0000 (oldest deadline 2019-12-08T17:23:16.799108+0000) 2019-12-08T17:23:57.246 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:23:57.241+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:33.016580+0000 front 2019-12-08T17:22:36.103432+0000 (oldest deadline 2019-12-08T17:23:15.824948+0000) 2019-12-08T17:23:57.359 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:23:57.357+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:22:50.520368+0000 (oldest deadline 2019-12-08T17:23:30.520368+0000) 2019-12-08T17:23:57.360 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:23:57.359+0000 1694f700 -1 osd.2 184 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e183) 2019-12-08T17:23:57.841 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:23:57.835+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:32.740891+0000 front 2019-12-08T17:22:32.759324+0000 (oldest deadline 2019-12-08T17:23:18.447847+0000) 2019-12-08T17:23:57.842 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:23:57.839+0000 1694f700 -1 osd.4 184 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4449.0:103421 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e184) 2019-12-08T17:23:57.860 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:23:57.856+0000 1694f700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.809017+0000 front 2019-12-08T17:22:36.091153+0000 (oldest deadline 2019-12-08T17:23:19.280706+0000) 2019-12-08T17:23:58.007 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:23:58.000+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:36.170816+0000 front 2019-12-08T17:22:36.183121+0000 (oldest deadline 2019-12-08T17:23:17.046659+0000) 2019-12-08T17:23:58.098 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:23:58.095+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.904359+0000 front 2019-12-08T17:22:35.608077+0000 (oldest deadline 2019-12-08T17:23:17.244215+0000) 2019-12-08T17:23:58.134 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:23:58.132+0000 1694f700 -1 osd.0 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:34.230982+0000 front 2019-12-08T17:22:33.660719+0000 (oldest deadline 2019-12-08T17:23:16.799108+0000) 2019-12-08T17:23:58.202 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:23:58.198+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:33.016580+0000 front 2019-12-08T17:22:36.103432+0000 (oldest deadline 2019-12-08T17:23:15.824948+0000) 2019-12-08T17:23:58.317 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:23:58.310+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:22:50.520368+0000 (oldest deadline 2019-12-08T17:23:30.520368+0000) 2019-12-08T17:23:58.318 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:23:58.316+0000 1694f700 -1 osd.2 184 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e183) 2019-12-08T17:23:58.827 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:23:58.822+0000 1694f700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.809017+0000 front 2019-12-08T17:22:36.091153+0000 (oldest deadline 2019-12-08T17:23:19.280706+0000) 2019-12-08T17:23:58.828 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:23:58.824+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:32.740891+0000 front 2019-12-08T17:22:32.759324+0000 (oldest deadline 2019-12-08T17:23:18.447847+0000) 2019-12-08T17:23:58.829 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:23:58.826+0000 1694f700 -1 osd.4 184 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4449.0:103421 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e184) 2019-12-08T17:23:58.967 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:23:58.960+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:36.170816+0000 front 2019-12-08T17:22:36.183121+0000 (oldest deadline 2019-12-08T17:23:17.046659+0000) 2019-12-08T17:23:59.057 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:23:59.055+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.904359+0000 front 2019-12-08T17:22:35.608077+0000 (oldest deadline 2019-12-08T17:23:17.244215+0000) 2019-12-08T17:23:59.096 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:23:59.093+0000 1694f700 -1 osd.0 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:34.230982+0000 front 2019-12-08T17:22:33.660719+0000 (oldest deadline 2019-12-08T17:23:16.799108+0000) 2019-12-08T17:23:59.257 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:23:59.252+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:33.016580+0000 front 2019-12-08T17:22:36.103432+0000 (oldest deadline 2019-12-08T17:23:15.824948+0000) 2019-12-08T17:23:59.346 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:23:59.344+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:22:50.520368+0000 (oldest deadline 2019-12-08T17:23:30.520368+0000) 2019-12-08T17:23:59.347 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:23:59.346+0000 1694f700 -1 osd.2 184 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e183) 2019-12-08T17:23:59.551 INFO:tasks.ceph.mon.b.smithi013.stderr:2019-12-08T17:23:59.547+0000 1a89c700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.1 [v2:172.21.15.79:6810/10449,v1:172.21.15.79:6811/10449] for 43sec e184 v184) 2019-12-08T17:23:59.826 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:23:59.822+0000 1694f700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.809017+0000 front 2019-12-08T17:22:36.091153+0000 (oldest deadline 2019-12-08T17:23:19.280706+0000) 2019-12-08T17:23:59.868 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:23:59.863+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:32.740891+0000 front 2019-12-08T17:22:32.759324+0000 (oldest deadline 2019-12-08T17:23:18.447847+0000) 2019-12-08T17:23:59.873 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:23:59.870+0000 1694f700 -1 osd.4 184 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4449.0:103421 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e184) 2019-12-08T17:23:59.952 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:23:59.943+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:36.170816+0000 front 2019-12-08T17:22:36.183121+0000 (oldest deadline 2019-12-08T17:23:17.046659+0000) 2019-12-08T17:24:00.022 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:24:00.020+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.904359+0000 front 2019-12-08T17:22:35.608077+0000 (oldest deadline 2019-12-08T17:23:17.244215+0000) 2019-12-08T17:24:00.070 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:24:00.067+0000 1694f700 -1 osd.0 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:34.230982+0000 front 2019-12-08T17:22:33.660719+0000 (oldest deadline 2019-12-08T17:23:16.799108+0000) 2019-12-08T17:24:00.240 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:24:00.235+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:33.016580+0000 front 2019-12-08T17:22:36.103432+0000 (oldest deadline 2019-12-08T17:23:15.824948+0000) 2019-12-08T17:24:00.329 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:24:00.324+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:22:50.520368+0000 (oldest deadline 2019-12-08T17:23:30.520368+0000) 2019-12-08T17:24:00.331 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:24:00.328+0000 1694f700 -1 osd.2 184 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e183) 2019-12-08T17:24:00.828 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:24:00.822+0000 1694f700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.809017+0000 front 2019-12-08T17:22:36.091153+0000 (oldest deadline 2019-12-08T17:23:19.280706+0000) 2019-12-08T17:24:00.875 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:24:00.870+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:32.740891+0000 front 2019-12-08T17:22:32.759324+0000 (oldest deadline 2019-12-08T17:23:18.447847+0000) 2019-12-08T17:24:00.876 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:24:00.873+0000 1694f700 -1 osd.4 184 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4449.0:103421 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e184) 2019-12-08T17:24:00.928 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:24:00.922+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:36.170816+0000 front 2019-12-08T17:22:36.183121+0000 (oldest deadline 2019-12-08T17:23:17.046659+0000) 2019-12-08T17:24:01.070 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:24:01.068+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.904359+0000 front 2019-12-08T17:22:35.608077+0000 (oldest deadline 2019-12-08T17:23:17.244215+0000) 2019-12-08T17:24:01.091 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:24:01.088+0000 1694f700 -1 osd.0 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:34.230982+0000 front 2019-12-08T17:22:33.660719+0000 (oldest deadline 2019-12-08T17:23:16.799108+0000) 2019-12-08T17:24:01.237 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:24:01.231+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:33.016580+0000 front 2019-12-08T17:22:36.103432+0000 (oldest deadline 2019-12-08T17:23:15.824948+0000) 2019-12-08T17:24:01.296 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:24:01.293+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:22:50.520368+0000 (oldest deadline 2019-12-08T17:23:30.520368+0000) 2019-12-08T17:24:01.297 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:24:01.295+0000 1694f700 -1 osd.2 184 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e183) 2019-12-08T17:24:01.853 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:24:01.848+0000 1694f700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.809017+0000 front 2019-12-08T17:22:36.091153+0000 (oldest deadline 2019-12-08T17:23:19.280706+0000) 2019-12-08T17:24:01.865 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:24:01.861+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:32.740891+0000 front 2019-12-08T17:22:32.759324+0000 (oldest deadline 2019-12-08T17:23:18.447847+0000) 2019-12-08T17:24:01.866 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:24:01.863+0000 1694f700 -1 osd.4 184 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4449.0:103421 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e184) 2019-12-08T17:24:01.952 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:24:01.946+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:36.170816+0000 front 2019-12-08T17:22:36.183121+0000 (oldest deadline 2019-12-08T17:23:17.046659+0000) 2019-12-08T17:24:02.078 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:24:02.075+0000 1694f700 -1 osd.0 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:34.230982+0000 front 2019-12-08T17:22:33.660719+0000 (oldest deadline 2019-12-08T17:23:16.799108+0000) 2019-12-08T17:24:02.087 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:24:02.084+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.904359+0000 front 2019-12-08T17:22:35.608077+0000 (oldest deadline 2019-12-08T17:23:17.244215+0000) 2019-12-08T17:24:02.281 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:24:02.275+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:33.016580+0000 front 2019-12-08T17:22:36.103432+0000 (oldest deadline 2019-12-08T17:23:15.824948+0000) 2019-12-08T17:24:02.351 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:24:02.347+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:22:50.520368+0000 (oldest deadline 2019-12-08T17:23:30.520368+0000) 2019-12-08T17:24:02.352 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:24:02.349+0000 1694f700 -1 osd.2 184 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e183) 2019-12-08T17:24:02.829 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:24:02.823+0000 1694f700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.809017+0000 front 2019-12-08T17:22:36.091153+0000 (oldest deadline 2019-12-08T17:23:19.280706+0000) 2019-12-08T17:24:02.840 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:24:02.832+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:32.740891+0000 front 2019-12-08T17:22:32.759324+0000 (oldest deadline 2019-12-08T17:23:18.447847+0000) 2019-12-08T17:24:02.841 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:24:02.837+0000 1694f700 -1 osd.4 184 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4449.0:103421 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e184) 2019-12-08T17:24:02.929 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:24:02.925+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:36.170816+0000 front 2019-12-08T17:22:36.183121+0000 (oldest deadline 2019-12-08T17:23:17.046659+0000) 2019-12-08T17:24:03.057 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:24:03.056+0000 1694f700 -1 osd.0 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:34.230982+0000 front 2019-12-08T17:22:33.660719+0000 (oldest deadline 2019-12-08T17:23:16.799108+0000) 2019-12-08T17:24:03.082 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:24:03.079+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.904359+0000 front 2019-12-08T17:22:35.608077+0000 (oldest deadline 2019-12-08T17:23:17.244215+0000) 2019-12-08T17:24:03.324 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:24:03.318+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:33.016580+0000 front 2019-12-08T17:22:36.103432+0000 (oldest deadline 2019-12-08T17:23:15.824948+0000) 2019-12-08T17:24:03.392 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:24:03.389+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:22:50.520368+0000 (oldest deadline 2019-12-08T17:23:30.520368+0000) 2019-12-08T17:24:03.393 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:24:03.391+0000 1694f700 -1 osd.2 184 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e183) 2019-12-08T17:24:03.812 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:24:03.807+0000 1694f700 -1 osd.4 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:32.740891+0000 front 2019-12-08T17:22:32.759324+0000 (oldest deadline 2019-12-08T17:23:18.447847+0000) 2019-12-08T17:24:03.816 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:24:03.813+0000 1694f700 -1 osd.4 184 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4449.0:103421 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e184) 2019-12-08T17:24:03.870 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:24:03.864+0000 1694f700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.809017+0000 front 2019-12-08T17:22:36.091153+0000 (oldest deadline 2019-12-08T17:23:19.280706+0000) 2019-12-08T17:24:03.922 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:24:03.917+0000 1694f700 -1 osd.7 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:36.170816+0000 front 2019-12-08T17:22:36.183121+0000 (oldest deadline 2019-12-08T17:23:17.046659+0000) 2019-12-08T17:24:04.039 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:24:04.036+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.904359+0000 front 2019-12-08T17:22:35.608077+0000 (oldest deadline 2019-12-08T17:23:17.244215+0000) 2019-12-08T17:24:04.048 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:24:04.046+0000 1694f700 -1 osd.0 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:34.230982+0000 front 2019-12-08T17:22:33.660719+0000 (oldest deadline 2019-12-08T17:23:16.799108+0000) 2019-12-08T17:24:04.287 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:24:04.282+0000 1694f700 -1 osd.5 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:33.016580+0000 front 2019-12-08T17:22:36.103432+0000 (oldest deadline 2019-12-08T17:23:15.824948+0000) 2019-12-08T17:24:04.442 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:24:04.437+0000 1694f700 -1 osd.2 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:22:50.520368+0000 (oldest deadline 2019-12-08T17:23:30.520368+0000) 2019-12-08T17:24:04.443 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:24:04.440+0000 1694f700 -1 osd.2 184 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e183) 2019-12-08T17:24:04.656 INFO:tasks.ceph.mon.b.smithi013.stderr:2019-12-08T17:24:04.644+0000 1a89c700 -1 mon.b@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.1 [v2:172.21.15.79:6810/10449,v1:172.21.15.79:6811/10449] for 43sec e184 v184) 2019-12-08T17:24:04.840 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:24:04.836+0000 1694f700 -1 osd.6 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.809017+0000 front 2019-12-08T17:22:36.091153+0000 (oldest deadline 2019-12-08T17:23:19.280706+0000) 2019-12-08T17:24:05.040 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:24:05.037+0000 1694f700 -1 osd.3 184 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:22:35.904359+0000 front 2019-12-08T17:22:35.608077+0000 (oldest deadline 2019-12-08T17:23:17.244215+0000) 2019-12-08T17:24:05.249 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:24:04.863+0000 1694f700 -1 osd.4 185 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4449.0:103421 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=251b] snapc 0=[] ondisk+write+known_if_redirected e184) 2019-12-08T17:24:07.230 INFO:tasks.rgw.client.0.smithi079.stdout:2019-12-08T17:24:07.230+0000 20e25700 -1 RGWWatcher::handle_error cookie 5469498224 err (107) Transport endpoint is not connected 2019-12-08T17:24:28.769 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:24:28.708+0000 1694f700 -1 osd.1 183 get_health_metrics reporting 27 slow ops, oldest is osd_op(client.4449.0:103404 7.d 7.25f726ad (undecoded) ondisk+write+known_if_redirected e183) 2019-12-08T17:24:29.044 INFO:tasks.rgw.client.0.smithi079.stdout:2019-12-08T17:24:29.036+0000 20e25700 -1 RGWWatcher::handle_error cookie 5455609152 err (107) Transport endpoint is not connected 2019-12-08T17:24:30.025 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:24:29.883+0000 1694f700 -1 osd.1 184 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4449.0:103423 5.9 5.84ada7c9 (undecoded) ondisk+write+known_if_redirected e184) 2019-12-08T17:24:52.239 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:05:22:16.942 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T17:24:52.241 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:05:22:16.944 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T17:24:52.251 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:05:22:16.886 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T17:24:52.256 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:05:22:16.891 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T17:24:52.381 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:05:22:17.015 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T17:24:52.386 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:05:22:17.021 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T17:24:52.481 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:05:22:17.115 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T17:24:52.519 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:05:22:17.222 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T17:24:52.594 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:05:22:17.228 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T17:25:54.987 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:25:54.984+0000 1694f700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:14.346293+0000 front 2019-12-08T17:25:15.071994+0000 (oldest deadline 2019-12-08T17:25:54.620251+0000) 2019-12-08T17:25:55.537 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:25:55.533+0000 1694f700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:10.865702+0000 front 2019-12-08T17:25:10.851005+0000 (oldest deadline 2019-12-08T17:25:55.526701+0000) 2019-12-08T17:25:55.950 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:25:55.948+0000 1694f700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:14.346293+0000 front 2019-12-08T17:25:15.071994+0000 (oldest deadline 2019-12-08T17:25:54.620251+0000) 2019-12-08T17:25:56.520 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:25:56.515+0000 1694f700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:10.865702+0000 front 2019-12-08T17:25:10.851005+0000 (oldest deadline 2019-12-08T17:25:55.526701+0000) 2019-12-08T17:25:56.872 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:25:56.866+0000 1694f700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:10.894751+0000 front 2019-12-08T17:25:11.512940+0000 (oldest deadline 2019-12-08T17:25:56.780337+0000) 2019-12-08T17:25:56.937 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:25:56.935+0000 1694f700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:14.346293+0000 front 2019-12-08T17:25:15.071994+0000 (oldest deadline 2019-12-08T17:25:54.620251+0000) 2019-12-08T17:25:57.232 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:25:57.229+0000 1694f700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:11.504121+0000 front 2019-12-08T17:25:10.916588+0000 (oldest deadline 2019-12-08T17:25:56.747517+0000) 2019-12-08T17:25:57.551 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:25:57.545+0000 1694f700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:10.865702+0000 front 2019-12-08T17:25:10.851005+0000 (oldest deadline 2019-12-08T17:25:55.526701+0000) 2019-12-08T17:25:57.889 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:25:57.883+0000 1694f700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:10.894751+0000 front 2019-12-08T17:25:11.512940+0000 (oldest deadline 2019-12-08T17:25:56.780337+0000) 2019-12-08T17:25:57.961 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:25:57.955+0000 1694f700 -1 osd.5 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:12.120944+0000 front 2019-12-08T17:25:12.614631+0000 (oldest deadline 2019-12-08T17:25:57.365984+0000) 2019-12-08T17:25:57.977 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:25:57.976+0000 1694f700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:14.346293+0000 front 2019-12-08T17:25:15.071994+0000 (oldest deadline 2019-12-08T17:25:54.620251+0000) 2019-12-08T17:25:58.277 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:25:58.273+0000 1694f700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:11.504121+0000 front 2019-12-08T17:25:10.916588+0000 (oldest deadline 2019-12-08T17:25:56.747517+0000) 2019-12-08T17:25:58.574 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:25:58.572+0000 1694f700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:13.021840+0000 front 2019-12-08T17:25:13.006075+0000 (oldest deadline 2019-12-08T17:25:57.687802+0000) 2019-12-08T17:25:58.602 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:25:58.596+0000 1694f700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:10.865702+0000 front 2019-12-08T17:25:10.851005+0000 (oldest deadline 2019-12-08T17:25:55.526701+0000) 2019-12-08T17:25:58.878 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:25:58.872+0000 1694f700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:10.894751+0000 front 2019-12-08T17:25:11.512940+0000 (oldest deadline 2019-12-08T17:25:56.780337+0000) 2019-12-08T17:25:58.958 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:25:58.953+0000 1694f700 -1 osd.5 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:12.120944+0000 front 2019-12-08T17:25:12.614631+0000 (oldest deadline 2019-12-08T17:25:57.365984+0000) 2019-12-08T17:25:59.021 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:25:59.013+0000 1694f700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:14.346293+0000 front 2019-12-08T17:25:15.071994+0000 (oldest deadline 2019-12-08T17:25:54.620251+0000) 2019-12-08T17:25:59.272 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:25:59.269+0000 1694f700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:11.504121+0000 front 2019-12-08T17:25:10.916588+0000 (oldest deadline 2019-12-08T17:25:56.747517+0000) 2019-12-08T17:25:59.612 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:25:59.606+0000 1694f700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:10.865702+0000 front 2019-12-08T17:25:10.851005+0000 (oldest deadline 2019-12-08T17:25:55.526701+0000) 2019-12-08T17:25:59.614 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:25:59.611+0000 1694f700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:13.021840+0000 front 2019-12-08T17:25:13.006075+0000 (oldest deadline 2019-12-08T17:25:57.687802+0000) 2019-12-08T17:25:59.855 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:25:59.849+0000 1694f700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:10.894751+0000 front 2019-12-08T17:25:11.512940+0000 (oldest deadline 2019-12-08T17:25:56.780337+0000) 2019-12-08T17:25:59.956 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:25:59.949+0000 1694f700 -1 osd.5 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:12.120944+0000 front 2019-12-08T17:25:12.614631+0000 (oldest deadline 2019-12-08T17:25:57.365984+0000) 2019-12-08T17:26:00.022 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:26:00.018+0000 1694f700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:14.346293+0000 front 2019-12-08T17:25:15.071994+0000 (oldest deadline 2019-12-08T17:25:54.620251+0000) 2019-12-08T17:26:00.034 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:26:00.027+0000 1694f700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:14.778878+0000 front 2019-12-08T17:25:15.827345+0000 (oldest deadline 2019-12-08T17:25:59.099118+0000) 2019-12-08T17:26:00.268 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:26:00.267+0000 1694f700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:11.504121+0000 front 2019-12-08T17:25:10.916588+0000 (oldest deadline 2019-12-08T17:25:56.747517+0000) 2019-12-08T17:26:00.579 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:26:00.574+0000 1694f700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:10.865702+0000 front 2019-12-08T17:25:10.851005+0000 (oldest deadline 2019-12-08T17:25:55.526701+0000) 2019-12-08T17:26:00.669 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:26:00.666+0000 1694f700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:13.021840+0000 front 2019-12-08T17:25:13.006075+0000 (oldest deadline 2019-12-08T17:25:57.687802+0000) 2019-12-08T17:26:00.879 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:26:00.873+0000 1694f700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:10.894751+0000 front 2019-12-08T17:25:11.512940+0000 (oldest deadline 2019-12-08T17:25:56.780337+0000) 2019-12-08T17:26:00.969 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:26:00.964+0000 1694f700 -1 osd.5 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:12.120944+0000 front 2019-12-08T17:25:12.614631+0000 (oldest deadline 2019-12-08T17:25:57.365984+0000) 2019-12-08T17:26:00.979 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:26:00.978+0000 1694f700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:14.346293+0000 front 2019-12-08T17:25:15.071994+0000 (oldest deadline 2019-12-08T17:25:54.620251+0000) 2019-12-08T17:26:01.005 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:26:00.998+0000 1694f700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:14.778878+0000 front 2019-12-08T17:25:15.827345+0000 (oldest deadline 2019-12-08T17:25:59.099118+0000) 2019-12-08T17:26:01.303 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:26:01.301+0000 1694f700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:11.504121+0000 front 2019-12-08T17:25:10.916588+0000 (oldest deadline 2019-12-08T17:25:56.747517+0000) 2019-12-08T17:26:01.564 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:26:01.557+0000 1694f700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:10.865702+0000 front 2019-12-08T17:25:10.851005+0000 (oldest deadline 2019-12-08T17:25:55.526701+0000) 2019-12-08T17:26:01.633 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:26:01.631+0000 1694f700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:13.021840+0000 front 2019-12-08T17:25:13.006075+0000 (oldest deadline 2019-12-08T17:25:57.687802+0000) 2019-12-08T17:26:01.909 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:26:01.904+0000 1694f700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:10.894751+0000 front 2019-12-08T17:25:11.512940+0000 (oldest deadline 2019-12-08T17:25:56.780337+0000) 2019-12-08T17:26:01.945 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:26:01.940+0000 1694f700 -1 osd.5 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:12.120944+0000 front 2019-12-08T17:25:12.614631+0000 (oldest deadline 2019-12-08T17:25:57.365984+0000) 2019-12-08T17:26:01.952 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:26:01.951+0000 1694f700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:14.346293+0000 front 2019-12-08T17:25:15.071994+0000 (oldest deadline 2019-12-08T17:25:54.620251+0000) 2019-12-08T17:26:02.043 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:26:02.038+0000 1694f700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:14.778878+0000 front 2019-12-08T17:25:15.827345+0000 (oldest deadline 2019-12-08T17:25:59.099118+0000) 2019-12-08T17:26:02.294 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:26:02.291+0000 1694f700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:11.504121+0000 front 2019-12-08T17:25:10.916588+0000 (oldest deadline 2019-12-08T17:25:56.747517+0000) 2019-12-08T17:26:02.592 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:26:02.586+0000 1694f700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:10.865702+0000 front 2019-12-08T17:25:10.851005+0000 (oldest deadline 2019-12-08T17:25:55.526701+0000) 2019-12-08T17:26:02.648 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:26:02.646+0000 1694f700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:13.021840+0000 front 2019-12-08T17:25:13.006075+0000 (oldest deadline 2019-12-08T17:25:57.687802+0000) 2019-12-08T17:26:02.936 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:26:02.927+0000 1694f700 -1 osd.5 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:12.120944+0000 front 2019-12-08T17:25:12.614631+0000 (oldest deadline 2019-12-08T17:25:57.365984+0000) 2019-12-08T17:26:02.959 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:26:02.958+0000 1694f700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:14.346293+0000 front 2019-12-08T17:25:15.071994+0000 (oldest deadline 2019-12-08T17:25:54.620251+0000) 2019-12-08T17:26:02.963 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:26:02.959+0000 1694f700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:10.894751+0000 front 2019-12-08T17:25:11.512940+0000 (oldest deadline 2019-12-08T17:25:56.780337+0000) 2019-12-08T17:26:03.015 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:26:03.008+0000 1694f700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:14.778878+0000 front 2019-12-08T17:25:15.827345+0000 (oldest deadline 2019-12-08T17:25:59.099118+0000) 2019-12-08T17:26:03.274 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:26:03.271+0000 1694f700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:11.504121+0000 front 2019-12-08T17:25:10.916588+0000 (oldest deadline 2019-12-08T17:25:56.747517+0000) 2019-12-08T17:26:03.610 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:26:03.605+0000 1694f700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:10.865702+0000 front 2019-12-08T17:25:10.851005+0000 (oldest deadline 2019-12-08T17:25:55.526701+0000) 2019-12-08T17:26:03.623 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:26:03.622+0000 1694f700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:13.021840+0000 front 2019-12-08T17:25:13.006075+0000 (oldest deadline 2019-12-08T17:25:57.687802+0000) 2019-12-08T17:26:03.943 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:26:03.937+0000 1694f700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:10.894751+0000 front 2019-12-08T17:25:11.512940+0000 (oldest deadline 2019-12-08T17:25:56.780337+0000) 2019-12-08T17:26:03.945 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:26:03.942+0000 1694f700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:14.346293+0000 front 2019-12-08T17:25:15.071994+0000 (oldest deadline 2019-12-08T17:25:54.620251+0000) 2019-12-08T17:26:03.964 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:26:03.958+0000 1694f700 -1 osd.5 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:12.120944+0000 front 2019-12-08T17:25:12.614631+0000 (oldest deadline 2019-12-08T17:25:57.365984+0000) 2019-12-08T17:26:04.042 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:26:04.035+0000 1694f700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:14.778878+0000 front 2019-12-08T17:25:15.827345+0000 (oldest deadline 2019-12-08T17:25:59.099118+0000) 2019-12-08T17:26:04.241 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:26:04.237+0000 1694f700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:11.504121+0000 front 2019-12-08T17:25:10.916588+0000 (oldest deadline 2019-12-08T17:25:56.747517+0000) 2019-12-08T17:26:04.615 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:26:04.609+0000 1694f700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:10.865702+0000 front 2019-12-08T17:25:10.851005+0000 (oldest deadline 2019-12-08T17:25:55.526701+0000) 2019-12-08T17:26:04.646 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:26:04.644+0000 1694f700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:13.021840+0000 front 2019-12-08T17:25:13.006075+0000 (oldest deadline 2019-12-08T17:25:57.687802+0000) 2019-12-08T17:26:04.918 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:26:04.910+0000 1694f700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:10.894751+0000 front 2019-12-08T17:25:11.512940+0000 (oldest deadline 2019-12-08T17:25:56.780337+0000) 2019-12-08T17:26:04.962 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:26:04.956+0000 1694f700 -1 osd.5 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:12.120944+0000 front 2019-12-08T17:25:12.614631+0000 (oldest deadline 2019-12-08T17:25:57.365984+0000) 2019-12-08T17:26:04.999 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:26:04.997+0000 1694f700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:14.346293+0000 front 2019-12-08T17:25:15.071994+0000 (oldest deadline 2019-12-08T17:25:54.620251+0000) 2019-12-08T17:26:05.090 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:26:05.084+0000 1694f700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:14.778878+0000 front 2019-12-08T17:25:15.827345+0000 (oldest deadline 2019-12-08T17:25:59.099118+0000) 2019-12-08T17:26:05.277 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:26:05.275+0000 1694f700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:11.504121+0000 front 2019-12-08T17:25:10.916588+0000 (oldest deadline 2019-12-08T17:25:56.747517+0000) 2019-12-08T17:26:05.637 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:26:05.631+0000 1694f700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:10.865702+0000 front 2019-12-08T17:25:10.851005+0000 (oldest deadline 2019-12-08T17:25:55.526701+0000) 2019-12-08T17:26:05.664 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:26:05.661+0000 1694f700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:13.021840+0000 front 2019-12-08T17:25:13.006075+0000 (oldest deadline 2019-12-08T17:25:57.687802+0000) 2019-12-08T17:26:05.913 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:26:05.907+0000 1694f700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:10.894751+0000 front 2019-12-08T17:25:11.512940+0000 (oldest deadline 2019-12-08T17:25:56.780337+0000) 2019-12-08T17:26:05.993 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:26:05.990+0000 1694f700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:14.346293+0000 front 2019-12-08T17:25:15.071994+0000 (oldest deadline 2019-12-08T17:25:54.620251+0000) 2019-12-08T17:26:06.014 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:26:06.008+0000 1694f700 -1 osd.5 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:12.120944+0000 front 2019-12-08T17:25:12.614631+0000 (oldest deadline 2019-12-08T17:25:57.365984+0000) 2019-12-08T17:26:06.058 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:26:06.052+0000 1694f700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:14.778878+0000 front 2019-12-08T17:25:15.827345+0000 (oldest deadline 2019-12-08T17:25:59.099118+0000) 2019-12-08T17:26:06.320 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:26:06.318+0000 1694f700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:11.504121+0000 front 2019-12-08T17:25:10.916588+0000 (oldest deadline 2019-12-08T17:25:56.747517+0000) 2019-12-08T17:26:06.677 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:26:06.666+0000 1694f700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:10.865702+0000 front 2019-12-08T17:25:10.851005+0000 (oldest deadline 2019-12-08T17:25:55.526701+0000) 2019-12-08T17:26:06.685 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:26:06.683+0000 1694f700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:13.021840+0000 front 2019-12-08T17:25:13.006075+0000 (oldest deadline 2019-12-08T17:25:57.687802+0000) 2019-12-08T17:26:06.942 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:26:06.935+0000 1694f700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:10.894751+0000 front 2019-12-08T17:25:11.512940+0000 (oldest deadline 2019-12-08T17:25:56.780337+0000) 2019-12-08T17:26:07.012 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:26:07.010+0000 1694f700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:14.346293+0000 front 2019-12-08T17:25:15.071994+0000 (oldest deadline 2019-12-08T17:25:54.620251+0000) 2019-12-08T17:26:07.037 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:26:07.031+0000 1694f700 -1 osd.5 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:12.120944+0000 front 2019-12-08T17:25:12.614631+0000 (oldest deadline 2019-12-08T17:25:57.365984+0000) 2019-12-08T17:26:07.056 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:26:07.050+0000 1694f700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:14.778878+0000 front 2019-12-08T17:25:15.827345+0000 (oldest deadline 2019-12-08T17:25:59.099118+0000) 2019-12-08T17:26:07.285 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:26:07.283+0000 1694f700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:11.504121+0000 front 2019-12-08T17:25:10.916588+0000 (oldest deadline 2019-12-08T17:25:56.747517+0000) 2019-12-08T17:26:07.645 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:26:07.642+0000 1694f700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:13.021840+0000 front 2019-12-08T17:25:13.006075+0000 (oldest deadline 2019-12-08T17:25:57.687802+0000) 2019-12-08T17:26:07.688 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:26:07.682+0000 1694f700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:10.865702+0000 front 2019-12-08T17:25:10.851005+0000 (oldest deadline 2019-12-08T17:25:55.526701+0000) 2019-12-08T17:26:07.981 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:26:07.974+0000 1694f700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:10.894751+0000 front 2019-12-08T17:25:11.512940+0000 (oldest deadline 2019-12-08T17:25:56.780337+0000) 2019-12-08T17:26:08.023 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:26:08.017+0000 1694f700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:14.778878+0000 front 2019-12-08T17:25:15.827345+0000 (oldest deadline 2019-12-08T17:25:59.099118+0000) 2019-12-08T17:26:08.031 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:26:08.029+0000 1694f700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:14.346293+0000 front 2019-12-08T17:25:15.071994+0000 (oldest deadline 2019-12-08T17:25:54.620251+0000) 2019-12-08T17:26:08.034 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:26:08.028+0000 1694f700 -1 osd.5 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:12.120944+0000 front 2019-12-08T17:25:12.614631+0000 (oldest deadline 2019-12-08T17:25:57.365984+0000) 2019-12-08T17:26:08.270 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:26:08.266+0000 1694f700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:11.504121+0000 front 2019-12-08T17:25:10.916588+0000 (oldest deadline 2019-12-08T17:25:56.747517+0000) 2019-12-08T17:26:08.644 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:26:08.641+0000 1694f700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:13.021840+0000 front 2019-12-08T17:25:13.006075+0000 (oldest deadline 2019-12-08T17:25:57.687802+0000) 2019-12-08T17:26:08.709 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:26:08.703+0000 1694f700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:10.865702+0000 front 2019-12-08T17:25:10.851005+0000 (oldest deadline 2019-12-08T17:25:55.526701+0000) 2019-12-08T17:26:08.965 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:26:08.960+0000 1694f700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:10.894751+0000 front 2019-12-08T17:25:11.512940+0000 (oldest deadline 2019-12-08T17:25:56.780337+0000) 2019-12-08T17:26:09.006 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:26:09.000+0000 1694f700 -1 osd.5 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:12.120944+0000 front 2019-12-08T17:25:12.614631+0000 (oldest deadline 2019-12-08T17:25:57.365984+0000) 2019-12-08T17:26:09.021 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:26:09.019+0000 1694f700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:14.346293+0000 front 2019-12-08T17:25:15.071994+0000 (oldest deadline 2019-12-08T17:25:54.620251+0000) 2019-12-08T17:26:09.026 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:26:09.020+0000 1694f700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:14.778878+0000 front 2019-12-08T17:25:15.827345+0000 (oldest deadline 2019-12-08T17:25:59.099118+0000) 2019-12-08T17:26:09.308 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:26:09.305+0000 1694f700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:11.504121+0000 front 2019-12-08T17:25:10.916588+0000 (oldest deadline 2019-12-08T17:25:56.747517+0000) 2019-12-08T17:26:09.605 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:26:09.602+0000 1694f700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:13.021840+0000 front 2019-12-08T17:25:13.006075+0000 (oldest deadline 2019-12-08T17:25:57.687802+0000) 2019-12-08T17:26:09.682 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:26:09.675+0000 1694f700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:10.865702+0000 front 2019-12-08T17:25:10.851005+0000 (oldest deadline 2019-12-08T17:25:55.526701+0000) 2019-12-08T17:26:09.925 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:26:09.919+0000 1694f700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:10.894751+0000 front 2019-12-08T17:25:11.512940+0000 (oldest deadline 2019-12-08T17:25:56.780337+0000) 2019-12-08T17:26:09.996 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:26:09.990+0000 1694f700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:14.778878+0000 front 2019-12-08T17:25:15.827345+0000 (oldest deadline 2019-12-08T17:25:59.099118+0000) 2019-12-08T17:26:10.016 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:26:10.013+0000 1694f700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:14.346293+0000 front 2019-12-08T17:25:15.071994+0000 (oldest deadline 2019-12-08T17:25:54.620251+0000) 2019-12-08T17:26:10.023 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:26:10.017+0000 1694f700 -1 osd.5 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:12.120944+0000 front 2019-12-08T17:25:12.614631+0000 (oldest deadline 2019-12-08T17:25:57.365984+0000) 2019-12-08T17:26:10.282 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:26:10.281+0000 1694f700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:11.504121+0000 front 2019-12-08T17:25:10.916588+0000 (oldest deadline 2019-12-08T17:25:56.747517+0000) 2019-12-08T17:26:10.632 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:26:10.629+0000 1694f700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:13.021840+0000 front 2019-12-08T17:25:13.006075+0000 (oldest deadline 2019-12-08T17:25:57.687802+0000) 2019-12-08T17:26:10.658 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:26:10.652+0000 1694f700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:10.865702+0000 front 2019-12-08T17:25:10.851005+0000 (oldest deadline 2019-12-08T17:25:55.526701+0000) 2019-12-08T17:26:10.953 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:26:10.947+0000 1694f700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:10.894751+0000 front 2019-12-08T17:25:11.512940+0000 (oldest deadline 2019-12-08T17:25:56.780337+0000) 2019-12-08T17:26:10.994 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:26:10.989+0000 1694f700 -1 osd.5 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:12.120944+0000 front 2019-12-08T17:25:12.614631+0000 (oldest deadline 2019-12-08T17:25:57.365984+0000) 2019-12-08T17:26:11.040 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:26:11.037+0000 1694f700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:14.346293+0000 front 2019-12-08T17:25:15.071994+0000 (oldest deadline 2019-12-08T17:25:54.620251+0000) 2019-12-08T17:26:11.050 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:26:11.044+0000 1694f700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:14.778878+0000 front 2019-12-08T17:25:15.827345+0000 (oldest deadline 2019-12-08T17:25:59.099118+0000) 2019-12-08T17:26:11.257 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:26:11.255+0000 1694f700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:11.504121+0000 front 2019-12-08T17:25:10.916588+0000 (oldest deadline 2019-12-08T17:25:56.747517+0000) 2019-12-08T17:26:11.597 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:26:11.596+0000 1694f700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:13.021840+0000 front 2019-12-08T17:25:13.006075+0000 (oldest deadline 2019-12-08T17:25:57.687802+0000) 2019-12-08T17:26:11.702 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:26:11.697+0000 1694f700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:10.865702+0000 front 2019-12-08T17:25:10.851005+0000 (oldest deadline 2019-12-08T17:25:55.526701+0000) 2019-12-08T17:26:11.988 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:26:11.983+0000 1694f700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:10.894751+0000 front 2019-12-08T17:25:11.512940+0000 (oldest deadline 2019-12-08T17:25:56.780337+0000) 2019-12-08T17:26:12.005 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:26:11.999+0000 1694f700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:14.778878+0000 front 2019-12-08T17:25:15.827345+0000 (oldest deadline 2019-12-08T17:25:59.099118+0000) 2019-12-08T17:26:12.029 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:26:12.023+0000 1694f700 -1 osd.5 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:12.120944+0000 front 2019-12-08T17:25:12.614631+0000 (oldest deadline 2019-12-08T17:25:57.365984+0000) 2019-12-08T17:26:12.065 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:26:12.061+0000 1694f700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:14.346293+0000 front 2019-12-08T17:25:15.071994+0000 (oldest deadline 2019-12-08T17:25:54.620251+0000) 2019-12-08T17:26:12.222 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:26:12.219+0000 1694f700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:11.504121+0000 front 2019-12-08T17:25:10.916588+0000 (oldest deadline 2019-12-08T17:25:56.747517+0000) 2019-12-08T17:26:12.635 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:26:12.633+0000 1694f700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:13.021840+0000 front 2019-12-08T17:25:13.006075+0000 (oldest deadline 2019-12-08T17:25:57.687802+0000) 2019-12-08T17:26:12.731 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:26:12.724+0000 1694f700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:10.865702+0000 front 2019-12-08T17:25:10.851005+0000 (oldest deadline 2019-12-08T17:25:55.526701+0000) 2019-12-08T17:26:12.991 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:26:12.985+0000 1694f700 -1 osd.5 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:12.120944+0000 front 2019-12-08T17:25:12.614631+0000 (oldest deadline 2019-12-08T17:25:57.365984+0000) 2019-12-08T17:26:13.018 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:26:13.016+0000 1694f700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:14.346293+0000 front 2019-12-08T17:25:15.071994+0000 (oldest deadline 2019-12-08T17:25:54.620251+0000) 2019-12-08T17:26:13.029 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:26:13.022+0000 1694f700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:10.894751+0000 front 2019-12-08T17:25:11.512940+0000 (oldest deadline 2019-12-08T17:25:56.780337+0000) 2019-12-08T17:26:13.032 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:26:13.026+0000 1694f700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:14.778878+0000 front 2019-12-08T17:25:15.827345+0000 (oldest deadline 2019-12-08T17:25:59.099118+0000) 2019-12-08T17:26:13.224 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:26:13.222+0000 1694f700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:11.504121+0000 front 2019-12-08T17:25:10.916588+0000 (oldest deadline 2019-12-08T17:25:56.747517+0000) 2019-12-08T17:26:13.588 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:26:13.586+0000 1694f700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:13.021840+0000 front 2019-12-08T17:25:13.006075+0000 (oldest deadline 2019-12-08T17:25:57.687802+0000) 2019-12-08T17:26:13.764 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:26:13.759+0000 1694f700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:10.865702+0000 front 2019-12-08T17:25:10.851005+0000 (oldest deadline 2019-12-08T17:25:55.526701+0000) 2019-12-08T17:26:14.005 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:26:13.999+0000 1694f700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:14.778878+0000 front 2019-12-08T17:25:15.827345+0000 (oldest deadline 2019-12-08T17:25:59.099118+0000) 2019-12-08T17:26:14.010 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:26:14.002+0000 1694f700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:10.894751+0000 front 2019-12-08T17:25:11.512940+0000 (oldest deadline 2019-12-08T17:25:56.780337+0000) 2019-12-08T17:26:14.043 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:26:14.037+0000 1694f700 -1 osd.5 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:12.120944+0000 front 2019-12-08T17:25:12.614631+0000 (oldest deadline 2019-12-08T17:25:57.365984+0000) 2019-12-08T17:26:14.050 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:26:14.048+0000 1694f700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:14.346293+0000 front 2019-12-08T17:25:15.071994+0000 (oldest deadline 2019-12-08T17:25:54.620251+0000) 2019-12-08T17:26:14.202 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:26:14.199+0000 1694f700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:11.504121+0000 front 2019-12-08T17:25:10.916588+0000 (oldest deadline 2019-12-08T17:25:56.747517+0000) 2019-12-08T17:26:14.640 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:26:14.636+0000 1694f700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:13.021840+0000 front 2019-12-08T17:25:13.006075+0000 (oldest deadline 2019-12-08T17:25:57.687802+0000) 2019-12-08T17:26:14.772 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:26:14.766+0000 1694f700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:10.865702+0000 front 2019-12-08T17:25:10.851005+0000 (oldest deadline 2019-12-08T17:25:55.526701+0000) 2019-12-08T17:26:15.012 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:26:15.006+0000 1694f700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:14.778878+0000 front 2019-12-08T17:25:15.827345+0000 (oldest deadline 2019-12-08T17:25:59.099118+0000) 2019-12-08T17:26:15.042 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:26:15.039+0000 1694f700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:14.346293+0000 front 2019-12-08T17:25:15.071994+0000 (oldest deadline 2019-12-08T17:25:54.620251+0000) 2019-12-08T17:26:15.060 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:26:15.055+0000 1694f700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:10.894751+0000 front 2019-12-08T17:25:11.512940+0000 (oldest deadline 2019-12-08T17:25:56.780337+0000) 2019-12-08T17:26:15.080 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:26:15.074+0000 1694f700 -1 osd.5 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:12.120944+0000 front 2019-12-08T17:25:12.614631+0000 (oldest deadline 2019-12-08T17:25:57.365984+0000) 2019-12-08T17:26:15.251 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:26:15.248+0000 1694f700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:11.504121+0000 front 2019-12-08T17:25:10.916588+0000 (oldest deadline 2019-12-08T17:25:56.747517+0000) 2019-12-08T17:26:15.688 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:26:15.686+0000 1694f700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:13.021840+0000 front 2019-12-08T17:25:13.006075+0000 (oldest deadline 2019-12-08T17:25:57.687802+0000) 2019-12-08T17:26:15.792 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:26:15.787+0000 1694f700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:10.865702+0000 front 2019-12-08T17:25:10.851005+0000 (oldest deadline 2019-12-08T17:25:55.526701+0000) 2019-12-08T17:26:16.032 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:26:16.026+0000 1694f700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:10.894751+0000 front 2019-12-08T17:25:11.512940+0000 (oldest deadline 2019-12-08T17:25:56.780337+0000) 2019-12-08T17:26:16.036 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:26:16.030+0000 1694f700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:14.778878+0000 front 2019-12-08T17:25:15.827345+0000 (oldest deadline 2019-12-08T17:25:59.099118+0000) 2019-12-08T17:26:16.046 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:26:16.044+0000 1694f700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:14.346293+0000 front 2019-12-08T17:25:15.071994+0000 (oldest deadline 2019-12-08T17:25:54.620251+0000) 2019-12-08T17:26:16.083 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:26:16.078+0000 1694f700 -1 osd.5 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:12.120944+0000 front 2019-12-08T17:25:12.614631+0000 (oldest deadline 2019-12-08T17:25:57.365984+0000) 2019-12-08T17:26:16.251 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:26:16.249+0000 1694f700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:11.504121+0000 front 2019-12-08T17:25:10.916588+0000 (oldest deadline 2019-12-08T17:25:56.747517+0000) 2019-12-08T17:26:16.665 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:26:16.661+0000 1694f700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:13.021840+0000 front 2019-12-08T17:25:13.006075+0000 (oldest deadline 2019-12-08T17:25:57.687802+0000) 2019-12-08T17:26:16.842 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:26:16.836+0000 1694f700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:10.865702+0000 front 2019-12-08T17:25:10.851005+0000 (oldest deadline 2019-12-08T17:25:55.526701+0000) 2019-12-08T17:26:17.028 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:26:17.026+0000 1694f700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:14.346293+0000 front 2019-12-08T17:25:15.071994+0000 (oldest deadline 2019-12-08T17:25:54.620251+0000) 2019-12-08T17:26:17.049 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:26:17.044+0000 1694f700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:10.894751+0000 front 2019-12-08T17:25:11.512940+0000 (oldest deadline 2019-12-08T17:25:56.780337+0000) 2019-12-08T17:26:17.067 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:26:17.062+0000 1694f700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:14.778878+0000 front 2019-12-08T17:25:15.827345+0000 (oldest deadline 2019-12-08T17:25:59.099118+0000) 2019-12-08T17:26:17.072 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:26:17.065+0000 1694f700 -1 osd.5 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:12.120944+0000 front 2019-12-08T17:25:12.614631+0000 (oldest deadline 2019-12-08T17:25:57.365984+0000) 2019-12-08T17:26:17.218 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:26:17.216+0000 1694f700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:11.504121+0000 front 2019-12-08T17:25:10.916588+0000 (oldest deadline 2019-12-08T17:25:56.747517+0000) 2019-12-08T17:26:17.643 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:26:17.640+0000 1694f700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:13.021840+0000 front 2019-12-08T17:25:13.006075+0000 (oldest deadline 2019-12-08T17:25:57.687802+0000) 2019-12-08T17:26:17.889 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:26:17.883+0000 1694f700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:10.865702+0000 front 2019-12-08T17:25:10.851005+0000 (oldest deadline 2019-12-08T17:25:55.526701+0000) 2019-12-08T17:26:18.053 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:26:18.047+0000 1694f700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:10.894751+0000 front 2019-12-08T17:25:11.512940+0000 (oldest deadline 2019-12-08T17:25:56.780337+0000) 2019-12-08T17:26:18.053 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:26:18.047+0000 1694f700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:14.778878+0000 front 2019-12-08T17:25:15.827345+0000 (oldest deadline 2019-12-08T17:25:59.099118+0000) 2019-12-08T17:26:18.068 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:26:18.065+0000 1694f700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:14.346293+0000 front 2019-12-08T17:25:15.071994+0000 (oldest deadline 2019-12-08T17:25:54.620251+0000) 2019-12-08T17:26:18.082 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:26:18.076+0000 1694f700 -1 osd.5 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:12.120944+0000 front 2019-12-08T17:25:12.614631+0000 (oldest deadline 2019-12-08T17:25:57.365984+0000) 2019-12-08T17:26:18.233 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:26:18.230+0000 1694f700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:11.504121+0000 front 2019-12-08T17:25:10.916588+0000 (oldest deadline 2019-12-08T17:25:56.747517+0000) 2019-12-08T17:26:18.637 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:26:18.634+0000 1694f700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:13.021840+0000 front 2019-12-08T17:25:13.006075+0000 (oldest deadline 2019-12-08T17:25:57.687802+0000) 2019-12-08T17:26:18.920 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:26:18.915+0000 1694f700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:10.865702+0000 front 2019-12-08T17:25:10.851005+0000 (oldest deadline 2019-12-08T17:25:55.526701+0000) 2019-12-08T17:26:19.034 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:26:19.028+0000 1694f700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:14.778878+0000 front 2019-12-08T17:25:15.827345+0000 (oldest deadline 2019-12-08T17:25:59.099118+0000) 2019-12-08T17:26:19.037 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:26:19.034+0000 1694f700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:14.346293+0000 front 2019-12-08T17:25:15.071994+0000 (oldest deadline 2019-12-08T17:25:54.620251+0000) 2019-12-08T17:26:19.074 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:26:19.068+0000 1694f700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:10.894751+0000 front 2019-12-08T17:25:11.512940+0000 (oldest deadline 2019-12-08T17:25:56.780337+0000) 2019-12-08T17:26:19.123 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:26:19.117+0000 1694f700 -1 osd.5 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:12.120944+0000 front 2019-12-08T17:25:12.614631+0000 (oldest deadline 2019-12-08T17:25:57.365984+0000) 2019-12-08T17:26:19.212 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:26:19.209+0000 1694f700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:11.504121+0000 front 2019-12-08T17:25:10.916588+0000 (oldest deadline 2019-12-08T17:25:56.747517+0000) 2019-12-08T17:26:19.677 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:26:19.674+0000 1694f700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:13.021840+0000 front 2019-12-08T17:25:13.006075+0000 (oldest deadline 2019-12-08T17:25:57.687802+0000) 2019-12-08T17:26:19.970 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:26:19.964+0000 1694f700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:10.865702+0000 front 2019-12-08T17:25:10.851005+0000 (oldest deadline 2019-12-08T17:25:55.526701+0000) 2019-12-08T17:26:19.992 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:26:19.990+0000 1694f700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:14.346293+0000 front 2019-12-08T17:25:15.071994+0000 (oldest deadline 2019-12-08T17:25:54.620251+0000) 2019-12-08T17:26:20.088 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:26:20.081+0000 1694f700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:14.778878+0000 front 2019-12-08T17:25:15.827345+0000 (oldest deadline 2019-12-08T17:25:59.099118+0000) 2019-12-08T17:26:20.091 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:26:20.085+0000 1694f700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:10.894751+0000 front 2019-12-08T17:25:11.512940+0000 (oldest deadline 2019-12-08T17:25:56.780337+0000) 2019-12-08T17:26:20.134 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:26:20.129+0000 1694f700 -1 osd.5 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:12.120944+0000 front 2019-12-08T17:25:12.614631+0000 (oldest deadline 2019-12-08T17:25:57.365984+0000) 2019-12-08T17:26:20.257 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:26:20.254+0000 1694f700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:11.504121+0000 front 2019-12-08T17:25:10.916588+0000 (oldest deadline 2019-12-08T17:25:56.747517+0000) 2019-12-08T17:26:20.670 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:26:20.670+0000 1694f700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:13.021840+0000 front 2019-12-08T17:25:13.006075+0000 (oldest deadline 2019-12-08T17:25:57.687802+0000) 2019-12-08T17:26:20.963 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:26:20.953+0000 1694f700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:10.865702+0000 front 2019-12-08T17:25:10.851005+0000 (oldest deadline 2019-12-08T17:25:55.526701+0000) 2019-12-08T17:26:20.973 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:26:20.968+0000 1694f700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:14.346293+0000 front 2019-12-08T17:25:15.071994+0000 (oldest deadline 2019-12-08T17:25:54.620251+0000) 2019-12-08T17:26:21.088 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:26:21.082+0000 1694f700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:14.778878+0000 front 2019-12-08T17:25:15.827345+0000 (oldest deadline 2019-12-08T17:25:59.099118+0000) 2019-12-08T17:26:21.124 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:26:21.117+0000 1694f700 -1 osd.5 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:12.120944+0000 front 2019-12-08T17:25:12.614631+0000 (oldest deadline 2019-12-08T17:25:57.365984+0000) 2019-12-08T17:26:21.132 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:26:21.127+0000 1694f700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:10.894751+0000 front 2019-12-08T17:25:11.512940+0000 (oldest deadline 2019-12-08T17:25:56.780337+0000) 2019-12-08T17:26:21.213 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:26:21.211+0000 1694f700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:11.504121+0000 front 2019-12-08T17:25:10.916588+0000 (oldest deadline 2019-12-08T17:25:56.747517+0000) 2019-12-08T17:26:21.714 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:26:21.711+0000 1694f700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:13.021840+0000 front 2019-12-08T17:25:13.006075+0000 (oldest deadline 2019-12-08T17:25:57.687802+0000) 2019-12-08T17:26:21.991 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:26:21.985+0000 1694f700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:10.865702+0000 front 2019-12-08T17:25:10.851005+0000 (oldest deadline 2019-12-08T17:25:55.526701+0000) 2019-12-08T17:26:22.014 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:26:22.011+0000 1694f700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:14.346293+0000 front 2019-12-08T17:25:15.071994+0000 (oldest deadline 2019-12-08T17:25:54.620251+0000) 2019-12-08T17:26:22.081 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:26:22.075+0000 1694f700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:14.778878+0000 front 2019-12-08T17:25:15.827345+0000 (oldest deadline 2019-12-08T17:25:59.099118+0000) 2019-12-08T17:26:22.165 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:26:22.160+0000 1694f700 -1 osd.5 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:12.120944+0000 front 2019-12-08T17:25:12.614631+0000 (oldest deadline 2019-12-08T17:25:57.365984+0000) 2019-12-08T17:26:22.189 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:26:22.183+0000 1694f700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:10.894751+0000 front 2019-12-08T17:25:11.512940+0000 (oldest deadline 2019-12-08T17:25:56.780337+0000) 2019-12-08T17:26:22.202 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:26:22.201+0000 1694f700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:11.504121+0000 front 2019-12-08T17:25:10.916588+0000 (oldest deadline 2019-12-08T17:25:56.747517+0000) 2019-12-08T17:26:22.726 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:26:22.725+0000 1694f700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:13.021840+0000 front 2019-12-08T17:25:13.006075+0000 (oldest deadline 2019-12-08T17:25:57.687802+0000) 2019-12-08T17:26:22.981 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:26:22.973+0000 1694f700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:10.865702+0000 front 2019-12-08T17:25:10.851005+0000 (oldest deadline 2019-12-08T17:25:55.526701+0000) 2019-12-08T17:26:22.996 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:26:22.994+0000 1694f700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:14.346293+0000 front 2019-12-08T17:25:15.071994+0000 (oldest deadline 2019-12-08T17:25:54.620251+0000) 2019-12-08T17:26:23.109 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:26:23.104+0000 1694f700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:14.778878+0000 front 2019-12-08T17:25:15.827345+0000 (oldest deadline 2019-12-08T17:25:59.099118+0000) 2019-12-08T17:26:23.136 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:26:23.127+0000 1694f700 -1 osd.5 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:12.120944+0000 front 2019-12-08T17:25:12.614631+0000 (oldest deadline 2019-12-08T17:25:57.365984+0000) 2019-12-08T17:26:23.195 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:26:23.194+0000 1694f700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:11.504121+0000 front 2019-12-08T17:25:10.916588+0000 (oldest deadline 2019-12-08T17:25:56.747517+0000) 2019-12-08T17:26:23.216 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:26:23.210+0000 1694f700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:10.894751+0000 front 2019-12-08T17:25:11.512940+0000 (oldest deadline 2019-12-08T17:25:56.780337+0000) 2019-12-08T17:26:23.767 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:26:23.764+0000 1694f700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:13.021840+0000 front 2019-12-08T17:25:13.006075+0000 (oldest deadline 2019-12-08T17:25:57.687802+0000) 2019-12-08T17:26:23.977 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:26:23.963+0000 1694f700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:10.865702+0000 front 2019-12-08T17:25:10.851005+0000 (oldest deadline 2019-12-08T17:25:55.526701+0000) 2019-12-08T17:26:24.041 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:26:24.040+0000 1694f700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:14.346293+0000 front 2019-12-08T17:25:15.071994+0000 (oldest deadline 2019-12-08T17:25:54.620251+0000) 2019-12-08T17:26:24.092 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:26:24.088+0000 1694f700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:14.778878+0000 front 2019-12-08T17:25:15.827345+0000 (oldest deadline 2019-12-08T17:25:59.099118+0000) 2019-12-08T17:26:24.195 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:26:24.188+0000 1694f700 -1 osd.5 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:12.120944+0000 front 2019-12-08T17:25:12.614631+0000 (oldest deadline 2019-12-08T17:25:57.365984+0000) 2019-12-08T17:26:24.224 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:26:24.218+0000 1694f700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:10.894751+0000 front 2019-12-08T17:25:11.512940+0000 (oldest deadline 2019-12-08T17:25:56.780337+0000) 2019-12-08T17:26:24.247 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:26:24.245+0000 1694f700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:11.504121+0000 front 2019-12-08T17:25:10.916588+0000 (oldest deadline 2019-12-08T17:25:56.747517+0000) 2019-12-08T17:26:24.790 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:26:24.789+0000 1694f700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:13.021840+0000 front 2019-12-08T17:25:13.006075+0000 (oldest deadline 2019-12-08T17:25:57.687802+0000) 2019-12-08T17:26:25.016 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:26:25.010+0000 1694f700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:10.865702+0000 front 2019-12-08T17:25:10.851005+0000 (oldest deadline 2019-12-08T17:25:55.526701+0000) 2019-12-08T17:26:25.063 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:26:25.054+0000 1694f700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:14.346293+0000 front 2019-12-08T17:25:15.071994+0000 (oldest deadline 2019-12-08T17:25:54.620251+0000) 2019-12-08T17:26:25.121 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:26:25.114+0000 1694f700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:14.778878+0000 front 2019-12-08T17:25:15.827345+0000 (oldest deadline 2019-12-08T17:25:59.099118+0000) 2019-12-08T17:26:25.191 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:26:25.186+0000 1694f700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:10.894751+0000 front 2019-12-08T17:25:11.512940+0000 (oldest deadline 2019-12-08T17:25:56.780337+0000) 2019-12-08T17:26:25.200 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:26:25.194+0000 1694f700 -1 osd.5 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:12.120944+0000 front 2019-12-08T17:25:12.614631+0000 (oldest deadline 2019-12-08T17:25:57.365984+0000) 2019-12-08T17:26:25.266 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:26:25.264+0000 1694f700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:11.504121+0000 front 2019-12-08T17:25:10.916588+0000 (oldest deadline 2019-12-08T17:25:56.747517+0000) 2019-12-08T17:26:25.325 INFO:tasks.ceph.mon.b.smithi013.stderr:2019-12-08T17:26:25.318+0000 1a89c700 -1 mon.b@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.2 [v2:172.21.15.79:6802/10448,v1:172.21.15.79:6803/10448] for 40sec e190 v190) 2019-12-08T17:26:25.772 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:26:25.771+0000 1694f700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:13.021840+0000 front 2019-12-08T17:25:13.006075+0000 (oldest deadline 2019-12-08T17:25:57.687802+0000) 2019-12-08T17:26:26.000 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:26:25.993+0000 1694f700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:10.865702+0000 front 2019-12-08T17:25:10.851005+0000 (oldest deadline 2019-12-08T17:25:55.526701+0000) 2019-12-08T17:26:26.043 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:26:26.042+0000 1694f700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:14.346293+0000 front 2019-12-08T17:25:15.071994+0000 (oldest deadline 2019-12-08T17:25:54.620251+0000) 2019-12-08T17:26:26.100 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:26:26.094+0000 1694f700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:14.778878+0000 front 2019-12-08T17:25:15.827345+0000 (oldest deadline 2019-12-08T17:25:59.099118+0000) 2019-12-08T17:26:26.187 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:26:26.181+0000 1694f700 -1 osd.5 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:12.120944+0000 front 2019-12-08T17:25:12.614631+0000 (oldest deadline 2019-12-08T17:25:57.365984+0000) 2019-12-08T17:26:26.210 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:26:26.204+0000 1694f700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:10.894751+0000 front 2019-12-08T17:25:11.512940+0000 (oldest deadline 2019-12-08T17:25:56.780337+0000) 2019-12-08T17:26:26.288 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:26:26.287+0000 1694f700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:11.504121+0000 front 2019-12-08T17:25:10.916588+0000 (oldest deadline 2019-12-08T17:25:56.747517+0000) 2019-12-08T17:26:26.817 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:26:26.811+0000 1694f700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:13.021840+0000 front 2019-12-08T17:25:13.006075+0000 (oldest deadline 2019-12-08T17:25:57.687802+0000) 2019-12-08T17:26:26.962 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:26:26.956+0000 1694f700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:10.865702+0000 front 2019-12-08T17:25:10.851005+0000 (oldest deadline 2019-12-08T17:25:55.526701+0000) 2019-12-08T17:26:27.087 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:26:27.086+0000 1694f700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:14.346293+0000 front 2019-12-08T17:25:15.071994+0000 (oldest deadline 2019-12-08T17:25:54.620251+0000) 2019-12-08T17:26:27.131 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:26:27.124+0000 1694f700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:14.778878+0000 front 2019-12-08T17:25:15.827345+0000 (oldest deadline 2019-12-08T17:25:59.099118+0000) 2019-12-08T17:26:27.175 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:26:27.170+0000 1694f700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:10.894751+0000 front 2019-12-08T17:25:11.512940+0000 (oldest deadline 2019-12-08T17:25:56.780337+0000) 2019-12-08T17:26:27.207 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:26:27.201+0000 1694f700 -1 osd.5 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:12.120944+0000 front 2019-12-08T17:25:12.614631+0000 (oldest deadline 2019-12-08T17:25:57.365984+0000) 2019-12-08T17:26:27.303 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:26:27.301+0000 1694f700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:11.504121+0000 front 2019-12-08T17:25:10.916588+0000 (oldest deadline 2019-12-08T17:25:56.747517+0000) 2019-12-08T17:26:27.809 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:26:27.806+0000 1694f700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:13.021840+0000 front 2019-12-08T17:25:13.006075+0000 (oldest deadline 2019-12-08T17:25:57.687802+0000) 2019-12-08T17:26:27.956 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:26:27.950+0000 1694f700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:10.865702+0000 front 2019-12-08T17:25:10.851005+0000 (oldest deadline 2019-12-08T17:25:55.526701+0000) 2019-12-08T17:26:28.136 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:26:28.134+0000 1694f700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:14.346293+0000 front 2019-12-08T17:25:15.071994+0000 (oldest deadline 2019-12-08T17:25:54.620251+0000) 2019-12-08T17:26:28.141 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:26:28.135+0000 1694f700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:14.778878+0000 front 2019-12-08T17:25:15.827345+0000 (oldest deadline 2019-12-08T17:25:59.099118+0000) 2019-12-08T17:26:28.163 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:26:28.157+0000 1694f700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:10.894751+0000 front 2019-12-08T17:25:11.512940+0000 (oldest deadline 2019-12-08T17:25:56.780337+0000) 2019-12-08T17:26:28.214 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:26:28.208+0000 1694f700 -1 osd.5 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:12.120944+0000 front 2019-12-08T17:25:12.614631+0000 (oldest deadline 2019-12-08T17:25:57.365984+0000) 2019-12-08T17:26:28.339 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:26:28.337+0000 1694f700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:11.504121+0000 front 2019-12-08T17:25:10.916588+0000 (oldest deadline 2019-12-08T17:25:56.747517+0000) 2019-12-08T17:26:28.806 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:26:28.804+0000 1694f700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:13.021840+0000 front 2019-12-08T17:25:13.006075+0000 (oldest deadline 2019-12-08T17:25:57.687802+0000) 2019-12-08T17:26:28.998 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:26:28.993+0000 1694f700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:10.865702+0000 front 2019-12-08T17:25:10.851005+0000 (oldest deadline 2019-12-08T17:25:55.526701+0000) 2019-12-08T17:26:29.157 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:26:29.152+0000 1694f700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:14.778878+0000 front 2019-12-08T17:25:15.827345+0000 (oldest deadline 2019-12-08T17:25:59.099118+0000) 2019-12-08T17:26:29.175 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:26:29.166+0000 1694f700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:10.894751+0000 front 2019-12-08T17:25:11.512940+0000 (oldest deadline 2019-12-08T17:25:56.780337+0000) 2019-12-08T17:26:29.181 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:26:29.180+0000 1694f700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:14.346293+0000 front 2019-12-08T17:25:15.071994+0000 (oldest deadline 2019-12-08T17:25:54.620251+0000) 2019-12-08T17:26:29.266 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:26:29.260+0000 1694f700 -1 osd.5 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:12.120944+0000 front 2019-12-08T17:25:12.614631+0000 (oldest deadline 2019-12-08T17:25:57.365984+0000) 2019-12-08T17:26:29.312 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:26:29.311+0000 1694f700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:11.504121+0000 front 2019-12-08T17:25:10.916588+0000 (oldest deadline 2019-12-08T17:25:56.747517+0000) 2019-12-08T17:26:29.856 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:26:29.854+0000 1694f700 -1 osd.3 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:13.021840+0000 front 2019-12-08T17:25:13.006075+0000 (oldest deadline 2019-12-08T17:25:57.687802+0000) 2019-12-08T17:26:29.995 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:26:29.990+0000 1694f700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:10.865702+0000 front 2019-12-08T17:25:10.851005+0000 (oldest deadline 2019-12-08T17:25:55.526701+0000) 2019-12-08T17:26:30.141 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:26:30.136+0000 1694f700 -1 osd.4 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:14.778878+0000 front 2019-12-08T17:25:15.827345+0000 (oldest deadline 2019-12-08T17:25:59.099118+0000) 2019-12-08T17:26:30.142 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:26:30.137+0000 1694f700 -1 osd.7 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:10.894751+0000 front 2019-12-08T17:25:11.512940+0000 (oldest deadline 2019-12-08T17:25:56.780337+0000) 2019-12-08T17:26:30.209 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:26:30.208+0000 1694f700 -1 osd.1 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:14.346293+0000 front 2019-12-08T17:25:15.071994+0000 (oldest deadline 2019-12-08T17:25:54.620251+0000) 2019-12-08T17:26:30.270 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:26:30.265+0000 1694f700 -1 osd.5 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:12.120944+0000 front 2019-12-08T17:25:12.614631+0000 (oldest deadline 2019-12-08T17:25:57.365984+0000) 2019-12-08T17:26:30.363 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:26:30.363+0000 1694f700 -1 osd.0 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:11.504121+0000 front 2019-12-08T17:25:10.916588+0000 (oldest deadline 2019-12-08T17:25:56.747517+0000) 2019-12-08T17:26:30.475 INFO:tasks.ceph.mon.b.smithi013.stderr:2019-12-08T17:26:30.458+0000 1a89c700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.2 [v2:172.21.15.79:6802/10448,v1:172.21.15.79:6803/10448] for 40sec e190 v190) 2019-12-08T17:26:30.968 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:26:30.964+0000 1694f700 -1 osd.6 190 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:25:10.865702+0000 front 2019-12-08T17:25:10.851005+0000 (oldest deadline 2019-12-08T17:25:55.526701+0000) 2019-12-08T17:27:28.349 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:27:28.346+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:48.096442+0000 front 2019-12-08T17:26:48.038442+0000 (oldest deadline 2019-12-08T17:27:28.000371+0000) 2019-12-08T17:27:28.664 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:27:28.661+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.580187+0000 front 2019-12-08T17:26:47.469336+0000 (oldest deadline 2019-12-08T17:27:28.537081+0000) 2019-12-08T17:27:29.306 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:27:29.304+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:48.096442+0000 front 2019-12-08T17:26:48.038442+0000 (oldest deadline 2019-12-08T17:27:28.000371+0000) 2019-12-08T17:27:29.666 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:27:29.663+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.580187+0000 front 2019-12-08T17:26:47.469336+0000 (oldest deadline 2019-12-08T17:27:28.537081+0000) 2019-12-08T17:27:29.972 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:27:29.966+0000 1694f700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.124512+0000 front 2019-12-08T17:26:45.549671+0000 (oldest deadline 2019-12-08T17:27:29.195239+0000) 2019-12-08T17:27:30.293 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:27:30.290+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:48.096442+0000 front 2019-12-08T17:26:48.038442+0000 (oldest deadline 2019-12-08T17:27:28.000371+0000) 2019-12-08T17:27:30.624 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:27:30.621+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.580187+0000 front 2019-12-08T17:26:47.469336+0000 (oldest deadline 2019-12-08T17:27:28.537081+0000) 2019-12-08T17:27:30.751 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:27:30.745+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.240392+0000 front 2019-12-08T17:26:47.564469+0000 (oldest deadline 2019-12-08T17:27:29.956524+0000) 2019-12-08T17:27:30.985 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:27:30.978+0000 1694f700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.124512+0000 front 2019-12-08T17:26:45.549671+0000 (oldest deadline 2019-12-08T17:27:29.195239+0000) 2019-12-08T17:27:31.236 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:27:31.230+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.024070+0000 front 2019-12-08T17:26:44.999176+0000 (oldest deadline 2019-12-08T17:27:30.812079+0000) 2019-12-08T17:27:31.328 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:27:31.326+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:48.096442+0000 front 2019-12-08T17:26:48.038442+0000 (oldest deadline 2019-12-08T17:27:28.000371+0000) 2019-12-08T17:27:31.654 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:27:31.651+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.580187+0000 front 2019-12-08T17:26:47.469336+0000 (oldest deadline 2019-12-08T17:27:28.537081+0000) 2019-12-08T17:27:31.792 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:27:31.786+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.240392+0000 front 2019-12-08T17:26:47.564469+0000 (oldest deadline 2019-12-08T17:27:29.956524+0000) 2019-12-08T17:27:31.989 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:27:31.983+0000 1694f700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.124512+0000 front 2019-12-08T17:26:45.549671+0000 (oldest deadline 2019-12-08T17:27:29.195239+0000) 2019-12-08T17:27:32.195 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:27:32.188+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.024070+0000 front 2019-12-08T17:26:44.999176+0000 (oldest deadline 2019-12-08T17:27:30.812079+0000) 2019-12-08T17:27:32.245 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:27:32.240+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:46.765421+0000 front 2019-12-08T17:26:46.761440+0000 (oldest deadline 2019-12-08T17:27:32.049747+0000) 2019-12-08T17:27:32.316 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:27:32.313+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:48.096442+0000 front 2019-12-08T17:26:48.038442+0000 (oldest deadline 2019-12-08T17:27:28.000371+0000) 2019-12-08T17:27:32.694 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:27:32.691+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.580187+0000 front 2019-12-08T17:26:47.469336+0000 (oldest deadline 2019-12-08T17:27:28.537081+0000) 2019-12-08T17:27:32.778 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:27:32.770+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.240392+0000 front 2019-12-08T17:26:47.564469+0000 (oldest deadline 2019-12-08T17:27:29.956524+0000) 2019-12-08T17:27:32.969 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:27:32.963+0000 1694f700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.124512+0000 front 2019-12-08T17:26:45.549671+0000 (oldest deadline 2019-12-08T17:27:29.195239+0000) 2019-12-08T17:27:33.214 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:27:33.204+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:46.765421+0000 front 2019-12-08T17:26:46.761440+0000 (oldest deadline 2019-12-08T17:27:32.049747+0000) 2019-12-08T17:27:33.229 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:27:33.223+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.024070+0000 front 2019-12-08T17:26:44.999176+0000 (oldest deadline 2019-12-08T17:27:30.812079+0000) 2019-12-08T17:27:33.292 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:27:33.288+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:48.096442+0000 front 2019-12-08T17:26:48.038442+0000 (oldest deadline 2019-12-08T17:27:28.000371+0000) 2019-12-08T17:27:33.683 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:27:33.679+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.580187+0000 front 2019-12-08T17:26:47.469336+0000 (oldest deadline 2019-12-08T17:27:28.537081+0000) 2019-12-08T17:27:33.759 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:27:33.752+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.240392+0000 front 2019-12-08T17:26:47.564469+0000 (oldest deadline 2019-12-08T17:27:29.956524+0000) 2019-12-08T17:27:33.980 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:27:33.974+0000 1694f700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.124512+0000 front 2019-12-08T17:26:45.549671+0000 (oldest deadline 2019-12-08T17:27:29.195239+0000) 2019-12-08T17:27:34.194 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:27:34.187+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:46.765421+0000 front 2019-12-08T17:26:46.761440+0000 (oldest deadline 2019-12-08T17:27:32.049747+0000) 2019-12-08T17:27:34.202 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:27:34.197+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.024070+0000 front 2019-12-08T17:26:44.999176+0000 (oldest deadline 2019-12-08T17:27:30.812079+0000) 2019-12-08T17:27:34.253 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:27:34.251+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:48.096442+0000 front 2019-12-08T17:26:48.038442+0000 (oldest deadline 2019-12-08T17:27:28.000371+0000) 2019-12-08T17:27:34.735 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:27:34.732+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.580187+0000 front 2019-12-08T17:26:47.469336+0000 (oldest deadline 2019-12-08T17:27:28.537081+0000) 2019-12-08T17:27:34.769 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:27:34.762+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.240392+0000 front 2019-12-08T17:26:47.564469+0000 (oldest deadline 2019-12-08T17:27:29.956524+0000) 2019-12-08T17:27:35.005 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:27:34.999+0000 1694f700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.124512+0000 front 2019-12-08T17:26:45.549671+0000 (oldest deadline 2019-12-08T17:27:29.195239+0000) 2019-12-08T17:27:35.237 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:27:35.229+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.024070+0000 front 2019-12-08T17:26:44.999176+0000 (oldest deadline 2019-12-08T17:27:30.812079+0000) 2019-12-08T17:27:35.244 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:27:35.238+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:46.765421+0000 front 2019-12-08T17:26:46.761440+0000 (oldest deadline 2019-12-08T17:27:32.049747+0000) 2019-12-08T17:27:35.271 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:27:35.268+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:48.096442+0000 front 2019-12-08T17:26:48.038442+0000 (oldest deadline 2019-12-08T17:27:28.000371+0000) 2019-12-08T17:27:35.738 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:27:35.736+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.580187+0000 front 2019-12-08T17:26:47.469336+0000 (oldest deadline 2019-12-08T17:27:28.537081+0000) 2019-12-08T17:27:35.759 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:27:35.753+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.240392+0000 front 2019-12-08T17:26:47.564469+0000 (oldest deadline 2019-12-08T17:27:29.956524+0000) 2019-12-08T17:27:36.057 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:27:36.050+0000 1694f700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.124512+0000 front 2019-12-08T17:26:45.549671+0000 (oldest deadline 2019-12-08T17:27:29.195239+0000) 2019-12-08T17:27:36.267 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:27:36.260+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.024070+0000 front 2019-12-08T17:26:44.999176+0000 (oldest deadline 2019-12-08T17:27:30.812079+0000) 2019-12-08T17:27:36.286 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:27:36.282+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:48.096442+0000 front 2019-12-08T17:26:48.038442+0000 (oldest deadline 2019-12-08T17:27:28.000371+0000) 2019-12-08T17:27:36.289 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:27:36.284+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:46.765421+0000 front 2019-12-08T17:26:46.761440+0000 (oldest deadline 2019-12-08T17:27:32.049747+0000) 2019-12-08T17:27:36.756 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:27:36.751+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.580187+0000 front 2019-12-08T17:26:47.469336+0000 (oldest deadline 2019-12-08T17:27:28.537081+0000) 2019-12-08T17:27:36.773 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:27:36.767+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.240392+0000 front 2019-12-08T17:26:47.564469+0000 (oldest deadline 2019-12-08T17:27:29.956524+0000) 2019-12-08T17:27:37.108 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:27:37.101+0000 1694f700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.124512+0000 front 2019-12-08T17:26:45.549671+0000 (oldest deadline 2019-12-08T17:27:29.195239+0000) 2019-12-08T17:27:37.265 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:27:37.258+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.024070+0000 front 2019-12-08T17:26:44.999176+0000 (oldest deadline 2019-12-08T17:27:30.812079+0000) 2019-12-08T17:27:37.296 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:27:37.293+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:48.096442+0000 front 2019-12-08T17:26:48.038442+0000 (oldest deadline 2019-12-08T17:27:28.000371+0000) 2019-12-08T17:27:37.307 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:27:37.300+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:46.765421+0000 front 2019-12-08T17:26:46.761440+0000 (oldest deadline 2019-12-08T17:27:32.049747+0000) 2019-12-08T17:27:37.720 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:27:37.715+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.580187+0000 front 2019-12-08T17:26:47.469336+0000 (oldest deadline 2019-12-08T17:27:28.537081+0000) 2019-12-08T17:27:37.821 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:27:37.815+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.240392+0000 front 2019-12-08T17:26:47.564469+0000 (oldest deadline 2019-12-08T17:27:29.956524+0000) 2019-12-08T17:27:38.137 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:27:38.131+0000 1694f700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.124512+0000 front 2019-12-08T17:26:45.549671+0000 (oldest deadline 2019-12-08T17:27:29.195239+0000) 2019-12-08T17:27:38.231 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:27:38.224+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.024070+0000 front 2019-12-08T17:26:44.999176+0000 (oldest deadline 2019-12-08T17:27:30.812079+0000) 2019-12-08T17:27:38.235 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:27:38.232+0000 1694f700 -1 osd.4 196 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103888 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=238b] snapc 0=[] ondisk+write+known_if_redirected e194) 2019-12-08T17:27:38.300 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:27:38.296+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:48.096442+0000 front 2019-12-08T17:26:48.038442+0000 (oldest deadline 2019-12-08T17:27:28.000371+0000) 2019-12-08T17:27:38.302 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:27:38.296+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:46.765421+0000 front 2019-12-08T17:26:46.761440+0000 (oldest deadline 2019-12-08T17:27:32.049747+0000) 2019-12-08T17:27:38.581 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:27:38.579+0000 1694f700 -1 osd.2 196 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4449.0:101483 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e194) 2019-12-08T17:27:38.679 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:27:38.676+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.580187+0000 front 2019-12-08T17:26:47.469336+0000 (oldest deadline 2019-12-08T17:27:28.537081+0000) 2019-12-08T17:27:38.796 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:27:38.789+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.240392+0000 front 2019-12-08T17:26:47.564469+0000 (oldest deadline 2019-12-08T17:27:29.956524+0000) 2019-12-08T17:27:39.121 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:27:39.115+0000 1694f700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.124512+0000 front 2019-12-08T17:26:45.549671+0000 (oldest deadline 2019-12-08T17:27:29.195239+0000) 2019-12-08T17:27:39.275 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:27:39.268+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.024070+0000 front 2019-12-08T17:26:44.999176+0000 (oldest deadline 2019-12-08T17:27:30.812079+0000) 2019-12-08T17:27:39.276 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:27:39.272+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:48.096442+0000 front 2019-12-08T17:26:48.038442+0000 (oldest deadline 2019-12-08T17:27:28.000371+0000) 2019-12-08T17:27:39.276 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:27:39.271+0000 1694f700 -1 osd.4 196 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103888 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=238b] snapc 0=[] ondisk+write+known_if_redirected e194) 2019-12-08T17:27:39.307 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:27:39.301+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:46.765421+0000 front 2019-12-08T17:26:46.761440+0000 (oldest deadline 2019-12-08T17:27:32.049747+0000) 2019-12-08T17:27:39.634 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:27:39.632+0000 1694f700 -1 osd.2 196 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4449.0:101483 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e194) 2019-12-08T17:27:39.644 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:27:39.639+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.580187+0000 front 2019-12-08T17:26:47.469336+0000 (oldest deadline 2019-12-08T17:27:28.537081+0000) 2019-12-08T17:27:39.831 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:27:39.824+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.240392+0000 front 2019-12-08T17:26:47.564469+0000 (oldest deadline 2019-12-08T17:27:29.956524+0000) 2019-12-08T17:27:40.079 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:27:40.073+0000 1694f700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.124512+0000 front 2019-12-08T17:26:45.549671+0000 (oldest deadline 2019-12-08T17:27:29.195239+0000) 2019-12-08T17:27:40.233 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:27:40.227+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.024070+0000 front 2019-12-08T17:26:44.999176+0000 (oldest deadline 2019-12-08T17:27:30.812079+0000) 2019-12-08T17:27:40.234 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:27:40.229+0000 1694f700 -1 osd.4 196 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103888 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=238b] snapc 0=[] ondisk+write+known_if_redirected e194) 2019-12-08T17:27:40.271 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:27:40.265+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:46.765421+0000 front 2019-12-08T17:26:46.761440+0000 (oldest deadline 2019-12-08T17:27:32.049747+0000) 2019-12-08T17:27:40.294 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:27:40.288+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:48.096442+0000 front 2019-12-08T17:26:48.038442+0000 (oldest deadline 2019-12-08T17:27:28.000371+0000) 2019-12-08T17:27:40.660 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:27:40.659+0000 1694f700 -1 osd.2 196 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4449.0:101483 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e194) 2019-12-08T17:27:40.665 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:27:40.663+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.580187+0000 front 2019-12-08T17:26:47.469336+0000 (oldest deadline 2019-12-08T17:27:28.537081+0000) 2019-12-08T17:27:40.797 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:27:40.791+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.240392+0000 front 2019-12-08T17:26:47.564469+0000 (oldest deadline 2019-12-08T17:27:29.956524+0000) 2019-12-08T17:27:41.116 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:27:41.109+0000 1694f700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.124512+0000 front 2019-12-08T17:26:45.549671+0000 (oldest deadline 2019-12-08T17:27:29.195239+0000) 2019-12-08T17:27:41.196 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:27:41.190+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.024070+0000 front 2019-12-08T17:26:44.999176+0000 (oldest deadline 2019-12-08T17:27:30.812079+0000) 2019-12-08T17:27:41.197 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:27:41.193+0000 1694f700 -1 osd.4 196 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103888 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=238b] snapc 0=[] ondisk+write+known_if_redirected e194) 2019-12-08T17:27:41.295 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:27:41.289+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:46.765421+0000 front 2019-12-08T17:26:46.761440+0000 (oldest deadline 2019-12-08T17:27:32.049747+0000) 2019-12-08T17:27:41.299 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:27:41.296+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:48.096442+0000 front 2019-12-08T17:26:48.038442+0000 (oldest deadline 2019-12-08T17:27:28.000371+0000) 2019-12-08T17:27:41.631 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:27:41.629+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.580187+0000 front 2019-12-08T17:26:47.469336+0000 (oldest deadline 2019-12-08T17:27:28.537081+0000) 2019-12-08T17:27:41.660 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:27:41.658+0000 1694f700 -1 osd.2 196 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4449.0:101483 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e194) 2019-12-08T17:27:41.793 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:27:41.788+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.240392+0000 front 2019-12-08T17:26:47.564469+0000 (oldest deadline 2019-12-08T17:27:29.956524+0000) 2019-12-08T17:27:42.076 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:27:42.069+0000 1694f700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.124512+0000 front 2019-12-08T17:26:45.549671+0000 (oldest deadline 2019-12-08T17:27:29.195239+0000) 2019-12-08T17:27:42.252 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:27:42.242+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.024070+0000 front 2019-12-08T17:26:44.999176+0000 (oldest deadline 2019-12-08T17:27:30.812079+0000) 2019-12-08T17:27:42.253 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:27:42.245+0000 1694f700 -1 osd.4 196 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103888 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=238b] snapc 0=[] ondisk+write+known_if_redirected e194) 2019-12-08T17:27:42.269 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:27:42.263+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:46.765421+0000 front 2019-12-08T17:26:46.761440+0000 (oldest deadline 2019-12-08T17:27:32.049747+0000) 2019-12-08T17:27:42.316 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:27:42.312+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:48.096442+0000 front 2019-12-08T17:26:48.038442+0000 (oldest deadline 2019-12-08T17:27:28.000371+0000) 2019-12-08T17:27:42.671 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:27:42.669+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.580187+0000 front 2019-12-08T17:26:47.469336+0000 (oldest deadline 2019-12-08T17:27:28.537081+0000) 2019-12-08T17:27:42.697 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:27:42.689+0000 1694f700 -1 osd.2 196 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4449.0:101483 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e194) 2019-12-08T17:27:42.796 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:27:42.790+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.240392+0000 front 2019-12-08T17:26:47.564469+0000 (oldest deadline 2019-12-08T17:27:29.956524+0000) 2019-12-08T17:27:43.092 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:27:43.086+0000 1694f700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.124512+0000 front 2019-12-08T17:26:45.549671+0000 (oldest deadline 2019-12-08T17:27:29.195239+0000) 2019-12-08T17:27:43.233 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:27:43.228+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.024070+0000 front 2019-12-08T17:26:44.999176+0000 (oldest deadline 2019-12-08T17:27:30.812079+0000) 2019-12-08T17:27:43.234 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:27:43.230+0000 1694f700 -1 osd.4 196 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103888 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=238b] snapc 0=[] ondisk+write+known_if_redirected e194) 2019-12-08T17:27:43.308 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:27:43.301+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:46.765421+0000 front 2019-12-08T17:26:46.761440+0000 (oldest deadline 2019-12-08T17:27:32.049747+0000) 2019-12-08T17:27:43.313 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:27:43.311+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:48.096442+0000 front 2019-12-08T17:26:48.038442+0000 (oldest deadline 2019-12-08T17:27:28.000371+0000) 2019-12-08T17:27:43.650 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:27:43.647+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.580187+0000 front 2019-12-08T17:26:47.469336+0000 (oldest deadline 2019-12-08T17:27:28.537081+0000) 2019-12-08T17:27:43.704 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:27:43.697+0000 1694f700 -1 osd.2 196 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4449.0:101483 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e194) 2019-12-08T17:27:43.842 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:27:43.836+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.240392+0000 front 2019-12-08T17:26:47.564469+0000 (oldest deadline 2019-12-08T17:27:29.956524+0000) 2019-12-08T17:27:44.150 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:27:44.140+0000 1694f700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.124512+0000 front 2019-12-08T17:26:45.549671+0000 (oldest deadline 2019-12-08T17:27:29.195239+0000) 2019-12-08T17:27:44.228 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:27:44.222+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.024070+0000 front 2019-12-08T17:26:44.999176+0000 (oldest deadline 2019-12-08T17:27:30.812079+0000) 2019-12-08T17:27:44.231 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:27:44.227+0000 1694f700 -1 osd.4 196 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103888 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=238b] snapc 0=[] ondisk+write+known_if_redirected e194) 2019-12-08T17:27:44.284 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:27:44.281+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:48.096442+0000 front 2019-12-08T17:26:48.038442+0000 (oldest deadline 2019-12-08T17:27:28.000371+0000) 2019-12-08T17:27:44.355 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:27:44.349+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:46.765421+0000 front 2019-12-08T17:26:46.761440+0000 (oldest deadline 2019-12-08T17:27:32.049747+0000) 2019-12-08T17:27:44.630 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:27:44.627+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.580187+0000 front 2019-12-08T17:26:47.469336+0000 (oldest deadline 2019-12-08T17:27:28.537081+0000) 2019-12-08T17:27:44.660 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:27:44.657+0000 1694f700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:27:04.180541+0000 (oldest deadline 2019-12-08T17:27:44.180541+0000) 2019-12-08T17:27:44.665 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:27:44.663+0000 1694f700 -1 osd.2 196 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4449.0:101483 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e194) 2019-12-08T17:27:44.811 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:27:44.805+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.240392+0000 front 2019-12-08T17:26:47.564469+0000 (oldest deadline 2019-12-08T17:27:29.956524+0000) 2019-12-08T17:27:45.161 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:27:45.155+0000 1694f700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.124512+0000 front 2019-12-08T17:26:45.549671+0000 (oldest deadline 2019-12-08T17:27:29.195239+0000) 2019-12-08T17:27:45.243 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:27:45.241+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:48.096442+0000 front 2019-12-08T17:26:48.038442+0000 (oldest deadline 2019-12-08T17:27:28.000371+0000) 2019-12-08T17:27:45.246 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:27:45.239+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.024070+0000 front 2019-12-08T17:26:44.999176+0000 (oldest deadline 2019-12-08T17:27:30.812079+0000) 2019-12-08T17:27:45.247 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:27:45.242+0000 1694f700 -1 osd.4 196 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103888 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=238b] snapc 0=[] ondisk+write+known_if_redirected e194) 2019-12-08T17:27:45.373 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:27:45.367+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:46.765421+0000 front 2019-12-08T17:26:46.761440+0000 (oldest deadline 2019-12-08T17:27:32.049747+0000) 2019-12-08T17:27:45.608 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:27:45.605+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.580187+0000 front 2019-12-08T17:26:47.469336+0000 (oldest deadline 2019-12-08T17:27:28.537081+0000) 2019-12-08T17:27:45.703 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:27:45.700+0000 1694f700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:27:04.180541+0000 (oldest deadline 2019-12-08T17:27:44.180541+0000) 2019-12-08T17:27:45.705 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:27:45.702+0000 1694f700 -1 osd.2 196 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4449.0:101483 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e194) 2019-12-08T17:27:45.801 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:27:45.795+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.240392+0000 front 2019-12-08T17:26:47.564469+0000 (oldest deadline 2019-12-08T17:27:29.956524+0000) 2019-12-08T17:27:46.200 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:27:46.193+0000 1694f700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.124512+0000 front 2019-12-08T17:26:45.549671+0000 (oldest deadline 2019-12-08T17:27:29.195239+0000) 2019-12-08T17:27:46.229 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:27:46.227+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:48.096442+0000 front 2019-12-08T17:26:48.038442+0000 (oldest deadline 2019-12-08T17:27:28.000371+0000) 2019-12-08T17:27:46.290 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:27:46.284+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.024070+0000 front 2019-12-08T17:26:44.999176+0000 (oldest deadline 2019-12-08T17:27:30.812079+0000) 2019-12-08T17:27:46.293 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:27:46.289+0000 1694f700 -1 osd.4 196 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103888 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=238b] snapc 0=[] ondisk+write+known_if_redirected e194) 2019-12-08T17:27:46.367 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:27:46.361+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:46.765421+0000 front 2019-12-08T17:26:46.761440+0000 (oldest deadline 2019-12-08T17:27:32.049747+0000) 2019-12-08T17:27:46.586 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:27:46.583+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.580187+0000 front 2019-12-08T17:26:47.469336+0000 (oldest deadline 2019-12-08T17:27:28.537081+0000) 2019-12-08T17:27:46.699 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:27:46.696+0000 1694f700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:27:04.180541+0000 (oldest deadline 2019-12-08T17:27:44.180541+0000) 2019-12-08T17:27:46.700 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:27:46.698+0000 1694f700 -1 osd.2 196 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4449.0:101483 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e194) 2019-12-08T17:27:46.829 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:27:46.822+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.240392+0000 front 2019-12-08T17:26:47.564469+0000 (oldest deadline 2019-12-08T17:27:29.956524+0000) 2019-12-08T17:27:47.188 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:27:47.183+0000 1694f700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.124512+0000 front 2019-12-08T17:26:45.549671+0000 (oldest deadline 2019-12-08T17:27:29.195239+0000) 2019-12-08T17:27:47.265 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:27:47.263+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:48.096442+0000 front 2019-12-08T17:26:48.038442+0000 (oldest deadline 2019-12-08T17:27:28.000371+0000) 2019-12-08T17:27:47.327 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:27:47.318+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.024070+0000 front 2019-12-08T17:26:44.999176+0000 (oldest deadline 2019-12-08T17:27:30.812079+0000) 2019-12-08T17:27:47.327 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:27:47.321+0000 1694f700 -1 osd.4 196 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103888 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=238b] snapc 0=[] ondisk+write+known_if_redirected e194) 2019-12-08T17:27:47.328 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:27:47.321+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:46.765421+0000 front 2019-12-08T17:26:46.761440+0000 (oldest deadline 2019-12-08T17:27:32.049747+0000) 2019-12-08T17:27:47.561 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:27:47.558+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.580187+0000 front 2019-12-08T17:26:47.469336+0000 (oldest deadline 2019-12-08T17:27:28.537081+0000) 2019-12-08T17:27:47.726 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:27:47.723+0000 1694f700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:27:04.180541+0000 (oldest deadline 2019-12-08T17:27:44.180541+0000) 2019-12-08T17:27:47.728 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:27:47.727+0000 1694f700 -1 osd.2 196 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4449.0:101483 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e194) 2019-12-08T17:27:47.788 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:27:47.783+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.240392+0000 front 2019-12-08T17:26:47.564469+0000 (oldest deadline 2019-12-08T17:27:29.956524+0000) 2019-12-08T17:27:48.192 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:27:48.186+0000 1694f700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.124512+0000 front 2019-12-08T17:26:45.549671+0000 (oldest deadline 2019-12-08T17:27:29.195239+0000) 2019-12-08T17:27:48.308 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:27:48.303+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.024070+0000 front 2019-12-08T17:26:44.999176+0000 (oldest deadline 2019-12-08T17:27:30.812079+0000) 2019-12-08T17:27:48.308 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:27:48.305+0000 1694f700 -1 osd.4 196 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103888 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=238b] snapc 0=[] ondisk+write+known_if_redirected e194) 2019-12-08T17:27:48.309 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:27:48.306+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:48.096442+0000 front 2019-12-08T17:26:48.038442+0000 (oldest deadline 2019-12-08T17:27:28.000371+0000) 2019-12-08T17:27:48.343 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:27:48.338+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:46.765421+0000 front 2019-12-08T17:26:46.761440+0000 (oldest deadline 2019-12-08T17:27:32.049747+0000) 2019-12-08T17:27:48.577 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:27:48.574+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.580187+0000 front 2019-12-08T17:26:47.469336+0000 (oldest deadline 2019-12-08T17:27:28.537081+0000) 2019-12-08T17:27:48.747 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:27:48.745+0000 1694f700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:27:04.180541+0000 (oldest deadline 2019-12-08T17:27:44.180541+0000) 2019-12-08T17:27:48.748 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:27:48.746+0000 1694f700 -1 osd.2 196 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4449.0:101483 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e194) 2019-12-08T17:27:48.847 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:27:48.838+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.240392+0000 front 2019-12-08T17:26:47.564469+0000 (oldest deadline 2019-12-08T17:27:29.956524+0000) 2019-12-08T17:27:49.206 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:27:49.201+0000 1694f700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.124512+0000 front 2019-12-08T17:26:45.549671+0000 (oldest deadline 2019-12-08T17:27:29.195239+0000) 2019-12-08T17:27:49.277 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:27:49.271+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.024070+0000 front 2019-12-08T17:26:44.999176+0000 (oldest deadline 2019-12-08T17:27:30.812079+0000) 2019-12-08T17:27:49.278 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:27:49.274+0000 1694f700 -1 osd.4 196 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103888 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=238b] snapc 0=[] ondisk+write+known_if_redirected e194) 2019-12-08T17:27:49.359 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:27:49.357+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:48.096442+0000 front 2019-12-08T17:26:48.038442+0000 (oldest deadline 2019-12-08T17:27:28.000371+0000) 2019-12-08T17:27:49.376 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:27:49.370+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:46.765421+0000 front 2019-12-08T17:26:46.761440+0000 (oldest deadline 2019-12-08T17:27:32.049747+0000) 2019-12-08T17:27:49.538 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:27:49.534+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.580187+0000 front 2019-12-08T17:26:47.469336+0000 (oldest deadline 2019-12-08T17:27:28.537081+0000) 2019-12-08T17:27:49.772 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:27:49.768+0000 1694f700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:27:04.180541+0000 (oldest deadline 2019-12-08T17:27:44.180541+0000) 2019-12-08T17:27:49.772 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:27:49.771+0000 1694f700 -1 osd.2 196 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4449.0:101483 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e194) 2019-12-08T17:27:49.803 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:27:49.798+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.240392+0000 front 2019-12-08T17:26:47.564469+0000 (oldest deadline 2019-12-08T17:27:29.956524+0000) 2019-12-08T17:27:50.205 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:27:50.199+0000 1694f700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.124512+0000 front 2019-12-08T17:26:45.549671+0000 (oldest deadline 2019-12-08T17:27:29.195239+0000) 2019-12-08T17:27:50.238 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:27:50.234+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.024070+0000 front 2019-12-08T17:26:44.999176+0000 (oldest deadline 2019-12-08T17:27:30.812079+0000) 2019-12-08T17:27:50.241 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:27:50.238+0000 1694f700 -1 osd.4 196 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103888 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=238b] snapc 0=[] ondisk+write+known_if_redirected e194) 2019-12-08T17:27:50.370 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:27:50.365+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:46.765421+0000 front 2019-12-08T17:26:46.761440+0000 (oldest deadline 2019-12-08T17:27:32.049747+0000) 2019-12-08T17:27:50.404 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:27:50.403+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:48.096442+0000 front 2019-12-08T17:26:48.038442+0000 (oldest deadline 2019-12-08T17:27:28.000371+0000) 2019-12-08T17:27:50.538 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:27:50.536+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.580187+0000 front 2019-12-08T17:26:47.469336+0000 (oldest deadline 2019-12-08T17:27:28.537081+0000) 2019-12-08T17:27:50.767 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:27:50.762+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.240392+0000 front 2019-12-08T17:26:47.564469+0000 (oldest deadline 2019-12-08T17:27:29.956524+0000) 2019-12-08T17:27:50.818 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:27:50.817+0000 1694f700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:27:04.180541+0000 (oldest deadline 2019-12-08T17:27:44.180541+0000) 2019-12-08T17:27:50.822 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:27:50.821+0000 1694f700 -1 osd.2 196 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4449.0:101483 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e194) 2019-12-08T17:27:51.209 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:27:51.203+0000 1694f700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.124512+0000 front 2019-12-08T17:26:45.549671+0000 (oldest deadline 2019-12-08T17:27:29.195239+0000) 2019-12-08T17:27:51.261 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:27:51.256+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.024070+0000 front 2019-12-08T17:26:44.999176+0000 (oldest deadline 2019-12-08T17:27:30.812079+0000) 2019-12-08T17:27:51.262 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:27:51.259+0000 1694f700 -1 osd.4 196 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103888 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=238b] snapc 0=[] ondisk+write+known_if_redirected e194) 2019-12-08T17:27:51.359 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:27:51.353+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:46.765421+0000 front 2019-12-08T17:26:46.761440+0000 (oldest deadline 2019-12-08T17:27:32.049747+0000) 2019-12-08T17:27:51.447 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:27:51.446+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:48.096442+0000 front 2019-12-08T17:26:48.038442+0000 (oldest deadline 2019-12-08T17:27:28.000371+0000) 2019-12-08T17:27:51.556 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:27:51.554+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.580187+0000 front 2019-12-08T17:26:47.469336+0000 (oldest deadline 2019-12-08T17:27:28.537081+0000) 2019-12-08T17:27:51.785 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:27:51.780+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.240392+0000 front 2019-12-08T17:26:47.564469+0000 (oldest deadline 2019-12-08T17:27:29.956524+0000) 2019-12-08T17:27:51.785 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:27:51.781+0000 1694f700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:27:04.180541+0000 (oldest deadline 2019-12-08T17:27:44.180541+0000) 2019-12-08T17:27:51.787 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:27:51.784+0000 1694f700 -1 osd.2 196 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4449.0:101483 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e194) 2019-12-08T17:27:52.210 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:27:52.205+0000 1694f700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.124512+0000 front 2019-12-08T17:26:45.549671+0000 (oldest deadline 2019-12-08T17:27:29.195239+0000) 2019-12-08T17:27:52.305 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:27:52.300+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.024070+0000 front 2019-12-08T17:26:44.999176+0000 (oldest deadline 2019-12-08T17:27:30.812079+0000) 2019-12-08T17:27:52.306 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:27:52.303+0000 1694f700 -1 osd.4 196 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103888 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=238b] snapc 0=[] ondisk+write+known_if_redirected e194) 2019-12-08T17:27:52.398 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:27:52.393+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:46.765421+0000 front 2019-12-08T17:26:46.761440+0000 (oldest deadline 2019-12-08T17:27:32.049747+0000) 2019-12-08T17:27:52.477 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:27:52.475+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:48.096442+0000 front 2019-12-08T17:26:48.038442+0000 (oldest deadline 2019-12-08T17:27:28.000371+0000) 2019-12-08T17:27:52.573 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:27:52.572+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.580187+0000 front 2019-12-08T17:26:47.469336+0000 (oldest deadline 2019-12-08T17:27:28.537081+0000) 2019-12-08T17:27:52.769 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:27:52.768+0000 1694f700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:27:04.180541+0000 (oldest deadline 2019-12-08T17:27:44.180541+0000) 2019-12-08T17:27:52.770 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:27:52.769+0000 1694f700 -1 osd.2 196 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4449.0:101483 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e194) 2019-12-08T17:27:52.829 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:27:52.823+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.240392+0000 front 2019-12-08T17:26:47.564469+0000 (oldest deadline 2019-12-08T17:27:29.956524+0000) 2019-12-08T17:27:53.179 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:27:53.175+0000 1694f700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.124512+0000 front 2019-12-08T17:26:45.549671+0000 (oldest deadline 2019-12-08T17:27:29.195239+0000) 2019-12-08T17:27:53.317 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:27:53.311+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.024070+0000 front 2019-12-08T17:26:44.999176+0000 (oldest deadline 2019-12-08T17:27:30.812079+0000) 2019-12-08T17:27:53.317 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:27:53.314+0000 1694f700 -1 osd.4 196 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103888 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=238b] snapc 0=[] ondisk+write+known_if_redirected e194) 2019-12-08T17:27:53.366 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:27:53.361+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:46.765421+0000 front 2019-12-08T17:26:46.761440+0000 (oldest deadline 2019-12-08T17:27:32.049747+0000) 2019-12-08T17:27:53.527 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:27:53.526+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:48.096442+0000 front 2019-12-08T17:26:48.038442+0000 (oldest deadline 2019-12-08T17:27:28.000371+0000) 2019-12-08T17:27:53.617 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:27:53.616+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.580187+0000 front 2019-12-08T17:26:47.469336+0000 (oldest deadline 2019-12-08T17:27:28.537081+0000) 2019-12-08T17:27:53.739 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:27:53.735+0000 1694f700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:27:04.180541+0000 (oldest deadline 2019-12-08T17:27:44.180541+0000) 2019-12-08T17:27:53.740 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:27:53.739+0000 1694f700 -1 osd.2 196 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4449.0:101483 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e194) 2019-12-08T17:27:53.794 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:27:53.789+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.240392+0000 front 2019-12-08T17:26:47.564469+0000 (oldest deadline 2019-12-08T17:27:29.956524+0000) 2019-12-08T17:27:54.181 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:27:54.176+0000 1694f700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.124512+0000 front 2019-12-08T17:26:45.549671+0000 (oldest deadline 2019-12-08T17:27:29.195239+0000) 2019-12-08T17:27:54.330 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:27:54.324+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.024070+0000 front 2019-12-08T17:26:44.999176+0000 (oldest deadline 2019-12-08T17:27:30.812079+0000) 2019-12-08T17:27:54.333 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:27:54.330+0000 1694f700 -1 osd.4 196 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103888 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=238b] snapc 0=[] ondisk+write+known_if_redirected e194) 2019-12-08T17:27:54.404 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:27:54.399+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:46.765421+0000 front 2019-12-08T17:26:46.761440+0000 (oldest deadline 2019-12-08T17:27:32.049747+0000) 2019-12-08T17:27:54.561 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:27:54.561+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:48.096442+0000 front 2019-12-08T17:26:48.038442+0000 (oldest deadline 2019-12-08T17:27:28.000371+0000) 2019-12-08T17:27:54.655 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:27:54.654+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.580187+0000 front 2019-12-08T17:26:47.469336+0000 (oldest deadline 2019-12-08T17:27:28.537081+0000) 2019-12-08T17:27:54.751 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:27:54.746+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.240392+0000 front 2019-12-08T17:26:47.564469+0000 (oldest deadline 2019-12-08T17:27:29.956524+0000) 2019-12-08T17:27:54.764 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:27:54.763+0000 1694f700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:27:04.180541+0000 (oldest deadline 2019-12-08T17:27:44.180541+0000) 2019-12-08T17:27:54.768 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:27:54.767+0000 1694f700 -1 osd.2 196 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4449.0:101483 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e194) 2019-12-08T17:27:55.142 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:27:55.137+0000 1694f700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.124512+0000 front 2019-12-08T17:26:45.549671+0000 (oldest deadline 2019-12-08T17:27:29.195239+0000) 2019-12-08T17:27:55.353 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:27:55.348+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.024070+0000 front 2019-12-08T17:26:44.999176+0000 (oldest deadline 2019-12-08T17:27:30.812079+0000) 2019-12-08T17:27:55.356 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:27:55.353+0000 1694f700 -1 osd.4 196 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103888 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=238b] snapc 0=[] ondisk+write+known_if_redirected e194) 2019-12-08T17:27:55.394 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:27:55.389+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:46.765421+0000 front 2019-12-08T17:26:46.761440+0000 (oldest deadline 2019-12-08T17:27:32.049747+0000) 2019-12-08T17:27:55.601 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:27:55.600+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:48.096442+0000 front 2019-12-08T17:26:48.038442+0000 (oldest deadline 2019-12-08T17:27:28.000371+0000) 2019-12-08T17:27:55.670 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:27:55.669+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.580187+0000 front 2019-12-08T17:26:47.469336+0000 (oldest deadline 2019-12-08T17:27:28.537081+0000) 2019-12-08T17:27:55.713 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:27:55.707+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.240392+0000 front 2019-12-08T17:26:47.564469+0000 (oldest deadline 2019-12-08T17:27:29.956524+0000) 2019-12-08T17:27:55.755 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:27:55.754+0000 1694f700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:27:04.180541+0000 (oldest deadline 2019-12-08T17:27:44.180541+0000) 2019-12-08T17:27:55.760 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:27:55.759+0000 1694f700 -1 osd.2 196 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4449.0:101483 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e194) 2019-12-08T17:27:56.122 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:27:56.117+0000 1694f700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.124512+0000 front 2019-12-08T17:26:45.549671+0000 (oldest deadline 2019-12-08T17:27:29.195239+0000) 2019-12-08T17:27:56.375 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:27:56.369+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.024070+0000 front 2019-12-08T17:26:44.999176+0000 (oldest deadline 2019-12-08T17:27:30.812079+0000) 2019-12-08T17:27:56.375 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:27:56.372+0000 1694f700 -1 osd.4 196 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103888 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=238b] snapc 0=[] ondisk+write+known_if_redirected e194) 2019-12-08T17:27:56.395 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:27:56.391+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:46.765421+0000 front 2019-12-08T17:26:46.761440+0000 (oldest deadline 2019-12-08T17:27:32.049747+0000) 2019-12-08T17:27:56.565 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:27:56.565+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:48.096442+0000 front 2019-12-08T17:26:48.038442+0000 (oldest deadline 2019-12-08T17:27:28.000371+0000) 2019-12-08T17:27:56.654 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:27:56.653+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.580187+0000 front 2019-12-08T17:26:47.469336+0000 (oldest deadline 2019-12-08T17:27:28.537081+0000) 2019-12-08T17:27:56.713 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:27:56.709+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.240392+0000 front 2019-12-08T17:26:47.564469+0000 (oldest deadline 2019-12-08T17:27:29.956524+0000) 2019-12-08T17:27:56.725 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:27:56.725+0000 1694f700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:27:04.180541+0000 (oldest deadline 2019-12-08T17:27:44.180541+0000) 2019-12-08T17:27:56.727 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:27:56.727+0000 1694f700 -1 osd.2 196 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4449.0:101483 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e194) 2019-12-08T17:27:57.080 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:27:57.075+0000 1694f700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.124512+0000 front 2019-12-08T17:26:45.549671+0000 (oldest deadline 2019-12-08T17:27:29.195239+0000) 2019-12-08T17:27:57.349 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:27:57.343+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.024070+0000 front 2019-12-08T17:26:44.999176+0000 (oldest deadline 2019-12-08T17:27:30.812079+0000) 2019-12-08T17:27:57.350 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:27:57.346+0000 1694f700 -1 osd.4 196 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103888 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=238b] snapc 0=[] ondisk+write+known_if_redirected e194) 2019-12-08T17:27:57.450 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:27:57.445+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:46.765421+0000 front 2019-12-08T17:26:46.761440+0000 (oldest deadline 2019-12-08T17:27:32.049747+0000) 2019-12-08T17:27:57.606 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:27:57.605+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:48.096442+0000 front 2019-12-08T17:26:48.038442+0000 (oldest deadline 2019-12-08T17:27:28.000371+0000) 2019-12-08T17:27:57.616 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:27:57.615+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.580187+0000 front 2019-12-08T17:26:47.469336+0000 (oldest deadline 2019-12-08T17:27:28.537081+0000) 2019-12-08T17:27:57.702 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:27:57.696+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.240392+0000 front 2019-12-08T17:26:47.564469+0000 (oldest deadline 2019-12-08T17:27:29.956524+0000) 2019-12-08T17:27:57.742 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:27:57.740+0000 1694f700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:27:04.180541+0000 (oldest deadline 2019-12-08T17:27:44.180541+0000) 2019-12-08T17:27:57.746 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:27:57.746+0000 1694f700 -1 osd.2 196 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4449.0:101483 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e194) 2019-12-08T17:27:58.091 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:27:58.086+0000 1694f700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.124512+0000 front 2019-12-08T17:26:45.549671+0000 (oldest deadline 2019-12-08T17:27:29.195239+0000) 2019-12-08T17:27:58.394 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:27:58.389+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.024070+0000 front 2019-12-08T17:26:44.999176+0000 (oldest deadline 2019-12-08T17:27:30.812079+0000) 2019-12-08T17:27:58.395 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:27:58.391+0000 1694f700 -1 osd.4 196 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103888 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=238b] snapc 0=[] ondisk+write+known_if_redirected e194) 2019-12-08T17:27:58.465 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:27:58.459+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:46.765421+0000 front 2019-12-08T17:26:46.761440+0000 (oldest deadline 2019-12-08T17:27:32.049747+0000) 2019-12-08T17:27:58.609 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:27:58.606+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:48.096442+0000 front 2019-12-08T17:26:48.038442+0000 (oldest deadline 2019-12-08T17:27:28.000371+0000) 2019-12-08T17:27:58.620 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:27:58.618+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.580187+0000 front 2019-12-08T17:26:47.469336+0000 (oldest deadline 2019-12-08T17:27:28.537081+0000) 2019-12-08T17:27:58.705 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:27:58.703+0000 1694f700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:27:04.180541+0000 (oldest deadline 2019-12-08T17:27:44.180541+0000) 2019-12-08T17:27:58.705 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:27:58.705+0000 1694f700 -1 osd.2 196 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4449.0:101483 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e194) 2019-12-08T17:27:58.717 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:27:58.701+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.240392+0000 front 2019-12-08T17:26:47.564469+0000 (oldest deadline 2019-12-08T17:27:29.956524+0000) 2019-12-08T17:27:59.072 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:27:59.066+0000 1694f700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.124512+0000 front 2019-12-08T17:26:45.549671+0000 (oldest deadline 2019-12-08T17:27:29.195239+0000) 2019-12-08T17:27:59.377 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:27:59.371+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.024070+0000 front 2019-12-08T17:26:44.999176+0000 (oldest deadline 2019-12-08T17:27:30.812079+0000) 2019-12-08T17:27:59.385 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:27:59.374+0000 1694f700 -1 osd.4 196 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103888 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=238b] snapc 0=[] ondisk+write+known_if_redirected e194) 2019-12-08T17:27:59.497 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:27:59.492+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:46.765421+0000 front 2019-12-08T17:26:46.761440+0000 (oldest deadline 2019-12-08T17:27:32.049747+0000) 2019-12-08T17:27:59.647 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:27:59.644+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:48.096442+0000 front 2019-12-08T17:26:48.038442+0000 (oldest deadline 2019-12-08T17:27:28.000371+0000) 2019-12-08T17:27:59.663 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:27:59.661+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.580187+0000 front 2019-12-08T17:26:47.469336+0000 (oldest deadline 2019-12-08T17:27:28.537081+0000) 2019-12-08T17:27:59.734 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:27:59.731+0000 1694f700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:27:04.180541+0000 (oldest deadline 2019-12-08T17:27:44.180541+0000) 2019-12-08T17:27:59.736 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:27:59.734+0000 1694f700 -1 osd.2 196 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4449.0:101483 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e194) 2019-12-08T17:27:59.748 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:27:59.742+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.240392+0000 front 2019-12-08T17:26:47.564469+0000 (oldest deadline 2019-12-08T17:27:29.956524+0000) 2019-12-08T17:28:00.045 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:28:00.040+0000 1694f700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.124512+0000 front 2019-12-08T17:26:45.549671+0000 (oldest deadline 2019-12-08T17:27:29.195239+0000) 2019-12-08T17:28:00.401 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:28:00.395+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.024070+0000 front 2019-12-08T17:26:44.999176+0000 (oldest deadline 2019-12-08T17:27:30.812079+0000) 2019-12-08T17:28:00.401 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:28:00.398+0000 1694f700 -1 osd.4 196 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103888 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=238b] snapc 0=[] ondisk+write+known_if_redirected e194) 2019-12-08T17:28:00.530 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:28:00.522+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:46.765421+0000 front 2019-12-08T17:26:46.761440+0000 (oldest deadline 2019-12-08T17:27:32.049747+0000) 2019-12-08T17:28:00.671 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:28:00.670+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:48.096442+0000 front 2019-12-08T17:26:48.038442+0000 (oldest deadline 2019-12-08T17:27:28.000371+0000) 2019-12-08T17:28:00.691 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:28:00.690+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.580187+0000 front 2019-12-08T17:26:47.469336+0000 (oldest deadline 2019-12-08T17:27:28.537081+0000) 2019-12-08T17:28:00.737 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:28:00.736+0000 1694f700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:27:04.180541+0000 (oldest deadline 2019-12-08T17:27:44.180541+0000) 2019-12-08T17:28:00.739 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:28:00.739+0000 1694f700 -1 osd.2 196 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4449.0:101483 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e194) 2019-12-08T17:28:00.754 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:28:00.749+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.240392+0000 front 2019-12-08T17:26:47.564469+0000 (oldest deadline 2019-12-08T17:27:29.956524+0000) 2019-12-08T17:28:00.812 INFO:tasks.ceph.mon.b.smithi013.stderr:2019-12-08T17:28:00.809+0000 1a89c700 -1 mon.b@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.1 [v2:172.21.15.79:6810/10449,v1:172.21.15.79:6811/10449] for 41sec e196 v196) 2019-12-08T17:28:01.017 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:28:01.012+0000 1694f700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.124512+0000 front 2019-12-08T17:26:45.549671+0000 (oldest deadline 2019-12-08T17:27:29.195239+0000) 2019-12-08T17:28:01.432 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:28:01.427+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.024070+0000 front 2019-12-08T17:26:44.999176+0000 (oldest deadline 2019-12-08T17:27:30.812079+0000) 2019-12-08T17:28:01.435 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:28:01.432+0000 1694f700 -1 osd.4 196 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103888 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=238b] snapc 0=[] ondisk+write+known_if_redirected e194) 2019-12-08T17:28:01.559 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:28:01.553+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:46.765421+0000 front 2019-12-08T17:26:46.761440+0000 (oldest deadline 2019-12-08T17:27:32.049747+0000) 2019-12-08T17:28:01.685 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:28:01.683+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:48.096442+0000 front 2019-12-08T17:26:48.038442+0000 (oldest deadline 2019-12-08T17:27:28.000371+0000) 2019-12-08T17:28:01.708 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:28:01.706+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.580187+0000 front 2019-12-08T17:26:47.469336+0000 (oldest deadline 2019-12-08T17:27:28.537081+0000) 2019-12-08T17:28:01.714 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:28:01.709+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.240392+0000 front 2019-12-08T17:26:47.564469+0000 (oldest deadline 2019-12-08T17:27:29.956524+0000) 2019-12-08T17:28:01.755 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:28:01.752+0000 1694f700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:27:04.180541+0000 (oldest deadline 2019-12-08T17:27:44.180541+0000) 2019-12-08T17:28:01.755 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:28:01.755+0000 1694f700 -1 osd.2 196 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4449.0:101483 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e194) 2019-12-08T17:28:01.977 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:28:01.973+0000 1694f700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.124512+0000 front 2019-12-08T17:26:45.549671+0000 (oldest deadline 2019-12-08T17:27:29.195239+0000) 2019-12-08T17:28:02.450 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:28:02.445+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.024070+0000 front 2019-12-08T17:26:44.999176+0000 (oldest deadline 2019-12-08T17:27:30.812079+0000) 2019-12-08T17:28:02.451 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:28:02.448+0000 1694f700 -1 osd.4 196 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103888 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=238b] snapc 0=[] ondisk+write+known_if_redirected e194) 2019-12-08T17:28:02.524 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:28:02.518+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:46.765421+0000 front 2019-12-08T17:26:46.761440+0000 (oldest deadline 2019-12-08T17:27:32.049747+0000) 2019-12-08T17:28:02.683 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:28:02.682+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:48.096442+0000 front 2019-12-08T17:26:48.038442+0000 (oldest deadline 2019-12-08T17:27:28.000371+0000) 2019-12-08T17:28:02.750 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:28:02.743+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.240392+0000 front 2019-12-08T17:26:47.564469+0000 (oldest deadline 2019-12-08T17:27:29.956524+0000) 2019-12-08T17:28:02.760 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:28:02.757+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.580187+0000 front 2019-12-08T17:26:47.469336+0000 (oldest deadline 2019-12-08T17:27:28.537081+0000) 2019-12-08T17:28:02.798 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:28:02.795+0000 1694f700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:27:04.180541+0000 (oldest deadline 2019-12-08T17:27:44.180541+0000) 2019-12-08T17:28:02.800 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:28:02.798+0000 1694f700 -1 osd.2 196 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4449.0:101483 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e194) 2019-12-08T17:28:02.982 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:28:02.976+0000 1694f700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.124512+0000 front 2019-12-08T17:26:45.549671+0000 (oldest deadline 2019-12-08T17:27:29.195239+0000) 2019-12-08T17:28:03.428 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:28:03.422+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.024070+0000 front 2019-12-08T17:26:44.999176+0000 (oldest deadline 2019-12-08T17:27:30.812079+0000) 2019-12-08T17:28:03.432 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:28:03.429+0000 1694f700 -1 osd.4 196 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103888 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=238b] snapc 0=[] ondisk+write+known_if_redirected e194) 2019-12-08T17:28:03.522 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:28:03.517+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:46.765421+0000 front 2019-12-08T17:26:46.761440+0000 (oldest deadline 2019-12-08T17:27:32.049747+0000) 2019-12-08T17:28:03.720 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:28:03.717+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:48.096442+0000 front 2019-12-08T17:26:48.038442+0000 (oldest deadline 2019-12-08T17:27:28.000371+0000) 2019-12-08T17:28:03.722 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:28:03.720+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.580187+0000 front 2019-12-08T17:26:47.469336+0000 (oldest deadline 2019-12-08T17:27:28.537081+0000) 2019-12-08T17:28:03.759 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:28:03.759+0000 1694f700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:27:04.180541+0000 (oldest deadline 2019-12-08T17:27:44.180541+0000) 2019-12-08T17:28:03.761 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:28:03.761+0000 1694f700 -1 osd.2 196 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4449.0:101483 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e194) 2019-12-08T17:28:03.768 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:28:03.764+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.240392+0000 front 2019-12-08T17:26:47.564469+0000 (oldest deadline 2019-12-08T17:27:29.956524+0000) 2019-12-08T17:28:03.989 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:28:03.984+0000 1694f700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.124512+0000 front 2019-12-08T17:26:45.549671+0000 (oldest deadline 2019-12-08T17:27:29.195239+0000) 2019-12-08T17:28:04.479 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:28:04.474+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.024070+0000 front 2019-12-08T17:26:44.999176+0000 (oldest deadline 2019-12-08T17:27:30.812079+0000) 2019-12-08T17:28:04.480 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:28:04.476+0000 1694f700 -1 osd.4 196 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103888 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=238b] snapc 0=[] ondisk+write+known_if_redirected e194) 2019-12-08T17:28:04.575 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:28:04.569+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:46.765421+0000 front 2019-12-08T17:26:46.761440+0000 (oldest deadline 2019-12-08T17:27:32.049747+0000) 2019-12-08T17:28:04.737 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:28:04.735+0000 1694f700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:27:04.180541+0000 (oldest deadline 2019-12-08T17:27:44.180541+0000) 2019-12-08T17:28:04.739 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:28:04.736+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:48.096442+0000 front 2019-12-08T17:26:48.038442+0000 (oldest deadline 2019-12-08T17:27:28.000371+0000) 2019-12-08T17:28:04.739 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:28:04.737+0000 1694f700 -1 osd.2 196 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4449.0:101483 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e194) 2019-12-08T17:28:04.754 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:28:04.752+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.580187+0000 front 2019-12-08T17:26:47.469336+0000 (oldest deadline 2019-12-08T17:27:28.537081+0000) 2019-12-08T17:28:04.791 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:28:04.787+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.240392+0000 front 2019-12-08T17:26:47.564469+0000 (oldest deadline 2019-12-08T17:27:29.956524+0000) 2019-12-08T17:28:04.996 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:28:04.991+0000 1694f700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.124512+0000 front 2019-12-08T17:26:45.549671+0000 (oldest deadline 2019-12-08T17:27:29.195239+0000) 2019-12-08T17:28:05.487 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:28:05.481+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.024070+0000 front 2019-12-08T17:26:44.999176+0000 (oldest deadline 2019-12-08T17:27:30.812079+0000) 2019-12-08T17:28:05.488 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:28:05.484+0000 1694f700 -1 osd.4 196 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103888 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=238b] snapc 0=[] ondisk+write+known_if_redirected e194) 2019-12-08T17:28:05.618 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:28:05.613+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:46.765421+0000 front 2019-12-08T17:26:46.761440+0000 (oldest deadline 2019-12-08T17:27:32.049747+0000) 2019-12-08T17:28:05.705 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:28:05.704+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:48.096442+0000 front 2019-12-08T17:26:48.038442+0000 (oldest deadline 2019-12-08T17:27:28.000371+0000) 2019-12-08T17:28:05.724 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:28:05.723+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.580187+0000 front 2019-12-08T17:26:47.469336+0000 (oldest deadline 2019-12-08T17:27:28.537081+0000) 2019-12-08T17:28:05.765 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:28:05.764+0000 1694f700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:27:04.180541+0000 (oldest deadline 2019-12-08T17:27:44.180541+0000) 2019-12-08T17:28:05.768 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:28:05.767+0000 1694f700 -1 osd.2 196 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4449.0:101483 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e194) 2019-12-08T17:28:05.834 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:28:05.830+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.240392+0000 front 2019-12-08T17:26:47.564469+0000 (oldest deadline 2019-12-08T17:27:29.956524+0000) 2019-12-08T17:28:05.843 INFO:tasks.ceph.mon.b.smithi013.stderr:2019-12-08T17:28:05.835+0000 1a89c700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.1 [v2:172.21.15.79:6810/10449,v1:172.21.15.79:6811/10449] for 41sec e196 v196) 2019-12-08T17:28:06.011 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:28:06.005+0000 1694f700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.124512+0000 front 2019-12-08T17:26:45.549671+0000 (oldest deadline 2019-12-08T17:27:29.195239+0000) 2019-12-08T17:28:06.542 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:28:06.536+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.024070+0000 front 2019-12-08T17:26:44.999176+0000 (oldest deadline 2019-12-08T17:27:30.812079+0000) 2019-12-08T17:28:06.543 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:28:06.539+0000 1694f700 -1 osd.4 196 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103888 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=238b] snapc 0=[] ondisk+write+known_if_redirected e194) 2019-12-08T17:28:06.589 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:28:06.583+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:46.765421+0000 front 2019-12-08T17:26:46.761440+0000 (oldest deadline 2019-12-08T17:27:32.049747+0000) 2019-12-08T17:28:06.684 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:28:06.682+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:48.096442+0000 front 2019-12-08T17:26:48.038442+0000 (oldest deadline 2019-12-08T17:27:28.000371+0000) 2019-12-08T17:28:06.709 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:28:06.707+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.580187+0000 front 2019-12-08T17:26:47.469336+0000 (oldest deadline 2019-12-08T17:27:28.537081+0000) 2019-12-08T17:28:06.769 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:28:06.769+0000 1694f700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:27:04.180541+0000 (oldest deadline 2019-12-08T17:27:44.180541+0000) 2019-12-08T17:28:06.773 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:28:06.772+0000 1694f700 -1 osd.2 196 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4449.0:101483 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e194) 2019-12-08T17:28:06.844 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:28:06.839+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.240392+0000 front 2019-12-08T17:26:47.564469+0000 (oldest deadline 2019-12-08T17:27:29.956524+0000) 2019-12-08T17:28:06.985 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:28:06.979+0000 1694f700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.124512+0000 front 2019-12-08T17:26:45.549671+0000 (oldest deadline 2019-12-08T17:27:29.195239+0000) 2019-12-08T17:28:07.570 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:28:07.565+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.024070+0000 front 2019-12-08T17:26:44.999176+0000 (oldest deadline 2019-12-08T17:27:30.812079+0000) 2019-12-08T17:28:07.574 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:28:07.570+0000 1694f700 -1 osd.4 196 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103888 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=238b] snapc 0=[] ondisk+write+known_if_redirected e194) 2019-12-08T17:28:07.577 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:28:07.571+0000 1694f700 -1 osd.6 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:46.765421+0000 front 2019-12-08T17:26:46.761440+0000 (oldest deadline 2019-12-08T17:27:32.049747+0000) 2019-12-08T17:28:07.687 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:28:07.684+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:48.096442+0000 front 2019-12-08T17:26:48.038442+0000 (oldest deadline 2019-12-08T17:27:28.000371+0000) 2019-12-08T17:28:07.733 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:28:07.732+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.580187+0000 front 2019-12-08T17:26:47.469336+0000 (oldest deadline 2019-12-08T17:27:28.537081+0000) 2019-12-08T17:28:07.777 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:28:07.775+0000 1694f700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:27:04.180541+0000 (oldest deadline 2019-12-08T17:27:44.180541+0000) 2019-12-08T17:28:07.779 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:28:07.777+0000 1694f700 -1 osd.2 196 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4449.0:101483 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e194) 2019-12-08T17:28:07.822 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:28:07.817+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.240392+0000 front 2019-12-08T17:26:47.564469+0000 (oldest deadline 2019-12-08T17:27:29.956524+0000) 2019-12-08T17:28:07.946 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:28:07.941+0000 1694f700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.124512+0000 front 2019-12-08T17:26:45.549671+0000 (oldest deadline 2019-12-08T17:27:29.195239+0000) 2019-12-08T17:28:08.550 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:28:08.544+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.024070+0000 front 2019-12-08T17:26:44.999176+0000 (oldest deadline 2019-12-08T17:27:30.812079+0000) 2019-12-08T17:28:08.551 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:28:08.548+0000 1694f700 -1 osd.4 196 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103888 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=238b] snapc 0=[] ondisk+write+known_if_redirected e194) 2019-12-08T17:28:08.690 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:28:08.689+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:48.096442+0000 front 2019-12-08T17:26:48.038442+0000 (oldest deadline 2019-12-08T17:27:28.000371+0000) 2019-12-08T17:28:08.735 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:28:08.733+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.580187+0000 front 2019-12-08T17:26:47.469336+0000 (oldest deadline 2019-12-08T17:27:28.537081+0000) 2019-12-08T17:28:08.793 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:28:08.792+0000 1694f700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:27:04.180541+0000 (oldest deadline 2019-12-08T17:27:44.180541+0000) 2019-12-08T17:28:08.794 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:28:08.793+0000 1694f700 -1 osd.2 196 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4449.0:101483 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e194) 2019-12-08T17:28:08.875 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:28:08.869+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.240392+0000 front 2019-12-08T17:26:47.564469+0000 (oldest deadline 2019-12-08T17:27:29.956524+0000) 2019-12-08T17:28:08.996 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:28:08.990+0000 1694f700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.124512+0000 front 2019-12-08T17:26:45.549671+0000 (oldest deadline 2019-12-08T17:27:29.195239+0000) 2019-12-08T17:28:09.594 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:28:09.589+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.024070+0000 front 2019-12-08T17:26:44.999176+0000 (oldest deadline 2019-12-08T17:27:30.812079+0000) 2019-12-08T17:28:09.597 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:28:09.594+0000 1694f700 -1 osd.4 196 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103888 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=238b] snapc 0=[] ondisk+write+known_if_redirected e194) 2019-12-08T17:28:09.734 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:28:09.733+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:48.096442+0000 front 2019-12-08T17:26:48.038442+0000 (oldest deadline 2019-12-08T17:27:28.000371+0000) 2019-12-08T17:28:09.786 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:28:09.782+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.580187+0000 front 2019-12-08T17:26:47.469336+0000 (oldest deadline 2019-12-08T17:27:28.537081+0000) 2019-12-08T17:28:09.821 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:28:09.820+0000 1694f700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:27:04.180541+0000 (oldest deadline 2019-12-08T17:27:44.180541+0000) 2019-12-08T17:28:09.823 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:28:09.822+0000 1694f700 -1 osd.2 196 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4449.0:101483 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e194) 2019-12-08T17:28:09.868 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:28:09.862+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.240392+0000 front 2019-12-08T17:26:47.564469+0000 (oldest deadline 2019-12-08T17:27:29.956524+0000) 2019-12-08T17:28:09.955 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:28:09.950+0000 1694f700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.124512+0000 front 2019-12-08T17:26:45.549671+0000 (oldest deadline 2019-12-08T17:27:29.195239+0000) 2019-12-08T17:28:10.556 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:28:10.550+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.024070+0000 front 2019-12-08T17:26:44.999176+0000 (oldest deadline 2019-12-08T17:27:30.812079+0000) 2019-12-08T17:28:10.557 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:28:10.553+0000 1694f700 -1 osd.4 196 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103888 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=238b] snapc 0=[] ondisk+write+known_if_redirected e194) 2019-12-08T17:28:10.768 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:28:10.767+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:48.096442+0000 front 2019-12-08T17:26:48.038442+0000 (oldest deadline 2019-12-08T17:27:28.000371+0000) 2019-12-08T17:28:10.775 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:28:10.774+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.580187+0000 front 2019-12-08T17:26:47.469336+0000 (oldest deadline 2019-12-08T17:27:28.537081+0000) 2019-12-08T17:28:10.851 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:28:10.848+0000 1694f700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:27:04.180541+0000 (oldest deadline 2019-12-08T17:27:44.180541+0000) 2019-12-08T17:28:10.853 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:28:10.851+0000 1694f700 -1 osd.2 196 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4449.0:101483 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e194) 2019-12-08T17:28:10.860 INFO:tasks.ceph.mon.b.smithi013.stderr:2019-12-08T17:28:10.856+0000 1a89c700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.1 [v2:172.21.15.79:6810/10449,v1:172.21.15.79:6811/10449] for 41sec e196 v196) 2019-12-08T17:28:10.865 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:28:10.860+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.240392+0000 front 2019-12-08T17:26:47.564469+0000 (oldest deadline 2019-12-08T17:27:29.956524+0000) 2019-12-08T17:28:10.999 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:28:10.994+0000 1694f700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.124512+0000 front 2019-12-08T17:26:45.549671+0000 (oldest deadline 2019-12-08T17:27:29.195239+0000) 2019-12-08T17:28:11.521 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:28:11.516+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.024070+0000 front 2019-12-08T17:26:44.999176+0000 (oldest deadline 2019-12-08T17:27:30.812079+0000) 2019-12-08T17:28:11.522 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:28:11.519+0000 1694f700 -1 osd.4 196 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103888 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=238b] snapc 0=[] ondisk+write+known_if_redirected e194) 2019-12-08T17:28:11.759 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:28:11.755+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.580187+0000 front 2019-12-08T17:26:47.469336+0000 (oldest deadline 2019-12-08T17:27:28.537081+0000) 2019-12-08T17:28:11.777 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:28:11.774+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:48.096442+0000 front 2019-12-08T17:26:48.038442+0000 (oldest deadline 2019-12-08T17:27:28.000371+0000) 2019-12-08T17:28:11.879 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:28:11.874+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.240392+0000 front 2019-12-08T17:26:47.564469+0000 (oldest deadline 2019-12-08T17:27:29.956524+0000) 2019-12-08T17:28:11.904 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:28:11.899+0000 1694f700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:27:04.180541+0000 (oldest deadline 2019-12-08T17:27:44.180541+0000) 2019-12-08T17:28:11.906 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:28:11.904+0000 1694f700 -1 osd.2 196 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4449.0:101483 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e194) 2019-12-08T17:28:12.057 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:28:12.052+0000 1694f700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.124512+0000 front 2019-12-08T17:26:45.549671+0000 (oldest deadline 2019-12-08T17:27:29.195239+0000) 2019-12-08T17:28:12.542 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:28:12.537+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.024070+0000 front 2019-12-08T17:26:44.999176+0000 (oldest deadline 2019-12-08T17:27:30.812079+0000) 2019-12-08T17:28:12.543 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:28:12.539+0000 1694f700 -1 osd.4 196 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103888 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=238b] snapc 0=[] ondisk+write+known_if_redirected e194) 2019-12-08T17:28:12.767 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:28:12.765+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.580187+0000 front 2019-12-08T17:26:47.469336+0000 (oldest deadline 2019-12-08T17:27:28.537081+0000) 2019-12-08T17:28:12.827 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:28:12.826+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:48.096442+0000 front 2019-12-08T17:26:48.038442+0000 (oldest deadline 2019-12-08T17:27:28.000371+0000) 2019-12-08T17:28:12.859 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:28:12.855+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.240392+0000 front 2019-12-08T17:26:47.564469+0000 (oldest deadline 2019-12-08T17:27:29.956524+0000) 2019-12-08T17:28:12.910 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:28:12.908+0000 1694f700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:27:04.180541+0000 (oldest deadline 2019-12-08T17:27:44.180541+0000) 2019-12-08T17:28:12.911 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:28:12.910+0000 1694f700 -1 osd.2 196 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4449.0:101483 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e194) 2019-12-08T17:28:13.017 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:28:13.013+0000 1694f700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.124512+0000 front 2019-12-08T17:26:45.549671+0000 (oldest deadline 2019-12-08T17:27:29.195239+0000) 2019-12-08T17:28:13.531 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:28:13.524+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.024070+0000 front 2019-12-08T17:26:44.999176+0000 (oldest deadline 2019-12-08T17:27:30.812079+0000) 2019-12-08T17:28:13.531 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:28:13.527+0000 1694f700 -1 osd.4 196 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103888 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=238b] snapc 0=[] ondisk+write+known_if_redirected e194) 2019-12-08T17:28:13.742 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:28:13.738+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.580187+0000 front 2019-12-08T17:26:47.469336+0000 (oldest deadline 2019-12-08T17:27:28.537081+0000) 2019-12-08T17:28:13.794 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:28:13.792+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:48.096442+0000 front 2019-12-08T17:26:48.038442+0000 (oldest deadline 2019-12-08T17:27:28.000371+0000) 2019-12-08T17:28:13.856 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:28:13.851+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.240392+0000 front 2019-12-08T17:26:47.564469+0000 (oldest deadline 2019-12-08T17:27:29.956524+0000) 2019-12-08T17:28:13.905 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:28:13.902+0000 1694f700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:27:04.180541+0000 (oldest deadline 2019-12-08T17:27:44.180541+0000) 2019-12-08T17:28:13.907 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:28:13.904+0000 1694f700 -1 osd.2 196 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4449.0:101483 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e194) 2019-12-08T17:28:14.017 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:28:14.013+0000 1694f700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.124512+0000 front 2019-12-08T17:26:45.549671+0000 (oldest deadline 2019-12-08T17:27:29.195239+0000) 2019-12-08T17:28:14.564 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:28:14.558+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.024070+0000 front 2019-12-08T17:26:44.999176+0000 (oldest deadline 2019-12-08T17:27:30.812079+0000) 2019-12-08T17:28:14.565 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:28:14.561+0000 1694f700 -1 osd.4 196 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103888 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=238b] snapc 0=[] ondisk+write+known_if_redirected e194) 2019-12-08T17:28:14.761 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:28:14.759+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.580187+0000 front 2019-12-08T17:26:47.469336+0000 (oldest deadline 2019-12-08T17:27:28.537081+0000) 2019-12-08T17:28:14.830 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:28:14.828+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:48.096442+0000 front 2019-12-08T17:26:48.038442+0000 (oldest deadline 2019-12-08T17:27:28.000371+0000) 2019-12-08T17:28:14.861 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:28:14.856+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.240392+0000 front 2019-12-08T17:26:47.564469+0000 (oldest deadline 2019-12-08T17:27:29.956524+0000) 2019-12-08T17:28:14.889 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:28:14.886+0000 1694f700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:27:04.180541+0000 (oldest deadline 2019-12-08T17:27:44.180541+0000) 2019-12-08T17:28:14.891 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:28:14.888+0000 1694f700 -1 osd.2 196 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4449.0:101483 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e194) 2019-12-08T17:28:15.039 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:28:15.034+0000 1694f700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.124512+0000 front 2019-12-08T17:26:45.549671+0000 (oldest deadline 2019-12-08T17:27:29.195239+0000) 2019-12-08T17:28:15.529 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:28:15.524+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.024070+0000 front 2019-12-08T17:26:44.999176+0000 (oldest deadline 2019-12-08T17:27:30.812079+0000) 2019-12-08T17:28:15.530 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:28:15.527+0000 1694f700 -1 osd.4 196 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103888 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=238b] snapc 0=[] ondisk+write+known_if_redirected e194) 2019-12-08T17:28:15.723 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:28:15.720+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.580187+0000 front 2019-12-08T17:26:47.469336+0000 (oldest deadline 2019-12-08T17:27:28.537081+0000) 2019-12-08T17:28:15.840 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:28:15.837+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:48.096442+0000 front 2019-12-08T17:26:48.038442+0000 (oldest deadline 2019-12-08T17:27:28.000371+0000) 2019-12-08T17:28:15.858 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:28:15.854+0000 1694f700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:27:04.180541+0000 (oldest deadline 2019-12-08T17:27:44.180541+0000) 2019-12-08T17:28:15.860 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:28:15.858+0000 1694f700 -1 osd.2 196 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4449.0:101483 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e194) 2019-12-08T17:28:15.875 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:28:15.868+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.240392+0000 front 2019-12-08T17:26:47.564469+0000 (oldest deadline 2019-12-08T17:27:29.956524+0000) 2019-12-08T17:28:15.884 INFO:tasks.ceph.mon.b.smithi013.stderr:2019-12-08T17:28:15.881+0000 1a89c700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.1 [v2:172.21.15.79:6810/10449,v1:172.21.15.79:6811/10449] for 41sec e196 v196) 2019-12-08T17:28:16.038 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:28:16.033+0000 1694f700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.124512+0000 front 2019-12-08T17:26:45.549671+0000 (oldest deadline 2019-12-08T17:27:29.195239+0000) 2019-12-08T17:28:16.507 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:28:16.501+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.024070+0000 front 2019-12-08T17:26:44.999176+0000 (oldest deadline 2019-12-08T17:27:30.812079+0000) 2019-12-08T17:28:16.508 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:28:16.504+0000 1694f700 -1 osd.4 196 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103888 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=238b] snapc 0=[] ondisk+write+known_if_redirected e194) 2019-12-08T17:28:16.745 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:28:16.742+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.580187+0000 front 2019-12-08T17:26:47.469336+0000 (oldest deadline 2019-12-08T17:27:28.537081+0000) 2019-12-08T17:28:16.861 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:28:16.859+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:48.096442+0000 front 2019-12-08T17:26:48.038442+0000 (oldest deadline 2019-12-08T17:27:28.000371+0000) 2019-12-08T17:28:16.898 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:28:16.896+0000 1694f700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:27:04.180541+0000 (oldest deadline 2019-12-08T17:27:44.180541+0000) 2019-12-08T17:28:16.901 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:28:16.900+0000 1694f700 -1 osd.2 196 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4449.0:101483 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e194) 2019-12-08T17:28:16.909 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:28:16.905+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.240392+0000 front 2019-12-08T17:26:47.564469+0000 (oldest deadline 2019-12-08T17:27:29.956524+0000) 2019-12-08T17:28:17.060 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:28:17.055+0000 1694f700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.124512+0000 front 2019-12-08T17:26:45.549671+0000 (oldest deadline 2019-12-08T17:27:29.195239+0000) 2019-12-08T17:28:17.527 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:28:17.522+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.024070+0000 front 2019-12-08T17:26:44.999176+0000 (oldest deadline 2019-12-08T17:27:30.812079+0000) 2019-12-08T17:28:17.528 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:28:17.525+0000 1694f700 -1 osd.4 196 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103888 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=238b] snapc 0=[] ondisk+write+known_if_redirected e194) 2019-12-08T17:28:17.793 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:28:17.790+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.580187+0000 front 2019-12-08T17:26:47.469336+0000 (oldest deadline 2019-12-08T17:27:28.537081+0000) 2019-12-08T17:28:17.848 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:28:17.847+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:48.096442+0000 front 2019-12-08T17:26:48.038442+0000 (oldest deadline 2019-12-08T17:27:28.000371+0000) 2019-12-08T17:28:17.930 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:28:17.929+0000 1694f700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:27:04.180541+0000 (oldest deadline 2019-12-08T17:27:44.180541+0000) 2019-12-08T17:28:17.932 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:28:17.932+0000 1694f700 -1 osd.2 196 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4449.0:101483 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e194) 2019-12-08T17:28:17.935 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:28:17.929+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.240392+0000 front 2019-12-08T17:26:47.564469+0000 (oldest deadline 2019-12-08T17:27:29.956524+0000) 2019-12-08T17:28:18.096 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:28:18.091+0000 1694f700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.124512+0000 front 2019-12-08T17:26:45.549671+0000 (oldest deadline 2019-12-08T17:27:29.195239+0000) 2019-12-08T17:28:18.488 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:28:18.482+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.024070+0000 front 2019-12-08T17:26:44.999176+0000 (oldest deadline 2019-12-08T17:27:30.812079+0000) 2019-12-08T17:28:18.489 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:28:18.485+0000 1694f700 -1 osd.4 196 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103888 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=238b] snapc 0=[] ondisk+write+known_if_redirected e194) 2019-12-08T17:28:18.768 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:28:18.765+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.580187+0000 front 2019-12-08T17:26:47.469336+0000 (oldest deadline 2019-12-08T17:27:28.537081+0000) 2019-12-08T17:28:18.818 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:28:18.815+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:48.096442+0000 front 2019-12-08T17:26:48.038442+0000 (oldest deadline 2019-12-08T17:27:28.000371+0000) 2019-12-08T17:28:18.894 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:28:18.893+0000 1694f700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:27:04.180541+0000 (oldest deadline 2019-12-08T17:27:44.180541+0000) 2019-12-08T17:28:18.897 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:28:18.896+0000 1694f700 -1 osd.2 196 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4449.0:101483 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e194) 2019-12-08T17:28:18.902 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:28:18.897+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.240392+0000 front 2019-12-08T17:26:47.564469+0000 (oldest deadline 2019-12-08T17:27:29.956524+0000) 2019-12-08T17:28:19.064 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:28:19.057+0000 1694f700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.124512+0000 front 2019-12-08T17:26:45.549671+0000 (oldest deadline 2019-12-08T17:27:29.195239+0000) 2019-12-08T17:28:19.509 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:28:19.504+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.024070+0000 front 2019-12-08T17:26:44.999176+0000 (oldest deadline 2019-12-08T17:27:30.812079+0000) 2019-12-08T17:28:19.510 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:28:19.507+0000 1694f700 -1 osd.4 196 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103888 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=238b] snapc 0=[] ondisk+write+known_if_redirected e194) 2019-12-08T17:28:19.808 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:28:19.805+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.580187+0000 front 2019-12-08T17:26:47.469336+0000 (oldest deadline 2019-12-08T17:27:28.537081+0000) 2019-12-08T17:28:19.861 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:28:19.858+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:48.096442+0000 front 2019-12-08T17:26:48.038442+0000 (oldest deadline 2019-12-08T17:27:28.000371+0000) 2019-12-08T17:28:19.940 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:28:19.935+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.240392+0000 front 2019-12-08T17:26:47.564469+0000 (oldest deadline 2019-12-08T17:27:29.956524+0000) 2019-12-08T17:28:19.944 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:28:19.942+0000 1694f700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:27:04.180541+0000 (oldest deadline 2019-12-08T17:27:44.180541+0000) 2019-12-08T17:28:19.946 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:28:19.945+0000 1694f700 -1 osd.2 196 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4449.0:101483 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e194) 2019-12-08T17:28:20.108 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:28:20.103+0000 1694f700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.124512+0000 front 2019-12-08T17:26:45.549671+0000 (oldest deadline 2019-12-08T17:27:29.195239+0000) 2019-12-08T17:28:20.470 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:28:20.464+0000 1694f700 -1 osd.4 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.024070+0000 front 2019-12-08T17:26:44.999176+0000 (oldest deadline 2019-12-08T17:27:30.812079+0000) 2019-12-08T17:28:20.470 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:28:20.467+0000 1694f700 -1 osd.4 196 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103888 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=238b] snapc 0=[] ondisk+write+known_if_redirected e194) 2019-12-08T17:28:20.799 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:28:20.796+0000 1694f700 -1 osd.0 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.580187+0000 front 2019-12-08T17:26:47.469336+0000 (oldest deadline 2019-12-08T17:27:28.537081+0000) 2019-12-08T17:28:20.843 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:28:20.841+0000 1694f700 -1 osd.3 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:48.096442+0000 front 2019-12-08T17:26:48.038442+0000 (oldest deadline 2019-12-08T17:27:28.000371+0000) 2019-12-08T17:28:20.924 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:28:20.920+0000 1694f700 -1 osd.2 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:27:04.180541+0000 (oldest deadline 2019-12-08T17:27:44.180541+0000) 2019-12-08T17:28:20.925 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:28:20.923+0000 1694f700 -1 osd.2 196 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4449.0:101483 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e194) 2019-12-08T17:28:20.946 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:28:20.941+0000 1694f700 -1 osd.7 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:47.240392+0000 front 2019-12-08T17:26:47.564469+0000 (oldest deadline 2019-12-08T17:27:29.956524+0000) 2019-12-08T17:28:21.009 INFO:tasks.ceph.mon.b.smithi013.stderr:2019-12-08T17:28:21.000+0000 1a89c700 -1 mon.b@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.1 [v2:172.21.15.79:6810/10449,v1:172.21.15.79:6811/10449] for 41sec e196 v196) 2019-12-08T17:28:21.082 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:28:21.077+0000 1694f700 -1 osd.5 196 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:26:45.124512+0000 front 2019-12-08T17:26:45.549671+0000 (oldest deadline 2019-12-08T17:27:29.195239+0000) 2019-12-08T17:28:21.667 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:28:21.625+0000 1694f700 -1 osd.4 197 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103888 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=238b] snapc 0=[] ondisk+write+known_if_redirected e194) 2019-12-08T17:28:21.919 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:28:21.911+0000 1694f700 -1 osd.2 197 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103641 7.1 7.8539b541 (undecoded) ondisk+retry+read+known_if_redirected e194) 2019-12-08T17:28:22.915 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:28:22.841+0000 1694f700 -1 osd.4 198 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:103888 6.9 6:999bad5f:users.uid::foo.client.0.buckets:head [call user.set_buckets_info in=238b] snapc 0=[] ondisk+write+known_if_redirected e194) 2019-12-08T17:28:23.388 INFO:tasks.rgw.client.0.smithi079.stdout:2019-12-08T17:28:23.381+0000 20e25700 -1 RGWWatcher::handle_error cookie 399053504 err (107) Transport endpoint is not connected 2019-12-08T17:28:42.896 INFO:tasks.rgw.client.0.smithi079.stdout:2019-12-08T17:28:42.896+0000 20e25700 -1 RGWWatcher::handle_error cookie 821646432 err (107) Transport endpoint is not connected 2019-12-08T17:28:43.697 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:28:43.628+0000 1694f700 -1 osd.1 194 get_health_metrics reporting 26 slow ops, oldest is osd_op(client.4449.0:103890 5.9 5.84ada7c9 (undecoded) ondisk+write+known_if_redirected e195) 2019-12-08T17:28:45.029 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:28:44.911+0000 1694f700 -1 osd.1 196 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4449.0:103898 5.9 5.84ada7c9 (undecoded) ondisk+write+known_if_redirected e196) 2019-12-08T17:28:57.342 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:05:26:22.045 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T17:28:57.355 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:05:26:22.058 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T17:28:57.377 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:05:26:22.011 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T17:28:57.378 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:05:26:22.012 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T17:28:57.382 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:05:26:22.016 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T17:28:57.388 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:05:26:22.022 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T17:28:57.694 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:05:26:22.397 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T17:28:57.767 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:05:26:22.401 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T17:28:57.771 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:05:26:22.406 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T17:29:19.517 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:29:19.249+0000 1694f700 -1 osd.2 202 get_health_metrics reporting 8 slow ops, oldest is osd_op(client.4449.0:101483 7.1 7:8bea0b29:::2019-12-08-17-f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.636-%e1%a0%83%ed%88%8f%ef%84%92%ce%a9%e5%98%88%e5%98%87%e0%a4%81%e0%a4%82%e1%a0%84%e3%9c%85%eb%8c%8c%e0%a4%82%e9%90%8c%ed%88%8d%e8%94%8b:head [append 0~738 in=738b] snapc 0=[] RETRY=14 ondisk+retry+write+known_if_redirected e200) 2019-12-08T17:30:01.700 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:05:27:26.403 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T17:30:01.722 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:05:27:26.357 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T17:30:01.729 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:05:27:26.432 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T17:30:01.749 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:05:27:26.384 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T17:30:01.772 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:05:27:26.406 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T17:30:01.787 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:05:27:26.420 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T17:30:01.800 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:05:27:26.435 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T17:30:01.813 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:05:27:26.516 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T17:30:01.826 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:05:27:26.460 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T17:30:08.870 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:30:08.863+0000 1694f700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.544080+0000 front 2019-12-08T17:29:25.238418+0000 (oldest deadline 2019-12-08T17:30:08.471572+0000) 2019-12-08T17:30:09.880 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:30:09.874+0000 1694f700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.544080+0000 front 2019-12-08T17:29:25.238418+0000 (oldest deadline 2019-12-08T17:30:08.471572+0000) 2019-12-08T17:30:10.481 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:30:10.479+0000 1694f700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:29.913190+0000 front 2019-12-08T17:29:29.916210+0000 (oldest deadline 2019-12-08T17:30:09.807950+0000) 2019-12-08T17:30:10.673 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:30:10.667+0000 1694f700 -1 osd.5 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.740390+0000 front 2019-12-08T17:29:27.707534+0000 (oldest deadline 2019-12-08T17:30:09.896475+0000) 2019-12-08T17:30:10.840 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:30:10.835+0000 1694f700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.544080+0000 front 2019-12-08T17:29:25.238418+0000 (oldest deadline 2019-12-08T17:30:08.471572+0000) 2019-12-08T17:30:11.154 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:30:11.148+0000 1694f700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:27.396059+0000 front 2019-12-08T17:29:27.659797+0000 (oldest deadline 2019-12-08T17:30:10.854336+0000) 2019-12-08T17:30:11.484 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:30:11.482+0000 1694f700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:29.913190+0000 front 2019-12-08T17:29:29.916210+0000 (oldest deadline 2019-12-08T17:30:09.807950+0000) 2019-12-08T17:30:11.682 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:30:11.676+0000 1694f700 -1 osd.5 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.740390+0000 front 2019-12-08T17:29:27.707534+0000 (oldest deadline 2019-12-08T17:30:09.896475+0000) 2019-12-08T17:30:11.812 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:30:11.807+0000 1694f700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.544080+0000 front 2019-12-08T17:29:25.238418+0000 (oldest deadline 2019-12-08T17:30:08.471572+0000) 2019-12-08T17:30:12.146 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:30:12.140+0000 1694f700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:27.396059+0000 front 2019-12-08T17:29:27.659797+0000 (oldest deadline 2019-12-08T17:30:10.854336+0000) 2019-12-08T17:30:12.442 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:30:12.441+0000 1694f700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:29.913190+0000 front 2019-12-08T17:29:29.916210+0000 (oldest deadline 2019-12-08T17:30:09.807950+0000) 2019-12-08T17:30:12.705 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:30:12.699+0000 1694f700 -1 osd.5 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.740390+0000 front 2019-12-08T17:29:27.707534+0000 (oldest deadline 2019-12-08T17:30:09.896475+0000) 2019-12-08T17:30:12.727 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:30:12.724+0000 1694f700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.429732+0000 front 2019-12-08T17:29:28.349593+0000 (oldest deadline 2019-12-08T17:30:12.678282+0000) 2019-12-08T17:30:12.866 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:30:12.860+0000 1694f700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.544080+0000 front 2019-12-08T17:29:25.238418+0000 (oldest deadline 2019-12-08T17:30:08.471572+0000) 2019-12-08T17:30:13.152 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:30:13.146+0000 1694f700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:27.396059+0000 front 2019-12-08T17:29:27.659797+0000 (oldest deadline 2019-12-08T17:30:10.854336+0000) 2019-12-08T17:30:13.409 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:30:13.407+0000 1694f700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:29.913190+0000 front 2019-12-08T17:29:29.916210+0000 (oldest deadline 2019-12-08T17:30:09.807950+0000) 2019-12-08T17:30:13.509 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:30:13.504+0000 1694f700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.742979+0000 front 2019-12-08T17:29:28.495337+0000 (oldest deadline 2019-12-08T17:30:13.022086+0000) 2019-12-08T17:30:13.723 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:30:13.720+0000 1694f700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.429732+0000 front 2019-12-08T17:29:28.349593+0000 (oldest deadline 2019-12-08T17:30:12.678282+0000) 2019-12-08T17:30:13.723 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:30:13.717+0000 1694f700 -1 osd.5 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.740390+0000 front 2019-12-08T17:29:27.707534+0000 (oldest deadline 2019-12-08T17:30:09.896475+0000) 2019-12-08T17:30:13.880 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:30:13.874+0000 1694f700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.544080+0000 front 2019-12-08T17:29:25.238418+0000 (oldest deadline 2019-12-08T17:30:08.471572+0000) 2019-12-08T17:30:14.125 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:30:14.118+0000 1694f700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:27.396059+0000 front 2019-12-08T17:29:27.659797+0000 (oldest deadline 2019-12-08T17:30:10.854336+0000) 2019-12-08T17:30:14.451 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:30:14.449+0000 1694f700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:29.913190+0000 front 2019-12-08T17:29:29.916210+0000 (oldest deadline 2019-12-08T17:30:09.807950+0000) 2019-12-08T17:30:14.515 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:30:14.509+0000 1694f700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.742979+0000 front 2019-12-08T17:29:28.495337+0000 (oldest deadline 2019-12-08T17:30:13.022086+0000) 2019-12-08T17:30:14.702 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:30:14.696+0000 1694f700 -1 osd.5 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.740390+0000 front 2019-12-08T17:29:27.707534+0000 (oldest deadline 2019-12-08T17:30:09.896475+0000) 2019-12-08T17:30:14.759 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:30:14.757+0000 1694f700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.429732+0000 front 2019-12-08T17:29:28.349593+0000 (oldest deadline 2019-12-08T17:30:12.678282+0000) 2019-12-08T17:30:14.928 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:30:14.922+0000 1694f700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.544080+0000 front 2019-12-08T17:29:25.238418+0000 (oldest deadline 2019-12-08T17:30:08.471572+0000) 2019-12-08T17:30:15.167 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:30:15.160+0000 1694f700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:27.396059+0000 front 2019-12-08T17:29:27.659797+0000 (oldest deadline 2019-12-08T17:30:10.854336+0000) 2019-12-08T17:30:15.482 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:30:15.481+0000 1694f700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:29.913190+0000 front 2019-12-08T17:29:29.916210+0000 (oldest deadline 2019-12-08T17:30:09.807950+0000) 2019-12-08T17:30:15.517 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:30:15.511+0000 1694f700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.742979+0000 front 2019-12-08T17:29:28.495337+0000 (oldest deadline 2019-12-08T17:30:13.022086+0000) 2019-12-08T17:30:15.739 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:30:15.733+0000 1694f700 -1 osd.5 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.740390+0000 front 2019-12-08T17:29:27.707534+0000 (oldest deadline 2019-12-08T17:30:09.896475+0000) 2019-12-08T17:30:15.772 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:30:15.771+0000 1694f700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.429732+0000 front 2019-12-08T17:29:28.349593+0000 (oldest deadline 2019-12-08T17:30:12.678282+0000) 2019-12-08T17:30:15.943 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:30:15.936+0000 1694f700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.544080+0000 front 2019-12-08T17:29:25.238418+0000 (oldest deadline 2019-12-08T17:30:08.471572+0000) 2019-12-08T17:30:16.124 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:30:16.118+0000 1694f700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:27.396059+0000 front 2019-12-08T17:29:27.659797+0000 (oldest deadline 2019-12-08T17:30:10.854336+0000) 2019-12-08T17:30:16.460 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:30:16.458+0000 1694f700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:29.913190+0000 front 2019-12-08T17:29:29.916210+0000 (oldest deadline 2019-12-08T17:30:09.807950+0000) 2019-12-08T17:30:16.489 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:30:16.483+0000 1694f700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.742979+0000 front 2019-12-08T17:29:28.495337+0000 (oldest deadline 2019-12-08T17:30:13.022086+0000) 2019-12-08T17:30:16.714 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:30:16.708+0000 1694f700 -1 osd.5 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.740390+0000 front 2019-12-08T17:29:27.707534+0000 (oldest deadline 2019-12-08T17:30:09.896475+0000) 2019-12-08T17:30:16.787 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:30:16.782+0000 1694f700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.429732+0000 front 2019-12-08T17:29:28.349593+0000 (oldest deadline 2019-12-08T17:30:12.678282+0000) 2019-12-08T17:30:16.941 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:30:16.934+0000 1694f700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.544080+0000 front 2019-12-08T17:29:25.238418+0000 (oldest deadline 2019-12-08T17:30:08.471572+0000) 2019-12-08T17:30:17.133 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:30:17.127+0000 1694f700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:27.396059+0000 front 2019-12-08T17:29:27.659797+0000 (oldest deadline 2019-12-08T17:30:10.854336+0000) 2019-12-08T17:30:17.471 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:30:17.467+0000 1694f700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:29.913190+0000 front 2019-12-08T17:29:29.916210+0000 (oldest deadline 2019-12-08T17:30:09.807950+0000) 2019-12-08T17:30:17.492 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:30:17.485+0000 1694f700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.742979+0000 front 2019-12-08T17:29:28.495337+0000 (oldest deadline 2019-12-08T17:30:13.022086+0000) 2019-12-08T17:30:17.753 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:30:17.747+0000 1694f700 -1 osd.5 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.740390+0000 front 2019-12-08T17:29:27.707534+0000 (oldest deadline 2019-12-08T17:30:09.896475+0000) 2019-12-08T17:30:17.784 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:30:17.783+0000 1694f700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.429732+0000 front 2019-12-08T17:29:28.349593+0000 (oldest deadline 2019-12-08T17:30:12.678282+0000) 2019-12-08T17:30:17.930 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:30:17.924+0000 1694f700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.544080+0000 front 2019-12-08T17:29:25.238418+0000 (oldest deadline 2019-12-08T17:30:08.471572+0000) 2019-12-08T17:30:18.144 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:30:18.138+0000 1694f700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:27.396059+0000 front 2019-12-08T17:29:27.659797+0000 (oldest deadline 2019-12-08T17:30:10.854336+0000) 2019-12-08T17:30:18.468 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:30:18.466+0000 1694f700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:29.913190+0000 front 2019-12-08T17:29:29.916210+0000 (oldest deadline 2019-12-08T17:30:09.807950+0000) 2019-12-08T17:30:18.512 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:30:18.506+0000 1694f700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.742979+0000 front 2019-12-08T17:29:28.495337+0000 (oldest deadline 2019-12-08T17:30:13.022086+0000) 2019-12-08T17:30:18.778 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:30:18.777+0000 1694f700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.429732+0000 front 2019-12-08T17:29:28.349593+0000 (oldest deadline 2019-12-08T17:30:12.678282+0000) 2019-12-08T17:30:18.804 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:30:18.798+0000 1694f700 -1 osd.5 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.740390+0000 front 2019-12-08T17:29:27.707534+0000 (oldest deadline 2019-12-08T17:30:09.896475+0000) 2019-12-08T17:30:18.910 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:30:18.904+0000 1694f700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.544080+0000 front 2019-12-08T17:29:25.238418+0000 (oldest deadline 2019-12-08T17:30:08.471572+0000) 2019-12-08T17:30:19.166 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:30:19.160+0000 1694f700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:27.396059+0000 front 2019-12-08T17:29:27.659797+0000 (oldest deadline 2019-12-08T17:30:10.854336+0000) 2019-12-08T17:30:19.463 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:30:19.461+0000 1694f700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:29.913190+0000 front 2019-12-08T17:29:29.916210+0000 (oldest deadline 2019-12-08T17:30:09.807950+0000) 2019-12-08T17:30:19.529 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:30:19.523+0000 1694f700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.742979+0000 front 2019-12-08T17:29:28.495337+0000 (oldest deadline 2019-12-08T17:30:13.022086+0000) 2019-12-08T17:30:19.769 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:30:19.767+0000 1694f700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.429732+0000 front 2019-12-08T17:29:28.349593+0000 (oldest deadline 2019-12-08T17:30:12.678282+0000) 2019-12-08T17:30:19.771 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:30:19.765+0000 1694f700 -1 osd.5 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.740390+0000 front 2019-12-08T17:29:27.707534+0000 (oldest deadline 2019-12-08T17:30:09.896475+0000) 2019-12-08T17:30:19.942 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:30:19.937+0000 1694f700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.544080+0000 front 2019-12-08T17:29:25.238418+0000 (oldest deadline 2019-12-08T17:30:08.471572+0000) 2019-12-08T17:30:20.181 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:30:20.174+0000 1694f700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:27.396059+0000 front 2019-12-08T17:29:27.659797+0000 (oldest deadline 2019-12-08T17:30:10.854336+0000) 2019-12-08T17:30:20.460 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:30:20.459+0000 1694f700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:29.913190+0000 front 2019-12-08T17:29:29.916210+0000 (oldest deadline 2019-12-08T17:30:09.807950+0000) 2019-12-08T17:30:20.532 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:30:20.527+0000 1694f700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.742979+0000 front 2019-12-08T17:29:28.495337+0000 (oldest deadline 2019-12-08T17:30:13.022086+0000) 2019-12-08T17:30:20.778 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:30:20.777+0000 1694f700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.429732+0000 front 2019-12-08T17:29:28.349593+0000 (oldest deadline 2019-12-08T17:30:12.678282+0000) 2019-12-08T17:30:20.788 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:30:20.783+0000 1694f700 -1 osd.5 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.740390+0000 front 2019-12-08T17:29:27.707534+0000 (oldest deadline 2019-12-08T17:30:09.896475+0000) 2019-12-08T17:30:20.924 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:30:20.918+0000 1694f700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.544080+0000 front 2019-12-08T17:29:25.238418+0000 (oldest deadline 2019-12-08T17:30:08.471572+0000) 2019-12-08T17:30:21.177 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:30:21.172+0000 1694f700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:27.396059+0000 front 2019-12-08T17:29:27.659797+0000 (oldest deadline 2019-12-08T17:30:10.854336+0000) 2019-12-08T17:30:21.482 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:30:21.481+0000 1694f700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:29.913190+0000 front 2019-12-08T17:29:29.916210+0000 (oldest deadline 2019-12-08T17:30:09.807950+0000) 2019-12-08T17:30:21.543 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:30:21.538+0000 1694f700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.742979+0000 front 2019-12-08T17:29:28.495337+0000 (oldest deadline 2019-12-08T17:30:13.022086+0000) 2019-12-08T17:30:21.812 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:30:21.812+0000 1694f700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.429732+0000 front 2019-12-08T17:29:28.349593+0000 (oldest deadline 2019-12-08T17:30:12.678282+0000) 2019-12-08T17:30:21.832 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:30:21.826+0000 1694f700 -1 osd.5 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.740390+0000 front 2019-12-08T17:29:27.707534+0000 (oldest deadline 2019-12-08T17:30:09.896475+0000) 2019-12-08T17:30:21.913 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:30:21.907+0000 1694f700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.544080+0000 front 2019-12-08T17:29:25.238418+0000 (oldest deadline 2019-12-08T17:30:08.471572+0000) 2019-12-08T17:30:22.161 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:30:22.150+0000 1694f700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:27.396059+0000 front 2019-12-08T17:29:27.659797+0000 (oldest deadline 2019-12-08T17:30:10.854336+0000) 2019-12-08T17:30:22.475 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:30:22.472+0000 1694f700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:29.913190+0000 front 2019-12-08T17:29:29.916210+0000 (oldest deadline 2019-12-08T17:30:09.807950+0000) 2019-12-08T17:30:22.518 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:30:22.508+0000 1694f700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.742979+0000 front 2019-12-08T17:29:28.495337+0000 (oldest deadline 2019-12-08T17:30:13.022086+0000) 2019-12-08T17:30:22.772 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:30:22.771+0000 1694f700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.429732+0000 front 2019-12-08T17:29:28.349593+0000 (oldest deadline 2019-12-08T17:30:12.678282+0000) 2019-12-08T17:30:22.869 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:30:22.864+0000 1694f700 -1 osd.5 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.740390+0000 front 2019-12-08T17:29:27.707534+0000 (oldest deadline 2019-12-08T17:30:09.896475+0000) 2019-12-08T17:30:22.934 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:30:22.929+0000 1694f700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.544080+0000 front 2019-12-08T17:29:25.238418+0000 (oldest deadline 2019-12-08T17:30:08.471572+0000) 2019-12-08T17:30:23.126 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:30:23.120+0000 1694f700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:27.396059+0000 front 2019-12-08T17:29:27.659797+0000 (oldest deadline 2019-12-08T17:30:10.854336+0000) 2019-12-08T17:30:23.507 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:30:23.505+0000 1694f700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:29.913190+0000 front 2019-12-08T17:29:29.916210+0000 (oldest deadline 2019-12-08T17:30:09.807950+0000) 2019-12-08T17:30:23.508 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:30:23.501+0000 1694f700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.742979+0000 front 2019-12-08T17:29:28.495337+0000 (oldest deadline 2019-12-08T17:30:13.022086+0000) 2019-12-08T17:30:23.777 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:30:23.775+0000 1694f700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.429732+0000 front 2019-12-08T17:29:28.349593+0000 (oldest deadline 2019-12-08T17:30:12.678282+0000) 2019-12-08T17:30:23.846 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:30:23.840+0000 1694f700 -1 osd.5 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.740390+0000 front 2019-12-08T17:29:27.707534+0000 (oldest deadline 2019-12-08T17:30:09.896475+0000) 2019-12-08T17:30:23.960 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:30:23.953+0000 1694f700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.544080+0000 front 2019-12-08T17:29:25.238418+0000 (oldest deadline 2019-12-08T17:30:08.471572+0000) 2019-12-08T17:30:24.156 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:30:24.150+0000 1694f700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:27.396059+0000 front 2019-12-08T17:29:27.659797+0000 (oldest deadline 2019-12-08T17:30:10.854336+0000) 2019-12-08T17:30:24.502 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:30:24.501+0000 1694f700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:29.913190+0000 front 2019-12-08T17:29:29.916210+0000 (oldest deadline 2019-12-08T17:30:09.807950+0000) 2019-12-08T17:30:24.511 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:30:24.505+0000 1694f700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.742979+0000 front 2019-12-08T17:29:28.495337+0000 (oldest deadline 2019-12-08T17:30:13.022086+0000) 2019-12-08T17:30:24.804 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:30:24.802+0000 1694f700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.429732+0000 front 2019-12-08T17:29:28.349593+0000 (oldest deadline 2019-12-08T17:30:12.678282+0000) 2019-12-08T17:30:24.823 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:30:24.816+0000 1694f700 -1 osd.5 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.740390+0000 front 2019-12-08T17:29:27.707534+0000 (oldest deadline 2019-12-08T17:30:09.896475+0000) 2019-12-08T17:30:24.937 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:30:24.931+0000 1694f700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.544080+0000 front 2019-12-08T17:29:25.238418+0000 (oldest deadline 2019-12-08T17:30:08.471572+0000) 2019-12-08T17:30:25.141 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:30:25.135+0000 1694f700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:27.396059+0000 front 2019-12-08T17:29:27.659797+0000 (oldest deadline 2019-12-08T17:30:10.854336+0000) 2019-12-08T17:30:25.507 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:30:25.506+0000 1694f700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:29.913190+0000 front 2019-12-08T17:29:29.916210+0000 (oldest deadline 2019-12-08T17:30:09.807950+0000) 2019-12-08T17:30:25.537 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:30:25.531+0000 1694f700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.742979+0000 front 2019-12-08T17:29:28.495337+0000 (oldest deadline 2019-12-08T17:30:13.022086+0000) 2019-12-08T17:30:25.787 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:30:25.786+0000 1694f700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.429732+0000 front 2019-12-08T17:29:28.349593+0000 (oldest deadline 2019-12-08T17:30:12.678282+0000) 2019-12-08T17:30:25.875 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:30:25.869+0000 1694f700 -1 osd.5 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.740390+0000 front 2019-12-08T17:29:27.707534+0000 (oldest deadline 2019-12-08T17:30:09.896475+0000) 2019-12-08T17:30:25.919 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:30:25.911+0000 1694f700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.544080+0000 front 2019-12-08T17:29:25.238418+0000 (oldest deadline 2019-12-08T17:30:08.471572+0000) 2019-12-08T17:30:26.143 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:30:26.138+0000 1694f700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:27.396059+0000 front 2019-12-08T17:29:27.659797+0000 (oldest deadline 2019-12-08T17:30:10.854336+0000) 2019-12-08T17:30:26.481 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:30:26.480+0000 1694f700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:29.913190+0000 front 2019-12-08T17:29:29.916210+0000 (oldest deadline 2019-12-08T17:30:09.807950+0000) 2019-12-08T17:30:26.554 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:30:26.549+0000 1694f700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.742979+0000 front 2019-12-08T17:29:28.495337+0000 (oldest deadline 2019-12-08T17:30:13.022086+0000) 2019-12-08T17:30:26.755 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:30:26.752+0000 1694f700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.429732+0000 front 2019-12-08T17:29:28.349593+0000 (oldest deadline 2019-12-08T17:30:12.678282+0000) 2019-12-08T17:30:26.867 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:30:26.861+0000 1694f700 -1 osd.5 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.740390+0000 front 2019-12-08T17:29:27.707534+0000 (oldest deadline 2019-12-08T17:30:09.896475+0000) 2019-12-08T17:30:26.940 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:30:26.933+0000 1694f700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.544080+0000 front 2019-12-08T17:29:25.238418+0000 (oldest deadline 2019-12-08T17:30:08.471572+0000) 2019-12-08T17:30:27.126 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:30:27.120+0000 1694f700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:27.396059+0000 front 2019-12-08T17:29:27.659797+0000 (oldest deadline 2019-12-08T17:30:10.854336+0000) 2019-12-08T17:30:27.487 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:30:27.484+0000 1694f700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:29.913190+0000 front 2019-12-08T17:29:29.916210+0000 (oldest deadline 2019-12-08T17:30:09.807950+0000) 2019-12-08T17:30:27.529 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:30:27.522+0000 1694f700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.742979+0000 front 2019-12-08T17:29:28.495337+0000 (oldest deadline 2019-12-08T17:30:13.022086+0000) 2019-12-08T17:30:27.790 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:30:27.788+0000 1694f700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.429732+0000 front 2019-12-08T17:29:28.349593+0000 (oldest deadline 2019-12-08T17:30:12.678282+0000) 2019-12-08T17:30:27.908 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:30:27.902+0000 1694f700 -1 osd.5 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.740390+0000 front 2019-12-08T17:29:27.707534+0000 (oldest deadline 2019-12-08T17:30:09.896475+0000) 2019-12-08T17:30:27.943 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:30:27.937+0000 1694f700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.544080+0000 front 2019-12-08T17:29:25.238418+0000 (oldest deadline 2019-12-08T17:30:08.471572+0000) 2019-12-08T17:30:28.101 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:30:28.097+0000 1694f700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:27.396059+0000 front 2019-12-08T17:29:27.659797+0000 (oldest deadline 2019-12-08T17:30:10.854336+0000) 2019-12-08T17:30:28.520 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:30:28.518+0000 1694f700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:29.913190+0000 front 2019-12-08T17:29:29.916210+0000 (oldest deadline 2019-12-08T17:30:09.807950+0000) 2019-12-08T17:30:28.555 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:30:28.552+0000 1694f700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.742979+0000 front 2019-12-08T17:29:28.495337+0000 (oldest deadline 2019-12-08T17:30:13.022086+0000) 2019-12-08T17:30:28.824 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:30:28.822+0000 1694f700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.429732+0000 front 2019-12-08T17:29:28.349593+0000 (oldest deadline 2019-12-08T17:30:12.678282+0000) 2019-12-08T17:30:28.949 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:30:28.944+0000 1694f700 -1 osd.5 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.740390+0000 front 2019-12-08T17:29:27.707534+0000 (oldest deadline 2019-12-08T17:30:09.896475+0000) 2019-12-08T17:30:28.995 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:30:28.990+0000 1694f700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.544080+0000 front 2019-12-08T17:29:25.238418+0000 (oldest deadline 2019-12-08T17:30:08.471572+0000) 2019-12-08T17:30:29.115 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:30:29.110+0000 1694f700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:27.396059+0000 front 2019-12-08T17:29:27.659797+0000 (oldest deadline 2019-12-08T17:30:10.854336+0000) 2019-12-08T17:30:29.527 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:30:29.521+0000 1694f700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.742979+0000 front 2019-12-08T17:29:28.495337+0000 (oldest deadline 2019-12-08T17:30:13.022086+0000) 2019-12-08T17:30:29.535 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:30:29.532+0000 1694f700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:29.913190+0000 front 2019-12-08T17:29:29.916210+0000 (oldest deadline 2019-12-08T17:30:09.807950+0000) 2019-12-08T17:30:29.825 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:30:29.822+0000 1694f700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.429732+0000 front 2019-12-08T17:29:28.349593+0000 (oldest deadline 2019-12-08T17:30:12.678282+0000) 2019-12-08T17:30:29.973 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:30:29.968+0000 1694f700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.544080+0000 front 2019-12-08T17:29:25.238418+0000 (oldest deadline 2019-12-08T17:30:08.471572+0000) 2019-12-08T17:30:29.985 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:30:29.979+0000 1694f700 -1 osd.5 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.740390+0000 front 2019-12-08T17:29:27.707534+0000 (oldest deadline 2019-12-08T17:30:09.896475+0000) 2019-12-08T17:30:30.155 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:30:30.150+0000 1694f700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:27.396059+0000 front 2019-12-08T17:29:27.659797+0000 (oldest deadline 2019-12-08T17:30:10.854336+0000) 2019-12-08T17:30:30.543 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:30:30.538+0000 1694f700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.742979+0000 front 2019-12-08T17:29:28.495337+0000 (oldest deadline 2019-12-08T17:30:13.022086+0000) 2019-12-08T17:30:30.560 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:30:30.559+0000 1694f700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:29.913190+0000 front 2019-12-08T17:29:29.916210+0000 (oldest deadline 2019-12-08T17:30:09.807950+0000) 2019-12-08T17:30:30.858 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:30:30.854+0000 1694f700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.429732+0000 front 2019-12-08T17:29:28.349593+0000 (oldest deadline 2019-12-08T17:30:12.678282+0000) 2019-12-08T17:30:30.942 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:30:30.936+0000 1694f700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.544080+0000 front 2019-12-08T17:29:25.238418+0000 (oldest deadline 2019-12-08T17:30:08.471572+0000) 2019-12-08T17:30:30.995 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:30:30.990+0000 1694f700 -1 osd.5 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.740390+0000 front 2019-12-08T17:29:27.707534+0000 (oldest deadline 2019-12-08T17:30:09.896475+0000) 2019-12-08T17:30:31.143 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:30:31.138+0000 1694f700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:27.396059+0000 front 2019-12-08T17:29:27.659797+0000 (oldest deadline 2019-12-08T17:30:10.854336+0000) 2019-12-08T17:30:31.547 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:30:31.542+0000 1694f700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.742979+0000 front 2019-12-08T17:29:28.495337+0000 (oldest deadline 2019-12-08T17:30:13.022086+0000) 2019-12-08T17:30:31.547 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:30:31.546+0000 1694f700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:29.913190+0000 front 2019-12-08T17:29:29.916210+0000 (oldest deadline 2019-12-08T17:30:09.807950+0000) 2019-12-08T17:30:31.809 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:30:31.808+0000 1694f700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.429732+0000 front 2019-12-08T17:29:28.349593+0000 (oldest deadline 2019-12-08T17:30:12.678282+0000) 2019-12-08T17:30:31.966 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:30:31.961+0000 1694f700 -1 osd.5 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.740390+0000 front 2019-12-08T17:29:27.707534+0000 (oldest deadline 2019-12-08T17:30:09.896475+0000) 2019-12-08T17:30:31.974 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:30:31.969+0000 1694f700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.544080+0000 front 2019-12-08T17:29:25.238418+0000 (oldest deadline 2019-12-08T17:30:08.471572+0000) 2019-12-08T17:30:32.127 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:30:32.122+0000 1694f700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:27.396059+0000 front 2019-12-08T17:29:27.659797+0000 (oldest deadline 2019-12-08T17:30:10.854336+0000) 2019-12-08T17:30:32.519 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:30:32.514+0000 1694f700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.742979+0000 front 2019-12-08T17:29:28.495337+0000 (oldest deadline 2019-12-08T17:30:13.022086+0000) 2019-12-08T17:30:32.543 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:30:32.541+0000 1694f700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:29.913190+0000 front 2019-12-08T17:29:29.916210+0000 (oldest deadline 2019-12-08T17:30:09.807950+0000) 2019-12-08T17:30:32.781 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:30:32.777+0000 1694f700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.429732+0000 front 2019-12-08T17:29:28.349593+0000 (oldest deadline 2019-12-08T17:30:12.678282+0000) 2019-12-08T17:30:32.949 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:30:32.944+0000 1694f700 -1 osd.5 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.740390+0000 front 2019-12-08T17:29:27.707534+0000 (oldest deadline 2019-12-08T17:30:09.896475+0000) 2019-12-08T17:30:33.024 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:30:33.018+0000 1694f700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.544080+0000 front 2019-12-08T17:29:25.238418+0000 (oldest deadline 2019-12-08T17:30:08.471572+0000) 2019-12-08T17:30:33.151 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:30:33.146+0000 1694f700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:27.396059+0000 front 2019-12-08T17:29:27.659797+0000 (oldest deadline 2019-12-08T17:30:10.854336+0000) 2019-12-08T17:30:33.498 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:30:33.484+0000 1694f700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.742979+0000 front 2019-12-08T17:29:28.495337+0000 (oldest deadline 2019-12-08T17:30:13.022086+0000) 2019-12-08T17:30:33.581 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:30:33.578+0000 1694f700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:29.913190+0000 front 2019-12-08T17:29:29.916210+0000 (oldest deadline 2019-12-08T17:30:09.807950+0000) 2019-12-08T17:30:33.754 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:30:33.752+0000 1694f700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.429732+0000 front 2019-12-08T17:29:28.349593+0000 (oldest deadline 2019-12-08T17:30:12.678282+0000) 2019-12-08T17:30:33.998 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:30:33.992+0000 1694f700 -1 osd.5 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.740390+0000 front 2019-12-08T17:29:27.707534+0000 (oldest deadline 2019-12-08T17:30:09.896475+0000) 2019-12-08T17:30:34.014 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:30:34.009+0000 1694f700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.544080+0000 front 2019-12-08T17:29:25.238418+0000 (oldest deadline 2019-12-08T17:30:08.471572+0000) 2019-12-08T17:30:34.192 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:30:34.187+0000 1694f700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:27.396059+0000 front 2019-12-08T17:29:27.659797+0000 (oldest deadline 2019-12-08T17:30:10.854336+0000) 2019-12-08T17:30:34.458 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:30:34.452+0000 1694f700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.742979+0000 front 2019-12-08T17:29:28.495337+0000 (oldest deadline 2019-12-08T17:30:13.022086+0000) 2019-12-08T17:30:34.567 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:30:34.564+0000 1694f700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:29.913190+0000 front 2019-12-08T17:29:29.916210+0000 (oldest deadline 2019-12-08T17:30:09.807950+0000) 2019-12-08T17:30:34.724 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:30:34.721+0000 1694f700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.429732+0000 front 2019-12-08T17:29:28.349593+0000 (oldest deadline 2019-12-08T17:30:12.678282+0000) 2019-12-08T17:30:35.013 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:30:35.008+0000 1694f700 -1 osd.5 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.740390+0000 front 2019-12-08T17:29:27.707534+0000 (oldest deadline 2019-12-08T17:30:09.896475+0000) 2019-12-08T17:30:35.019 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:30:35.014+0000 1694f700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.544080+0000 front 2019-12-08T17:29:25.238418+0000 (oldest deadline 2019-12-08T17:30:08.471572+0000) 2019-12-08T17:30:35.245 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:30:35.241+0000 1694f700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:27.396059+0000 front 2019-12-08T17:29:27.659797+0000 (oldest deadline 2019-12-08T17:30:10.854336+0000) 2019-12-08T17:30:35.442 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:30:35.437+0000 1694f700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.742979+0000 front 2019-12-08T17:29:28.495337+0000 (oldest deadline 2019-12-08T17:30:13.022086+0000) 2019-12-08T17:30:35.601 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:30:35.598+0000 1694f700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:29.913190+0000 front 2019-12-08T17:29:29.916210+0000 (oldest deadline 2019-12-08T17:30:09.807950+0000) 2019-12-08T17:30:35.713 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:30:35.710+0000 1694f700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.429732+0000 front 2019-12-08T17:29:28.349593+0000 (oldest deadline 2019-12-08T17:30:12.678282+0000) 2019-12-08T17:30:36.000 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:30:35.995+0000 1694f700 -1 osd.5 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.740390+0000 front 2019-12-08T17:29:27.707534+0000 (oldest deadline 2019-12-08T17:30:09.896475+0000) 2019-12-08T17:30:36.070 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:30:36.066+0000 1694f700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.544080+0000 front 2019-12-08T17:29:25.238418+0000 (oldest deadline 2019-12-08T17:30:08.471572+0000) 2019-12-08T17:30:36.291 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:30:36.286+0000 1694f700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:27.396059+0000 front 2019-12-08T17:29:27.659797+0000 (oldest deadline 2019-12-08T17:30:10.854336+0000) 2019-12-08T17:30:36.488 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:30:36.481+0000 1694f700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.742979+0000 front 2019-12-08T17:29:28.495337+0000 (oldest deadline 2019-12-08T17:30:13.022086+0000) 2019-12-08T17:30:36.599 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:30:36.597+0000 1694f700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:29.913190+0000 front 2019-12-08T17:29:29.916210+0000 (oldest deadline 2019-12-08T17:30:09.807950+0000) 2019-12-08T17:30:36.760 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:30:36.758+0000 1694f700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.429732+0000 front 2019-12-08T17:29:28.349593+0000 (oldest deadline 2019-12-08T17:30:12.678282+0000) 2019-12-08T17:30:36.993 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:30:36.989+0000 1694f700 -1 osd.5 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.740390+0000 front 2019-12-08T17:29:27.707534+0000 (oldest deadline 2019-12-08T17:30:09.896475+0000) 2019-12-08T17:30:37.036 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:30:37.031+0000 1694f700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.544080+0000 front 2019-12-08T17:29:25.238418+0000 (oldest deadline 2019-12-08T17:30:08.471572+0000) 2019-12-08T17:30:37.309 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:30:37.304+0000 1694f700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:27.396059+0000 front 2019-12-08T17:29:27.659797+0000 (oldest deadline 2019-12-08T17:30:10.854336+0000) 2019-12-08T17:30:37.467 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:30:37.463+0000 1694f700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.742979+0000 front 2019-12-08T17:29:28.495337+0000 (oldest deadline 2019-12-08T17:30:13.022086+0000) 2019-12-08T17:30:37.568 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:30:37.565+0000 1694f700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:29.913190+0000 front 2019-12-08T17:29:29.916210+0000 (oldest deadline 2019-12-08T17:30:09.807950+0000) 2019-12-08T17:30:37.725 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:30:37.721+0000 1694f700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.429732+0000 front 2019-12-08T17:29:28.349593+0000 (oldest deadline 2019-12-08T17:30:12.678282+0000) 2019-12-08T17:30:37.952 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:30:37.947+0000 1694f700 -1 osd.5 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.740390+0000 front 2019-12-08T17:29:27.707534+0000 (oldest deadline 2019-12-08T17:30:09.896475+0000) 2019-12-08T17:30:38.055 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:30:38.050+0000 1694f700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.544080+0000 front 2019-12-08T17:29:25.238418+0000 (oldest deadline 2019-12-08T17:30:08.471572+0000) 2019-12-08T17:30:38.327 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:30:38.322+0000 1694f700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:27.396059+0000 front 2019-12-08T17:29:27.659797+0000 (oldest deadline 2019-12-08T17:30:10.854336+0000) 2019-12-08T17:30:38.449 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:30:38.443+0000 1694f700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.742979+0000 front 2019-12-08T17:29:28.495337+0000 (oldest deadline 2019-12-08T17:30:13.022086+0000) 2019-12-08T17:30:38.549 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:30:38.546+0000 1694f700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:29.913190+0000 front 2019-12-08T17:29:29.916210+0000 (oldest deadline 2019-12-08T17:30:09.807950+0000) 2019-12-08T17:30:38.730 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:30:38.727+0000 1694f700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.429732+0000 front 2019-12-08T17:29:28.349593+0000 (oldest deadline 2019-12-08T17:30:12.678282+0000) 2019-12-08T17:30:38.970 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:30:38.965+0000 1694f700 -1 osd.5 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.740390+0000 front 2019-12-08T17:29:27.707534+0000 (oldest deadline 2019-12-08T17:30:09.896475+0000) 2019-12-08T17:30:39.041 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:30:39.036+0000 1694f700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.544080+0000 front 2019-12-08T17:29:25.238418+0000 (oldest deadline 2019-12-08T17:30:08.471572+0000) 2019-12-08T17:30:39.353 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:30:39.347+0000 1694f700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:27.396059+0000 front 2019-12-08T17:29:27.659797+0000 (oldest deadline 2019-12-08T17:30:10.854336+0000) 2019-12-08T17:30:39.430 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:30:39.424+0000 1694f700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.742979+0000 front 2019-12-08T17:29:28.495337+0000 (oldest deadline 2019-12-08T17:30:13.022086+0000) 2019-12-08T17:30:39.508 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:30:39.504+0000 1694f700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:29.913190+0000 front 2019-12-08T17:29:29.916210+0000 (oldest deadline 2019-12-08T17:30:09.807950+0000) 2019-12-08T17:30:39.720 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:30:39.717+0000 1694f700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.429732+0000 front 2019-12-08T17:29:28.349593+0000 (oldest deadline 2019-12-08T17:30:12.678282+0000) 2019-12-08T17:30:39.974 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:30:39.968+0000 1694f700 -1 osd.5 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.740390+0000 front 2019-12-08T17:29:27.707534+0000 (oldest deadline 2019-12-08T17:30:09.896475+0000) 2019-12-08T17:30:40.009 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:30:40.004+0000 1694f700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.544080+0000 front 2019-12-08T17:29:25.238418+0000 (oldest deadline 2019-12-08T17:30:08.471572+0000) 2019-12-08T17:30:40.395 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:30:40.391+0000 1694f700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:27.396059+0000 front 2019-12-08T17:29:27.659797+0000 (oldest deadline 2019-12-08T17:30:10.854336+0000) 2019-12-08T17:30:40.413 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:30:40.408+0000 1694f700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.742979+0000 front 2019-12-08T17:29:28.495337+0000 (oldest deadline 2019-12-08T17:30:13.022086+0000) 2019-12-08T17:30:40.546 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:30:40.544+0000 1694f700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:29.913190+0000 front 2019-12-08T17:29:29.916210+0000 (oldest deadline 2019-12-08T17:30:09.807950+0000) 2019-12-08T17:30:40.768 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:30:40.765+0000 1694f700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.429732+0000 front 2019-12-08T17:29:28.349593+0000 (oldest deadline 2019-12-08T17:30:12.678282+0000) 2019-12-08T17:30:40.962 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:30:40.958+0000 1694f700 -1 osd.5 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.740390+0000 front 2019-12-08T17:29:27.707534+0000 (oldest deadline 2019-12-08T17:30:09.896475+0000) 2019-12-08T17:30:40.986 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:30:40.981+0000 1694f700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.544080+0000 front 2019-12-08T17:29:25.238418+0000 (oldest deadline 2019-12-08T17:30:08.471572+0000) 2019-12-08T17:30:41.376 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:30:41.370+0000 1694f700 -1 osd.4 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:27.396059+0000 front 2019-12-08T17:29:27.659797+0000 (oldest deadline 2019-12-08T17:30:10.854336+0000) 2019-12-08T17:30:41.421 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:30:41.415+0000 1694f700 -1 osd.6 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.742979+0000 front 2019-12-08T17:29:28.495337+0000 (oldest deadline 2019-12-08T17:30:13.022086+0000) 2019-12-08T17:30:41.591 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:30:41.588+0000 1694f700 -1 osd.3 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:29.913190+0000 front 2019-12-08T17:29:29.916210+0000 (oldest deadline 2019-12-08T17:30:09.807950+0000) 2019-12-08T17:30:41.817 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:30:41.814+0000 1694f700 -1 osd.0 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.429732+0000 front 2019-12-08T17:29:28.349593+0000 (oldest deadline 2019-12-08T17:30:12.678282+0000) 2019-12-08T17:30:41.834 INFO:tasks.ceph.mon.b.smithi013.stderr:2019-12-08T17:30:41.827+0000 1a89c700 -1 mon.b@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.2 [v2:172.21.15.79:6802/10448,v1:172.21.15.79:6803/10448] for 43sec e202 v202) 2019-12-08T17:30:41.946 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:30:41.940+0000 1694f700 -1 osd.7 202 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:29:28.544080+0000 front 2019-12-08T17:29:25.238418+0000 (oldest deadline 2019-12-08T17:30:08.471572+0000) 2019-12-08T17:31:40.186 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:31:40.180+0000 1694f700 -1 osd.5 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.478358+0000 front 2019-12-08T17:30:58.569616+0000 (oldest deadline 2019-12-08T17:31:40.091835+0000) 2019-12-08T17:31:40.868 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:31:40.866+0000 1694f700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.965371+0000 front 2019-12-08T17:30:58.176225+0000 (oldest deadline 2019-12-08T17:31:40.233728+0000) 2019-12-08T17:31:41.178 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:31:41.171+0000 1694f700 -1 osd.6 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:55.365032+0000 front 2019-12-08T17:30:55.810031+0000 (oldest deadline 2019-12-08T17:31:40.634686+0000) 2019-12-08T17:31:41.244 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:31:41.237+0000 1694f700 -1 osd.5 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.478358+0000 front 2019-12-08T17:30:58.569616+0000 (oldest deadline 2019-12-08T17:31:40.091835+0000) 2019-12-08T17:31:41.672 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:31:41.666+0000 1694f700 -1 osd.7 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.202583+0000 front 2019-12-08T17:30:58.246419+0000 (oldest deadline 2019-12-08T17:31:41.588427+0000) 2019-12-08T17:31:41.850 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:31:41.848+0000 1694f700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.965371+0000 front 2019-12-08T17:30:58.176225+0000 (oldest deadline 2019-12-08T17:31:40.233728+0000) 2019-12-08T17:31:42.171 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:31:42.164+0000 1694f700 -1 osd.6 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:55.365032+0000 front 2019-12-08T17:30:55.810031+0000 (oldest deadline 2019-12-08T17:31:40.634686+0000) 2019-12-08T17:31:42.242 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:31:42.237+0000 1694f700 -1 osd.5 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.478358+0000 front 2019-12-08T17:30:58.569616+0000 (oldest deadline 2019-12-08T17:31:40.091835+0000) 2019-12-08T17:31:42.688 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:31:42.682+0000 1694f700 -1 osd.7 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.202583+0000 front 2019-12-08T17:30:58.246419+0000 (oldest deadline 2019-12-08T17:31:41.588427+0000) 2019-12-08T17:31:42.819 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:31:42.815+0000 1694f700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.965371+0000 front 2019-12-08T17:30:58.176225+0000 (oldest deadline 2019-12-08T17:31:40.233728+0000) 2019-12-08T17:31:43.128 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:31:43.123+0000 1694f700 -1 osd.6 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:55.365032+0000 front 2019-12-08T17:30:55.810031+0000 (oldest deadline 2019-12-08T17:31:40.634686+0000) 2019-12-08T17:31:43.143 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:31:43.137+0000 1694f700 -1 osd.4 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.662816+0000 front 2019-12-08T17:30:57.708138+0000 (oldest deadline 2019-12-08T17:31:42.856304+0000) 2019-12-08T17:31:43.295 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:31:43.289+0000 1694f700 -1 osd.5 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.478358+0000 front 2019-12-08T17:30:58.569616+0000 (oldest deadline 2019-12-08T17:31:40.091835+0000) 2019-12-08T17:31:43.673 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:31:43.665+0000 1694f700 -1 osd.7 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.202583+0000 front 2019-12-08T17:30:58.246419+0000 (oldest deadline 2019-12-08T17:31:41.588427+0000) 2019-12-08T17:31:43.781 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:31:43.779+0000 1694f700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.965371+0000 front 2019-12-08T17:30:58.176225+0000 (oldest deadline 2019-12-08T17:31:40.233728+0000) 2019-12-08T17:31:44.139 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:31:44.132+0000 1694f700 -1 osd.4 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.662816+0000 front 2019-12-08T17:30:57.708138+0000 (oldest deadline 2019-12-08T17:31:42.856304+0000) 2019-12-08T17:31:44.177 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:31:44.170+0000 1694f700 -1 osd.6 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:55.365032+0000 front 2019-12-08T17:30:55.810031+0000 (oldest deadline 2019-12-08T17:31:40.634686+0000) 2019-12-08T17:31:44.254 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:31:44.248+0000 1694f700 -1 osd.5 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.478358+0000 front 2019-12-08T17:30:58.569616+0000 (oldest deadline 2019-12-08T17:31:40.091835+0000) 2019-12-08T17:31:44.508 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:31:44.506+0000 1694f700 -1 osd.0 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:59.066187+0000 front 2019-12-08T17:30:58.861147+0000 (oldest deadline 2019-12-08T17:31:43.503985+0000) 2019-12-08T17:31:44.630 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:31:44.625+0000 1694f700 -1 osd.7 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.202583+0000 front 2019-12-08T17:30:58.246419+0000 (oldest deadline 2019-12-08T17:31:41.588427+0000) 2019-12-08T17:31:44.760 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:31:44.759+0000 1694f700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.965371+0000 front 2019-12-08T17:30:58.176225+0000 (oldest deadline 2019-12-08T17:31:40.233728+0000) 2019-12-08T17:31:45.144 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:31:45.137+0000 1694f700 -1 osd.6 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:55.365032+0000 front 2019-12-08T17:30:55.810031+0000 (oldest deadline 2019-12-08T17:31:40.634686+0000) 2019-12-08T17:31:45.159 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:31:45.153+0000 1694f700 -1 osd.4 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.662816+0000 front 2019-12-08T17:30:57.708138+0000 (oldest deadline 2019-12-08T17:31:42.856304+0000) 2019-12-08T17:31:45.253 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:31:45.247+0000 1694f700 -1 osd.5 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.478358+0000 front 2019-12-08T17:30:58.569616+0000 (oldest deadline 2019-12-08T17:31:40.091835+0000) 2019-12-08T17:31:45.518 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:31:45.516+0000 1694f700 -1 osd.0 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:59.066187+0000 front 2019-12-08T17:30:58.861147+0000 (oldest deadline 2019-12-08T17:31:43.503985+0000) 2019-12-08T17:31:45.586 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:31:45.580+0000 1694f700 -1 osd.7 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.202583+0000 front 2019-12-08T17:30:58.246419+0000 (oldest deadline 2019-12-08T17:31:41.588427+0000) 2019-12-08T17:31:45.797 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:31:45.795+0000 1694f700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.965371+0000 front 2019-12-08T17:30:58.176225+0000 (oldest deadline 2019-12-08T17:31:40.233728+0000) 2019-12-08T17:31:46.125 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:31:46.119+0000 1694f700 -1 osd.4 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.662816+0000 front 2019-12-08T17:30:57.708138+0000 (oldest deadline 2019-12-08T17:31:42.856304+0000) 2019-12-08T17:31:46.139 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:31:46.133+0000 1694f700 -1 osd.6 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:55.365032+0000 front 2019-12-08T17:30:55.810031+0000 (oldest deadline 2019-12-08T17:31:40.634686+0000) 2019-12-08T17:31:46.246 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:31:46.239+0000 1694f700 -1 osd.5 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.478358+0000 front 2019-12-08T17:30:58.569616+0000 (oldest deadline 2019-12-08T17:31:40.091835+0000) 2019-12-08T17:31:46.517 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:31:46.514+0000 1694f700 -1 osd.0 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:59.066187+0000 front 2019-12-08T17:30:58.861147+0000 (oldest deadline 2019-12-08T17:31:43.503985+0000) 2019-12-08T17:31:46.549 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:31:46.543+0000 1694f700 -1 osd.7 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.202583+0000 front 2019-12-08T17:30:58.246419+0000 (oldest deadline 2019-12-08T17:31:41.588427+0000) 2019-12-08T17:31:46.791 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:31:46.790+0000 1694f700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.965371+0000 front 2019-12-08T17:30:58.176225+0000 (oldest deadline 2019-12-08T17:31:40.233728+0000) 2019-12-08T17:31:47.132 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:31:47.126+0000 1694f700 -1 osd.6 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:55.365032+0000 front 2019-12-08T17:30:55.810031+0000 (oldest deadline 2019-12-08T17:31:40.634686+0000) 2019-12-08T17:31:47.150 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:31:47.145+0000 1694f700 -1 osd.4 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.662816+0000 front 2019-12-08T17:30:57.708138+0000 (oldest deadline 2019-12-08T17:31:42.856304+0000) 2019-12-08T17:31:47.290 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:31:47.284+0000 1694f700 -1 osd.5 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.478358+0000 front 2019-12-08T17:30:58.569616+0000 (oldest deadline 2019-12-08T17:31:40.091835+0000) 2019-12-08T17:31:47.542 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:31:47.540+0000 1694f700 -1 osd.0 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:59.066187+0000 front 2019-12-08T17:30:58.861147+0000 (oldest deadline 2019-12-08T17:31:43.503985+0000) 2019-12-08T17:31:47.593 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:31:47.586+0000 1694f700 -1 osd.7 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.202583+0000 front 2019-12-08T17:30:58.246419+0000 (oldest deadline 2019-12-08T17:31:41.588427+0000) 2019-12-08T17:31:47.831 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:31:47.831+0000 1694f700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.965371+0000 front 2019-12-08T17:30:58.176225+0000 (oldest deadline 2019-12-08T17:31:40.233728+0000) 2019-12-08T17:31:48.125 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:31:48.120+0000 1694f700 -1 osd.6 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:55.365032+0000 front 2019-12-08T17:30:55.810031+0000 (oldest deadline 2019-12-08T17:31:40.634686+0000) 2019-12-08T17:31:48.169 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:31:48.163+0000 1694f700 -1 osd.4 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.662816+0000 front 2019-12-08T17:30:57.708138+0000 (oldest deadline 2019-12-08T17:31:42.856304+0000) 2019-12-08T17:31:48.295 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:31:48.286+0000 1694f700 -1 osd.5 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.478358+0000 front 2019-12-08T17:30:58.569616+0000 (oldest deadline 2019-12-08T17:31:40.091835+0000) 2019-12-08T17:31:48.564 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:31:48.562+0000 1694f700 -1 osd.0 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:59.066187+0000 front 2019-12-08T17:30:58.861147+0000 (oldest deadline 2019-12-08T17:31:43.503985+0000) 2019-12-08T17:31:48.601 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:31:48.597+0000 1694f700 -1 osd.7 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.202583+0000 front 2019-12-08T17:30:58.246419+0000 (oldest deadline 2019-12-08T17:31:41.588427+0000) 2019-12-08T17:31:48.877 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:31:48.874+0000 1694f700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.965371+0000 front 2019-12-08T17:30:58.176225+0000 (oldest deadline 2019-12-08T17:31:40.233728+0000) 2019-12-08T17:31:49.122 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:31:49.118+0000 1694f700 -1 osd.6 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:55.365032+0000 front 2019-12-08T17:30:55.810031+0000 (oldest deadline 2019-12-08T17:31:40.634686+0000) 2019-12-08T17:31:49.133 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:31:49.128+0000 1694f700 -1 osd.4 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.662816+0000 front 2019-12-08T17:30:57.708138+0000 (oldest deadline 2019-12-08T17:31:42.856304+0000) 2019-12-08T17:31:49.279 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:31:49.273+0000 1694f700 -1 osd.5 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.478358+0000 front 2019-12-08T17:30:58.569616+0000 (oldest deadline 2019-12-08T17:31:40.091835+0000) 2019-12-08T17:31:49.538 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:31:49.536+0000 1694f700 -1 osd.0 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:59.066187+0000 front 2019-12-08T17:30:58.861147+0000 (oldest deadline 2019-12-08T17:31:43.503985+0000) 2019-12-08T17:31:49.605 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:31:49.600+0000 1694f700 -1 osd.7 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.202583+0000 front 2019-12-08T17:30:58.246419+0000 (oldest deadline 2019-12-08T17:31:41.588427+0000) 2019-12-08T17:31:49.921 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:31:49.918+0000 1694f700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.965371+0000 front 2019-12-08T17:30:58.176225+0000 (oldest deadline 2019-12-08T17:31:40.233728+0000) 2019-12-08T17:31:50.079 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:31:50.074+0000 1694f700 -1 osd.6 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:55.365032+0000 front 2019-12-08T17:30:55.810031+0000 (oldest deadline 2019-12-08T17:31:40.634686+0000) 2019-12-08T17:31:50.088 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:31:50.087+0000 1694f700 -1 osd.2 209 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e207) 2019-12-08T17:31:50.093 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:31:50.088+0000 1694f700 -1 osd.4 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.662816+0000 front 2019-12-08T17:30:57.708138+0000 (oldest deadline 2019-12-08T17:31:42.856304+0000) 2019-12-08T17:31:50.272 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:31:50.266+0000 1694f700 -1 osd.5 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.478358+0000 front 2019-12-08T17:30:58.569616+0000 (oldest deadline 2019-12-08T17:31:40.091835+0000) 2019-12-08T17:31:50.514 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:31:50.513+0000 1694f700 -1 osd.0 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:59.066187+0000 front 2019-12-08T17:30:58.861147+0000 (oldest deadline 2019-12-08T17:31:43.503985+0000) 2019-12-08T17:31:50.571 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:31:50.565+0000 1694f700 -1 osd.7 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.202583+0000 front 2019-12-08T17:30:58.246419+0000 (oldest deadline 2019-12-08T17:31:41.588427+0000) 2019-12-08T17:31:50.884 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:31:50.883+0000 1694f700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.965371+0000 front 2019-12-08T17:30:58.176225+0000 (oldest deadline 2019-12-08T17:31:40.233728+0000) 2019-12-08T17:31:51.054 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:31:51.049+0000 1694f700 -1 osd.6 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:55.365032+0000 front 2019-12-08T17:30:55.810031+0000 (oldest deadline 2019-12-08T17:31:40.634686+0000) 2019-12-08T17:31:51.058 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:31:51.058+0000 1694f700 -1 osd.2 209 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e207) 2019-12-08T17:31:51.076 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:31:51.072+0000 1694f700 -1 osd.4 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.662816+0000 front 2019-12-08T17:30:57.708138+0000 (oldest deadline 2019-12-08T17:31:42.856304+0000) 2019-12-08T17:31:51.257 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:31:51.252+0000 1694f700 -1 osd.5 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.478358+0000 front 2019-12-08T17:30:58.569616+0000 (oldest deadline 2019-12-08T17:31:40.091835+0000) 2019-12-08T17:31:51.501 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:31:51.499+0000 1694f700 -1 osd.0 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:59.066187+0000 front 2019-12-08T17:30:58.861147+0000 (oldest deadline 2019-12-08T17:31:43.503985+0000) 2019-12-08T17:31:51.579 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:31:51.574+0000 1694f700 -1 osd.7 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.202583+0000 front 2019-12-08T17:30:58.246419+0000 (oldest deadline 2019-12-08T17:31:41.588427+0000) 2019-12-08T17:31:51.843 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:31:51.841+0000 1694f700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.965371+0000 front 2019-12-08T17:30:58.176225+0000 (oldest deadline 2019-12-08T17:31:40.233728+0000) 2019-12-08T17:31:52.072 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:31:52.066+0000 1694f700 -1 osd.6 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:55.365032+0000 front 2019-12-08T17:30:55.810031+0000 (oldest deadline 2019-12-08T17:31:40.634686+0000) 2019-12-08T17:31:52.073 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:31:52.072+0000 1694f700 -1 osd.2 209 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e207) 2019-12-08T17:31:52.084 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:31:52.079+0000 1694f700 -1 osd.4 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.662816+0000 front 2019-12-08T17:30:57.708138+0000 (oldest deadline 2019-12-08T17:31:42.856304+0000) 2019-12-08T17:31:52.227 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:31:52.223+0000 1694f700 -1 osd.5 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.478358+0000 front 2019-12-08T17:30:58.569616+0000 (oldest deadline 2019-12-08T17:31:40.091835+0000) 2019-12-08T17:31:52.459 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:31:52.457+0000 1694f700 -1 osd.0 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:59.066187+0000 front 2019-12-08T17:30:58.861147+0000 (oldest deadline 2019-12-08T17:31:43.503985+0000) 2019-12-08T17:31:52.622 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:31:52.617+0000 1694f700 -1 osd.7 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.202583+0000 front 2019-12-08T17:30:58.246419+0000 (oldest deadline 2019-12-08T17:31:41.588427+0000) 2019-12-08T17:31:52.878 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:31:52.876+0000 1694f700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.965371+0000 front 2019-12-08T17:30:58.176225+0000 (oldest deadline 2019-12-08T17:31:40.233728+0000) 2019-12-08T17:31:53.071 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:31:53.066+0000 1694f700 -1 osd.6 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:55.365032+0000 front 2019-12-08T17:30:55.810031+0000 (oldest deadline 2019-12-08T17:31:40.634686+0000) 2019-12-08T17:31:53.089 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:31:53.089+0000 1694f700 -1 osd.2 209 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e207) 2019-12-08T17:31:53.122 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:31:53.116+0000 1694f700 -1 osd.4 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.662816+0000 front 2019-12-08T17:30:57.708138+0000 (oldest deadline 2019-12-08T17:31:42.856304+0000) 2019-12-08T17:31:53.226 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:31:53.222+0000 1694f700 -1 osd.5 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.478358+0000 front 2019-12-08T17:30:58.569616+0000 (oldest deadline 2019-12-08T17:31:40.091835+0000) 2019-12-08T17:31:53.459 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:31:53.457+0000 1694f700 -1 osd.0 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:59.066187+0000 front 2019-12-08T17:30:58.861147+0000 (oldest deadline 2019-12-08T17:31:43.503985+0000) 2019-12-08T17:31:53.588 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:31:53.583+0000 1694f700 -1 osd.7 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.202583+0000 front 2019-12-08T17:30:58.246419+0000 (oldest deadline 2019-12-08T17:31:41.588427+0000) 2019-12-08T17:31:53.912 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:31:53.911+0000 1694f700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.965371+0000 front 2019-12-08T17:30:58.176225+0000 (oldest deadline 2019-12-08T17:31:40.233728+0000) 2019-12-08T17:31:54.090 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:31:54.084+0000 1694f700 -1 osd.6 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:55.365032+0000 front 2019-12-08T17:30:55.810031+0000 (oldest deadline 2019-12-08T17:31:40.634686+0000) 2019-12-08T17:31:54.137 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:31:54.136+0000 1694f700 -1 osd.2 209 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e207) 2019-12-08T17:31:54.177 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:31:54.172+0000 1694f700 -1 osd.4 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.662816+0000 front 2019-12-08T17:30:57.708138+0000 (oldest deadline 2019-12-08T17:31:42.856304+0000) 2019-12-08T17:31:54.279 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:31:54.273+0000 1694f700 -1 osd.5 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.478358+0000 front 2019-12-08T17:30:58.569616+0000 (oldest deadline 2019-12-08T17:31:40.091835+0000) 2019-12-08T17:31:54.434 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:31:54.430+0000 1694f700 -1 osd.0 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:59.066187+0000 front 2019-12-08T17:30:58.861147+0000 (oldest deadline 2019-12-08T17:31:43.503985+0000) 2019-12-08T17:31:54.631 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:31:54.626+0000 1694f700 -1 osd.7 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.202583+0000 front 2019-12-08T17:30:58.246419+0000 (oldest deadline 2019-12-08T17:31:41.588427+0000) 2019-12-08T17:31:54.871 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:31:54.869+0000 1694f700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.965371+0000 front 2019-12-08T17:30:58.176225+0000 (oldest deadline 2019-12-08T17:31:40.233728+0000) 2019-12-08T17:31:55.097 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:31:55.095+0000 1694f700 -1 osd.2 209 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e207) 2019-12-08T17:31:55.113 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:31:55.109+0000 1694f700 -1 osd.6 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:55.365032+0000 front 2019-12-08T17:30:55.810031+0000 (oldest deadline 2019-12-08T17:31:40.634686+0000) 2019-12-08T17:31:55.163 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:31:55.158+0000 1694f700 -1 osd.4 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.662816+0000 front 2019-12-08T17:30:57.708138+0000 (oldest deadline 2019-12-08T17:31:42.856304+0000) 2019-12-08T17:31:55.250 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:31:55.246+0000 1694f700 -1 osd.5 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.478358+0000 front 2019-12-08T17:30:58.569616+0000 (oldest deadline 2019-12-08T17:31:40.091835+0000) 2019-12-08T17:31:55.457 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:31:55.455+0000 1694f700 -1 osd.0 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:59.066187+0000 front 2019-12-08T17:30:58.861147+0000 (oldest deadline 2019-12-08T17:31:43.503985+0000) 2019-12-08T17:31:55.617 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:31:55.612+0000 1694f700 -1 osd.7 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.202583+0000 front 2019-12-08T17:30:58.246419+0000 (oldest deadline 2019-12-08T17:31:41.588427+0000) 2019-12-08T17:31:55.855 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:31:55.853+0000 1694f700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.965371+0000 front 2019-12-08T17:30:58.176225+0000 (oldest deadline 2019-12-08T17:31:40.233728+0000) 2019-12-08T17:31:56.096 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:31:56.095+0000 1694f700 -1 osd.2 209 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e207) 2019-12-08T17:31:56.123 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:31:56.118+0000 1694f700 -1 osd.6 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:55.365032+0000 front 2019-12-08T17:30:55.810031+0000 (oldest deadline 2019-12-08T17:31:40.634686+0000) 2019-12-08T17:31:56.169 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:31:56.163+0000 1694f700 -1 osd.4 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.662816+0000 front 2019-12-08T17:30:57.708138+0000 (oldest deadline 2019-12-08T17:31:42.856304+0000) 2019-12-08T17:31:56.257 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:31:56.252+0000 1694f700 -1 osd.5 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.478358+0000 front 2019-12-08T17:30:58.569616+0000 (oldest deadline 2019-12-08T17:31:40.091835+0000) 2019-12-08T17:31:56.418 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:31:56.416+0000 1694f700 -1 osd.0 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:59.066187+0000 front 2019-12-08T17:30:58.861147+0000 (oldest deadline 2019-12-08T17:31:43.503985+0000) 2019-12-08T17:31:56.611 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:31:56.606+0000 1694f700 -1 osd.7 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.202583+0000 front 2019-12-08T17:30:58.246419+0000 (oldest deadline 2019-12-08T17:31:41.588427+0000) 2019-12-08T17:31:56.841 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:31:56.839+0000 1694f700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.965371+0000 front 2019-12-08T17:30:58.176225+0000 (oldest deadline 2019-12-08T17:31:40.233728+0000) 2019-12-08T17:31:57.069 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:31:57.067+0000 1694f700 -1 osd.2 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:31:16.598458+0000 (oldest deadline 2019-12-08T17:31:56.598458+0000) 2019-12-08T17:31:57.069 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:31:57.068+0000 1694f700 -1 osd.2 209 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e207) 2019-12-08T17:31:57.140 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:31:57.135+0000 1694f700 -1 osd.6 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:55.365032+0000 front 2019-12-08T17:30:55.810031+0000 (oldest deadline 2019-12-08T17:31:40.634686+0000) 2019-12-08T17:31:57.161 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:31:57.157+0000 1694f700 -1 osd.4 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.662816+0000 front 2019-12-08T17:30:57.708138+0000 (oldest deadline 2019-12-08T17:31:42.856304+0000) 2019-12-08T17:31:57.299 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:31:57.293+0000 1694f700 -1 osd.5 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.478358+0000 front 2019-12-08T17:30:58.569616+0000 (oldest deadline 2019-12-08T17:31:40.091835+0000) 2019-12-08T17:31:57.440 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:31:57.436+0000 1694f700 -1 osd.0 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:59.066187+0000 front 2019-12-08T17:30:58.861147+0000 (oldest deadline 2019-12-08T17:31:43.503985+0000) 2019-12-08T17:31:57.634 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:31:57.630+0000 1694f700 -1 osd.7 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.202583+0000 front 2019-12-08T17:30:58.246419+0000 (oldest deadline 2019-12-08T17:31:41.588427+0000) 2019-12-08T17:31:57.805 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:31:57.802+0000 1694f700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.965371+0000 front 2019-12-08T17:30:58.176225+0000 (oldest deadline 2019-12-08T17:31:40.233728+0000) 2019-12-08T17:31:58.086 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:31:58.082+0000 1694f700 -1 osd.2 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:31:16.598458+0000 (oldest deadline 2019-12-08T17:31:56.598458+0000) 2019-12-08T17:31:58.088 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:31:58.085+0000 1694f700 -1 osd.2 209 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e207) 2019-12-08T17:31:58.157 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:31:58.151+0000 1694f700 -1 osd.4 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.662816+0000 front 2019-12-08T17:30:57.708138+0000 (oldest deadline 2019-12-08T17:31:42.856304+0000) 2019-12-08T17:31:58.171 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:31:58.166+0000 1694f700 -1 osd.6 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:55.365032+0000 front 2019-12-08T17:30:55.810031+0000 (oldest deadline 2019-12-08T17:31:40.634686+0000) 2019-12-08T17:31:58.341 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:31:58.335+0000 1694f700 -1 osd.5 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.478358+0000 front 2019-12-08T17:30:58.569616+0000 (oldest deadline 2019-12-08T17:31:40.091835+0000) 2019-12-08T17:31:58.483 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:31:58.479+0000 1694f700 -1 osd.0 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:59.066187+0000 front 2019-12-08T17:30:58.861147+0000 (oldest deadline 2019-12-08T17:31:43.503985+0000) 2019-12-08T17:31:58.680 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:31:58.675+0000 1694f700 -1 osd.7 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.202583+0000 front 2019-12-08T17:30:58.246419+0000 (oldest deadline 2019-12-08T17:31:41.588427+0000) 2019-12-08T17:31:58.843 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:31:58.841+0000 1694f700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.965371+0000 front 2019-12-08T17:30:58.176225+0000 (oldest deadline 2019-12-08T17:31:40.233728+0000) 2019-12-08T17:31:59.130 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:31:59.126+0000 1694f700 -1 osd.2 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:31:16.598458+0000 (oldest deadline 2019-12-08T17:31:56.598458+0000) 2019-12-08T17:31:59.132 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:31:59.129+0000 1694f700 -1 osd.2 209 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e207) 2019-12-08T17:31:59.134 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:31:59.130+0000 1694f700 -1 osd.6 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:55.365032+0000 front 2019-12-08T17:30:55.810031+0000 (oldest deadline 2019-12-08T17:31:40.634686+0000) 2019-12-08T17:31:59.139 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:31:59.134+0000 1694f700 -1 osd.4 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.662816+0000 front 2019-12-08T17:30:57.708138+0000 (oldest deadline 2019-12-08T17:31:42.856304+0000) 2019-12-08T17:31:59.343 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:31:59.337+0000 1694f700 -1 osd.5 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.478358+0000 front 2019-12-08T17:30:58.569616+0000 (oldest deadline 2019-12-08T17:31:40.091835+0000) 2019-12-08T17:31:59.528 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:31:59.525+0000 1694f700 -1 osd.0 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:59.066187+0000 front 2019-12-08T17:30:58.861147+0000 (oldest deadline 2019-12-08T17:31:43.503985+0000) 2019-12-08T17:31:59.706 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:31:59.702+0000 1694f700 -1 osd.7 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.202583+0000 front 2019-12-08T17:30:58.246419+0000 (oldest deadline 2019-12-08T17:31:41.588427+0000) 2019-12-08T17:31:59.843 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:31:59.840+0000 1694f700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.965371+0000 front 2019-12-08T17:30:58.176225+0000 (oldest deadline 2019-12-08T17:31:40.233728+0000) 2019-12-08T17:32:00.136 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:32:00.130+0000 1694f700 -1 osd.6 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:55.365032+0000 front 2019-12-08T17:30:55.810031+0000 (oldest deadline 2019-12-08T17:31:40.634686+0000) 2019-12-08T17:32:00.147 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:32:00.146+0000 1694f700 -1 osd.2 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:31:16.598458+0000 (oldest deadline 2019-12-08T17:31:56.598458+0000) 2019-12-08T17:32:00.151 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:32:00.149+0000 1694f700 -1 osd.2 209 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e207) 2019-12-08T17:32:00.173 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:32:00.165+0000 1694f700 -1 osd.4 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.662816+0000 front 2019-12-08T17:30:57.708138+0000 (oldest deadline 2019-12-08T17:31:42.856304+0000) 2019-12-08T17:32:00.372 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:32:00.367+0000 1694f700 -1 osd.5 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.478358+0000 front 2019-12-08T17:30:58.569616+0000 (oldest deadline 2019-12-08T17:31:40.091835+0000) 2019-12-08T17:32:00.522 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:32:00.518+0000 1694f700 -1 osd.0 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:59.066187+0000 front 2019-12-08T17:30:58.861147+0000 (oldest deadline 2019-12-08T17:31:43.503985+0000) 2019-12-08T17:32:00.677 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:32:00.672+0000 1694f700 -1 osd.7 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.202583+0000 front 2019-12-08T17:30:58.246419+0000 (oldest deadline 2019-12-08T17:31:41.588427+0000) 2019-12-08T17:32:00.815 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:32:00.813+0000 1694f700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.965371+0000 front 2019-12-08T17:30:58.176225+0000 (oldest deadline 2019-12-08T17:31:40.233728+0000) 2019-12-08T17:32:01.177 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:32:01.172+0000 1694f700 -1 osd.4 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.662816+0000 front 2019-12-08T17:30:57.708138+0000 (oldest deadline 2019-12-08T17:31:42.856304+0000) 2019-12-08T17:32:01.181 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:32:01.179+0000 1694f700 -1 osd.2 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:31:16.598458+0000 (oldest deadline 2019-12-08T17:31:56.598458+0000) 2019-12-08T17:32:01.184 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:32:01.183+0000 1694f700 -1 osd.2 209 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e207) 2019-12-08T17:32:01.188 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:32:01.183+0000 1694f700 -1 osd.6 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:55.365032+0000 front 2019-12-08T17:30:55.810031+0000 (oldest deadline 2019-12-08T17:31:40.634686+0000) 2019-12-08T17:32:01.376 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:32:01.370+0000 1694f700 -1 osd.5 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.478358+0000 front 2019-12-08T17:30:58.569616+0000 (oldest deadline 2019-12-08T17:31:40.091835+0000) 2019-12-08T17:32:01.557 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:32:01.554+0000 1694f700 -1 osd.0 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:59.066187+0000 front 2019-12-08T17:30:58.861147+0000 (oldest deadline 2019-12-08T17:31:43.503985+0000) 2019-12-08T17:32:01.663 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:32:01.658+0000 1694f700 -1 osd.7 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.202583+0000 front 2019-12-08T17:30:58.246419+0000 (oldest deadline 2019-12-08T17:31:41.588427+0000) 2019-12-08T17:32:01.843 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:32:01.840+0000 1694f700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.965371+0000 front 2019-12-08T17:30:58.176225+0000 (oldest deadline 2019-12-08T17:31:40.233728+0000) 2019-12-08T17:32:02.197 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:32:02.194+0000 1694f700 -1 osd.2 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:31:16.598458+0000 (oldest deadline 2019-12-08T17:31:56.598458+0000) 2019-12-08T17:32:02.198 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:32:02.196+0000 1694f700 -1 osd.2 209 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e207) 2019-12-08T17:32:02.205 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:32:02.200+0000 1694f700 -1 osd.4 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.662816+0000 front 2019-12-08T17:30:57.708138+0000 (oldest deadline 2019-12-08T17:31:42.856304+0000) 2019-12-08T17:32:02.206 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:32:02.201+0000 1694f700 -1 osd.6 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:55.365032+0000 front 2019-12-08T17:30:55.810031+0000 (oldest deadline 2019-12-08T17:31:40.634686+0000) 2019-12-08T17:32:02.359 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:32:02.353+0000 1694f700 -1 osd.5 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.478358+0000 front 2019-12-08T17:30:58.569616+0000 (oldest deadline 2019-12-08T17:31:40.091835+0000) 2019-12-08T17:32:02.542 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:32:02.539+0000 1694f700 -1 osd.0 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:59.066187+0000 front 2019-12-08T17:30:58.861147+0000 (oldest deadline 2019-12-08T17:31:43.503985+0000) 2019-12-08T17:32:02.661 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:32:02.656+0000 1694f700 -1 osd.7 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.202583+0000 front 2019-12-08T17:30:58.246419+0000 (oldest deadline 2019-12-08T17:31:41.588427+0000) 2019-12-08T17:32:02.834 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:32:02.833+0000 1694f700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.965371+0000 front 2019-12-08T17:30:58.176225+0000 (oldest deadline 2019-12-08T17:31:40.233728+0000) 2019-12-08T17:32:03.170 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:32:03.165+0000 1694f700 -1 osd.4 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.662816+0000 front 2019-12-08T17:30:57.708138+0000 (oldest deadline 2019-12-08T17:31:42.856304+0000) 2019-12-08T17:32:03.215 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:32:03.213+0000 1694f700 -1 osd.2 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:31:16.598458+0000 (oldest deadline 2019-12-08T17:31:56.598458+0000) 2019-12-08T17:32:03.218 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:32:03.217+0000 1694f700 -1 osd.2 209 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e207) 2019-12-08T17:32:03.243 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:32:03.238+0000 1694f700 -1 osd.6 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:55.365032+0000 front 2019-12-08T17:30:55.810031+0000 (oldest deadline 2019-12-08T17:31:40.634686+0000) 2019-12-08T17:32:03.407 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:32:03.401+0000 1694f700 -1 osd.5 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.478358+0000 front 2019-12-08T17:30:58.569616+0000 (oldest deadline 2019-12-08T17:31:40.091835+0000) 2019-12-08T17:32:03.511 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:32:03.509+0000 1694f700 -1 osd.0 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:59.066187+0000 front 2019-12-08T17:30:58.861147+0000 (oldest deadline 2019-12-08T17:31:43.503985+0000) 2019-12-08T17:32:03.658 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:32:03.652+0000 1694f700 -1 osd.7 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.202583+0000 front 2019-12-08T17:30:58.246419+0000 (oldest deadline 2019-12-08T17:31:41.588427+0000) 2019-12-08T17:32:03.814 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:32:03.811+0000 1694f700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.965371+0000 front 2019-12-08T17:30:58.176225+0000 (oldest deadline 2019-12-08T17:31:40.233728+0000) 2019-12-08T17:32:04.126 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:32:04.121+0000 1694f700 -1 osd.4 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.662816+0000 front 2019-12-08T17:30:57.708138+0000 (oldest deadline 2019-12-08T17:31:42.856304+0000) 2019-12-08T17:32:04.222 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:32:04.217+0000 1694f700 -1 osd.6 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:55.365032+0000 front 2019-12-08T17:30:55.810031+0000 (oldest deadline 2019-12-08T17:31:40.634686+0000) 2019-12-08T17:32:04.240 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:32:04.238+0000 1694f700 -1 osd.2 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:31:16.598458+0000 (oldest deadline 2019-12-08T17:31:56.598458+0000) 2019-12-08T17:32:04.242 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:32:04.240+0000 1694f700 -1 osd.2 209 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e207) 2019-12-08T17:32:04.417 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:32:04.411+0000 1694f700 -1 osd.5 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.478358+0000 front 2019-12-08T17:30:58.569616+0000 (oldest deadline 2019-12-08T17:31:40.091835+0000) 2019-12-08T17:32:04.521 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:32:04.520+0000 1694f700 -1 osd.0 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:59.066187+0000 front 2019-12-08T17:30:58.861147+0000 (oldest deadline 2019-12-08T17:31:43.503985+0000) 2019-12-08T17:32:04.645 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:32:04.640+0000 1694f700 -1 osd.7 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.202583+0000 front 2019-12-08T17:30:58.246419+0000 (oldest deadline 2019-12-08T17:31:41.588427+0000) 2019-12-08T17:32:04.867 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:32:04.864+0000 1694f700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.965371+0000 front 2019-12-08T17:30:58.176225+0000 (oldest deadline 2019-12-08T17:31:40.233728+0000) 2019-12-08T17:32:05.163 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:32:05.157+0000 1694f700 -1 osd.4 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.662816+0000 front 2019-12-08T17:30:57.708138+0000 (oldest deadline 2019-12-08T17:31:42.856304+0000) 2019-12-08T17:32:05.202 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:32:05.196+0000 1694f700 -1 osd.2 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:31:16.598458+0000 (oldest deadline 2019-12-08T17:31:56.598458+0000) 2019-12-08T17:32:05.203 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:32:05.200+0000 1694f700 -1 osd.2 209 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e207) 2019-12-08T17:32:05.206 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:32:05.202+0000 1694f700 -1 osd.6 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:55.365032+0000 front 2019-12-08T17:30:55.810031+0000 (oldest deadline 2019-12-08T17:31:40.634686+0000) 2019-12-08T17:32:05.430 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:32:05.424+0000 1694f700 -1 osd.5 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.478358+0000 front 2019-12-08T17:30:58.569616+0000 (oldest deadline 2019-12-08T17:31:40.091835+0000) 2019-12-08T17:32:05.503 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:32:05.500+0000 1694f700 -1 osd.0 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:59.066187+0000 front 2019-12-08T17:30:58.861147+0000 (oldest deadline 2019-12-08T17:31:43.503985+0000) 2019-12-08T17:32:05.612 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:32:05.607+0000 1694f700 -1 osd.7 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.202583+0000 front 2019-12-08T17:30:58.246419+0000 (oldest deadline 2019-12-08T17:31:41.588427+0000) 2019-12-08T17:32:05.847 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:32:05.844+0000 1694f700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.965371+0000 front 2019-12-08T17:30:58.176225+0000 (oldest deadline 2019-12-08T17:31:40.233728+0000) 2019-12-08T17:32:06.169 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:32:06.163+0000 1694f700 -1 osd.4 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.662816+0000 front 2019-12-08T17:30:57.708138+0000 (oldest deadline 2019-12-08T17:31:42.856304+0000) 2019-12-08T17:32:06.198 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:32:06.195+0000 1694f700 -1 osd.2 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:31:16.598458+0000 (oldest deadline 2019-12-08T17:31:56.598458+0000) 2019-12-08T17:32:06.201 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:32:06.200+0000 1694f700 -1 osd.2 209 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e207) 2019-12-08T17:32:06.207 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:32:06.202+0000 1694f700 -1 osd.6 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:55.365032+0000 front 2019-12-08T17:30:55.810031+0000 (oldest deadline 2019-12-08T17:31:40.634686+0000) 2019-12-08T17:32:06.388 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:32:06.384+0000 1694f700 -1 osd.5 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.478358+0000 front 2019-12-08T17:30:58.569616+0000 (oldest deadline 2019-12-08T17:31:40.091835+0000) 2019-12-08T17:32:06.520 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:32:06.517+0000 1694f700 -1 osd.0 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:59.066187+0000 front 2019-12-08T17:30:58.861147+0000 (oldest deadline 2019-12-08T17:31:43.503985+0000) 2019-12-08T17:32:06.600 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:32:06.595+0000 1694f700 -1 osd.7 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.202583+0000 front 2019-12-08T17:30:58.246419+0000 (oldest deadline 2019-12-08T17:31:41.588427+0000) 2019-12-08T17:32:06.813 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:32:06.810+0000 1694f700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.965371+0000 front 2019-12-08T17:30:58.176225+0000 (oldest deadline 2019-12-08T17:31:40.233728+0000) 2019-12-08T17:32:07.132 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:32:07.126+0000 1694f700 -1 osd.4 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.662816+0000 front 2019-12-08T17:30:57.708138+0000 (oldest deadline 2019-12-08T17:31:42.856304+0000) 2019-12-08T17:32:07.249 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:32:07.244+0000 1694f700 -1 osd.6 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:55.365032+0000 front 2019-12-08T17:30:55.810031+0000 (oldest deadline 2019-12-08T17:31:40.634686+0000) 2019-12-08T17:32:07.256 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:32:07.252+0000 1694f700 -1 osd.2 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:31:16.598458+0000 (oldest deadline 2019-12-08T17:31:56.598458+0000) 2019-12-08T17:32:07.257 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:32:07.256+0000 1694f700 -1 osd.2 209 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e207) 2019-12-08T17:32:07.394 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:32:07.389+0000 1694f700 -1 osd.5 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.478358+0000 front 2019-12-08T17:30:58.569616+0000 (oldest deadline 2019-12-08T17:31:40.091835+0000) 2019-12-08T17:32:07.567 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:32:07.562+0000 1694f700 -1 osd.7 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.202583+0000 front 2019-12-08T17:30:58.246419+0000 (oldest deadline 2019-12-08T17:31:41.588427+0000) 2019-12-08T17:32:07.571 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:32:07.567+0000 1694f700 -1 osd.0 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:59.066187+0000 front 2019-12-08T17:30:58.861147+0000 (oldest deadline 2019-12-08T17:31:43.503985+0000) 2019-12-08T17:32:07.808 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:32:07.805+0000 1694f700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.965371+0000 front 2019-12-08T17:30:58.176225+0000 (oldest deadline 2019-12-08T17:31:40.233728+0000) 2019-12-08T17:32:08.146 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:32:08.137+0000 1694f700 -1 osd.4 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.662816+0000 front 2019-12-08T17:30:57.708138+0000 (oldest deadline 2019-12-08T17:31:42.856304+0000) 2019-12-08T17:32:08.246 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:32:08.241+0000 1694f700 -1 osd.6 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:55.365032+0000 front 2019-12-08T17:30:55.810031+0000 (oldest deadline 2019-12-08T17:31:40.634686+0000) 2019-12-08T17:32:08.295 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:32:08.291+0000 1694f700 -1 osd.2 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:31:16.598458+0000 (oldest deadline 2019-12-08T17:31:56.598458+0000) 2019-12-08T17:32:08.296 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:32:08.294+0000 1694f700 -1 osd.2 209 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e207) 2019-12-08T17:32:08.448 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:32:08.443+0000 1694f700 -1 osd.5 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.478358+0000 front 2019-12-08T17:30:58.569616+0000 (oldest deadline 2019-12-08T17:31:40.091835+0000) 2019-12-08T17:32:08.592 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:32:08.588+0000 1694f700 -1 osd.0 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:59.066187+0000 front 2019-12-08T17:30:58.861147+0000 (oldest deadline 2019-12-08T17:31:43.503985+0000) 2019-12-08T17:32:08.592 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:32:08.583+0000 1694f700 -1 osd.7 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.202583+0000 front 2019-12-08T17:30:58.246419+0000 (oldest deadline 2019-12-08T17:31:41.588427+0000) 2019-12-08T17:32:08.839 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:32:08.837+0000 1694f700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.965371+0000 front 2019-12-08T17:30:58.176225+0000 (oldest deadline 2019-12-08T17:31:40.233728+0000) 2019-12-08T17:32:09.116 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:32:09.110+0000 1694f700 -1 osd.4 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.662816+0000 front 2019-12-08T17:30:57.708138+0000 (oldest deadline 2019-12-08T17:31:42.856304+0000) 2019-12-08T17:32:09.258 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:32:09.254+0000 1694f700 -1 osd.2 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:31:16.598458+0000 (oldest deadline 2019-12-08T17:31:56.598458+0000) 2019-12-08T17:32:09.260 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:32:09.257+0000 1694f700 -1 osd.2 209 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e207) 2019-12-08T17:32:09.281 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:32:09.276+0000 1694f700 -1 osd.6 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:55.365032+0000 front 2019-12-08T17:30:55.810031+0000 (oldest deadline 2019-12-08T17:31:40.634686+0000) 2019-12-08T17:32:09.413 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:32:09.407+0000 1694f700 -1 osd.5 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.478358+0000 front 2019-12-08T17:30:58.569616+0000 (oldest deadline 2019-12-08T17:31:40.091835+0000) 2019-12-08T17:32:09.552 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:32:09.547+0000 1694f700 -1 osd.7 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.202583+0000 front 2019-12-08T17:30:58.246419+0000 (oldest deadline 2019-12-08T17:31:41.588427+0000) 2019-12-08T17:32:09.611 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:32:09.609+0000 1694f700 -1 osd.0 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:59.066187+0000 front 2019-12-08T17:30:58.861147+0000 (oldest deadline 2019-12-08T17:31:43.503985+0000) 2019-12-08T17:32:09.813 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:32:09.810+0000 1694f700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.965371+0000 front 2019-12-08T17:30:58.176225+0000 (oldest deadline 2019-12-08T17:31:40.233728+0000) 2019-12-08T17:32:10.154 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:32:10.149+0000 1694f700 -1 osd.4 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.662816+0000 front 2019-12-08T17:30:57.708138+0000 (oldest deadline 2019-12-08T17:31:42.856304+0000) 2019-12-08T17:32:10.211 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:32:10.209+0000 1694f700 -1 osd.2 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:31:16.598458+0000 (oldest deadline 2019-12-08T17:31:56.598458+0000) 2019-12-08T17:32:10.214 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:32:10.213+0000 1694f700 -1 osd.2 209 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e207) 2019-12-08T17:32:10.265 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:32:10.260+0000 1694f700 -1 osd.6 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:55.365032+0000 front 2019-12-08T17:30:55.810031+0000 (oldest deadline 2019-12-08T17:31:40.634686+0000) 2019-12-08T17:32:10.391 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:32:10.386+0000 1694f700 -1 osd.5 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.478358+0000 front 2019-12-08T17:30:58.569616+0000 (oldest deadline 2019-12-08T17:31:40.091835+0000) 2019-12-08T17:32:10.510 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:32:10.506+0000 1694f700 -1 osd.7 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.202583+0000 front 2019-12-08T17:30:58.246419+0000 (oldest deadline 2019-12-08T17:31:41.588427+0000) 2019-12-08T17:32:10.660 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:32:10.658+0000 1694f700 -1 osd.0 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:59.066187+0000 front 2019-12-08T17:30:58.861147+0000 (oldest deadline 2019-12-08T17:31:43.503985+0000) 2019-12-08T17:32:10.833 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:32:10.831+0000 1694f700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.965371+0000 front 2019-12-08T17:30:58.176225+0000 (oldest deadline 2019-12-08T17:31:40.233728+0000) 2019-12-08T17:32:11.191 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:32:11.185+0000 1694f700 -1 osd.4 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.662816+0000 front 2019-12-08T17:30:57.708138+0000 (oldest deadline 2019-12-08T17:31:42.856304+0000) 2019-12-08T17:32:11.212 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:32:11.209+0000 1694f700 -1 osd.2 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:31:16.598458+0000 (oldest deadline 2019-12-08T17:31:56.598458+0000) 2019-12-08T17:32:11.213 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:32:11.212+0000 1694f700 -1 osd.2 209 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e207) 2019-12-08T17:32:11.296 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:32:11.289+0000 1694f700 -1 osd.6 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:55.365032+0000 front 2019-12-08T17:30:55.810031+0000 (oldest deadline 2019-12-08T17:31:40.634686+0000) 2019-12-08T17:32:11.372 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:32:11.368+0000 1694f700 -1 osd.5 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.478358+0000 front 2019-12-08T17:30:58.569616+0000 (oldest deadline 2019-12-08T17:31:40.091835+0000) 2019-12-08T17:32:11.503 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:32:11.498+0000 1694f700 -1 osd.7 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.202583+0000 front 2019-12-08T17:30:58.246419+0000 (oldest deadline 2019-12-08T17:31:41.588427+0000) 2019-12-08T17:32:11.621 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:32:11.618+0000 1694f700 -1 osd.0 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:59.066187+0000 front 2019-12-08T17:30:58.861147+0000 (oldest deadline 2019-12-08T17:31:43.503985+0000) 2019-12-08T17:32:11.849 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:32:11.845+0000 1694f700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.965371+0000 front 2019-12-08T17:30:58.176225+0000 (oldest deadline 2019-12-08T17:31:40.233728+0000) 2019-12-08T17:32:12.167 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:32:12.162+0000 1694f700 -1 osd.4 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.662816+0000 front 2019-12-08T17:30:57.708138+0000 (oldest deadline 2019-12-08T17:31:42.856304+0000) 2019-12-08T17:32:12.186 INFO:tasks.ceph.mon.b.smithi013.stderr:2019-12-08T17:32:12.182+0000 1a89c700 -1 mon.b@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.1 [v2:172.21.15.79:6810/10449,v1:172.21.15.79:6811/10449] for 42sec e209 v209) 2019-12-08T17:32:12.243 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:32:12.240+0000 1694f700 -1 osd.2 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:31:16.598458+0000 (oldest deadline 2019-12-08T17:31:56.598458+0000) 2019-12-08T17:32:12.244 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:32:12.242+0000 1694f700 -1 osd.2 209 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e207) 2019-12-08T17:32:12.294 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:32:12.289+0000 1694f700 -1 osd.6 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:55.365032+0000 front 2019-12-08T17:30:55.810031+0000 (oldest deadline 2019-12-08T17:31:40.634686+0000) 2019-12-08T17:32:12.362 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:32:12.356+0000 1694f700 -1 osd.5 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.478358+0000 front 2019-12-08T17:30:58.569616+0000 (oldest deadline 2019-12-08T17:31:40.091835+0000) 2019-12-08T17:32:12.475 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:32:12.470+0000 1694f700 -1 osd.7 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.202583+0000 front 2019-12-08T17:30:58.246419+0000 (oldest deadline 2019-12-08T17:31:41.588427+0000) 2019-12-08T17:32:12.672 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:32:12.669+0000 1694f700 -1 osd.0 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:59.066187+0000 front 2019-12-08T17:30:58.861147+0000 (oldest deadline 2019-12-08T17:31:43.503985+0000) 2019-12-08T17:32:12.824 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:32:12.821+0000 1694f700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.965371+0000 front 2019-12-08T17:30:58.176225+0000 (oldest deadline 2019-12-08T17:31:40.233728+0000) 2019-12-08T17:32:13.199 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:32:13.193+0000 1694f700 -1 osd.4 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.662816+0000 front 2019-12-08T17:30:57.708138+0000 (oldest deadline 2019-12-08T17:31:42.856304+0000) 2019-12-08T17:32:13.222 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:32:13.217+0000 1694f700 -1 osd.2 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:31:16.598458+0000 (oldest deadline 2019-12-08T17:31:56.598458+0000) 2019-12-08T17:32:13.223 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:32:13.221+0000 1694f700 -1 osd.2 209 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e207) 2019-12-08T17:32:13.273 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:32:13.268+0000 1694f700 -1 osd.6 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:55.365032+0000 front 2019-12-08T17:30:55.810031+0000 (oldest deadline 2019-12-08T17:31:40.634686+0000) 2019-12-08T17:32:13.399 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:32:13.393+0000 1694f700 -1 osd.5 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.478358+0000 front 2019-12-08T17:30:58.569616+0000 (oldest deadline 2019-12-08T17:31:40.091835+0000) 2019-12-08T17:32:13.494 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:32:13.487+0000 1694f700 -1 osd.7 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.202583+0000 front 2019-12-08T17:30:58.246419+0000 (oldest deadline 2019-12-08T17:31:41.588427+0000) 2019-12-08T17:32:13.655 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:32:13.652+0000 1694f700 -1 osd.0 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:59.066187+0000 front 2019-12-08T17:30:58.861147+0000 (oldest deadline 2019-12-08T17:31:43.503985+0000) 2019-12-08T17:32:13.854 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:32:13.851+0000 1694f700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.965371+0000 front 2019-12-08T17:30:58.176225+0000 (oldest deadline 2019-12-08T17:31:40.233728+0000) 2019-12-08T17:32:14.160 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:32:14.154+0000 1694f700 -1 osd.4 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.662816+0000 front 2019-12-08T17:30:57.708138+0000 (oldest deadline 2019-12-08T17:31:42.856304+0000) 2019-12-08T17:32:14.215 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:32:14.211+0000 1694f700 -1 osd.2 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:31:16.598458+0000 (oldest deadline 2019-12-08T17:31:56.598458+0000) 2019-12-08T17:32:14.217 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:32:14.214+0000 1694f700 -1 osd.2 209 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e207) 2019-12-08T17:32:14.239 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:32:14.233+0000 1694f700 -1 osd.6 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:55.365032+0000 front 2019-12-08T17:30:55.810031+0000 (oldest deadline 2019-12-08T17:31:40.634686+0000) 2019-12-08T17:32:14.399 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:32:14.395+0000 1694f700 -1 osd.5 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.478358+0000 front 2019-12-08T17:30:58.569616+0000 (oldest deadline 2019-12-08T17:31:40.091835+0000) 2019-12-08T17:32:14.513 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:32:14.509+0000 1694f700 -1 osd.7 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.202583+0000 front 2019-12-08T17:30:58.246419+0000 (oldest deadline 2019-12-08T17:31:41.588427+0000) 2019-12-08T17:32:14.642 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:32:14.641+0000 1694f700 -1 osd.0 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:59.066187+0000 front 2019-12-08T17:30:58.861147+0000 (oldest deadline 2019-12-08T17:31:43.503985+0000) 2019-12-08T17:32:14.883 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:32:14.881+0000 1694f700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.965371+0000 front 2019-12-08T17:30:58.176225+0000 (oldest deadline 2019-12-08T17:31:40.233728+0000) 2019-12-08T17:32:15.185 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:32:15.181+0000 1694f700 -1 osd.4 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.662816+0000 front 2019-12-08T17:30:57.708138+0000 (oldest deadline 2019-12-08T17:31:42.856304+0000) 2019-12-08T17:32:15.240 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:32:15.236+0000 1694f700 -1 osd.2 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:31:16.598458+0000 (oldest deadline 2019-12-08T17:31:56.598458+0000) 2019-12-08T17:32:15.242 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:32:15.239+0000 1694f700 -1 osd.2 209 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e207) 2019-12-08T17:32:15.246 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:32:15.240+0000 1694f700 -1 osd.6 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:55.365032+0000 front 2019-12-08T17:30:55.810031+0000 (oldest deadline 2019-12-08T17:31:40.634686+0000) 2019-12-08T17:32:15.361 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:32:15.355+0000 1694f700 -1 osd.5 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.478358+0000 front 2019-12-08T17:30:58.569616+0000 (oldest deadline 2019-12-08T17:31:40.091835+0000) 2019-12-08T17:32:15.489 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:32:15.484+0000 1694f700 -1 osd.7 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.202583+0000 front 2019-12-08T17:30:58.246419+0000 (oldest deadline 2019-12-08T17:31:41.588427+0000) 2019-12-08T17:32:15.649 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:32:15.646+0000 1694f700 -1 osd.0 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:59.066187+0000 front 2019-12-08T17:30:58.861147+0000 (oldest deadline 2019-12-08T17:31:43.503985+0000) 2019-12-08T17:32:15.927 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:32:15.924+0000 1694f700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.965371+0000 front 2019-12-08T17:30:58.176225+0000 (oldest deadline 2019-12-08T17:31:40.233728+0000) 2019-12-08T17:32:16.240 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:32:16.234+0000 1694f700 -1 osd.4 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.662816+0000 front 2019-12-08T17:30:57.708138+0000 (oldest deadline 2019-12-08T17:31:42.856304+0000) 2019-12-08T17:32:16.260 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:32:16.257+0000 1694f700 -1 osd.2 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:31:16.598458+0000 (oldest deadline 2019-12-08T17:31:56.598458+0000) 2019-12-08T17:32:16.264 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:32:16.262+0000 1694f700 -1 osd.2 209 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e207) 2019-12-08T17:32:16.281 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:32:16.276+0000 1694f700 -1 osd.6 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:55.365032+0000 front 2019-12-08T17:30:55.810031+0000 (oldest deadline 2019-12-08T17:31:40.634686+0000) 2019-12-08T17:32:16.353 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:32:16.348+0000 1694f700 -1 osd.5 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.478358+0000 front 2019-12-08T17:30:58.569616+0000 (oldest deadline 2019-12-08T17:31:40.091835+0000) 2019-12-08T17:32:16.473 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:32:16.467+0000 1694f700 -1 osd.7 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.202583+0000 front 2019-12-08T17:30:58.246419+0000 (oldest deadline 2019-12-08T17:31:41.588427+0000) 2019-12-08T17:32:16.623 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:32:16.620+0000 1694f700 -1 osd.0 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:59.066187+0000 front 2019-12-08T17:30:58.861147+0000 (oldest deadline 2019-12-08T17:31:43.503985+0000) 2019-12-08T17:32:16.919 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:32:16.917+0000 1694f700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.965371+0000 front 2019-12-08T17:30:58.176225+0000 (oldest deadline 2019-12-08T17:31:40.233728+0000) 2019-12-08T17:32:17.208 INFO:tasks.ceph.mon.b.smithi013.stderr:2019-12-08T17:32:17.204+0000 1a89c700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.1 [v2:172.21.15.79:6810/10449,v1:172.21.15.79:6811/10449] for 42sec e209 v209) 2019-12-08T17:32:17.233 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:32:17.232+0000 1694f700 -1 osd.2 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:31:16.598458+0000 (oldest deadline 2019-12-08T17:31:56.598458+0000) 2019-12-08T17:32:17.235 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:32:17.234+0000 1694f700 -1 osd.2 209 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e207) 2019-12-08T17:32:17.260 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:32:17.253+0000 1694f700 -1 osd.6 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:55.365032+0000 front 2019-12-08T17:30:55.810031+0000 (oldest deadline 2019-12-08T17:31:40.634686+0000) 2019-12-08T17:32:17.282 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:32:17.275+0000 1694f700 -1 osd.4 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.662816+0000 front 2019-12-08T17:30:57.708138+0000 (oldest deadline 2019-12-08T17:31:42.856304+0000) 2019-12-08T17:32:17.393 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:32:17.388+0000 1694f700 -1 osd.5 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.478358+0000 front 2019-12-08T17:30:58.569616+0000 (oldest deadline 2019-12-08T17:31:40.091835+0000) 2019-12-08T17:32:17.503 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:32:17.497+0000 1694f700 -1 osd.7 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.202583+0000 front 2019-12-08T17:30:58.246419+0000 (oldest deadline 2019-12-08T17:31:41.588427+0000) 2019-12-08T17:32:17.613 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:32:17.611+0000 1694f700 -1 osd.0 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:59.066187+0000 front 2019-12-08T17:30:58.861147+0000 (oldest deadline 2019-12-08T17:31:43.503985+0000) 2019-12-08T17:32:17.879 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:32:17.876+0000 1694f700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.965371+0000 front 2019-12-08T17:30:58.176225+0000 (oldest deadline 2019-12-08T17:31:40.233728+0000) 2019-12-08T17:32:18.280 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:32:18.274+0000 1694f700 -1 osd.4 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.662816+0000 front 2019-12-08T17:30:57.708138+0000 (oldest deadline 2019-12-08T17:31:42.856304+0000) 2019-12-08T17:32:18.281 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:32:18.275+0000 1694f700 -1 osd.6 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:55.365032+0000 front 2019-12-08T17:30:55.810031+0000 (oldest deadline 2019-12-08T17:31:40.634686+0000) 2019-12-08T17:32:18.285 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:32:18.282+0000 1694f700 -1 osd.2 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:31:16.598458+0000 (oldest deadline 2019-12-08T17:31:56.598458+0000) 2019-12-08T17:32:18.287 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:32:18.284+0000 1694f700 -1 osd.2 209 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e207) 2019-12-08T17:32:18.405 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:32:18.400+0000 1694f700 -1 osd.5 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.478358+0000 front 2019-12-08T17:30:58.569616+0000 (oldest deadline 2019-12-08T17:31:40.091835+0000) 2019-12-08T17:32:18.520 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:32:18.515+0000 1694f700 -1 osd.7 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.202583+0000 front 2019-12-08T17:30:58.246419+0000 (oldest deadline 2019-12-08T17:31:41.588427+0000) 2019-12-08T17:32:18.580 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:32:18.579+0000 1694f700 -1 osd.0 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:59.066187+0000 front 2019-12-08T17:30:58.861147+0000 (oldest deadline 2019-12-08T17:31:43.503985+0000) 2019-12-08T17:32:18.919 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:32:18.915+0000 1694f700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.965371+0000 front 2019-12-08T17:30:58.176225+0000 (oldest deadline 2019-12-08T17:31:40.233728+0000) 2019-12-08T17:32:19.238 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:32:19.232+0000 1694f700 -1 osd.6 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:55.365032+0000 front 2019-12-08T17:30:55.810031+0000 (oldest deadline 2019-12-08T17:31:40.634686+0000) 2019-12-08T17:32:19.277 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:32:19.274+0000 1694f700 -1 osd.2 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:31:16.598458+0000 (oldest deadline 2019-12-08T17:31:56.598458+0000) 2019-12-08T17:32:19.278 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:32:19.277+0000 1694f700 -1 osd.2 209 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e207) 2019-12-08T17:32:19.288 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:32:19.283+0000 1694f700 -1 osd.4 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.662816+0000 front 2019-12-08T17:30:57.708138+0000 (oldest deadline 2019-12-08T17:31:42.856304+0000) 2019-12-08T17:32:19.450 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:32:19.445+0000 1694f700 -1 osd.5 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.478358+0000 front 2019-12-08T17:30:58.569616+0000 (oldest deadline 2019-12-08T17:31:40.091835+0000) 2019-12-08T17:32:19.534 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:32:19.526+0000 1694f700 -1 osd.7 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.202583+0000 front 2019-12-08T17:30:58.246419+0000 (oldest deadline 2019-12-08T17:31:41.588427+0000) 2019-12-08T17:32:19.608 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:32:19.605+0000 1694f700 -1 osd.0 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:59.066187+0000 front 2019-12-08T17:30:58.861147+0000 (oldest deadline 2019-12-08T17:31:43.503985+0000) 2019-12-08T17:32:19.929 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:32:19.926+0000 1694f700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.965371+0000 front 2019-12-08T17:30:58.176225+0000 (oldest deadline 2019-12-08T17:31:40.233728+0000) 2019-12-08T17:32:20.266 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:32:20.261+0000 1694f700 -1 osd.4 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.662816+0000 front 2019-12-08T17:30:57.708138+0000 (oldest deadline 2019-12-08T17:31:42.856304+0000) 2019-12-08T17:32:20.289 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:32:20.284+0000 1694f700 -1 osd.6 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:55.365032+0000 front 2019-12-08T17:30:55.810031+0000 (oldest deadline 2019-12-08T17:31:40.634686+0000) 2019-12-08T17:32:20.322 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:32:20.319+0000 1694f700 -1 osd.2 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:31:16.598458+0000 (oldest deadline 2019-12-08T17:31:56.598458+0000) 2019-12-08T17:32:20.324 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:32:20.321+0000 1694f700 -1 osd.2 209 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e207) 2019-12-08T17:32:20.488 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:32:20.482+0000 1694f700 -1 osd.5 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.478358+0000 front 2019-12-08T17:30:58.569616+0000 (oldest deadline 2019-12-08T17:31:40.091835+0000) 2019-12-08T17:32:20.561 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:32:20.556+0000 1694f700 -1 osd.7 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.202583+0000 front 2019-12-08T17:30:58.246419+0000 (oldest deadline 2019-12-08T17:31:41.588427+0000) 2019-12-08T17:32:20.653 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:32:20.651+0000 1694f700 -1 osd.0 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:59.066187+0000 front 2019-12-08T17:30:58.861147+0000 (oldest deadline 2019-12-08T17:31:43.503985+0000) 2019-12-08T17:32:20.929 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:32:20.928+0000 1694f700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.965371+0000 front 2019-12-08T17:30:58.176225+0000 (oldest deadline 2019-12-08T17:31:40.233728+0000) 2019-12-08T17:32:21.300 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:32:21.294+0000 1694f700 -1 osd.6 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:55.365032+0000 front 2019-12-08T17:30:55.810031+0000 (oldest deadline 2019-12-08T17:31:40.634686+0000) 2019-12-08T17:32:21.301 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:32:21.297+0000 1694f700 -1 osd.2 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:31:16.598458+0000 (oldest deadline 2019-12-08T17:31:56.598458+0000) 2019-12-08T17:32:21.301 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:32:21.300+0000 1694f700 -1 osd.2 209 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e207) 2019-12-08T17:32:21.304 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:32:21.297+0000 1694f700 -1 osd.4 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.662816+0000 front 2019-12-08T17:30:57.708138+0000 (oldest deadline 2019-12-08T17:31:42.856304+0000) 2019-12-08T17:32:21.455 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:32:21.449+0000 1694f700 -1 osd.5 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.478358+0000 front 2019-12-08T17:30:58.569616+0000 (oldest deadline 2019-12-08T17:31:40.091835+0000) 2019-12-08T17:32:21.529 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:32:21.522+0000 1694f700 -1 osd.7 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.202583+0000 front 2019-12-08T17:30:58.246419+0000 (oldest deadline 2019-12-08T17:31:41.588427+0000) 2019-12-08T17:32:21.619 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:32:21.617+0000 1694f700 -1 osd.0 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:59.066187+0000 front 2019-12-08T17:30:58.861147+0000 (oldest deadline 2019-12-08T17:31:43.503985+0000) 2019-12-08T17:32:21.902 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:32:21.902+0000 1694f700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.965371+0000 front 2019-12-08T17:30:58.176225+0000 (oldest deadline 2019-12-08T17:31:40.233728+0000) 2019-12-08T17:32:22.235 INFO:tasks.ceph.mon.b.smithi013.stderr:2019-12-08T17:32:22.228+0000 1a89c700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.1 [v2:172.21.15.79:6810/10449,v1:172.21.15.79:6811/10449] for 42sec e209 v209) 2019-12-08T17:32:22.277 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:32:22.271+0000 1694f700 -1 osd.4 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.662816+0000 front 2019-12-08T17:30:57.708138+0000 (oldest deadline 2019-12-08T17:31:42.856304+0000) 2019-12-08T17:32:22.323 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:32:22.318+0000 1694f700 -1 osd.6 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:55.365032+0000 front 2019-12-08T17:30:55.810031+0000 (oldest deadline 2019-12-08T17:31:40.634686+0000) 2019-12-08T17:32:22.333 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:32:22.329+0000 1694f700 -1 osd.2 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:31:16.598458+0000 (oldest deadline 2019-12-08T17:31:56.598458+0000) 2019-12-08T17:32:22.334 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:32:22.333+0000 1694f700 -1 osd.2 209 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e207) 2019-12-08T17:32:22.460 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:32:22.454+0000 1694f700 -1 osd.5 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.478358+0000 front 2019-12-08T17:30:58.569616+0000 (oldest deadline 2019-12-08T17:31:40.091835+0000) 2019-12-08T17:32:22.495 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:32:22.491+0000 1694f700 -1 osd.7 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.202583+0000 front 2019-12-08T17:30:58.246419+0000 (oldest deadline 2019-12-08T17:31:41.588427+0000) 2019-12-08T17:32:22.596 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:32:22.594+0000 1694f700 -1 osd.0 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:59.066187+0000 front 2019-12-08T17:30:58.861147+0000 (oldest deadline 2019-12-08T17:31:43.503985+0000) 2019-12-08T17:32:22.856 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:32:22.855+0000 1694f700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.965371+0000 front 2019-12-08T17:30:58.176225+0000 (oldest deadline 2019-12-08T17:31:40.233728+0000) 2019-12-08T17:32:23.301 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:32:23.295+0000 1694f700 -1 osd.4 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.662816+0000 front 2019-12-08T17:30:57.708138+0000 (oldest deadline 2019-12-08T17:31:42.856304+0000) 2019-12-08T17:32:23.303 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:32:23.299+0000 1694f700 -1 osd.6 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:55.365032+0000 front 2019-12-08T17:30:55.810031+0000 (oldest deadline 2019-12-08T17:31:40.634686+0000) 2019-12-08T17:32:23.314 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:32:23.312+0000 1694f700 -1 osd.2 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:31:16.598458+0000 (oldest deadline 2019-12-08T17:31:56.598458+0000) 2019-12-08T17:32:23.315 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:32:23.315+0000 1694f700 -1 osd.2 209 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e207) 2019-12-08T17:32:23.465 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:32:23.460+0000 1694f700 -1 osd.7 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.202583+0000 front 2019-12-08T17:30:58.246419+0000 (oldest deadline 2019-12-08T17:31:41.588427+0000) 2019-12-08T17:32:23.498 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:32:23.493+0000 1694f700 -1 osd.5 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.478358+0000 front 2019-12-08T17:30:58.569616+0000 (oldest deadline 2019-12-08T17:31:40.091835+0000) 2019-12-08T17:32:23.601 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:32:23.599+0000 1694f700 -1 osd.0 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:59.066187+0000 front 2019-12-08T17:30:58.861147+0000 (oldest deadline 2019-12-08T17:31:43.503985+0000) 2019-12-08T17:32:23.908 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:32:23.907+0000 1694f700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.965371+0000 front 2019-12-08T17:30:58.176225+0000 (oldest deadline 2019-12-08T17:31:40.233728+0000) 2019-12-08T17:32:24.267 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:32:24.262+0000 1694f700 -1 osd.4 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.662816+0000 front 2019-12-08T17:30:57.708138+0000 (oldest deadline 2019-12-08T17:31:42.856304+0000) 2019-12-08T17:32:24.329 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:32:24.327+0000 1694f700 -1 osd.2 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:31:16.598458+0000 (oldest deadline 2019-12-08T17:31:56.598458+0000) 2019-12-08T17:32:24.330 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:32:24.329+0000 1694f700 -1 osd.2 209 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e207) 2019-12-08T17:32:24.335 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:32:24.330+0000 1694f700 -1 osd.6 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:55.365032+0000 front 2019-12-08T17:30:55.810031+0000 (oldest deadline 2019-12-08T17:31:40.634686+0000) 2019-12-08T17:32:24.479 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:32:24.473+0000 1694f700 -1 osd.5 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.478358+0000 front 2019-12-08T17:30:58.569616+0000 (oldest deadline 2019-12-08T17:31:40.091835+0000) 2019-12-08T17:32:24.507 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:32:24.486+0000 1694f700 -1 osd.7 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.202583+0000 front 2019-12-08T17:30:58.246419+0000 (oldest deadline 2019-12-08T17:31:41.588427+0000) 2019-12-08T17:32:24.583 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:32:24.579+0000 1694f700 -1 osd.0 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:59.066187+0000 front 2019-12-08T17:30:58.861147+0000 (oldest deadline 2019-12-08T17:31:43.503985+0000) 2019-12-08T17:32:24.960 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:32:24.958+0000 1694f700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.965371+0000 front 2019-12-08T17:30:58.176225+0000 (oldest deadline 2019-12-08T17:31:40.233728+0000) 2019-12-08T17:32:25.293 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:32:25.287+0000 1694f700 -1 osd.4 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.662816+0000 front 2019-12-08T17:30:57.708138+0000 (oldest deadline 2019-12-08T17:31:42.856304+0000) 2019-12-08T17:32:25.302 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:32:25.297+0000 1694f700 -1 osd.6 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:55.365032+0000 front 2019-12-08T17:30:55.810031+0000 (oldest deadline 2019-12-08T17:31:40.634686+0000) 2019-12-08T17:32:25.315 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:32:25.314+0000 1694f700 -1 osd.2 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:31:16.598458+0000 (oldest deadline 2019-12-08T17:31:56.598458+0000) 2019-12-08T17:32:25.318 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:32:25.318+0000 1694f700 -1 osd.2 209 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e207) 2019-12-08T17:32:25.468 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:32:25.457+0000 1694f700 -1 osd.7 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.202583+0000 front 2019-12-08T17:30:58.246419+0000 (oldest deadline 2019-12-08T17:31:41.588427+0000) 2019-12-08T17:32:25.468 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:32:25.460+0000 1694f700 -1 osd.5 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.478358+0000 front 2019-12-08T17:30:58.569616+0000 (oldest deadline 2019-12-08T17:31:40.091835+0000) 2019-12-08T17:32:25.545 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:32:25.545+0000 1694f700 -1 osd.0 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:59.066187+0000 front 2019-12-08T17:30:58.861147+0000 (oldest deadline 2019-12-08T17:31:43.503985+0000) 2019-12-08T17:32:25.992 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:32:25.991+0000 1694f700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.965371+0000 front 2019-12-08T17:30:58.176225+0000 (oldest deadline 2019-12-08T17:31:40.233728+0000) 2019-12-08T17:32:26.261 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:32:26.255+0000 1694f700 -1 osd.6 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:55.365032+0000 front 2019-12-08T17:30:55.810031+0000 (oldest deadline 2019-12-08T17:31:40.634686+0000) 2019-12-08T17:32:26.266 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:32:26.261+0000 1694f700 -1 osd.4 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.662816+0000 front 2019-12-08T17:30:57.708138+0000 (oldest deadline 2019-12-08T17:31:42.856304+0000) 2019-12-08T17:32:26.370 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:32:26.368+0000 1694f700 -1 osd.2 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:31:16.598458+0000 (oldest deadline 2019-12-08T17:31:56.598458+0000) 2019-12-08T17:32:26.371 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:32:26.370+0000 1694f700 -1 osd.2 209 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e207) 2019-12-08T17:32:26.499 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:32:26.494+0000 1694f700 -1 osd.5 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.478358+0000 front 2019-12-08T17:30:58.569616+0000 (oldest deadline 2019-12-08T17:31:40.091835+0000) 2019-12-08T17:32:26.501 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:32:26.496+0000 1694f700 -1 osd.7 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.202583+0000 front 2019-12-08T17:30:58.246419+0000 (oldest deadline 2019-12-08T17:31:41.588427+0000) 2019-12-08T17:32:26.550 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:32:26.547+0000 1694f700 -1 osd.0 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:59.066187+0000 front 2019-12-08T17:30:58.861147+0000 (oldest deadline 2019-12-08T17:31:43.503985+0000) 2019-12-08T17:32:26.984 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:32:26.982+0000 1694f700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.965371+0000 front 2019-12-08T17:30:58.176225+0000 (oldest deadline 2019-12-08T17:31:40.233728+0000) 2019-12-08T17:32:27.255 INFO:tasks.ceph.mon.b.smithi013.stderr:2019-12-08T17:32:27.251+0000 1a89c700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.1 [v2:172.21.15.79:6810/10449,v1:172.21.15.79:6811/10449] for 42sec e209 v209) 2019-12-08T17:32:27.294 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:32:27.290+0000 1694f700 -1 osd.6 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:55.365032+0000 front 2019-12-08T17:30:55.810031+0000 (oldest deadline 2019-12-08T17:31:40.634686+0000) 2019-12-08T17:32:27.315 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:32:27.310+0000 1694f700 -1 osd.4 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.662816+0000 front 2019-12-08T17:30:57.708138+0000 (oldest deadline 2019-12-08T17:31:42.856304+0000) 2019-12-08T17:32:27.369 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:32:27.365+0000 1694f700 -1 osd.2 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:31:16.598458+0000 (oldest deadline 2019-12-08T17:31:56.598458+0000) 2019-12-08T17:32:27.370 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:32:27.369+0000 1694f700 -1 osd.2 209 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e207) 2019-12-08T17:32:27.485 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:32:27.479+0000 1694f700 -1 osd.5 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.478358+0000 front 2019-12-08T17:30:58.569616+0000 (oldest deadline 2019-12-08T17:31:40.091835+0000) 2019-12-08T17:32:27.506 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:32:27.503+0000 1694f700 -1 osd.0 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:59.066187+0000 front 2019-12-08T17:30:58.861147+0000 (oldest deadline 2019-12-08T17:31:43.503985+0000) 2019-12-08T17:32:27.549 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:32:27.543+0000 1694f700 -1 osd.7 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.202583+0000 front 2019-12-08T17:30:58.246419+0000 (oldest deadline 2019-12-08T17:31:41.588427+0000) 2019-12-08T17:32:28.033 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:32:28.032+0000 1694f700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.965371+0000 front 2019-12-08T17:30:58.176225+0000 (oldest deadline 2019-12-08T17:31:40.233728+0000) 2019-12-08T17:32:28.252 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:32:28.247+0000 1694f700 -1 osd.6 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:55.365032+0000 front 2019-12-08T17:30:55.810031+0000 (oldest deadline 2019-12-08T17:31:40.634686+0000) 2019-12-08T17:32:28.282 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:32:28.270+0000 1694f700 -1 osd.4 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.662816+0000 front 2019-12-08T17:30:57.708138+0000 (oldest deadline 2019-12-08T17:31:42.856304+0000) 2019-12-08T17:32:28.363 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:32:28.362+0000 1694f700 -1 osd.2 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:31:16.598458+0000 (oldest deadline 2019-12-08T17:31:56.598458+0000) 2019-12-08T17:32:28.366 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:32:28.366+0000 1694f700 -1 osd.2 209 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e207) 2019-12-08T17:32:28.516 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:32:28.510+0000 1694f700 -1 osd.5 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.478358+0000 front 2019-12-08T17:30:58.569616+0000 (oldest deadline 2019-12-08T17:31:40.091835+0000) 2019-12-08T17:32:28.525 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:32:28.520+0000 1694f700 -1 osd.7 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.202583+0000 front 2019-12-08T17:30:58.246419+0000 (oldest deadline 2019-12-08T17:31:41.588427+0000) 2019-12-08T17:32:28.535 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:32:28.531+0000 1694f700 -1 osd.0 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:59.066187+0000 front 2019-12-08T17:30:58.861147+0000 (oldest deadline 2019-12-08T17:31:43.503985+0000) 2019-12-08T17:32:28.995 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:32:28.992+0000 1694f700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.965371+0000 front 2019-12-08T17:30:58.176225+0000 (oldest deadline 2019-12-08T17:31:40.233728+0000) 2019-12-08T17:32:29.214 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:32:29.209+0000 1694f700 -1 osd.6 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:55.365032+0000 front 2019-12-08T17:30:55.810031+0000 (oldest deadline 2019-12-08T17:31:40.634686+0000) 2019-12-08T17:32:29.266 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:32:29.260+0000 1694f700 -1 osd.4 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.662816+0000 front 2019-12-08T17:30:57.708138+0000 (oldest deadline 2019-12-08T17:31:42.856304+0000) 2019-12-08T17:32:29.330 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:32:29.327+0000 1694f700 -1 osd.2 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:31:16.598458+0000 (oldest deadline 2019-12-08T17:31:56.598458+0000) 2019-12-08T17:32:29.330 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:32:29.330+0000 1694f700 -1 osd.2 209 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e207) 2019-12-08T17:32:29.508 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:32:29.503+0000 1694f700 -1 osd.7 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.202583+0000 front 2019-12-08T17:30:58.246419+0000 (oldest deadline 2019-12-08T17:31:41.588427+0000) 2019-12-08T17:32:29.514 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:32:29.512+0000 1694f700 -1 osd.0 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:59.066187+0000 front 2019-12-08T17:30:58.861147+0000 (oldest deadline 2019-12-08T17:31:43.503985+0000) 2019-12-08T17:32:29.555 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:32:29.549+0000 1694f700 -1 osd.5 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.478358+0000 front 2019-12-08T17:30:58.569616+0000 (oldest deadline 2019-12-08T17:31:40.091835+0000) 2019-12-08T17:32:30.030 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:32:30.028+0000 1694f700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.965371+0000 front 2019-12-08T17:30:58.176225+0000 (oldest deadline 2019-12-08T17:31:40.233728+0000) 2019-12-08T17:32:30.261 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:32:30.255+0000 1694f700 -1 osd.6 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:55.365032+0000 front 2019-12-08T17:30:55.810031+0000 (oldest deadline 2019-12-08T17:31:40.634686+0000) 2019-12-08T17:32:30.281 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:32:30.275+0000 1694f700 -1 osd.4 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.662816+0000 front 2019-12-08T17:30:57.708138+0000 (oldest deadline 2019-12-08T17:31:42.856304+0000) 2019-12-08T17:32:30.347 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:32:30.347+0000 1694f700 -1 osd.2 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:31:16.598458+0000 (oldest deadline 2019-12-08T17:31:56.598458+0000) 2019-12-08T17:32:30.348 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:32:30.348+0000 1694f700 -1 osd.2 209 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e207) 2019-12-08T17:32:30.466 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:32:30.461+0000 1694f700 -1 osd.7 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.202583+0000 front 2019-12-08T17:30:58.246419+0000 (oldest deadline 2019-12-08T17:31:41.588427+0000) 2019-12-08T17:32:30.485 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:32:30.483+0000 1694f700 -1 osd.0 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:59.066187+0000 front 2019-12-08T17:30:58.861147+0000 (oldest deadline 2019-12-08T17:31:43.503985+0000) 2019-12-08T17:32:30.592 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:32:30.586+0000 1694f700 -1 osd.5 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.478358+0000 front 2019-12-08T17:30:58.569616+0000 (oldest deadline 2019-12-08T17:31:40.091835+0000) 2019-12-08T17:32:31.064 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:32:31.063+0000 1694f700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.965371+0000 front 2019-12-08T17:30:58.176225+0000 (oldest deadline 2019-12-08T17:31:40.233728+0000) 2019-12-08T17:32:31.260 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:32:31.255+0000 1694f700 -1 osd.4 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.662816+0000 front 2019-12-08T17:30:57.708138+0000 (oldest deadline 2019-12-08T17:31:42.856304+0000) 2019-12-08T17:32:31.307 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:32:31.302+0000 1694f700 -1 osd.6 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:55.365032+0000 front 2019-12-08T17:30:55.810031+0000 (oldest deadline 2019-12-08T17:31:40.634686+0000) 2019-12-08T17:32:31.357 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:32:31.355+0000 1694f700 -1 osd.2 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:31:16.598458+0000 (oldest deadline 2019-12-08T17:31:56.598458+0000) 2019-12-08T17:32:31.358 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:32:31.357+0000 1694f700 -1 osd.2 209 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e207) 2019-12-08T17:32:31.485 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:32:31.483+0000 1694f700 -1 osd.0 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:59.066187+0000 front 2019-12-08T17:30:58.861147+0000 (oldest deadline 2019-12-08T17:31:43.503985+0000) 2019-12-08T17:32:31.503 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:32:31.499+0000 1694f700 -1 osd.7 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.202583+0000 front 2019-12-08T17:30:58.246419+0000 (oldest deadline 2019-12-08T17:31:41.588427+0000) 2019-12-08T17:32:31.562 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:32:31.556+0000 1694f700 -1 osd.5 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.478358+0000 front 2019-12-08T17:30:58.569616+0000 (oldest deadline 2019-12-08T17:31:40.091835+0000) 2019-12-08T17:32:32.061 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:32:32.059+0000 1694f700 -1 osd.3 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.965371+0000 front 2019-12-08T17:30:58.176225+0000 (oldest deadline 2019-12-08T17:31:40.233728+0000) 2019-12-08T17:32:32.225 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:32:32.219+0000 1694f700 -1 osd.4 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:57.662816+0000 front 2019-12-08T17:30:57.708138+0000 (oldest deadline 2019-12-08T17:31:42.856304+0000) 2019-12-08T17:32:32.298 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:32:32.293+0000 1694f700 -1 osd.6 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:55.365032+0000 front 2019-12-08T17:30:55.810031+0000 (oldest deadline 2019-12-08T17:31:40.634686+0000) 2019-12-08T17:32:32.363 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:32:32.361+0000 1694f700 -1 osd.2 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:31:16.598458+0000 (oldest deadline 2019-12-08T17:31:56.598458+0000) 2019-12-08T17:32:32.364 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:32:32.363+0000 1694f700 -1 osd.2 209 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e207) 2019-12-08T17:32:32.438 INFO:tasks.ceph.mon.b.smithi013.stderr:2019-12-08T17:32:32.344+0000 1a89c700 -1 mon.b@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.1 [v2:172.21.15.79:6810/10449,v1:172.21.15.79:6811/10449] for 42sec e209 v209) 2019-12-08T17:32:32.455 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:32:32.453+0000 1694f700 -1 osd.0 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:59.066187+0000 front 2019-12-08T17:30:58.861147+0000 (oldest deadline 2019-12-08T17:31:43.503985+0000) 2019-12-08T17:32:32.497 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:32:32.492+0000 1694f700 -1 osd.7 209 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:30:58.202583+0000 front 2019-12-08T17:30:58.246419+0000 (oldest deadline 2019-12-08T17:31:41.588427+0000) 2019-12-08T17:32:34.965 INFO:tasks.rgw.client.0.smithi079.stdout:2019-12-08T17:32:34.966+0000 20e25700 -1 RGWWatcher::handle_error cookie 398287776 err (107) Transport endpoint is not connected 2019-12-08T17:32:48.183 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:32:48.027+0000 1694f700 -1 osd.1 206 get_health_metrics reporting 29 slow ops, oldest is osd_op(client.4449.0:104246 5.f 5.4322fa9f (undecoded) ondisk+write+known_if_redirected e205) 2019-12-08T17:32:49.270 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:32:49.218+0000 1694f700 -1 osd.1 207 get_health_metrics reporting 22 slow ops, oldest is osd_op(client.4449.0:104294 5.9 5.84ada7c9 (undecoded) ondisk+write+known_if_redirected e208) 2019-12-08T17:32:50.762 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:32:50.536+0000 1694f700 -1 osd.1 209 get_health_metrics reporting 22 slow ops, oldest is osd_op(client.4449.0:104302 5.9 5.84ada7c9 (undecoded) ondisk+write+known_if_redirected e209) 2019-12-08T17:32:52.640 INFO:tasks.rgw.client.0.smithi079.stdout:2019-12-08T17:32:52.610+0000 20e25700 -1 RGWWatcher::handle_error cookie 5413283184 err (107) Transport endpoint is not connected 2019-12-08T17:32:57.068 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:32:57.048+0000 33a73700 -1 osd.1 214 build_incremental_map_msg missing incremental map 214 2019-12-08T17:32:57.226 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:32:57.184+0000 3a280700 -1 osd.1 214 build_incremental_map_msg missing incremental map 214 2019-12-08T17:32:57.374 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:32:57.324+0000 34274700 -1 osd.1 214 build_incremental_map_msg missing incremental map 214 2019-12-08T17:32:57.496 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:32:57.464+0000 3aa81700 -1 osd.1 214 build_incremental_map_msg missing incremental map 214 2019-12-08T17:32:58.766 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:05:30:23.469 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T17:32:58.781 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:05:30:23.415 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T17:32:58.783 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:05:30:23.486 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T17:32:58.785 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:05:30:23.420 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T17:32:58.788 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:05:30:23.423 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T17:32:58.789 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:05:30:23.424 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T17:32:59.028 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:05:30:23.662 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T17:32:59.034 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:05:30:23.737 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T17:32:59.099 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:05:30:23.734 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T17:33:01.057 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:33:01.045+0000 34274700 -1 osd.1 215 build_incremental_map_msg missing incremental map 214 2019-12-08T17:34:14.321 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:34:14.317+0000 1694f700 -1 osd.0 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.636157+0000 front 2019-12-08T17:33:34.105423+0000 (oldest deadline 2019-12-08T17:34:13.909725+0000) 2019-12-08T17:34:15.224 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:34:15.221+0000 1694f700 -1 osd.1 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:29.322482+0000 front 2019-12-08T17:33:29.598506+0000 (oldest deadline 2019-12-08T17:34:15.189995+0000) 2019-12-08T17:34:15.284 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:34:15.282+0000 1694f700 -1 osd.0 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.636157+0000 front 2019-12-08T17:33:34.105423+0000 (oldest deadline 2019-12-08T17:34:13.909725+0000) 2019-12-08T17:34:15.427 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:34:15.421+0000 1694f700 -1 osd.4 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.276542+0000 front 2019-12-08T17:33:32.126563+0000 (oldest deadline 2019-12-08T17:34:14.926680+0000) 2019-12-08T17:34:15.437 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:34:15.435+0000 1694f700 -1 osd.3 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:29.360806+0000 front 2019-12-08T17:33:29.585108+0000 (oldest deadline 2019-12-08T17:34:14.901540+0000) 2019-12-08T17:34:15.686 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:34:15.679+0000 1694f700 -1 osd.7 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:33.596414+0000 front 2019-12-08T17:33:33.597983+0000 (oldest deadline 2019-12-08T17:34:15.165198+0000) 2019-12-08T17:34:16.238 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:34:16.232+0000 1694f700 -1 osd.1 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:29.322482+0000 front 2019-12-08T17:33:29.598506+0000 (oldest deadline 2019-12-08T17:34:15.189995+0000) 2019-12-08T17:34:16.306 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:34:16.304+0000 1694f700 -1 osd.0 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.636157+0000 front 2019-12-08T17:33:34.105423+0000 (oldest deadline 2019-12-08T17:34:13.909725+0000) 2019-12-08T17:34:16.444 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:34:16.439+0000 1694f700 -1 osd.4 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.276542+0000 front 2019-12-08T17:33:32.126563+0000 (oldest deadline 2019-12-08T17:34:14.926680+0000) 2019-12-08T17:34:16.474 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:34:16.470+0000 1694f700 -1 osd.3 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:29.360806+0000 front 2019-12-08T17:33:29.585108+0000 (oldest deadline 2019-12-08T17:34:14.901540+0000) 2019-12-08T17:34:16.709 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:34:16.705+0000 1694f700 -1 osd.7 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:33.596414+0000 front 2019-12-08T17:33:33.597983+0000 (oldest deadline 2019-12-08T17:34:15.165198+0000) 2019-12-08T17:34:17.227 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:34:17.224+0000 1694f700 -1 osd.1 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:29.322482+0000 front 2019-12-08T17:33:29.598506+0000 (oldest deadline 2019-12-08T17:34:15.189995+0000) 2019-12-08T17:34:17.272 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:34:17.270+0000 1694f700 -1 osd.0 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.636157+0000 front 2019-12-08T17:33:34.105423+0000 (oldest deadline 2019-12-08T17:34:13.909725+0000) 2019-12-08T17:34:17.445 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:34:17.439+0000 1694f700 -1 osd.4 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.276542+0000 front 2019-12-08T17:33:32.126563+0000 (oldest deadline 2019-12-08T17:34:14.926680+0000) 2019-12-08T17:34:17.483 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:34:17.479+0000 1694f700 -1 osd.3 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:29.360806+0000 front 2019-12-08T17:33:29.585108+0000 (oldest deadline 2019-12-08T17:34:14.901540+0000) 2019-12-08T17:34:17.682 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:34:17.671+0000 1694f700 -1 osd.6 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.618676+0000 front 2019-12-08T17:33:33.590137+0000 (oldest deadline 2019-12-08T17:34:16.650457+0000) 2019-12-08T17:34:17.732 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:34:17.726+0000 1694f700 -1 osd.7 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:33.596414+0000 front 2019-12-08T17:33:33.597983+0000 (oldest deadline 2019-12-08T17:34:15.165198+0000) 2019-12-08T17:34:17.761 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:34:17.755+0000 1694f700 -1 osd.5 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.069249+0000 front 2019-12-08T17:33:33.502946+0000 (oldest deadline 2019-12-08T17:34:17.014180+0000) 2019-12-08T17:34:18.222 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:34:18.221+0000 1694f700 -1 osd.1 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:29.322482+0000 front 2019-12-08T17:33:29.598506+0000 (oldest deadline 2019-12-08T17:34:15.189995+0000) 2019-12-08T17:34:18.249 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:34:18.247+0000 1694f700 -1 osd.0 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.636157+0000 front 2019-12-08T17:33:34.105423+0000 (oldest deadline 2019-12-08T17:34:13.909725+0000) 2019-12-08T17:34:18.429 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:34:18.420+0000 1694f700 -1 osd.4 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.276542+0000 front 2019-12-08T17:33:32.126563+0000 (oldest deadline 2019-12-08T17:34:14.926680+0000) 2019-12-08T17:34:18.498 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:34:18.497+0000 1694f700 -1 osd.3 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:29.360806+0000 front 2019-12-08T17:33:29.585108+0000 (oldest deadline 2019-12-08T17:34:14.901540+0000) 2019-12-08T17:34:18.729 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:34:18.723+0000 1694f700 -1 osd.6 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.618676+0000 front 2019-12-08T17:33:33.590137+0000 (oldest deadline 2019-12-08T17:34:16.650457+0000) 2019-12-08T17:34:18.760 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:34:18.754+0000 1694f700 -1 osd.7 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:33.596414+0000 front 2019-12-08T17:33:33.597983+0000 (oldest deadline 2019-12-08T17:34:15.165198+0000) 2019-12-08T17:34:18.782 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:34:18.776+0000 1694f700 -1 osd.5 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.069249+0000 front 2019-12-08T17:33:33.502946+0000 (oldest deadline 2019-12-08T17:34:17.014180+0000) 2019-12-08T17:34:19.229 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:34:19.226+0000 1694f700 -1 osd.1 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:29.322482+0000 front 2019-12-08T17:33:29.598506+0000 (oldest deadline 2019-12-08T17:34:15.189995+0000) 2019-12-08T17:34:19.278 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:34:19.276+0000 1694f700 -1 osd.0 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.636157+0000 front 2019-12-08T17:33:34.105423+0000 (oldest deadline 2019-12-08T17:34:13.909725+0000) 2019-12-08T17:34:19.405 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:34:19.400+0000 1694f700 -1 osd.4 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.276542+0000 front 2019-12-08T17:33:32.126563+0000 (oldest deadline 2019-12-08T17:34:14.926680+0000) 2019-12-08T17:34:19.497 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:34:19.495+0000 1694f700 -1 osd.3 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:29.360806+0000 front 2019-12-08T17:33:29.585108+0000 (oldest deadline 2019-12-08T17:34:14.901540+0000) 2019-12-08T17:34:19.687 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:34:19.681+0000 1694f700 -1 osd.6 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.618676+0000 front 2019-12-08T17:33:33.590137+0000 (oldest deadline 2019-12-08T17:34:16.650457+0000) 2019-12-08T17:34:19.741 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:34:19.736+0000 1694f700 -1 osd.5 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.069249+0000 front 2019-12-08T17:33:33.502946+0000 (oldest deadline 2019-12-08T17:34:17.014180+0000) 2019-12-08T17:34:19.803 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:34:19.797+0000 1694f700 -1 osd.7 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:33.596414+0000 front 2019-12-08T17:33:33.597983+0000 (oldest deadline 2019-12-08T17:34:15.165198+0000) 2019-12-08T17:34:20.232 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:34:20.229+0000 1694f700 -1 osd.1 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:29.322482+0000 front 2019-12-08T17:33:29.598506+0000 (oldest deadline 2019-12-08T17:34:15.189995+0000) 2019-12-08T17:34:20.278 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:34:20.276+0000 1694f700 -1 osd.0 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.636157+0000 front 2019-12-08T17:33:34.105423+0000 (oldest deadline 2019-12-08T17:34:13.909725+0000) 2019-12-08T17:34:20.450 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:34:20.444+0000 1694f700 -1 osd.4 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.276542+0000 front 2019-12-08T17:33:32.126563+0000 (oldest deadline 2019-12-08T17:34:14.926680+0000) 2019-12-08T17:34:20.529 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:34:20.527+0000 1694f700 -1 osd.3 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:29.360806+0000 front 2019-12-08T17:33:29.585108+0000 (oldest deadline 2019-12-08T17:34:14.901540+0000) 2019-12-08T17:34:20.707 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:34:20.701+0000 1694f700 -1 osd.6 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.618676+0000 front 2019-12-08T17:33:33.590137+0000 (oldest deadline 2019-12-08T17:34:16.650457+0000) 2019-12-08T17:34:20.711 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:34:20.704+0000 1694f700 -1 osd.5 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.069249+0000 front 2019-12-08T17:33:33.502946+0000 (oldest deadline 2019-12-08T17:34:17.014180+0000) 2019-12-08T17:34:20.787 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:34:20.781+0000 1694f700 -1 osd.7 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:33.596414+0000 front 2019-12-08T17:33:33.597983+0000 (oldest deadline 2019-12-08T17:34:15.165198+0000) 2019-12-08T17:34:21.211 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:34:21.209+0000 1694f700 -1 osd.1 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:29.322482+0000 front 2019-12-08T17:33:29.598506+0000 (oldest deadline 2019-12-08T17:34:15.189995+0000) 2019-12-08T17:34:21.279 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:34:21.276+0000 1694f700 -1 osd.0 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.636157+0000 front 2019-12-08T17:33:34.105423+0000 (oldest deadline 2019-12-08T17:34:13.909725+0000) 2019-12-08T17:34:21.422 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:34:21.416+0000 1694f700 -1 osd.4 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.276542+0000 front 2019-12-08T17:33:32.126563+0000 (oldest deadline 2019-12-08T17:34:14.926680+0000) 2019-12-08T17:34:21.534 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:34:21.530+0000 1694f700 -1 osd.3 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:29.360806+0000 front 2019-12-08T17:33:29.585108+0000 (oldest deadline 2019-12-08T17:34:14.901540+0000) 2019-12-08T17:34:21.675 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:34:21.659+0000 1694f700 -1 osd.6 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.618676+0000 front 2019-12-08T17:33:33.590137+0000 (oldest deadline 2019-12-08T17:34:16.650457+0000) 2019-12-08T17:34:21.753 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:34:21.748+0000 1694f700 -1 osd.5 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.069249+0000 front 2019-12-08T17:33:33.502946+0000 (oldest deadline 2019-12-08T17:34:17.014180+0000) 2019-12-08T17:34:21.798 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:34:21.792+0000 1694f700 -1 osd.7 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:33.596414+0000 front 2019-12-08T17:33:33.597983+0000 (oldest deadline 2019-12-08T17:34:15.165198+0000) 2019-12-08T17:34:22.186 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:34:22.184+0000 1694f700 -1 osd.1 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:29.322482+0000 front 2019-12-08T17:33:29.598506+0000 (oldest deadline 2019-12-08T17:34:15.189995+0000) 2019-12-08T17:34:22.266 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:34:22.264+0000 1694f700 -1 osd.0 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.636157+0000 front 2019-12-08T17:33:34.105423+0000 (oldest deadline 2019-12-08T17:34:13.909725+0000) 2019-12-08T17:34:22.475 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:34:22.462+0000 1694f700 -1 osd.4 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.276542+0000 front 2019-12-08T17:33:32.126563+0000 (oldest deadline 2019-12-08T17:34:14.926680+0000) 2019-12-08T17:34:22.571 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:34:22.569+0000 1694f700 -1 osd.3 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:29.360806+0000 front 2019-12-08T17:33:29.585108+0000 (oldest deadline 2019-12-08T17:34:14.901540+0000) 2019-12-08T17:34:22.706 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:34:22.700+0000 1694f700 -1 osd.6 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.618676+0000 front 2019-12-08T17:33:33.590137+0000 (oldest deadline 2019-12-08T17:34:16.650457+0000) 2019-12-08T17:34:22.733 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:34:22.722+0000 1694f700 -1 osd.5 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.069249+0000 front 2019-12-08T17:33:33.502946+0000 (oldest deadline 2019-12-08T17:34:17.014180+0000) 2019-12-08T17:34:22.767 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:34:22.761+0000 1694f700 -1 osd.7 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:33.596414+0000 front 2019-12-08T17:33:33.597983+0000 (oldest deadline 2019-12-08T17:34:15.165198+0000) 2019-12-08T17:34:23.207 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:34:23.205+0000 1694f700 -1 osd.1 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:29.322482+0000 front 2019-12-08T17:33:29.598506+0000 (oldest deadline 2019-12-08T17:34:15.189995+0000) 2019-12-08T17:34:23.255 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:34:23.253+0000 1694f700 -1 osd.0 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.636157+0000 front 2019-12-08T17:33:34.105423+0000 (oldest deadline 2019-12-08T17:34:13.909725+0000) 2019-12-08T17:34:23.447 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:34:23.440+0000 1694f700 -1 osd.4 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.276542+0000 front 2019-12-08T17:33:32.126563+0000 (oldest deadline 2019-12-08T17:34:14.926680+0000) 2019-12-08T17:34:23.612 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:34:23.609+0000 1694f700 -1 osd.3 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:29.360806+0000 front 2019-12-08T17:33:29.585108+0000 (oldest deadline 2019-12-08T17:34:14.901540+0000) 2019-12-08T17:34:23.694 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:34:23.688+0000 1694f700 -1 osd.6 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.618676+0000 front 2019-12-08T17:33:33.590137+0000 (oldest deadline 2019-12-08T17:34:16.650457+0000) 2019-12-08T17:34:23.727 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:34:23.721+0000 1694f700 -1 osd.5 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.069249+0000 front 2019-12-08T17:33:33.502946+0000 (oldest deadline 2019-12-08T17:34:17.014180+0000) 2019-12-08T17:34:23.781 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:34:23.776+0000 1694f700 -1 osd.7 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:33.596414+0000 front 2019-12-08T17:33:33.597983+0000 (oldest deadline 2019-12-08T17:34:15.165198+0000) 2019-12-08T17:34:24.222 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:34:24.220+0000 1694f700 -1 osd.0 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.636157+0000 front 2019-12-08T17:33:34.105423+0000 (oldest deadline 2019-12-08T17:34:13.909725+0000) 2019-12-08T17:34:24.240 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:34:24.237+0000 1694f700 -1 osd.1 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:29.322482+0000 front 2019-12-08T17:33:29.598506+0000 (oldest deadline 2019-12-08T17:34:15.189995+0000) 2019-12-08T17:34:24.466 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:34:24.460+0000 1694f700 -1 osd.4 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.276542+0000 front 2019-12-08T17:33:32.126563+0000 (oldest deadline 2019-12-08T17:34:14.926680+0000) 2019-12-08T17:34:24.574 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:34:24.569+0000 1694f700 -1 osd.3 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:29.360806+0000 front 2019-12-08T17:33:29.585108+0000 (oldest deadline 2019-12-08T17:34:14.901540+0000) 2019-12-08T17:34:24.681 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:34:24.677+0000 1694f700 -1 osd.6 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.618676+0000 front 2019-12-08T17:33:33.590137+0000 (oldest deadline 2019-12-08T17:34:16.650457+0000) 2019-12-08T17:34:24.697 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:34:24.691+0000 1694f700 -1 osd.5 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.069249+0000 front 2019-12-08T17:33:33.502946+0000 (oldest deadline 2019-12-08T17:34:17.014180+0000) 2019-12-08T17:34:24.797 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:34:24.791+0000 1694f700 -1 osd.7 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:33.596414+0000 front 2019-12-08T17:33:33.597983+0000 (oldest deadline 2019-12-08T17:34:15.165198+0000) 2019-12-08T17:34:25.264 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:34:25.261+0000 1694f700 -1 osd.1 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:29.322482+0000 front 2019-12-08T17:33:29.598506+0000 (oldest deadline 2019-12-08T17:34:15.189995+0000) 2019-12-08T17:34:25.266 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:34:25.264+0000 1694f700 -1 osd.0 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.636157+0000 front 2019-12-08T17:33:34.105423+0000 (oldest deadline 2019-12-08T17:34:13.909725+0000) 2019-12-08T17:34:25.474 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:34:25.468+0000 1694f700 -1 osd.4 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.276542+0000 front 2019-12-08T17:33:32.126563+0000 (oldest deadline 2019-12-08T17:34:14.926680+0000) 2019-12-08T17:34:25.579 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:34:25.576+0000 1694f700 -1 osd.3 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:29.360806+0000 front 2019-12-08T17:33:29.585108+0000 (oldest deadline 2019-12-08T17:34:14.901540+0000) 2019-12-08T17:34:25.671 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:34:25.666+0000 1694f700 -1 osd.5 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.069249+0000 front 2019-12-08T17:33:33.502946+0000 (oldest deadline 2019-12-08T17:34:17.014180+0000) 2019-12-08T17:34:25.676 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:34:25.669+0000 1694f700 -1 osd.6 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.618676+0000 front 2019-12-08T17:33:33.590137+0000 (oldest deadline 2019-12-08T17:34:16.650457+0000) 2019-12-08T17:34:25.852 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:34:25.845+0000 1694f700 -1 osd.7 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:33.596414+0000 front 2019-12-08T17:33:33.597983+0000 (oldest deadline 2019-12-08T17:34:15.165198+0000) 2019-12-08T17:34:26.227 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:34:26.225+0000 1694f700 -1 osd.1 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:29.322482+0000 front 2019-12-08T17:33:29.598506+0000 (oldest deadline 2019-12-08T17:34:15.189995+0000) 2019-12-08T17:34:26.244 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:34:26.242+0000 1694f700 -1 osd.0 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.636157+0000 front 2019-12-08T17:33:34.105423+0000 (oldest deadline 2019-12-08T17:34:13.909725+0000) 2019-12-08T17:34:26.501 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:34:26.495+0000 1694f700 -1 osd.4 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.276542+0000 front 2019-12-08T17:33:32.126563+0000 (oldest deadline 2019-12-08T17:34:14.926680+0000) 2019-12-08T17:34:26.558 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:34:26.556+0000 1694f700 -1 osd.3 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:29.360806+0000 front 2019-12-08T17:33:29.585108+0000 (oldest deadline 2019-12-08T17:34:14.901540+0000) 2019-12-08T17:34:26.632 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:34:26.626+0000 1694f700 -1 osd.5 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.069249+0000 front 2019-12-08T17:33:33.502946+0000 (oldest deadline 2019-12-08T17:34:17.014180+0000) 2019-12-08T17:34:26.685 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:34:26.679+0000 1694f700 -1 osd.6 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.618676+0000 front 2019-12-08T17:33:33.590137+0000 (oldest deadline 2019-12-08T17:34:16.650457+0000) 2019-12-08T17:34:26.856 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:34:26.850+0000 1694f700 -1 osd.7 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:33.596414+0000 front 2019-12-08T17:33:33.597983+0000 (oldest deadline 2019-12-08T17:34:15.165198+0000) 2019-12-08T17:34:27.219 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:34:27.217+0000 1694f700 -1 osd.1 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:29.322482+0000 front 2019-12-08T17:33:29.598506+0000 (oldest deadline 2019-12-08T17:34:15.189995+0000) 2019-12-08T17:34:27.227 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:34:27.226+0000 1694f700 -1 osd.0 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.636157+0000 front 2019-12-08T17:33:34.105423+0000 (oldest deadline 2019-12-08T17:34:13.909725+0000) 2019-12-08T17:34:27.466 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:34:27.461+0000 1694f700 -1 osd.4 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.276542+0000 front 2019-12-08T17:33:32.126563+0000 (oldest deadline 2019-12-08T17:34:14.926680+0000) 2019-12-08T17:34:27.546 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:34:27.543+0000 1694f700 -1 osd.3 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:29.360806+0000 front 2019-12-08T17:33:29.585108+0000 (oldest deadline 2019-12-08T17:34:14.901540+0000) 2019-12-08T17:34:27.639 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:34:27.632+0000 1694f700 -1 osd.5 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.069249+0000 front 2019-12-08T17:33:33.502946+0000 (oldest deadline 2019-12-08T17:34:17.014180+0000) 2019-12-08T17:34:27.699 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:34:27.693+0000 1694f700 -1 osd.6 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.618676+0000 front 2019-12-08T17:33:33.590137+0000 (oldest deadline 2019-12-08T17:34:16.650457+0000) 2019-12-08T17:34:27.840 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:34:27.834+0000 1694f700 -1 osd.7 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:33.596414+0000 front 2019-12-08T17:33:33.597983+0000 (oldest deadline 2019-12-08T17:34:15.165198+0000) 2019-12-08T17:34:28.223 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:34:28.221+0000 1694f700 -1 osd.1 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:29.322482+0000 front 2019-12-08T17:33:29.598506+0000 (oldest deadline 2019-12-08T17:34:15.189995+0000) 2019-12-08T17:34:28.240 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:34:28.237+0000 1694f700 -1 osd.0 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.636157+0000 front 2019-12-08T17:33:34.105423+0000 (oldest deadline 2019-12-08T17:34:13.909725+0000) 2019-12-08T17:34:28.437 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:34:28.432+0000 1694f700 -1 osd.4 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.276542+0000 front 2019-12-08T17:33:32.126563+0000 (oldest deadline 2019-12-08T17:34:14.926680+0000) 2019-12-08T17:34:28.597 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:34:28.594+0000 1694f700 -1 osd.3 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:29.360806+0000 front 2019-12-08T17:33:29.585108+0000 (oldest deadline 2019-12-08T17:34:14.901540+0000) 2019-12-08T17:34:28.615 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:34:28.610+0000 1694f700 -1 osd.5 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.069249+0000 front 2019-12-08T17:33:33.502946+0000 (oldest deadline 2019-12-08T17:34:17.014180+0000) 2019-12-08T17:34:28.708 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:34:28.702+0000 1694f700 -1 osd.6 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.618676+0000 front 2019-12-08T17:33:33.590137+0000 (oldest deadline 2019-12-08T17:34:16.650457+0000) 2019-12-08T17:34:28.871 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:34:28.865+0000 1694f700 -1 osd.7 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:33.596414+0000 front 2019-12-08T17:33:33.597983+0000 (oldest deadline 2019-12-08T17:34:15.165198+0000) 2019-12-08T17:34:29.197 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:34:29.194+0000 1694f700 -1 osd.1 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:29.322482+0000 front 2019-12-08T17:33:29.598506+0000 (oldest deadline 2019-12-08T17:34:15.189995+0000) 2019-12-08T17:34:29.275 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:34:29.272+0000 1694f700 -1 osd.0 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.636157+0000 front 2019-12-08T17:33:34.105423+0000 (oldest deadline 2019-12-08T17:34:13.909725+0000) 2019-12-08T17:34:29.403 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:34:29.398+0000 1694f700 -1 osd.4 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.276542+0000 front 2019-12-08T17:33:32.126563+0000 (oldest deadline 2019-12-08T17:34:14.926680+0000) 2019-12-08T17:34:29.572 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:34:29.568+0000 1694f700 -1 osd.3 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:29.360806+0000 front 2019-12-08T17:33:29.585108+0000 (oldest deadline 2019-12-08T17:34:14.901540+0000) 2019-12-08T17:34:29.640 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:34:29.634+0000 1694f700 -1 osd.5 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.069249+0000 front 2019-12-08T17:33:33.502946+0000 (oldest deadline 2019-12-08T17:34:17.014180+0000) 2019-12-08T17:34:29.693 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:34:29.688+0000 1694f700 -1 osd.6 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.618676+0000 front 2019-12-08T17:33:33.590137+0000 (oldest deadline 2019-12-08T17:34:16.650457+0000) 2019-12-08T17:34:29.908 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:34:29.904+0000 1694f700 -1 osd.7 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:33.596414+0000 front 2019-12-08T17:33:33.597983+0000 (oldest deadline 2019-12-08T17:34:15.165198+0000) 2019-12-08T17:34:30.179 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:34:30.177+0000 1694f700 -1 osd.1 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:29.322482+0000 front 2019-12-08T17:33:29.598506+0000 (oldest deadline 2019-12-08T17:34:15.189995+0000) 2019-12-08T17:34:30.325 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:34:30.322+0000 1694f700 -1 osd.0 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.636157+0000 front 2019-12-08T17:33:34.105423+0000 (oldest deadline 2019-12-08T17:34:13.909725+0000) 2019-12-08T17:34:30.413 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:34:30.408+0000 1694f700 -1 osd.4 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.276542+0000 front 2019-12-08T17:33:32.126563+0000 (oldest deadline 2019-12-08T17:34:14.926680+0000) 2019-12-08T17:34:30.590 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:34:30.587+0000 1694f700 -1 osd.3 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:29.360806+0000 front 2019-12-08T17:33:29.585108+0000 (oldest deadline 2019-12-08T17:34:14.901540+0000) 2019-12-08T17:34:30.608 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:34:30.603+0000 1694f700 -1 osd.5 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.069249+0000 front 2019-12-08T17:33:33.502946+0000 (oldest deadline 2019-12-08T17:34:17.014180+0000) 2019-12-08T17:34:30.698 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:34:30.693+0000 1694f700 -1 osd.6 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.618676+0000 front 2019-12-08T17:33:33.590137+0000 (oldest deadline 2019-12-08T17:34:16.650457+0000) 2019-12-08T17:34:30.912 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:34:30.907+0000 1694f700 -1 osd.7 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:33.596414+0000 front 2019-12-08T17:33:33.597983+0000 (oldest deadline 2019-12-08T17:34:15.165198+0000) 2019-12-08T17:34:31.134 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:34:31.132+0000 1694f700 -1 osd.1 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:29.322482+0000 front 2019-12-08T17:33:29.598506+0000 (oldest deadline 2019-12-08T17:34:15.189995+0000) 2019-12-08T17:34:31.289 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:34:31.287+0000 1694f700 -1 osd.0 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.636157+0000 front 2019-12-08T17:33:34.105423+0000 (oldest deadline 2019-12-08T17:34:13.909725+0000) 2019-12-08T17:34:31.407 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:34:31.402+0000 1694f700 -1 osd.4 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.276542+0000 front 2019-12-08T17:33:32.126563+0000 (oldest deadline 2019-12-08T17:34:14.926680+0000) 2019-12-08T17:34:31.596 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:34:31.591+0000 1694f700 -1 osd.5 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.069249+0000 front 2019-12-08T17:33:33.502946+0000 (oldest deadline 2019-12-08T17:34:17.014180+0000) 2019-12-08T17:34:31.620 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:34:31.618+0000 1694f700 -1 osd.3 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:29.360806+0000 front 2019-12-08T17:33:29.585108+0000 (oldest deadline 2019-12-08T17:34:14.901540+0000) 2019-12-08T17:34:31.714 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:34:31.709+0000 1694f700 -1 osd.6 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.618676+0000 front 2019-12-08T17:33:33.590137+0000 (oldest deadline 2019-12-08T17:34:16.650457+0000) 2019-12-08T17:34:31.941 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:34:31.937+0000 1694f700 -1 osd.7 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:33.596414+0000 front 2019-12-08T17:33:33.597983+0000 (oldest deadline 2019-12-08T17:34:15.165198+0000) 2019-12-08T17:34:32.153 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:34:32.150+0000 1694f700 -1 osd.1 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:29.322482+0000 front 2019-12-08T17:33:29.598506+0000 (oldest deadline 2019-12-08T17:34:15.189995+0000) 2019-12-08T17:34:32.267 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:34:32.266+0000 1694f700 -1 osd.0 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.636157+0000 front 2019-12-08T17:33:34.105423+0000 (oldest deadline 2019-12-08T17:34:13.909725+0000) 2019-12-08T17:34:32.457 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:34:32.446+0000 1694f700 -1 osd.4 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.276542+0000 front 2019-12-08T17:33:32.126563+0000 (oldest deadline 2019-12-08T17:34:14.926680+0000) 2019-12-08T17:34:32.565 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:34:32.560+0000 1694f700 -1 osd.5 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.069249+0000 front 2019-12-08T17:33:33.502946+0000 (oldest deadline 2019-12-08T17:34:17.014180+0000) 2019-12-08T17:34:32.603 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:34:32.602+0000 1694f700 -1 osd.3 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:29.360806+0000 front 2019-12-08T17:33:29.585108+0000 (oldest deadline 2019-12-08T17:34:14.901540+0000) 2019-12-08T17:34:32.685 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:34:32.681+0000 1694f700 -1 osd.6 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.618676+0000 front 2019-12-08T17:33:33.590137+0000 (oldest deadline 2019-12-08T17:34:16.650457+0000) 2019-12-08T17:34:32.981 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:34:32.975+0000 1694f700 -1 osd.7 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:33.596414+0000 front 2019-12-08T17:33:33.597983+0000 (oldest deadline 2019-12-08T17:34:15.165198+0000) 2019-12-08T17:34:33.119 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:34:33.118+0000 1694f700 -1 osd.1 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:29.322482+0000 front 2019-12-08T17:33:29.598506+0000 (oldest deadline 2019-12-08T17:34:15.189995+0000) 2019-12-08T17:34:33.230 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:34:33.228+0000 1694f700 -1 osd.0 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.636157+0000 front 2019-12-08T17:33:34.105423+0000 (oldest deadline 2019-12-08T17:34:13.909725+0000) 2019-12-08T17:34:33.474 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:34:33.469+0000 1694f700 -1 osd.4 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.276542+0000 front 2019-12-08T17:33:32.126563+0000 (oldest deadline 2019-12-08T17:34:14.926680+0000) 2019-12-08T17:34:33.607 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:34:33.601+0000 1694f700 -1 osd.5 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.069249+0000 front 2019-12-08T17:33:33.502946+0000 (oldest deadline 2019-12-08T17:34:17.014180+0000) 2019-12-08T17:34:33.646 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:34:33.644+0000 1694f700 -1 osd.3 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:29.360806+0000 front 2019-12-08T17:33:29.585108+0000 (oldest deadline 2019-12-08T17:34:14.901540+0000) 2019-12-08T17:34:33.648 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:34:33.643+0000 1694f700 -1 osd.6 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.618676+0000 front 2019-12-08T17:33:33.590137+0000 (oldest deadline 2019-12-08T17:34:16.650457+0000) 2019-12-08T17:34:34.021 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:34:34.016+0000 1694f700 -1 osd.7 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:33.596414+0000 front 2019-12-08T17:33:33.597983+0000 (oldest deadline 2019-12-08T17:34:15.165198+0000) 2019-12-08T17:34:34.159 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:34:34.157+0000 1694f700 -1 osd.1 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:29.322482+0000 front 2019-12-08T17:33:29.598506+0000 (oldest deadline 2019-12-08T17:34:15.189995+0000) 2019-12-08T17:34:34.212 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:34:34.210+0000 1694f700 -1 osd.0 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.636157+0000 front 2019-12-08T17:33:34.105423+0000 (oldest deadline 2019-12-08T17:34:13.909725+0000) 2019-12-08T17:34:34.513 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:34:34.509+0000 1694f700 -1 osd.4 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.276542+0000 front 2019-12-08T17:33:32.126563+0000 (oldest deadline 2019-12-08T17:34:14.926680+0000) 2019-12-08T17:34:34.618 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:34:34.613+0000 1694f700 -1 osd.6 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.618676+0000 front 2019-12-08T17:33:33.590137+0000 (oldest deadline 2019-12-08T17:34:16.650457+0000) 2019-12-08T17:34:34.633 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:34:34.627+0000 1694f700 -1 osd.5 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.069249+0000 front 2019-12-08T17:33:33.502946+0000 (oldest deadline 2019-12-08T17:34:17.014180+0000) 2019-12-08T17:34:34.686 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:34:34.684+0000 1694f700 -1 osd.3 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:29.360806+0000 front 2019-12-08T17:33:29.585108+0000 (oldest deadline 2019-12-08T17:34:14.901540+0000) 2019-12-08T17:34:35.007 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:34:35.001+0000 1694f700 -1 osd.7 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:33.596414+0000 front 2019-12-08T17:33:33.597983+0000 (oldest deadline 2019-12-08T17:34:15.165198+0000) 2019-12-08T17:34:35.139 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:34:35.137+0000 1694f700 -1 osd.1 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:29.322482+0000 front 2019-12-08T17:33:29.598506+0000 (oldest deadline 2019-12-08T17:34:15.189995+0000) 2019-12-08T17:34:35.195 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:34:35.192+0000 1694f700 -1 osd.0 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.636157+0000 front 2019-12-08T17:33:34.105423+0000 (oldest deadline 2019-12-08T17:34:13.909725+0000) 2019-12-08T17:34:35.521 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:34:35.515+0000 1694f700 -1 osd.4 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.276542+0000 front 2019-12-08T17:33:32.126563+0000 (oldest deadline 2019-12-08T17:34:14.926680+0000) 2019-12-08T17:34:35.632 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:34:35.627+0000 1694f700 -1 osd.6 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.618676+0000 front 2019-12-08T17:33:33.590137+0000 (oldest deadline 2019-12-08T17:34:16.650457+0000) 2019-12-08T17:34:35.650 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:34:35.645+0000 1694f700 -1 osd.5 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.069249+0000 front 2019-12-08T17:33:33.502946+0000 (oldest deadline 2019-12-08T17:34:17.014180+0000) 2019-12-08T17:34:35.717 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:34:35.710+0000 1694f700 -1 osd.3 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:29.360806+0000 front 2019-12-08T17:33:29.585108+0000 (oldest deadline 2019-12-08T17:34:14.901540+0000) 2019-12-08T17:34:35.964 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:34:35.960+0000 1694f700 -1 osd.7 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:33.596414+0000 front 2019-12-08T17:33:33.597983+0000 (oldest deadline 2019-12-08T17:34:15.165198+0000) 2019-12-08T17:34:36.156 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:34:36.153+0000 1694f700 -1 osd.1 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:29.322482+0000 front 2019-12-08T17:33:29.598506+0000 (oldest deadline 2019-12-08T17:34:15.189995+0000) 2019-12-08T17:34:36.248 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:34:36.245+0000 1694f700 -1 osd.0 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.636157+0000 front 2019-12-08T17:33:34.105423+0000 (oldest deadline 2019-12-08T17:34:13.909725+0000) 2019-12-08T17:34:36.565 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:34:36.559+0000 1694f700 -1 osd.4 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.276542+0000 front 2019-12-08T17:33:32.126563+0000 (oldest deadline 2019-12-08T17:34:14.926680+0000) 2019-12-08T17:34:36.596 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:34:36.591+0000 1694f700 -1 osd.6 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.618676+0000 front 2019-12-08T17:33:33.590137+0000 (oldest deadline 2019-12-08T17:34:16.650457+0000) 2019-12-08T17:34:36.630 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:34:36.625+0000 1694f700 -1 osd.5 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.069249+0000 front 2019-12-08T17:33:33.502946+0000 (oldest deadline 2019-12-08T17:34:17.014180+0000) 2019-12-08T17:34:36.719 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:34:36.718+0000 1694f700 -1 osd.3 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:29.360806+0000 front 2019-12-08T17:33:29.585108+0000 (oldest deadline 2019-12-08T17:34:14.901540+0000) 2019-12-08T17:34:36.964 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:34:36.958+0000 1694f700 -1 osd.7 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:33.596414+0000 front 2019-12-08T17:33:33.597983+0000 (oldest deadline 2019-12-08T17:34:15.165198+0000) 2019-12-08T17:34:37.148 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:34:37.146+0000 1694f700 -1 osd.1 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:29.322482+0000 front 2019-12-08T17:33:29.598506+0000 (oldest deadline 2019-12-08T17:34:15.189995+0000) 2019-12-08T17:34:37.299 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:34:37.298+0000 1694f700 -1 osd.0 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.636157+0000 front 2019-12-08T17:33:34.105423+0000 (oldest deadline 2019-12-08T17:34:13.909725+0000) 2019-12-08T17:34:37.590 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:34:37.585+0000 1694f700 -1 osd.5 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.069249+0000 front 2019-12-08T17:33:33.502946+0000 (oldest deadline 2019-12-08T17:34:17.014180+0000) 2019-12-08T17:34:37.617 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:34:37.612+0000 1694f700 -1 osd.4 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.276542+0000 front 2019-12-08T17:33:32.126563+0000 (oldest deadline 2019-12-08T17:34:14.926680+0000) 2019-12-08T17:34:37.627 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:34:37.623+0000 1694f700 -1 osd.6 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.618676+0000 front 2019-12-08T17:33:33.590137+0000 (oldest deadline 2019-12-08T17:34:16.650457+0000) 2019-12-08T17:34:37.725 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:34:37.721+0000 1694f700 -1 osd.3 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:29.360806+0000 front 2019-12-08T17:33:29.585108+0000 (oldest deadline 2019-12-08T17:34:14.901540+0000) 2019-12-08T17:34:37.930 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:34:37.924+0000 1694f700 -1 osd.7 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:33.596414+0000 front 2019-12-08T17:33:33.597983+0000 (oldest deadline 2019-12-08T17:34:15.165198+0000) 2019-12-08T17:34:38.114 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:34:38.111+0000 1694f700 -1 osd.1 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:29.322482+0000 front 2019-12-08T17:33:29.598506+0000 (oldest deadline 2019-12-08T17:34:15.189995+0000) 2019-12-08T17:34:38.307 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:34:38.305+0000 1694f700 -1 osd.0 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.636157+0000 front 2019-12-08T17:33:34.105423+0000 (oldest deadline 2019-12-08T17:34:13.909725+0000) 2019-12-08T17:34:38.579 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:34:38.575+0000 1694f700 -1 osd.5 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.069249+0000 front 2019-12-08T17:33:33.502946+0000 (oldest deadline 2019-12-08T17:34:17.014180+0000) 2019-12-08T17:34:38.621 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:34:38.617+0000 1694f700 -1 osd.6 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.618676+0000 front 2019-12-08T17:33:33.590137+0000 (oldest deadline 2019-12-08T17:34:16.650457+0000) 2019-12-08T17:34:38.658 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:34:38.653+0000 1694f700 -1 osd.4 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.276542+0000 front 2019-12-08T17:33:32.126563+0000 (oldest deadline 2019-12-08T17:34:14.926680+0000) 2019-12-08T17:34:38.732 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:34:38.731+0000 1694f700 -1 osd.3 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:29.360806+0000 front 2019-12-08T17:33:29.585108+0000 (oldest deadline 2019-12-08T17:34:14.901540+0000) 2019-12-08T17:34:38.891 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:34:38.885+0000 1694f700 -1 osd.7 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:33.596414+0000 front 2019-12-08T17:33:33.597983+0000 (oldest deadline 2019-12-08T17:34:15.165198+0000) 2019-12-08T17:34:39.091 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:34:39.088+0000 1694f700 -1 osd.1 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:29.322482+0000 front 2019-12-08T17:33:29.598506+0000 (oldest deadline 2019-12-08T17:34:15.189995+0000) 2019-12-08T17:34:39.349 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:34:39.348+0000 1694f700 -1 osd.0 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.636157+0000 front 2019-12-08T17:33:34.105423+0000 (oldest deadline 2019-12-08T17:34:13.909725+0000) 2019-12-08T17:34:39.585 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:34:39.571+0000 1694f700 -1 osd.5 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.069249+0000 front 2019-12-08T17:33:33.502946+0000 (oldest deadline 2019-12-08T17:34:17.014180+0000) 2019-12-08T17:34:39.602 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:34:39.597+0000 1694f700 -1 osd.6 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.618676+0000 front 2019-12-08T17:33:33.590137+0000 (oldest deadline 2019-12-08T17:34:16.650457+0000) 2019-12-08T17:34:39.663 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:34:39.659+0000 1694f700 -1 osd.4 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.276542+0000 front 2019-12-08T17:33:32.126563+0000 (oldest deadline 2019-12-08T17:34:14.926680+0000) 2019-12-08T17:34:39.780 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:34:39.779+0000 1694f700 -1 osd.3 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:29.360806+0000 front 2019-12-08T17:33:29.585108+0000 (oldest deadline 2019-12-08T17:34:14.901540+0000) 2019-12-08T17:34:39.890 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:34:39.885+0000 1694f700 -1 osd.7 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:33.596414+0000 front 2019-12-08T17:33:33.597983+0000 (oldest deadline 2019-12-08T17:34:15.165198+0000) 2019-12-08T17:34:40.121 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:34:40.119+0000 1694f700 -1 osd.1 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:29.322482+0000 front 2019-12-08T17:33:29.598506+0000 (oldest deadline 2019-12-08T17:34:15.189995+0000) 2019-12-08T17:34:40.314 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:34:40.312+0000 1694f700 -1 osd.0 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.636157+0000 front 2019-12-08T17:33:34.105423+0000 (oldest deadline 2019-12-08T17:34:13.909725+0000) 2019-12-08T17:34:40.569 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:34:40.564+0000 1694f700 -1 osd.5 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.069249+0000 front 2019-12-08T17:33:33.502946+0000 (oldest deadline 2019-12-08T17:34:17.014180+0000) 2019-12-08T17:34:40.616 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:34:40.610+0000 1694f700 -1 osd.6 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.618676+0000 front 2019-12-08T17:33:33.590137+0000 (oldest deadline 2019-12-08T17:34:16.650457+0000) 2019-12-08T17:34:40.688 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:34:40.683+0000 1694f700 -1 osd.4 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.276542+0000 front 2019-12-08T17:33:32.126563+0000 (oldest deadline 2019-12-08T17:34:14.926680+0000) 2019-12-08T17:34:40.789 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:34:40.788+0000 1694f700 -1 osd.3 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:29.360806+0000 front 2019-12-08T17:33:29.585108+0000 (oldest deadline 2019-12-08T17:34:14.901540+0000) 2019-12-08T17:34:40.878 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:34:40.873+0000 1694f700 -1 osd.7 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:33.596414+0000 front 2019-12-08T17:33:33.597983+0000 (oldest deadline 2019-12-08T17:34:15.165198+0000) 2019-12-08T17:34:41.166 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:34:41.164+0000 1694f700 -1 osd.1 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:29.322482+0000 front 2019-12-08T17:33:29.598506+0000 (oldest deadline 2019-12-08T17:34:15.189995+0000) 2019-12-08T17:34:41.337 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:34:41.335+0000 1694f700 -1 osd.0 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.636157+0000 front 2019-12-08T17:33:34.105423+0000 (oldest deadline 2019-12-08T17:34:13.909725+0000) 2019-12-08T17:34:41.566 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:34:41.562+0000 1694f700 -1 osd.5 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.069249+0000 front 2019-12-08T17:33:33.502946+0000 (oldest deadline 2019-12-08T17:34:17.014180+0000) 2019-12-08T17:34:41.637 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:34:41.632+0000 1694f700 -1 osd.6 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.618676+0000 front 2019-12-08T17:33:33.590137+0000 (oldest deadline 2019-12-08T17:34:16.650457+0000) 2019-12-08T17:34:41.729 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:34:41.724+0000 1694f700 -1 osd.4 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.276542+0000 front 2019-12-08T17:33:32.126563+0000 (oldest deadline 2019-12-08T17:34:14.926680+0000) 2019-12-08T17:34:41.752 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:34:41.750+0000 1694f700 -1 osd.3 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:29.360806+0000 front 2019-12-08T17:33:29.585108+0000 (oldest deadline 2019-12-08T17:34:14.901540+0000) 2019-12-08T17:34:41.859 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:34:41.855+0000 1694f700 -1 osd.7 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:33.596414+0000 front 2019-12-08T17:33:33.597983+0000 (oldest deadline 2019-12-08T17:34:15.165198+0000) 2019-12-08T17:34:42.120 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:34:42.119+0000 1694f700 -1 osd.1 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:29.322482+0000 front 2019-12-08T17:33:29.598506+0000 (oldest deadline 2019-12-08T17:34:15.189995+0000) 2019-12-08T17:34:42.380 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:34:42.379+0000 1694f700 -1 osd.0 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.636157+0000 front 2019-12-08T17:33:34.105423+0000 (oldest deadline 2019-12-08T17:34:13.909725+0000) 2019-12-08T17:34:42.604 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:34:42.598+0000 1694f700 -1 osd.5 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.069249+0000 front 2019-12-08T17:33:33.502946+0000 (oldest deadline 2019-12-08T17:34:17.014180+0000) 2019-12-08T17:34:42.659 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:34:42.654+0000 1694f700 -1 osd.6 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.618676+0000 front 2019-12-08T17:33:33.590137+0000 (oldest deadline 2019-12-08T17:34:16.650457+0000) 2019-12-08T17:34:42.686 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:34:42.681+0000 1694f700 -1 osd.4 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.276542+0000 front 2019-12-08T17:33:32.126563+0000 (oldest deadline 2019-12-08T17:34:14.926680+0000) 2019-12-08T17:34:42.774 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:34:42.772+0000 1694f700 -1 osd.3 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:29.360806+0000 front 2019-12-08T17:33:29.585108+0000 (oldest deadline 2019-12-08T17:34:14.901540+0000) 2019-12-08T17:34:42.895 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:34:42.890+0000 1694f700 -1 osd.7 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:33.596414+0000 front 2019-12-08T17:33:33.597983+0000 (oldest deadline 2019-12-08T17:34:15.165198+0000) 2019-12-08T17:34:43.130 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:34:43.129+0000 1694f700 -1 osd.1 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:29.322482+0000 front 2019-12-08T17:33:29.598506+0000 (oldest deadline 2019-12-08T17:34:15.189995+0000) 2019-12-08T17:34:43.421 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:34:43.419+0000 1694f700 -1 osd.0 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.636157+0000 front 2019-12-08T17:33:34.105423+0000 (oldest deadline 2019-12-08T17:34:13.909725+0000) 2019-12-08T17:34:43.636 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:34:43.631+0000 1694f700 -1 osd.5 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.069249+0000 front 2019-12-08T17:33:33.502946+0000 (oldest deadline 2019-12-08T17:34:17.014180+0000) 2019-12-08T17:34:43.677 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:34:43.673+0000 1694f700 -1 osd.6 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.618676+0000 front 2019-12-08T17:33:33.590137+0000 (oldest deadline 2019-12-08T17:34:16.650457+0000) 2019-12-08T17:34:43.693 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:34:43.689+0000 1694f700 -1 osd.4 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.276542+0000 front 2019-12-08T17:33:32.126563+0000 (oldest deadline 2019-12-08T17:34:14.926680+0000) 2019-12-08T17:34:43.798 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:34:43.797+0000 1694f700 -1 osd.3 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:29.360806+0000 front 2019-12-08T17:33:29.585108+0000 (oldest deadline 2019-12-08T17:34:14.901540+0000) 2019-12-08T17:34:43.876 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:34:43.871+0000 1694f700 -1 osd.7 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:33.596414+0000 front 2019-12-08T17:33:33.597983+0000 (oldest deadline 2019-12-08T17:34:15.165198+0000) 2019-12-08T17:34:44.088 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:34:44.087+0000 1694f700 -1 osd.1 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:29.322482+0000 front 2019-12-08T17:33:29.598506+0000 (oldest deadline 2019-12-08T17:34:15.189995+0000) 2019-12-08T17:34:44.437 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:34:44.436+0000 1694f700 -1 osd.0 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.636157+0000 front 2019-12-08T17:33:34.105423+0000 (oldest deadline 2019-12-08T17:34:13.909725+0000) 2019-12-08T17:34:44.605 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:34:44.599+0000 1694f700 -1 osd.5 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.069249+0000 front 2019-12-08T17:33:33.502946+0000 (oldest deadline 2019-12-08T17:34:17.014180+0000) 2019-12-08T17:34:44.706 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:34:44.702+0000 1694f700 -1 osd.6 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.618676+0000 front 2019-12-08T17:33:33.590137+0000 (oldest deadline 2019-12-08T17:34:16.650457+0000) 2019-12-08T17:34:44.729 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:34:44.720+0000 1694f700 -1 osd.4 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.276542+0000 front 2019-12-08T17:33:32.126563+0000 (oldest deadline 2019-12-08T17:34:14.926680+0000) 2019-12-08T17:34:44.847 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:34:44.846+0000 1694f700 -1 osd.3 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:29.360806+0000 front 2019-12-08T17:33:29.585108+0000 (oldest deadline 2019-12-08T17:34:14.901540+0000) 2019-12-08T17:34:44.886 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:34:44.881+0000 1694f700 -1 osd.7 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:33.596414+0000 front 2019-12-08T17:33:33.597983+0000 (oldest deadline 2019-12-08T17:34:15.165198+0000) 2019-12-08T17:34:45.091 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:34:45.090+0000 1694f700 -1 osd.1 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:29.322482+0000 front 2019-12-08T17:33:29.598506+0000 (oldest deadline 2019-12-08T17:34:15.189995+0000) 2019-12-08T17:34:45.449 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:34:45.447+0000 1694f700 -1 osd.0 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.636157+0000 front 2019-12-08T17:33:34.105423+0000 (oldest deadline 2019-12-08T17:34:13.909725+0000) 2019-12-08T17:34:45.653 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:34:45.648+0000 1694f700 -1 osd.5 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.069249+0000 front 2019-12-08T17:33:33.502946+0000 (oldest deadline 2019-12-08T17:34:17.014180+0000) 2019-12-08T17:34:45.738 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:34:45.733+0000 1694f700 -1 osd.6 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.618676+0000 front 2019-12-08T17:33:33.590137+0000 (oldest deadline 2019-12-08T17:34:16.650457+0000) 2019-12-08T17:34:45.752 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:34:45.748+0000 1694f700 -1 osd.4 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.276542+0000 front 2019-12-08T17:33:32.126563+0000 (oldest deadline 2019-12-08T17:34:14.926680+0000) 2019-12-08T17:34:45.836 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:34:45.836+0000 1694f700 -1 osd.3 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:29.360806+0000 front 2019-12-08T17:33:29.585108+0000 (oldest deadline 2019-12-08T17:34:14.901540+0000) 2019-12-08T17:34:45.941 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:34:45.935+0000 1694f700 -1 osd.7 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:33.596414+0000 front 2019-12-08T17:33:33.597983+0000 (oldest deadline 2019-12-08T17:34:15.165198+0000) 2019-12-08T17:34:46.141 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:34:46.139+0000 1694f700 -1 osd.1 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:29.322482+0000 front 2019-12-08T17:33:29.598506+0000 (oldest deadline 2019-12-08T17:34:15.189995+0000) 2019-12-08T17:34:46.470 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:34:46.469+0000 1694f700 -1 osd.0 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.636157+0000 front 2019-12-08T17:33:34.105423+0000 (oldest deadline 2019-12-08T17:34:13.909725+0000) 2019-12-08T17:34:46.610 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:34:46.604+0000 1694f700 -1 osd.5 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.069249+0000 front 2019-12-08T17:33:33.502946+0000 (oldest deadline 2019-12-08T17:34:17.014180+0000) 2019-12-08T17:34:46.731 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:34:46.726+0000 1694f700 -1 osd.4 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.276542+0000 front 2019-12-08T17:33:32.126563+0000 (oldest deadline 2019-12-08T17:34:14.926680+0000) 2019-12-08T17:34:46.778 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:34:46.773+0000 1694f700 -1 osd.6 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.618676+0000 front 2019-12-08T17:33:33.590137+0000 (oldest deadline 2019-12-08T17:34:16.650457+0000) 2019-12-08T17:34:46.833 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:34:46.832+0000 1694f700 -1 osd.3 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:29.360806+0000 front 2019-12-08T17:33:29.585108+0000 (oldest deadline 2019-12-08T17:34:14.901540+0000) 2019-12-08T17:34:46.945 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:34:46.940+0000 1694f700 -1 osd.7 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:33.596414+0000 front 2019-12-08T17:33:33.597983+0000 (oldest deadline 2019-12-08T17:34:15.165198+0000) 2019-12-08T17:34:47.187 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:34:47.186+0000 1694f700 -1 osd.1 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:29.322482+0000 front 2019-12-08T17:33:29.598506+0000 (oldest deadline 2019-12-08T17:34:15.189995+0000) 2019-12-08T17:34:47.479 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:34:47.478+0000 1694f700 -1 osd.0 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.636157+0000 front 2019-12-08T17:33:34.105423+0000 (oldest deadline 2019-12-08T17:34:13.909725+0000) 2019-12-08T17:34:47.643 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:34:47.638+0000 1694f700 -1 osd.5 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.069249+0000 front 2019-12-08T17:33:33.502946+0000 (oldest deadline 2019-12-08T17:34:17.014180+0000) 2019-12-08T17:34:47.719 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:34:47.715+0000 1694f700 -1 osd.4 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.276542+0000 front 2019-12-08T17:33:32.126563+0000 (oldest deadline 2019-12-08T17:34:14.926680+0000) 2019-12-08T17:34:47.736 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:34:47.731+0000 1694f700 -1 osd.6 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.618676+0000 front 2019-12-08T17:33:33.590137+0000 (oldest deadline 2019-12-08T17:34:16.650457+0000) 2019-12-08T17:34:47.824 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:34:47.821+0000 1694f700 -1 osd.3 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:29.360806+0000 front 2019-12-08T17:33:29.585108+0000 (oldest deadline 2019-12-08T17:34:14.901540+0000) 2019-12-08T17:34:47.993 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:34:47.989+0000 1694f700 -1 osd.7 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:33.596414+0000 front 2019-12-08T17:33:33.597983+0000 (oldest deadline 2019-12-08T17:34:15.165198+0000) 2019-12-08T17:34:48.018 INFO:tasks.ceph.mon.b.smithi013.stderr:2019-12-08T17:34:48.014+0000 1a89c700 -1 mon.b@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.2 [v2:172.21.15.79:6802/10448,v1:172.21.15.79:6803/10448] for 47sec e215 v215) 2019-12-08T17:34:48.160 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:34:48.157+0000 1694f700 -1 osd.1 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:29.322482+0000 front 2019-12-08T17:33:29.598506+0000 (oldest deadline 2019-12-08T17:34:15.189995+0000) 2019-12-08T17:34:48.433 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:34:48.432+0000 1694f700 -1 osd.0 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.636157+0000 front 2019-12-08T17:33:34.105423+0000 (oldest deadline 2019-12-08T17:34:13.909725+0000) 2019-12-08T17:34:48.669 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:34:48.665+0000 1694f700 -1 osd.5 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.069249+0000 front 2019-12-08T17:33:33.502946+0000 (oldest deadline 2019-12-08T17:34:17.014180+0000) 2019-12-08T17:34:48.766 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:34:48.762+0000 1694f700 -1 osd.4 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.276542+0000 front 2019-12-08T17:33:32.126563+0000 (oldest deadline 2019-12-08T17:34:14.926680+0000) 2019-12-08T17:34:48.768 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:34:48.765+0000 1694f700 -1 osd.6 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.618676+0000 front 2019-12-08T17:33:33.590137+0000 (oldest deadline 2019-12-08T17:34:16.650457+0000) 2019-12-08T17:34:48.797 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:34:48.796+0000 1694f700 -1 osd.3 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:29.360806+0000 front 2019-12-08T17:33:29.585108+0000 (oldest deadline 2019-12-08T17:34:14.901540+0000) 2019-12-08T17:34:48.949 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:34:48.943+0000 1694f700 -1 osd.7 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:33.596414+0000 front 2019-12-08T17:33:33.597983+0000 (oldest deadline 2019-12-08T17:34:15.165198+0000) 2019-12-08T17:34:49.125 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:34:49.123+0000 1694f700 -1 osd.1 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:29.322482+0000 front 2019-12-08T17:33:29.598506+0000 (oldest deadline 2019-12-08T17:34:15.189995+0000) 2019-12-08T17:34:49.467 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:34:49.466+0000 1694f700 -1 osd.0 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.636157+0000 front 2019-12-08T17:33:34.105423+0000 (oldest deadline 2019-12-08T17:34:13.909725+0000) 2019-12-08T17:34:49.658 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:34:49.653+0000 1694f700 -1 osd.5 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.069249+0000 front 2019-12-08T17:33:33.502946+0000 (oldest deadline 2019-12-08T17:34:17.014180+0000) 2019-12-08T17:34:49.784 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:34:49.779+0000 1694f700 -1 osd.4 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.276542+0000 front 2019-12-08T17:33:32.126563+0000 (oldest deadline 2019-12-08T17:34:14.926680+0000) 2019-12-08T17:34:49.787 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:34:49.782+0000 1694f700 -1 osd.6 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.618676+0000 front 2019-12-08T17:33:33.590137+0000 (oldest deadline 2019-12-08T17:34:16.650457+0000) 2019-12-08T17:34:49.794 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:34:49.793+0000 1694f700 -1 osd.3 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:29.360806+0000 front 2019-12-08T17:33:29.585108+0000 (oldest deadline 2019-12-08T17:34:14.901540+0000) 2019-12-08T17:34:49.982 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:34:49.976+0000 1694f700 -1 osd.7 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:33.596414+0000 front 2019-12-08T17:33:33.597983+0000 (oldest deadline 2019-12-08T17:34:15.165198+0000) 2019-12-08T17:34:50.094 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:34:50.092+0000 1694f700 -1 osd.1 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:29.322482+0000 front 2019-12-08T17:33:29.598506+0000 (oldest deadline 2019-12-08T17:34:15.189995+0000) 2019-12-08T17:34:50.483 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:34:50.481+0000 1694f700 -1 osd.0 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.636157+0000 front 2019-12-08T17:33:34.105423+0000 (oldest deadline 2019-12-08T17:34:13.909725+0000) 2019-12-08T17:34:50.651 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:34:50.646+0000 1694f700 -1 osd.5 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.069249+0000 front 2019-12-08T17:33:33.502946+0000 (oldest deadline 2019-12-08T17:34:17.014180+0000) 2019-12-08T17:34:50.763 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:34:50.759+0000 1694f700 -1 osd.6 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.618676+0000 front 2019-12-08T17:33:33.590137+0000 (oldest deadline 2019-12-08T17:34:16.650457+0000) 2019-12-08T17:34:50.829 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:34:50.824+0000 1694f700 -1 osd.4 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.276542+0000 front 2019-12-08T17:33:32.126563+0000 (oldest deadline 2019-12-08T17:34:14.926680+0000) 2019-12-08T17:34:50.838 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:34:50.836+0000 1694f700 -1 osd.3 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:29.360806+0000 front 2019-12-08T17:33:29.585108+0000 (oldest deadline 2019-12-08T17:34:14.901540+0000) 2019-12-08T17:34:51.019 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:34:51.014+0000 1694f700 -1 osd.7 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:33.596414+0000 front 2019-12-08T17:33:33.597983+0000 (oldest deadline 2019-12-08T17:34:15.165198+0000) 2019-12-08T17:34:51.117 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:34:51.116+0000 1694f700 -1 osd.1 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:29.322482+0000 front 2019-12-08T17:33:29.598506+0000 (oldest deadline 2019-12-08T17:34:15.189995+0000) 2019-12-08T17:34:51.531 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:34:51.530+0000 1694f700 -1 osd.0 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.636157+0000 front 2019-12-08T17:33:34.105423+0000 (oldest deadline 2019-12-08T17:34:13.909725+0000) 2019-12-08T17:34:51.666 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:34:51.661+0000 1694f700 -1 osd.5 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.069249+0000 front 2019-12-08T17:33:33.502946+0000 (oldest deadline 2019-12-08T17:34:17.014180+0000) 2019-12-08T17:34:51.797 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:34:51.792+0000 1694f700 -1 osd.6 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.618676+0000 front 2019-12-08T17:33:33.590137+0000 (oldest deadline 2019-12-08T17:34:16.650457+0000) 2019-12-08T17:34:51.856 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:34:51.853+0000 1694f700 -1 osd.3 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:29.360806+0000 front 2019-12-08T17:33:29.585108+0000 (oldest deadline 2019-12-08T17:34:14.901540+0000) 2019-12-08T17:34:51.864 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:34:51.859+0000 1694f700 -1 osd.4 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.276542+0000 front 2019-12-08T17:33:32.126563+0000 (oldest deadline 2019-12-08T17:34:14.926680+0000) 2019-12-08T17:34:52.005 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:34:52.000+0000 1694f700 -1 osd.7 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:33.596414+0000 front 2019-12-08T17:33:33.597983+0000 (oldest deadline 2019-12-08T17:34:15.165198+0000) 2019-12-08T17:34:52.096 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:34:52.094+0000 1694f700 -1 osd.1 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:29.322482+0000 front 2019-12-08T17:33:29.598506+0000 (oldest deadline 2019-12-08T17:34:15.189995+0000) 2019-12-08T17:34:52.520 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:34:52.517+0000 1694f700 -1 osd.0 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.636157+0000 front 2019-12-08T17:33:34.105423+0000 (oldest deadline 2019-12-08T17:34:13.909725+0000) 2019-12-08T17:34:52.641 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:34:52.636+0000 1694f700 -1 osd.5 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.069249+0000 front 2019-12-08T17:33:33.502946+0000 (oldest deadline 2019-12-08T17:34:17.014180+0000) 2019-12-08T17:34:52.781 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:34:52.777+0000 1694f700 -1 osd.6 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.618676+0000 front 2019-12-08T17:33:33.590137+0000 (oldest deadline 2019-12-08T17:34:16.650457+0000) 2019-12-08T17:34:52.884 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:34:52.880+0000 1694f700 -1 osd.4 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:32.276542+0000 front 2019-12-08T17:33:32.126563+0000 (oldest deadline 2019-12-08T17:34:14.926680+0000) 2019-12-08T17:34:52.898 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:34:52.896+0000 1694f700 -1 osd.3 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:29.360806+0000 front 2019-12-08T17:33:29.585108+0000 (oldest deadline 2019-12-08T17:34:14.901540+0000) 2019-12-08T17:34:53.015 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:34:53.010+0000 1694f700 -1 osd.7 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:33.596414+0000 front 2019-12-08T17:33:33.597983+0000 (oldest deadline 2019-12-08T17:34:15.165198+0000) 2019-12-08T17:34:53.094 INFO:tasks.ceph.mon.b.smithi013.stderr:2019-12-08T17:34:53.091+0000 1a89c700 -1 mon.b@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.2 [v2:172.21.15.79:6802/10448,v1:172.21.15.79:6803/10448] for 47sec e215 v215) 2019-12-08T17:34:53.115 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:34:53.114+0000 1694f700 -1 osd.1 215 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:33:29.322482+0000 front 2019-12-08T17:33:29.598506+0000 (oldest deadline 2019-12-08T17:34:15.189995+0000) 2019-12-08T17:35:03.501 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:05:32:28.203 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T17:35:03.552 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:05:32:28.255 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T17:35:03.589 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:05:32:28.224 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T17:35:03.615 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:05:32:28.249 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T17:35:03.636 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:05:32:28.271 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T17:35:03.639 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:05:32:28.273 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T17:35:03.747 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:05:32:28.382 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T17:35:03.763 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:05:32:28.398 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T17:35:03.816 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:05:32:28.518 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T17:35:50.571 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:35:50.565+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:09.491799+0000 front 2019-12-08T17:35:09.577880+0000 (oldest deadline 2019-12-08T17:35:50.562578+0000) 2019-12-08T17:35:50.713 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:35:50.708+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:07.891947+0000 front 2019-12-08T17:35:08.005515+0000 (oldest deadline 2019-12-08T17:35:50.637056+0000) 2019-12-08T17:35:51.422 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:35:51.419+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:08.975354+0000 front 2019-12-08T17:35:08.844427+0000 (oldest deadline 2019-12-08T17:35:50.447777+0000) 2019-12-08T17:35:51.427 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:35:51.422+0000 1694f700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:06.946681+0000 front 2019-12-08T17:35:06.951892+0000 (oldest deadline 2019-12-08T17:35:50.425881+0000) 2019-12-08T17:35:51.553 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:35:51.551+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:05.412335+0000 front 2019-12-08T17:35:05.376978+0000 (oldest deadline 2019-12-08T17:35:50.677187+0000) 2019-12-08T17:35:51.582 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:35:51.577+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:09.491799+0000 front 2019-12-08T17:35:09.577880+0000 (oldest deadline 2019-12-08T17:35:50.562578+0000) 2019-12-08T17:35:51.735 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:35:51.730+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:07.891947+0000 front 2019-12-08T17:35:08.005515+0000 (oldest deadline 2019-12-08T17:35:50.637056+0000) 2019-12-08T17:35:52.216 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:35:52.207+0000 1694f700 -1 osd.7 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:08.172056+0000 front 2019-12-08T17:35:08.133922+0000 (oldest deadline 2019-12-08T17:35:51.487003+0000) 2019-12-08T17:35:52.404 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:35:52.402+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:08.975354+0000 front 2019-12-08T17:35:08.844427+0000 (oldest deadline 2019-12-08T17:35:50.447777+0000) 2019-12-08T17:35:52.455 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:35:52.449+0000 1694f700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:06.946681+0000 front 2019-12-08T17:35:06.951892+0000 (oldest deadline 2019-12-08T17:35:50.425881+0000) 2019-12-08T17:35:52.558 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:35:52.552+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:09.491799+0000 front 2019-12-08T17:35:09.577880+0000 (oldest deadline 2019-12-08T17:35:50.562578+0000) 2019-12-08T17:35:52.587 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:35:52.584+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:05.412335+0000 front 2019-12-08T17:35:05.376978+0000 (oldest deadline 2019-12-08T17:35:50.677187+0000) 2019-12-08T17:35:52.744 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:35:52.739+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:07.891947+0000 front 2019-12-08T17:35:08.005515+0000 (oldest deadline 2019-12-08T17:35:50.637056+0000) 2019-12-08T17:35:53.186 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:35:53.182+0000 1694f700 -1 osd.7 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:08.172056+0000 front 2019-12-08T17:35:08.133922+0000 (oldest deadline 2019-12-08T17:35:51.487003+0000) 2019-12-08T17:35:53.379 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:35:53.376+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:08.975354+0000 front 2019-12-08T17:35:08.844427+0000 (oldest deadline 2019-12-08T17:35:50.447777+0000) 2019-12-08T17:35:53.444 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:35:53.439+0000 1694f700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:06.946681+0000 front 2019-12-08T17:35:06.951892+0000 (oldest deadline 2019-12-08T17:35:50.425881+0000) 2019-12-08T17:35:53.524 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:35:53.519+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:09.491799+0000 front 2019-12-08T17:35:09.577880+0000 (oldest deadline 2019-12-08T17:35:50.562578+0000) 2019-12-08T17:35:53.581 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:35:53.577+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:05.412335+0000 front 2019-12-08T17:35:05.376978+0000 (oldest deadline 2019-12-08T17:35:50.677187+0000) 2019-12-08T17:35:53.768 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:35:53.762+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:07.891947+0000 front 2019-12-08T17:35:08.005515+0000 (oldest deadline 2019-12-08T17:35:50.637056+0000) 2019-12-08T17:35:53.867 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:35:53.864+0000 1694f700 -1 osd.2 221 get_health_metrics reporting 2 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e219) 2019-12-08T17:35:54.220 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:35:54.214+0000 1694f700 -1 osd.7 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:08.172056+0000 front 2019-12-08T17:35:08.133922+0000 (oldest deadline 2019-12-08T17:35:51.487003+0000) 2019-12-08T17:35:54.374 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:35:54.371+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:08.975354+0000 front 2019-12-08T17:35:08.844427+0000 (oldest deadline 2019-12-08T17:35:50.447777+0000) 2019-12-08T17:35:54.502 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:35:54.496+0000 1694f700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:06.946681+0000 front 2019-12-08T17:35:06.951892+0000 (oldest deadline 2019-12-08T17:35:50.425881+0000) 2019-12-08T17:35:54.562 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:35:54.557+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:09.491799+0000 front 2019-12-08T17:35:09.577880+0000 (oldest deadline 2019-12-08T17:35:50.562578+0000) 2019-12-08T17:35:54.603 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:35:54.601+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:05.412335+0000 front 2019-12-08T17:35:05.376978+0000 (oldest deadline 2019-12-08T17:35:50.677187+0000) 2019-12-08T17:35:54.785 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:35:54.780+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:07.891947+0000 front 2019-12-08T17:35:08.005515+0000 (oldest deadline 2019-12-08T17:35:50.637056+0000) 2019-12-08T17:35:54.917 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:35:54.915+0000 1694f700 -1 osd.2 221 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e219) 2019-12-08T17:35:55.249 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:35:55.243+0000 1694f700 -1 osd.7 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:08.172056+0000 front 2019-12-08T17:35:08.133922+0000 (oldest deadline 2019-12-08T17:35:51.487003+0000) 2019-12-08T17:35:55.410 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:35:55.407+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:08.975354+0000 front 2019-12-08T17:35:08.844427+0000 (oldest deadline 2019-12-08T17:35:50.447777+0000) 2019-12-08T17:35:55.512 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:35:55.506+0000 1694f700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:06.946681+0000 front 2019-12-08T17:35:06.951892+0000 (oldest deadline 2019-12-08T17:35:50.425881+0000) 2019-12-08T17:35:55.555 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:35:55.550+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:09.491799+0000 front 2019-12-08T17:35:09.577880+0000 (oldest deadline 2019-12-08T17:35:50.562578+0000) 2019-12-08T17:35:55.645 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:35:55.642+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:05.412335+0000 front 2019-12-08T17:35:05.376978+0000 (oldest deadline 2019-12-08T17:35:50.677187+0000) 2019-12-08T17:35:55.802 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:35:55.797+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:07.891947+0000 front 2019-12-08T17:35:08.005515+0000 (oldest deadline 2019-12-08T17:35:50.637056+0000) 2019-12-08T17:35:55.897 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:35:55.896+0000 1694f700 -1 osd.2 221 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e219) 2019-12-08T17:35:56.234 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:35:56.227+0000 1694f700 -1 osd.7 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:08.172056+0000 front 2019-12-08T17:35:08.133922+0000 (oldest deadline 2019-12-08T17:35:51.487003+0000) 2019-12-08T17:35:56.427 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:35:56.414+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:08.975354+0000 front 2019-12-08T17:35:08.844427+0000 (oldest deadline 2019-12-08T17:35:50.447777+0000) 2019-12-08T17:35:56.549 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:35:56.546+0000 1694f700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:06.946681+0000 front 2019-12-08T17:35:06.951892+0000 (oldest deadline 2019-12-08T17:35:50.425881+0000) 2019-12-08T17:35:56.587 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:35:56.582+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:09.491799+0000 front 2019-12-08T17:35:09.577880+0000 (oldest deadline 2019-12-08T17:35:50.562578+0000) 2019-12-08T17:35:56.611 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:35:56.609+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:05.412335+0000 front 2019-12-08T17:35:05.376978+0000 (oldest deadline 2019-12-08T17:35:50.677187+0000) 2019-12-08T17:35:56.767 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:35:56.762+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:07.891947+0000 front 2019-12-08T17:35:08.005515+0000 (oldest deadline 2019-12-08T17:35:50.637056+0000) 2019-12-08T17:35:56.888 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:35:56.887+0000 1694f700 -1 osd.2 221 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e219) 2019-12-08T17:35:57.219 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:35:57.215+0000 1694f700 -1 osd.7 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:08.172056+0000 front 2019-12-08T17:35:08.133922+0000 (oldest deadline 2019-12-08T17:35:51.487003+0000) 2019-12-08T17:35:57.387 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:35:57.385+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:08.975354+0000 front 2019-12-08T17:35:08.844427+0000 (oldest deadline 2019-12-08T17:35:50.447777+0000) 2019-12-08T17:35:57.553 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:35:57.545+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:09.491799+0000 front 2019-12-08T17:35:09.577880+0000 (oldest deadline 2019-12-08T17:35:50.562578+0000) 2019-12-08T17:35:57.576 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:35:57.571+0000 1694f700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:06.946681+0000 front 2019-12-08T17:35:06.951892+0000 (oldest deadline 2019-12-08T17:35:50.425881+0000) 2019-12-08T17:35:57.625 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:35:57.623+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:05.412335+0000 front 2019-12-08T17:35:05.376978+0000 (oldest deadline 2019-12-08T17:35:50.677187+0000) 2019-12-08T17:35:57.763 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:35:57.757+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:07.891947+0000 front 2019-12-08T17:35:08.005515+0000 (oldest deadline 2019-12-08T17:35:50.637056+0000) 2019-12-08T17:35:57.929 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:35:57.927+0000 1694f700 -1 osd.2 221 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e219) 2019-12-08T17:35:58.212 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:35:58.206+0000 1694f700 -1 osd.7 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:08.172056+0000 front 2019-12-08T17:35:08.133922+0000 (oldest deadline 2019-12-08T17:35:51.487003+0000) 2019-12-08T17:35:58.417 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:35:58.415+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:08.975354+0000 front 2019-12-08T17:35:08.844427+0000 (oldest deadline 2019-12-08T17:35:50.447777+0000) 2019-12-08T17:35:58.565 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:35:58.559+0000 1694f700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:06.946681+0000 front 2019-12-08T17:35:06.951892+0000 (oldest deadline 2019-12-08T17:35:50.425881+0000) 2019-12-08T17:35:58.592 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:35:58.586+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:09.491799+0000 front 2019-12-08T17:35:09.577880+0000 (oldest deadline 2019-12-08T17:35:50.562578+0000) 2019-12-08T17:35:58.598 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:35:58.596+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:05.412335+0000 front 2019-12-08T17:35:05.376978+0000 (oldest deadline 2019-12-08T17:35:50.677187+0000) 2019-12-08T17:35:58.788 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:35:58.783+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:07.891947+0000 front 2019-12-08T17:35:08.005515+0000 (oldest deadline 2019-12-08T17:35:50.637056+0000) 2019-12-08T17:35:58.978 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:35:58.976+0000 1694f700 -1 osd.2 221 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e219) 2019-12-08T17:35:59.209 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:35:59.204+0000 1694f700 -1 osd.7 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:08.172056+0000 front 2019-12-08T17:35:08.133922+0000 (oldest deadline 2019-12-08T17:35:51.487003+0000) 2019-12-08T17:35:59.400 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:35:59.398+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:08.975354+0000 front 2019-12-08T17:35:08.844427+0000 (oldest deadline 2019-12-08T17:35:50.447777+0000) 2019-12-08T17:35:59.539 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:35:59.534+0000 1694f700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:06.946681+0000 front 2019-12-08T17:35:06.951892+0000 (oldest deadline 2019-12-08T17:35:50.425881+0000) 2019-12-08T17:35:59.563 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:35:59.561+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:05.412335+0000 front 2019-12-08T17:35:05.376978+0000 (oldest deadline 2019-12-08T17:35:50.677187+0000) 2019-12-08T17:35:59.644 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:35:59.638+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:09.491799+0000 front 2019-12-08T17:35:09.577880+0000 (oldest deadline 2019-12-08T17:35:50.562578+0000) 2019-12-08T17:35:59.829 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:35:59.824+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:07.891947+0000 front 2019-12-08T17:35:08.005515+0000 (oldest deadline 2019-12-08T17:35:50.637056+0000) 2019-12-08T17:35:59.993 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:35:59.991+0000 1694f700 -1 osd.2 221 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e219) 2019-12-08T17:36:00.214 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:36:00.209+0000 1694f700 -1 osd.7 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:08.172056+0000 front 2019-12-08T17:35:08.133922+0000 (oldest deadline 2019-12-08T17:35:51.487003+0000) 2019-12-08T17:36:00.401 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:36:00.398+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:08.975354+0000 front 2019-12-08T17:35:08.844427+0000 (oldest deadline 2019-12-08T17:35:50.447777+0000) 2019-12-08T17:36:00.498 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:36:00.493+0000 1694f700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:06.946681+0000 front 2019-12-08T17:35:06.951892+0000 (oldest deadline 2019-12-08T17:35:50.425881+0000) 2019-12-08T17:36:00.532 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:36:00.530+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:05.412335+0000 front 2019-12-08T17:35:05.376978+0000 (oldest deadline 2019-12-08T17:35:50.677187+0000) 2019-12-08T17:36:00.696 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:36:00.692+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:09.491799+0000 front 2019-12-08T17:35:09.577880+0000 (oldest deadline 2019-12-08T17:35:50.562578+0000) 2019-12-08T17:36:00.838 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:36:00.832+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:07.891947+0000 front 2019-12-08T17:35:08.005515+0000 (oldest deadline 2019-12-08T17:35:50.637056+0000) 2019-12-08T17:36:01.013 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:36:01.011+0000 1694f700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:35:21.010804+0000 (oldest deadline 2019-12-08T17:36:01.010804+0000) 2019-12-08T17:36:01.014 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:36:01.013+0000 1694f700 -1 osd.2 221 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e219) 2019-12-08T17:36:01.231 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:36:01.222+0000 1694f700 -1 osd.7 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:08.172056+0000 front 2019-12-08T17:35:08.133922+0000 (oldest deadline 2019-12-08T17:35:51.487003+0000) 2019-12-08T17:36:01.418 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:36:01.415+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:08.975354+0000 front 2019-12-08T17:35:08.844427+0000 (oldest deadline 2019-12-08T17:35:50.447777+0000) 2019-12-08T17:36:01.484 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:36:01.479+0000 1694f700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:06.946681+0000 front 2019-12-08T17:35:06.951892+0000 (oldest deadline 2019-12-08T17:35:50.425881+0000) 2019-12-08T17:36:01.486 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:36:01.484+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:05.412335+0000 front 2019-12-08T17:35:05.376978+0000 (oldest deadline 2019-12-08T17:35:50.677187+0000) 2019-12-08T17:36:01.704 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:36:01.698+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:09.491799+0000 front 2019-12-08T17:35:09.577880+0000 (oldest deadline 2019-12-08T17:35:50.562578+0000) 2019-12-08T17:36:01.864 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:36:01.859+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:07.891947+0000 front 2019-12-08T17:35:08.005515+0000 (oldest deadline 2019-12-08T17:35:50.637056+0000) 2019-12-08T17:36:02.025 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:36:02.020+0000 1694f700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:35:21.010804+0000 (oldest deadline 2019-12-08T17:36:01.010804+0000) 2019-12-08T17:36:02.063 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:36:02.023+0000 1694f700 -1 osd.2 221 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e219) 2019-12-08T17:36:02.220 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:36:02.215+0000 1694f700 -1 osd.7 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:08.172056+0000 front 2019-12-08T17:35:08.133922+0000 (oldest deadline 2019-12-08T17:35:51.487003+0000) 2019-12-08T17:36:02.447 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:36:02.445+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:05.412335+0000 front 2019-12-08T17:35:05.376978+0000 (oldest deadline 2019-12-08T17:35:50.677187+0000) 2019-12-08T17:36:02.456 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:36:02.446+0000 1694f700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:06.946681+0000 front 2019-12-08T17:35:06.951892+0000 (oldest deadline 2019-12-08T17:35:50.425881+0000) 2019-12-08T17:36:02.466 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:36:02.464+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:08.975354+0000 front 2019-12-08T17:35:08.844427+0000 (oldest deadline 2019-12-08T17:35:50.447777+0000) 2019-12-08T17:36:02.669 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:36:02.663+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:09.491799+0000 front 2019-12-08T17:35:09.577880+0000 (oldest deadline 2019-12-08T17:35:50.562578+0000) 2019-12-08T17:36:02.820 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:36:02.815+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:07.891947+0000 front 2019-12-08T17:35:08.005515+0000 (oldest deadline 2019-12-08T17:35:50.637056+0000) 2019-12-08T17:36:03.029 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:36:03.027+0000 1694f700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:35:21.010804+0000 (oldest deadline 2019-12-08T17:36:01.010804+0000) 2019-12-08T17:36:03.031 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:36:03.029+0000 1694f700 -1 osd.2 221 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e219) 2019-12-08T17:36:03.238 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:36:03.232+0000 1694f700 -1 osd.7 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:08.172056+0000 front 2019-12-08T17:35:08.133922+0000 (oldest deadline 2019-12-08T17:35:51.487003+0000) 2019-12-08T17:36:03.416 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:36:03.413+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:05.412335+0000 front 2019-12-08T17:35:05.376978+0000 (oldest deadline 2019-12-08T17:35:50.677187+0000) 2019-12-08T17:36:03.484 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:36:03.481+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:08.975354+0000 front 2019-12-08T17:35:08.844427+0000 (oldest deadline 2019-12-08T17:35:50.447777+0000) 2019-12-08T17:36:03.498 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:36:03.493+0000 1694f700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:06.946681+0000 front 2019-12-08T17:35:06.951892+0000 (oldest deadline 2019-12-08T17:35:50.425881+0000) 2019-12-08T17:36:03.676 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:36:03.670+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:09.491799+0000 front 2019-12-08T17:35:09.577880+0000 (oldest deadline 2019-12-08T17:35:50.562578+0000) 2019-12-08T17:36:03.779 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:36:03.775+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:07.891947+0000 front 2019-12-08T17:35:08.005515+0000 (oldest deadline 2019-12-08T17:35:50.637056+0000) 2019-12-08T17:36:04.050 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:36:04.046+0000 1694f700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:35:21.010804+0000 (oldest deadline 2019-12-08T17:36:01.010804+0000) 2019-12-08T17:36:04.050 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:36:04.049+0000 1694f700 -1 osd.2 221 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e219) 2019-12-08T17:36:04.217 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:36:04.212+0000 1694f700 -1 osd.7 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:08.172056+0000 front 2019-12-08T17:35:08.133922+0000 (oldest deadline 2019-12-08T17:35:51.487003+0000) 2019-12-08T17:36:04.404 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:36:04.401+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:05.412335+0000 front 2019-12-08T17:35:05.376978+0000 (oldest deadline 2019-12-08T17:35:50.677187+0000) 2019-12-08T17:36:04.497 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:36:04.490+0000 1694f700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:06.946681+0000 front 2019-12-08T17:35:06.951892+0000 (oldest deadline 2019-12-08T17:35:50.425881+0000) 2019-12-08T17:36:04.508 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:36:04.505+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:08.975354+0000 front 2019-12-08T17:35:08.844427+0000 (oldest deadline 2019-12-08T17:35:50.447777+0000) 2019-12-08T17:36:04.641 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:36:04.636+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:09.491799+0000 front 2019-12-08T17:35:09.577880+0000 (oldest deadline 2019-12-08T17:35:50.562578+0000) 2019-12-08T17:36:04.749 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:36:04.744+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:07.891947+0000 front 2019-12-08T17:35:08.005515+0000 (oldest deadline 2019-12-08T17:35:50.637056+0000) 2019-12-08T17:36:05.100 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:36:05.096+0000 1694f700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:35:21.010804+0000 (oldest deadline 2019-12-08T17:36:01.010804+0000) 2019-12-08T17:36:05.102 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:36:05.099+0000 1694f700 -1 osd.2 221 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e219) 2019-12-08T17:36:05.222 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:36:05.214+0000 1694f700 -1 osd.7 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:08.172056+0000 front 2019-12-08T17:35:08.133922+0000 (oldest deadline 2019-12-08T17:35:51.487003+0000) 2019-12-08T17:36:05.425 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:36:05.422+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:05.412335+0000 front 2019-12-08T17:35:05.376978+0000 (oldest deadline 2019-12-08T17:35:50.677187+0000) 2019-12-08T17:36:05.489 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:36:05.483+0000 1694f700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:06.946681+0000 front 2019-12-08T17:35:06.951892+0000 (oldest deadline 2019-12-08T17:35:50.425881+0000) 2019-12-08T17:36:05.554 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:36:05.550+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:08.975354+0000 front 2019-12-08T17:35:08.844427+0000 (oldest deadline 2019-12-08T17:35:50.447777+0000) 2019-12-08T17:36:05.650 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:36:05.645+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:09.491799+0000 front 2019-12-08T17:35:09.577880+0000 (oldest deadline 2019-12-08T17:35:50.562578+0000) 2019-12-08T17:36:05.726 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:36:05.721+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:07.891947+0000 front 2019-12-08T17:35:08.005515+0000 (oldest deadline 2019-12-08T17:35:50.637056+0000) 2019-12-08T17:36:06.105 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:36:06.103+0000 1694f700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:35:21.010804+0000 (oldest deadline 2019-12-08T17:36:01.010804+0000) 2019-12-08T17:36:06.105 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:36:06.104+0000 1694f700 -1 osd.2 221 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e219) 2019-12-08T17:36:06.255 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:36:06.249+0000 1694f700 -1 osd.7 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:08.172056+0000 front 2019-12-08T17:35:08.133922+0000 (oldest deadline 2019-12-08T17:35:51.487003+0000) 2019-12-08T17:36:06.412 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:36:06.409+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:05.412335+0000 front 2019-12-08T17:35:05.376978+0000 (oldest deadline 2019-12-08T17:35:50.677187+0000) 2019-12-08T17:36:06.519 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:36:06.516+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:08.975354+0000 front 2019-12-08T17:35:08.844427+0000 (oldest deadline 2019-12-08T17:35:50.447777+0000) 2019-12-08T17:36:06.545 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:36:06.539+0000 1694f700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:06.946681+0000 front 2019-12-08T17:35:06.951892+0000 (oldest deadline 2019-12-08T17:35:50.425881+0000) 2019-12-08T17:36:06.655 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:36:06.649+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:09.491799+0000 front 2019-12-08T17:35:09.577880+0000 (oldest deadline 2019-12-08T17:35:50.562578+0000) 2019-12-08T17:36:06.711 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:36:06.705+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:07.891947+0000 front 2019-12-08T17:35:08.005515+0000 (oldest deadline 2019-12-08T17:35:50.637056+0000) 2019-12-08T17:36:07.139 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:36:07.137+0000 1694f700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:35:21.010804+0000 (oldest deadline 2019-12-08T17:36:01.010804+0000) 2019-12-08T17:36:07.140 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:36:07.140+0000 1694f700 -1 osd.2 221 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e219) 2019-12-08T17:36:07.232 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:36:07.227+0000 1694f700 -1 osd.7 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:08.172056+0000 front 2019-12-08T17:35:08.133922+0000 (oldest deadline 2019-12-08T17:35:51.487003+0000) 2019-12-08T17:36:07.399 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:36:07.398+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:05.412335+0000 front 2019-12-08T17:35:05.376978+0000 (oldest deadline 2019-12-08T17:35:50.677187+0000) 2019-12-08T17:36:07.496 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:36:07.494+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:08.975354+0000 front 2019-12-08T17:35:08.844427+0000 (oldest deadline 2019-12-08T17:35:50.447777+0000) 2019-12-08T17:36:07.585 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:36:07.579+0000 1694f700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:06.946681+0000 front 2019-12-08T17:35:06.951892+0000 (oldest deadline 2019-12-08T17:35:50.425881+0000) 2019-12-08T17:36:07.627 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:36:07.622+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:09.491799+0000 front 2019-12-08T17:35:09.577880+0000 (oldest deadline 2019-12-08T17:35:50.562578+0000) 2019-12-08T17:36:07.710 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:36:07.705+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:07.891947+0000 front 2019-12-08T17:35:08.005515+0000 (oldest deadline 2019-12-08T17:35:50.637056+0000) 2019-12-08T17:36:08.115 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:36:08.114+0000 1694f700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:35:21.010804+0000 (oldest deadline 2019-12-08T17:36:01.010804+0000) 2019-12-08T17:36:08.118 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:36:08.118+0000 1694f700 -1 osd.2 221 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e219) 2019-12-08T17:36:08.239 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:36:08.232+0000 1694f700 -1 osd.7 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:08.172056+0000 front 2019-12-08T17:35:08.133922+0000 (oldest deadline 2019-12-08T17:35:51.487003+0000) 2019-12-08T17:36:08.387 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:36:08.386+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:05.412335+0000 front 2019-12-08T17:35:05.376978+0000 (oldest deadline 2019-12-08T17:35:50.677187+0000) 2019-12-08T17:36:08.522 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:36:08.521+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:08.975354+0000 front 2019-12-08T17:35:08.844427+0000 (oldest deadline 2019-12-08T17:35:50.447777+0000) 2019-12-08T17:36:08.560 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:36:08.556+0000 1694f700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:06.946681+0000 front 2019-12-08T17:35:06.951892+0000 (oldest deadline 2019-12-08T17:35:50.425881+0000) 2019-12-08T17:36:08.665 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:36:08.660+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:09.491799+0000 front 2019-12-08T17:35:09.577880+0000 (oldest deadline 2019-12-08T17:35:50.562578+0000) 2019-12-08T17:36:08.714 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:36:08.708+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:07.891947+0000 front 2019-12-08T17:35:08.005515+0000 (oldest deadline 2019-12-08T17:35:50.637056+0000) 2019-12-08T17:36:09.156 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:36:09.154+0000 1694f700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:35:21.010804+0000 (oldest deadline 2019-12-08T17:36:01.010804+0000) 2019-12-08T17:36:09.156 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:36:09.156+0000 1694f700 -1 osd.2 221 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e219) 2019-12-08T17:36:09.286 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:36:09.281+0000 1694f700 -1 osd.7 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:08.172056+0000 front 2019-12-08T17:35:08.133922+0000 (oldest deadline 2019-12-08T17:35:51.487003+0000) 2019-12-08T17:36:09.352 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:36:09.350+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:05.412335+0000 front 2019-12-08T17:35:05.376978+0000 (oldest deadline 2019-12-08T17:35:50.677187+0000) 2019-12-08T17:36:09.550 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:36:09.547+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:08.975354+0000 front 2019-12-08T17:35:08.844427+0000 (oldest deadline 2019-12-08T17:35:50.447777+0000) 2019-12-08T17:36:09.612 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:36:09.607+0000 1694f700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:06.946681+0000 front 2019-12-08T17:35:06.951892+0000 (oldest deadline 2019-12-08T17:35:50.425881+0000) 2019-12-08T17:36:09.681 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:36:09.675+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:09.491799+0000 front 2019-12-08T17:35:09.577880+0000 (oldest deadline 2019-12-08T17:35:50.562578+0000) 2019-12-08T17:36:09.720 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:36:09.715+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:07.891947+0000 front 2019-12-08T17:35:08.005515+0000 (oldest deadline 2019-12-08T17:35:50.637056+0000) 2019-12-08T17:36:10.196 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:36:10.194+0000 1694f700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:35:21.010804+0000 (oldest deadline 2019-12-08T17:36:01.010804+0000) 2019-12-08T17:36:10.198 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:36:10.198+0000 1694f700 -1 osd.2 221 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e219) 2019-12-08T17:36:10.309 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:36:10.304+0000 1694f700 -1 osd.7 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:08.172056+0000 front 2019-12-08T17:35:08.133922+0000 (oldest deadline 2019-12-08T17:35:51.487003+0000) 2019-12-08T17:36:10.317 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:36:10.316+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:05.412335+0000 front 2019-12-08T17:35:05.376978+0000 (oldest deadline 2019-12-08T17:35:50.677187+0000) 2019-12-08T17:36:10.582 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:36:10.580+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:08.975354+0000 front 2019-12-08T17:35:08.844427+0000 (oldest deadline 2019-12-08T17:35:50.447777+0000) 2019-12-08T17:36:10.655 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:36:10.649+0000 1694f700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:06.946681+0000 front 2019-12-08T17:35:06.951892+0000 (oldest deadline 2019-12-08T17:35:50.425881+0000) 2019-12-08T17:36:10.697 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:36:10.692+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:09.491799+0000 front 2019-12-08T17:35:09.577880+0000 (oldest deadline 2019-12-08T17:35:50.562578+0000) 2019-12-08T17:36:10.719 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:36:10.714+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:07.891947+0000 front 2019-12-08T17:35:08.005515+0000 (oldest deadline 2019-12-08T17:35:50.637056+0000) 2019-12-08T17:36:11.166 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:36:11.165+0000 1694f700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:35:21.010804+0000 (oldest deadline 2019-12-08T17:36:01.010804+0000) 2019-12-08T17:36:11.169 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:36:11.169+0000 1694f700 -1 osd.2 221 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e219) 2019-12-08T17:36:11.351 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:36:11.345+0000 1694f700 -1 osd.7 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:08.172056+0000 front 2019-12-08T17:35:08.133922+0000 (oldest deadline 2019-12-08T17:35:51.487003+0000) 2019-12-08T17:36:11.363 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:36:11.361+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:05.412335+0000 front 2019-12-08T17:35:05.376978+0000 (oldest deadline 2019-12-08T17:35:50.677187+0000) 2019-12-08T17:36:11.583 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:36:11.581+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:08.975354+0000 front 2019-12-08T17:35:08.844427+0000 (oldest deadline 2019-12-08T17:35:50.447777+0000) 2019-12-08T17:36:11.654 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:36:11.648+0000 1694f700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:06.946681+0000 front 2019-12-08T17:35:06.951892+0000 (oldest deadline 2019-12-08T17:35:50.425881+0000) 2019-12-08T17:36:11.686 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:36:11.679+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:09.491799+0000 front 2019-12-08T17:35:09.577880+0000 (oldest deadline 2019-12-08T17:35:50.562578+0000) 2019-12-08T17:36:11.777 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:36:11.771+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:07.891947+0000 front 2019-12-08T17:35:08.005515+0000 (oldest deadline 2019-12-08T17:35:50.637056+0000) 2019-12-08T17:36:12.197 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:36:12.197+0000 1694f700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:35:21.010804+0000 (oldest deadline 2019-12-08T17:36:01.010804+0000) 2019-12-08T17:36:12.198 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:36:12.198+0000 1694f700 -1 osd.2 221 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e219) 2019-12-08T17:36:12.393 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:36:12.391+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:05.412335+0000 front 2019-12-08T17:35:05.376978+0000 (oldest deadline 2019-12-08T17:35:50.677187+0000) 2019-12-08T17:36:12.396 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:36:12.391+0000 1694f700 -1 osd.7 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:08.172056+0000 front 2019-12-08T17:35:08.133922+0000 (oldest deadline 2019-12-08T17:35:51.487003+0000) 2019-12-08T17:36:12.557 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:36:12.556+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:08.975354+0000 front 2019-12-08T17:35:08.844427+0000 (oldest deadline 2019-12-08T17:35:50.447777+0000) 2019-12-08T17:36:12.657 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:36:12.652+0000 1694f700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:06.946681+0000 front 2019-12-08T17:35:06.951892+0000 (oldest deadline 2019-12-08T17:35:50.425881+0000) 2019-12-08T17:36:12.694 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:36:12.688+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:09.491799+0000 front 2019-12-08T17:35:09.577880+0000 (oldest deadline 2019-12-08T17:35:50.562578+0000) 2019-12-08T17:36:12.763 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:36:12.753+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:07.891947+0000 front 2019-12-08T17:35:08.005515+0000 (oldest deadline 2019-12-08T17:35:50.637056+0000) 2019-12-08T17:36:13.240 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:36:13.237+0000 1694f700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:35:21.010804+0000 (oldest deadline 2019-12-08T17:36:01.010804+0000) 2019-12-08T17:36:13.241 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:36:13.240+0000 1694f700 -1 osd.2 221 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e219) 2019-12-08T17:36:13.388 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:36:13.383+0000 1694f700 -1 osd.7 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:08.172056+0000 front 2019-12-08T17:35:08.133922+0000 (oldest deadline 2019-12-08T17:35:51.487003+0000) 2019-12-08T17:36:13.402 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:36:13.401+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:05.412335+0000 front 2019-12-08T17:35:05.376978+0000 (oldest deadline 2019-12-08T17:35:50.677187+0000) 2019-12-08T17:36:13.599 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:36:13.598+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:08.975354+0000 front 2019-12-08T17:35:08.844427+0000 (oldest deadline 2019-12-08T17:35:50.447777+0000) 2019-12-08T17:36:13.645 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:36:13.640+0000 1694f700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:06.946681+0000 front 2019-12-08T17:35:06.951892+0000 (oldest deadline 2019-12-08T17:35:50.425881+0000) 2019-12-08T17:36:13.670 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:36:13.664+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:09.491799+0000 front 2019-12-08T17:35:09.577880+0000 (oldest deadline 2019-12-08T17:35:50.562578+0000) 2019-12-08T17:36:13.755 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:36:13.750+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:07.891947+0000 front 2019-12-08T17:35:08.005515+0000 (oldest deadline 2019-12-08T17:35:50.637056+0000) 2019-12-08T17:36:14.224 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:36:14.221+0000 1694f700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:35:21.010804+0000 (oldest deadline 2019-12-08T17:36:01.010804+0000) 2019-12-08T17:36:14.225 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:36:14.224+0000 1694f700 -1 osd.2 221 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e219) 2019-12-08T17:36:14.358 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:36:14.352+0000 1694f700 -1 osd.7 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:08.172056+0000 front 2019-12-08T17:35:08.133922+0000 (oldest deadline 2019-12-08T17:35:51.487003+0000) 2019-12-08T17:36:14.402 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:36:14.401+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:05.412335+0000 front 2019-12-08T17:35:05.376978+0000 (oldest deadline 2019-12-08T17:35:50.677187+0000) 2019-12-08T17:36:14.565 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:36:14.564+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:08.975354+0000 front 2019-12-08T17:35:08.844427+0000 (oldest deadline 2019-12-08T17:35:50.447777+0000) 2019-12-08T17:36:14.691 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:36:14.686+0000 1694f700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:06.946681+0000 front 2019-12-08T17:35:06.951892+0000 (oldest deadline 2019-12-08T17:35:50.425881+0000) 2019-12-08T17:36:14.695 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:36:14.689+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:09.491799+0000 front 2019-12-08T17:35:09.577880+0000 (oldest deadline 2019-12-08T17:35:50.562578+0000) 2019-12-08T17:36:14.793 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:36:14.788+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:07.891947+0000 front 2019-12-08T17:35:08.005515+0000 (oldest deadline 2019-12-08T17:35:50.637056+0000) 2019-12-08T17:36:15.209 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:36:15.209+0000 1694f700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:35:21.010804+0000 (oldest deadline 2019-12-08T17:36:01.010804+0000) 2019-12-08T17:36:15.211 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:36:15.210+0000 1694f700 -1 osd.2 221 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e219) 2019-12-08T17:36:15.368 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:36:15.368+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:05.412335+0000 front 2019-12-08T17:35:05.376978+0000 (oldest deadline 2019-12-08T17:35:50.677187+0000) 2019-12-08T17:36:15.399 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:36:15.395+0000 1694f700 -1 osd.7 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:08.172056+0000 front 2019-12-08T17:35:08.133922+0000 (oldest deadline 2019-12-08T17:35:51.487003+0000) 2019-12-08T17:36:15.594 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:36:15.593+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:08.975354+0000 front 2019-12-08T17:35:08.844427+0000 (oldest deadline 2019-12-08T17:35:50.447777+0000) 2019-12-08T17:36:15.661 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:36:15.657+0000 1694f700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:06.946681+0000 front 2019-12-08T17:35:06.951892+0000 (oldest deadline 2019-12-08T17:35:50.425881+0000) 2019-12-08T17:36:15.667 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:36:15.661+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:09.491799+0000 front 2019-12-08T17:35:09.577880+0000 (oldest deadline 2019-12-08T17:35:50.562578+0000) 2019-12-08T17:36:15.772 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:36:15.767+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:07.891947+0000 front 2019-12-08T17:35:08.005515+0000 (oldest deadline 2019-12-08T17:35:50.637056+0000) 2019-12-08T17:36:16.245 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:36:16.243+0000 1694f700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:35:21.010804+0000 (oldest deadline 2019-12-08T17:36:01.010804+0000) 2019-12-08T17:36:16.245 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:36:16.245+0000 1694f700 -1 osd.2 221 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e219) 2019-12-08T17:36:16.364 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:36:16.359+0000 1694f700 -1 osd.7 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:08.172056+0000 front 2019-12-08T17:35:08.133922+0000 (oldest deadline 2019-12-08T17:35:51.487003+0000) 2019-12-08T17:36:16.389 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:36:16.387+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:05.412335+0000 front 2019-12-08T17:35:05.376978+0000 (oldest deadline 2019-12-08T17:35:50.677187+0000) 2019-12-08T17:36:16.643 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:36:16.641+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:08.975354+0000 front 2019-12-08T17:35:08.844427+0000 (oldest deadline 2019-12-08T17:35:50.447777+0000) 2019-12-08T17:36:16.656 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:36:16.650+0000 1694f700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:06.946681+0000 front 2019-12-08T17:35:06.951892+0000 (oldest deadline 2019-12-08T17:35:50.425881+0000) 2019-12-08T17:36:16.681 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:36:16.676+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:09.491799+0000 front 2019-12-08T17:35:09.577880+0000 (oldest deadline 2019-12-08T17:35:50.562578+0000) 2019-12-08T17:36:16.793 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:36:16.788+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:07.891947+0000 front 2019-12-08T17:35:08.005515+0000 (oldest deadline 2019-12-08T17:35:50.637056+0000) 2019-12-08T17:36:17.293 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:36:17.291+0000 1694f700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:35:21.010804+0000 (oldest deadline 2019-12-08T17:36:01.010804+0000) 2019-12-08T17:36:17.296 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:36:17.295+0000 1694f700 -1 osd.2 221 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e219) 2019-12-08T17:36:17.351 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:36:17.349+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:05.412335+0000 front 2019-12-08T17:35:05.376978+0000 (oldest deadline 2019-12-08T17:35:50.677187+0000) 2019-12-08T17:36:17.363 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:36:17.357+0000 1694f700 -1 osd.7 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:08.172056+0000 front 2019-12-08T17:35:08.133922+0000 (oldest deadline 2019-12-08T17:35:51.487003+0000) 2019-12-08T17:36:17.635 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:36:17.631+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:08.975354+0000 front 2019-12-08T17:35:08.844427+0000 (oldest deadline 2019-12-08T17:35:50.447777+0000) 2019-12-08T17:36:17.649 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:36:17.643+0000 1694f700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:06.946681+0000 front 2019-12-08T17:35:06.951892+0000 (oldest deadline 2019-12-08T17:35:50.425881+0000) 2019-12-08T17:36:17.737 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:36:17.731+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:09.491799+0000 front 2019-12-08T17:35:09.577880+0000 (oldest deadline 2019-12-08T17:35:50.562578+0000) 2019-12-08T17:36:17.767 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:36:17.762+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:07.891947+0000 front 2019-12-08T17:35:08.005515+0000 (oldest deadline 2019-12-08T17:35:50.637056+0000) 2019-12-08T17:36:18.271 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:36:18.270+0000 1694f700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:35:21.010804+0000 (oldest deadline 2019-12-08T17:36:01.010804+0000) 2019-12-08T17:36:18.272 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:36:18.271+0000 1694f700 -1 osd.2 221 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e219) 2019-12-08T17:36:18.329 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:36:18.313+0000 1694f700 -1 osd.7 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:08.172056+0000 front 2019-12-08T17:35:08.133922+0000 (oldest deadline 2019-12-08T17:35:51.487003+0000) 2019-12-08T17:36:18.331 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:36:18.330+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:05.412335+0000 front 2019-12-08T17:35:05.376978+0000 (oldest deadline 2019-12-08T17:35:50.677187+0000) 2019-12-08T17:36:18.612 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:36:18.609+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:08.975354+0000 front 2019-12-08T17:35:08.844427+0000 (oldest deadline 2019-12-08T17:35:50.447777+0000) 2019-12-08T17:36:18.651 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:36:18.646+0000 1694f700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:06.946681+0000 front 2019-12-08T17:35:06.951892+0000 (oldest deadline 2019-12-08T17:35:50.425881+0000) 2019-12-08T17:36:18.784 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:36:18.779+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:09.491799+0000 front 2019-12-08T17:35:09.577880+0000 (oldest deadline 2019-12-08T17:35:50.562578+0000) 2019-12-08T17:36:18.790 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:36:18.784+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:07.891947+0000 front 2019-12-08T17:35:08.005515+0000 (oldest deadline 2019-12-08T17:35:50.637056+0000) 2019-12-08T17:36:19.243 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:36:19.241+0000 1694f700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:35:21.010804+0000 (oldest deadline 2019-12-08T17:36:01.010804+0000) 2019-12-08T17:36:19.247 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:36:19.246+0000 1694f700 -1 osd.2 221 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e219) 2019-12-08T17:36:19.301 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:36:19.300+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:05.412335+0000 front 2019-12-08T17:35:05.376978+0000 (oldest deadline 2019-12-08T17:35:50.677187+0000) 2019-12-08T17:36:19.338 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:36:19.334+0000 1694f700 -1 osd.7 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:08.172056+0000 front 2019-12-08T17:35:08.133922+0000 (oldest deadline 2019-12-08T17:35:51.487003+0000) 2019-12-08T17:36:19.638 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:36:19.633+0000 1694f700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:06.946681+0000 front 2019-12-08T17:35:06.951892+0000 (oldest deadline 2019-12-08T17:35:50.425881+0000) 2019-12-08T17:36:19.653 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:36:19.652+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:08.975354+0000 front 2019-12-08T17:35:08.844427+0000 (oldest deadline 2019-12-08T17:35:50.447777+0000) 2019-12-08T17:36:19.766 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:36:19.762+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:07.891947+0000 front 2019-12-08T17:35:08.005515+0000 (oldest deadline 2019-12-08T17:35:50.637056+0000) 2019-12-08T17:36:19.837 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:36:19.832+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:09.491799+0000 front 2019-12-08T17:35:09.577880+0000 (oldest deadline 2019-12-08T17:35:50.562578+0000) 2019-12-08T17:36:20.239 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:36:20.237+0000 1694f700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:35:21.010804+0000 (oldest deadline 2019-12-08T17:36:01.010804+0000) 2019-12-08T17:36:20.242 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:36:20.242+0000 1694f700 -1 osd.2 221 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e219) 2019-12-08T17:36:20.306 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:36:20.304+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:05.412335+0000 front 2019-12-08T17:35:05.376978+0000 (oldest deadline 2019-12-08T17:35:50.677187+0000) 2019-12-08T17:36:20.365 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:36:20.361+0000 1694f700 -1 osd.7 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:08.172056+0000 front 2019-12-08T17:35:08.133922+0000 (oldest deadline 2019-12-08T17:35:51.487003+0000) 2019-12-08T17:36:20.609 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:36:20.603+0000 1694f700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:06.946681+0000 front 2019-12-08T17:35:06.951892+0000 (oldest deadline 2019-12-08T17:35:50.425881+0000) 2019-12-08T17:36:20.637 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:36:20.635+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:08.975354+0000 front 2019-12-08T17:35:08.844427+0000 (oldest deadline 2019-12-08T17:35:50.447777+0000) 2019-12-08T17:36:20.776 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:36:20.772+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:07.891947+0000 front 2019-12-08T17:35:08.005515+0000 (oldest deadline 2019-12-08T17:35:50.637056+0000) 2019-12-08T17:36:20.838 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:36:20.829+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:09.491799+0000 front 2019-12-08T17:35:09.577880+0000 (oldest deadline 2019-12-08T17:35:50.562578+0000) 2019-12-08T17:36:21.256 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:36:21.256+0000 1694f700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:35:21.010804+0000 (oldest deadline 2019-12-08T17:36:01.010804+0000) 2019-12-08T17:36:21.259 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:36:21.259+0000 1694f700 -1 osd.2 221 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e219) 2019-12-08T17:36:21.335 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:36:21.329+0000 1694f700 -1 osd.7 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:08.172056+0000 front 2019-12-08T17:35:08.133922+0000 (oldest deadline 2019-12-08T17:35:51.487003+0000) 2019-12-08T17:36:21.352 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:36:21.348+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:05.412335+0000 front 2019-12-08T17:35:05.376978+0000 (oldest deadline 2019-12-08T17:35:50.677187+0000) 2019-12-08T17:36:21.598 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:36:21.594+0000 1694f700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:06.946681+0000 front 2019-12-08T17:35:06.951892+0000 (oldest deadline 2019-12-08T17:35:50.425881+0000) 2019-12-08T17:36:21.615 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:36:21.613+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:08.975354+0000 front 2019-12-08T17:35:08.844427+0000 (oldest deadline 2019-12-08T17:35:50.447777+0000) 2019-12-08T17:36:21.744 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:36:21.738+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:07.891947+0000 front 2019-12-08T17:35:08.005515+0000 (oldest deadline 2019-12-08T17:35:50.637056+0000) 2019-12-08T17:36:21.876 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:36:21.867+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:09.491799+0000 front 2019-12-08T17:35:09.577880+0000 (oldest deadline 2019-12-08T17:35:50.562578+0000) 2019-12-08T17:36:22.232 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:36:22.230+0000 1694f700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:35:21.010804+0000 (oldest deadline 2019-12-08T17:36:01.010804+0000) 2019-12-08T17:36:22.233 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:36:22.232+0000 1694f700 -1 osd.2 221 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e219) 2019-12-08T17:36:22.319 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:36:22.318+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:05.412335+0000 front 2019-12-08T17:35:05.376978+0000 (oldest deadline 2019-12-08T17:35:50.677187+0000) 2019-12-08T17:36:22.323 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:36:22.318+0000 1694f700 -1 osd.7 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:08.172056+0000 front 2019-12-08T17:35:08.133922+0000 (oldest deadline 2019-12-08T17:35:51.487003+0000) 2019-12-08T17:36:22.568 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:36:22.563+0000 1694f700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:06.946681+0000 front 2019-12-08T17:35:06.951892+0000 (oldest deadline 2019-12-08T17:35:50.425881+0000) 2019-12-08T17:36:22.596 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:36:22.594+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:08.975354+0000 front 2019-12-08T17:35:08.844427+0000 (oldest deadline 2019-12-08T17:35:50.447777+0000) 2019-12-08T17:36:22.779 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:36:22.774+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:07.891947+0000 front 2019-12-08T17:35:08.005515+0000 (oldest deadline 2019-12-08T17:35:50.637056+0000) 2019-12-08T17:36:22.841 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:36:22.836+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:09.491799+0000 front 2019-12-08T17:35:09.577880+0000 (oldest deadline 2019-12-08T17:35:50.562578+0000) 2019-12-08T17:36:23.192 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:36:23.192+0000 1694f700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:35:21.010804+0000 (oldest deadline 2019-12-08T17:36:01.010804+0000) 2019-12-08T17:36:23.193 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:36:23.193+0000 1694f700 -1 osd.2 221 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e219) 2019-12-08T17:36:23.293 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:36:23.291+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:05.412335+0000 front 2019-12-08T17:35:05.376978+0000 (oldest deadline 2019-12-08T17:35:50.677187+0000) 2019-12-08T17:36:23.318 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:36:23.313+0000 1694f700 -1 osd.7 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:08.172056+0000 front 2019-12-08T17:35:08.133922+0000 (oldest deadline 2019-12-08T17:35:51.487003+0000) 2019-12-08T17:36:23.615 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:36:23.609+0000 1694f700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:06.946681+0000 front 2019-12-08T17:35:06.951892+0000 (oldest deadline 2019-12-08T17:35:50.425881+0000) 2019-12-08T17:36:23.637 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:36:23.635+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:08.975354+0000 front 2019-12-08T17:35:08.844427+0000 (oldest deadline 2019-12-08T17:35:50.447777+0000) 2019-12-08T17:36:23.739 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:36:23.734+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:07.891947+0000 front 2019-12-08T17:35:08.005515+0000 (oldest deadline 2019-12-08T17:35:50.637056+0000) 2019-12-08T17:36:23.863 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:36:23.858+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:09.491799+0000 front 2019-12-08T17:35:09.577880+0000 (oldest deadline 2019-12-08T17:35:50.562578+0000) 2019-12-08T17:36:23.882 INFO:tasks.ceph.mon.b.smithi013.stderr:2019-12-08T17:36:23.876+0000 1a89c700 -1 mon.b@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.1 [v2:172.21.15.79:6810/10449,v1:172.21.15.79:6811/10449] for 43sec e221 v221) 2019-12-08T17:36:24.208 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:36:24.204+0000 1694f700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:35:21.010804+0000 (oldest deadline 2019-12-08T17:36:01.010804+0000) 2019-12-08T17:36:24.210 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:36:24.208+0000 1694f700 -1 osd.2 221 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e219) 2019-12-08T17:36:24.249 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:36:24.246+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:05.412335+0000 front 2019-12-08T17:35:05.376978+0000 (oldest deadline 2019-12-08T17:35:50.677187+0000) 2019-12-08T17:36:24.340 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:36:24.335+0000 1694f700 -1 osd.7 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:08.172056+0000 front 2019-12-08T17:35:08.133922+0000 (oldest deadline 2019-12-08T17:35:51.487003+0000) 2019-12-08T17:36:24.617 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:36:24.612+0000 1694f700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:06.946681+0000 front 2019-12-08T17:35:06.951892+0000 (oldest deadline 2019-12-08T17:35:50.425881+0000) 2019-12-08T17:36:24.629 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:36:24.627+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:08.975354+0000 front 2019-12-08T17:35:08.844427+0000 (oldest deadline 2019-12-08T17:35:50.447777+0000) 2019-12-08T17:36:24.762 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:36:24.757+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:07.891947+0000 front 2019-12-08T17:35:08.005515+0000 (oldest deadline 2019-12-08T17:35:50.637056+0000) 2019-12-08T17:36:24.846 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:36:24.841+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:09.491799+0000 front 2019-12-08T17:35:09.577880+0000 (oldest deadline 2019-12-08T17:35:50.562578+0000) 2019-12-08T17:36:25.178 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:36:25.176+0000 1694f700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:35:21.010804+0000 (oldest deadline 2019-12-08T17:36:01.010804+0000) 2019-12-08T17:36:25.179 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:36:25.178+0000 1694f700 -1 osd.2 221 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e219) 2019-12-08T17:36:25.283 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:36:25.280+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:05.412335+0000 front 2019-12-08T17:35:05.376978+0000 (oldest deadline 2019-12-08T17:35:50.677187+0000) 2019-12-08T17:36:25.343 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:36:25.339+0000 1694f700 -1 osd.7 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:08.172056+0000 front 2019-12-08T17:35:08.133922+0000 (oldest deadline 2019-12-08T17:35:51.487003+0000) 2019-12-08T17:36:25.598 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:36:25.591+0000 1694f700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:06.946681+0000 front 2019-12-08T17:35:06.951892+0000 (oldest deadline 2019-12-08T17:35:50.425881+0000) 2019-12-08T17:36:25.617 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:36:25.614+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:08.975354+0000 front 2019-12-08T17:35:08.844427+0000 (oldest deadline 2019-12-08T17:35:50.447777+0000) 2019-12-08T17:36:25.799 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:36:25.793+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:07.891947+0000 front 2019-12-08T17:35:08.005515+0000 (oldest deadline 2019-12-08T17:35:50.637056+0000) 2019-12-08T17:36:25.885 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:36:25.879+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:09.491799+0000 front 2019-12-08T17:35:09.577880+0000 (oldest deadline 2019-12-08T17:35:50.562578+0000) 2019-12-08T17:36:26.179 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:36:26.177+0000 1694f700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:35:21.010804+0000 (oldest deadline 2019-12-08T17:36:01.010804+0000) 2019-12-08T17:36:26.181 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:36:26.179+0000 1694f700 -1 osd.2 221 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e219) 2019-12-08T17:36:26.305 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:36:26.303+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:05.412335+0000 front 2019-12-08T17:35:05.376978+0000 (oldest deadline 2019-12-08T17:35:50.677187+0000) 2019-12-08T17:36:26.390 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:36:26.385+0000 1694f700 -1 osd.7 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:08.172056+0000 front 2019-12-08T17:35:08.133922+0000 (oldest deadline 2019-12-08T17:35:51.487003+0000) 2019-12-08T17:36:26.568 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:36:26.562+0000 1694f700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:06.946681+0000 front 2019-12-08T17:35:06.951892+0000 (oldest deadline 2019-12-08T17:35:50.425881+0000) 2019-12-08T17:36:26.658 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:36:26.657+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:08.975354+0000 front 2019-12-08T17:35:08.844427+0000 (oldest deadline 2019-12-08T17:35:50.447777+0000) 2019-12-08T17:36:26.821 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:36:26.816+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:07.891947+0000 front 2019-12-08T17:35:08.005515+0000 (oldest deadline 2019-12-08T17:35:50.637056+0000) 2019-12-08T17:36:26.893 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:36:26.889+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:09.491799+0000 front 2019-12-08T17:35:09.577880+0000 (oldest deadline 2019-12-08T17:35:50.562578+0000) 2019-12-08T17:36:27.227 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:36:27.224+0000 1694f700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:35:21.010804+0000 (oldest deadline 2019-12-08T17:36:01.010804+0000) 2019-12-08T17:36:27.228 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:36:27.227+0000 1694f700 -1 osd.2 221 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e219) 2019-12-08T17:36:27.313 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:36:27.311+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:05.412335+0000 front 2019-12-08T17:35:05.376978+0000 (oldest deadline 2019-12-08T17:35:50.677187+0000) 2019-12-08T17:36:27.438 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:36:27.433+0000 1694f700 -1 osd.7 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:08.172056+0000 front 2019-12-08T17:35:08.133922+0000 (oldest deadline 2019-12-08T17:35:51.487003+0000) 2019-12-08T17:36:27.530 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:36:27.525+0000 1694f700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:06.946681+0000 front 2019-12-08T17:35:06.951892+0000 (oldest deadline 2019-12-08T17:35:50.425881+0000) 2019-12-08T17:36:27.619 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:36:27.617+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:08.975354+0000 front 2019-12-08T17:35:08.844427+0000 (oldest deadline 2019-12-08T17:35:50.447777+0000) 2019-12-08T17:36:27.786 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:36:27.781+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:07.891947+0000 front 2019-12-08T17:35:08.005515+0000 (oldest deadline 2019-12-08T17:35:50.637056+0000) 2019-12-08T17:36:27.904 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:36:27.899+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:09.491799+0000 front 2019-12-08T17:35:09.577880+0000 (oldest deadline 2019-12-08T17:35:50.562578+0000) 2019-12-08T17:36:28.260 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:36:28.258+0000 1694f700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:35:21.010804+0000 (oldest deadline 2019-12-08T17:36:01.010804+0000) 2019-12-08T17:36:28.261 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:36:28.260+0000 1694f700 -1 osd.2 221 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e219) 2019-12-08T17:36:28.298 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:36:28.295+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:05.412335+0000 front 2019-12-08T17:35:05.376978+0000 (oldest deadline 2019-12-08T17:35:50.677187+0000) 2019-12-08T17:36:28.410 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:36:28.405+0000 1694f700 -1 osd.7 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:08.172056+0000 front 2019-12-08T17:35:08.133922+0000 (oldest deadline 2019-12-08T17:35:51.487003+0000) 2019-12-08T17:36:28.521 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:36:28.516+0000 1694f700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:06.946681+0000 front 2019-12-08T17:35:06.951892+0000 (oldest deadline 2019-12-08T17:35:50.425881+0000) 2019-12-08T17:36:28.589 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:36:28.587+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:08.975354+0000 front 2019-12-08T17:35:08.844427+0000 (oldest deadline 2019-12-08T17:35:50.447777+0000) 2019-12-08T17:36:28.801 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:36:28.797+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:07.891947+0000 front 2019-12-08T17:35:08.005515+0000 (oldest deadline 2019-12-08T17:35:50.637056+0000) 2019-12-08T17:36:28.902 INFO:tasks.ceph.mon.b.smithi013.stderr:2019-12-08T17:36:28.892+0000 1a89c700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.1 [v2:172.21.15.79:6810/10449,v1:172.21.15.79:6811/10449] for 43sec e221 v221) 2019-12-08T17:36:28.959 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:36:28.953+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:09.491799+0000 front 2019-12-08T17:35:09.577880+0000 (oldest deadline 2019-12-08T17:35:50.562578+0000) 2019-12-08T17:36:29.250 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:36:29.247+0000 1694f700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:35:21.010804+0000 (oldest deadline 2019-12-08T17:36:01.010804+0000) 2019-12-08T17:36:29.254 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:36:29.252+0000 1694f700 -1 osd.2 221 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e219) 2019-12-08T17:36:29.276 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:36:29.273+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:05.412335+0000 front 2019-12-08T17:35:05.376978+0000 (oldest deadline 2019-12-08T17:35:50.677187+0000) 2019-12-08T17:36:29.403 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:36:29.399+0000 1694f700 -1 osd.7 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:08.172056+0000 front 2019-12-08T17:35:08.133922+0000 (oldest deadline 2019-12-08T17:35:51.487003+0000) 2019-12-08T17:36:29.559 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:36:29.557+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:08.975354+0000 front 2019-12-08T17:35:08.844427+0000 (oldest deadline 2019-12-08T17:35:50.447777+0000) 2019-12-08T17:36:29.572 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:36:29.566+0000 1694f700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:06.946681+0000 front 2019-12-08T17:35:06.951892+0000 (oldest deadline 2019-12-08T17:35:50.425881+0000) 2019-12-08T17:36:29.788 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:36:29.783+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:07.891947+0000 front 2019-12-08T17:35:08.005515+0000 (oldest deadline 2019-12-08T17:35:50.637056+0000) 2019-12-08T17:36:29.987 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:36:29.982+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:09.491799+0000 front 2019-12-08T17:35:09.577880+0000 (oldest deadline 2019-12-08T17:35:50.562578+0000) 2019-12-08T17:36:30.236 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:36:30.233+0000 1694f700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:35:21.010804+0000 (oldest deadline 2019-12-08T17:36:01.010804+0000) 2019-12-08T17:36:30.240 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:36:30.238+0000 1694f700 -1 osd.2 221 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e219) 2019-12-08T17:36:30.282 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:36:30.279+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:05.412335+0000 front 2019-12-08T17:35:05.376978+0000 (oldest deadline 2019-12-08T17:35:50.677187+0000) 2019-12-08T17:36:30.374 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:36:30.368+0000 1694f700 -1 osd.7 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:08.172056+0000 front 2019-12-08T17:35:08.133922+0000 (oldest deadline 2019-12-08T17:35:51.487003+0000) 2019-12-08T17:36:30.532 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:36:30.530+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:08.975354+0000 front 2019-12-08T17:35:08.844427+0000 (oldest deadline 2019-12-08T17:35:50.447777+0000) 2019-12-08T17:36:30.573 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:36:30.565+0000 1694f700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:06.946681+0000 front 2019-12-08T17:35:06.951892+0000 (oldest deadline 2019-12-08T17:35:50.425881+0000) 2019-12-08T17:36:30.812 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:36:30.808+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:07.891947+0000 front 2019-12-08T17:35:08.005515+0000 (oldest deadline 2019-12-08T17:35:50.637056+0000) 2019-12-08T17:36:31.010 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:36:31.005+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:09.491799+0000 front 2019-12-08T17:35:09.577880+0000 (oldest deadline 2019-12-08T17:35:50.562578+0000) 2019-12-08T17:36:31.263 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:36:31.261+0000 1694f700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:35:21.010804+0000 (oldest deadline 2019-12-08T17:36:01.010804+0000) 2019-12-08T17:36:31.269 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:36:31.266+0000 1694f700 -1 osd.2 221 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e219) 2019-12-08T17:36:31.306 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:36:31.301+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:05.412335+0000 front 2019-12-08T17:35:05.376978+0000 (oldest deadline 2019-12-08T17:35:50.677187+0000) 2019-12-08T17:36:31.417 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:36:31.413+0000 1694f700 -1 osd.7 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:08.172056+0000 front 2019-12-08T17:35:08.133922+0000 (oldest deadline 2019-12-08T17:35:51.487003+0000) 2019-12-08T17:36:31.515 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:36:31.513+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:08.975354+0000 front 2019-12-08T17:35:08.844427+0000 (oldest deadline 2019-12-08T17:35:50.447777+0000) 2019-12-08T17:36:31.621 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:36:31.615+0000 1694f700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:06.946681+0000 front 2019-12-08T17:35:06.951892+0000 (oldest deadline 2019-12-08T17:35:50.425881+0000) 2019-12-08T17:36:31.804 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:36:31.799+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:07.891947+0000 front 2019-12-08T17:35:08.005515+0000 (oldest deadline 2019-12-08T17:35:50.637056+0000) 2019-12-08T17:36:31.993 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:36:31.988+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:09.491799+0000 front 2019-12-08T17:35:09.577880+0000 (oldest deadline 2019-12-08T17:35:50.562578+0000) 2019-12-08T17:36:32.286 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:36:32.282+0000 1694f700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:35:21.010804+0000 (oldest deadline 2019-12-08T17:36:01.010804+0000) 2019-12-08T17:36:32.287 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:36:32.285+0000 1694f700 -1 osd.2 221 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e219) 2019-12-08T17:36:32.335 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:36:32.333+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:05.412335+0000 front 2019-12-08T17:35:05.376978+0000 (oldest deadline 2019-12-08T17:35:50.677187+0000) 2019-12-08T17:36:32.405 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:36:32.400+0000 1694f700 -1 osd.7 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:08.172056+0000 front 2019-12-08T17:35:08.133922+0000 (oldest deadline 2019-12-08T17:35:51.487003+0000) 2019-12-08T17:36:32.543 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:36:32.539+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:08.975354+0000 front 2019-12-08T17:35:08.844427+0000 (oldest deadline 2019-12-08T17:35:50.447777+0000) 2019-12-08T17:36:32.625 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:36:32.620+0000 1694f700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:06.946681+0000 front 2019-12-08T17:35:06.951892+0000 (oldest deadline 2019-12-08T17:35:50.425881+0000) 2019-12-08T17:36:32.806 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:36:32.800+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:07.891947+0000 front 2019-12-08T17:35:08.005515+0000 (oldest deadline 2019-12-08T17:35:50.637056+0000) 2019-12-08T17:36:32.976 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:36:32.970+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:09.491799+0000 front 2019-12-08T17:35:09.577880+0000 (oldest deadline 2019-12-08T17:35:50.562578+0000) 2019-12-08T17:36:33.243 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:36:33.241+0000 1694f700 -1 osd.2 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:35:21.010804+0000 (oldest deadline 2019-12-08T17:36:01.010804+0000) 2019-12-08T17:36:33.246 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:36:33.245+0000 1694f700 -1 osd.2 221 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e219) 2019-12-08T17:36:33.361 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:36:33.358+0000 1694f700 -1 osd.3 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:05.412335+0000 front 2019-12-08T17:35:05.376978+0000 (oldest deadline 2019-12-08T17:35:50.677187+0000) 2019-12-08T17:36:33.420 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:36:33.414+0000 1694f700 -1 osd.7 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:08.172056+0000 front 2019-12-08T17:35:08.133922+0000 (oldest deadline 2019-12-08T17:35:51.487003+0000) 2019-12-08T17:36:33.518 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:36:33.515+0000 1694f700 -1 osd.0 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:08.975354+0000 front 2019-12-08T17:35:08.844427+0000 (oldest deadline 2019-12-08T17:35:50.447777+0000) 2019-12-08T17:36:33.602 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:36:33.597+0000 1694f700 -1 osd.6 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:06.946681+0000 front 2019-12-08T17:35:06.951892+0000 (oldest deadline 2019-12-08T17:35:50.425881+0000) 2019-12-08T17:36:33.830 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:36:33.824+0000 1694f700 -1 osd.4 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:07.891947+0000 front 2019-12-08T17:35:08.005515+0000 (oldest deadline 2019-12-08T17:35:50.637056+0000) 2019-12-08T17:36:33.958 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:36:33.953+0000 1694f700 -1 osd.5 221 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:35:09.491799+0000 front 2019-12-08T17:35:09.577880+0000 (oldest deadline 2019-12-08T17:35:50.562578+0000) 2019-12-08T17:36:34.013 INFO:tasks.ceph.mon.b.smithi013.stderr:2019-12-08T17:36:33.999+0000 1a89c700 -1 mon.b@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.1 [v2:172.21.15.79:6810/10449,v1:172.21.15.79:6811/10449] for 43sec e221 v221) 2019-12-08T17:36:36.510 INFO:tasks.rgw.client.0.smithi079.stdout:2019-12-08T17:36:36.493+0000 20e25700 -1 RGWWatcher::handle_error cookie 384008544 err (107) Transport endpoint is not connected 2019-12-08T17:37:02.365 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:37:02.326+0000 1694f700 -1 osd.1 220 get_health_metrics reporting 26 slow ops, oldest is osd_op(client.4449.0:104691 5.9 5.84ada7c9 (undecoded) ondisk+write+known_if_redirected e221) 2019-12-08T17:37:03.714 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:37:03.712+0000 1694f700 -1 osd.1 221 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:104788 5.f 5.4322fa9f (undecoded) ondisk+write+known_if_redirected e221) 2019-12-08T17:37:04.061 INFO:tasks.rgw.client.0.smithi079.stdout:2019-12-08T17:37:03.986+0000 20e25700 -1 RGWWatcher::handle_error cookie 5462069504 err (107) Transport endpoint is not connected 2019-12-08T17:37:05.314 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:05:34:30.016 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T17:37:05.327 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:05:34:29.961 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T17:37:05.327 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:05:34:29.962 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T17:37:05.330 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:05:34:29.965 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T17:37:05.333 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:05:34:29.968 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T17:37:05.337 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:05:34:30.040 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T17:37:05.478 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:05:34:30.108 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T17:37:05.489 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:05:34:30.123 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T17:37:05.512 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:05:34:30.215 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T17:37:07.393 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:37:07.318+0000 34274700 -1 osd.5 225 build_incremental_map_msg missing incremental map 225 2019-12-08T17:37:07.411 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:37:07.345+0000 34274700 -1 osd.5 225 build_incremental_map_msg missing incremental map 225 2019-12-08T17:37:07.447 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:37:07.410+0000 3927e700 -1 osd.7 225 build_incremental_map_msg missing incremental map 225 2019-12-08T17:37:07.467 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:37:07.412+0000 33a73700 -1 osd.7 225 build_incremental_map_msg missing incremental map 225 2019-12-08T17:37:07.471 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:37:07.436+0000 34274700 -1 osd.0 225 build_incremental_map_msg missing incremental map 225 2019-12-08T17:37:07.476 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:37:07.459+0000 35276700 -1 osd.0 225 build_incremental_map_msg missing incremental map 225 2019-12-08T17:37:07.482 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:37:07.463+0000 35276700 -1 osd.0 225 build_incremental_map_msg missing incremental map 225 2019-12-08T17:37:07.511 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:37:07.476+0000 33a73700 -1 osd.0 225 build_incremental_map_msg missing incremental map 225 2019-12-08T17:37:07.535 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:37:07.447+0000 3927e700 -1 osd.7 225 build_incremental_map_msg missing incremental map 225 2019-12-08T17:37:07.606 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:37:07.505+0000 3927e700 -1 osd.7 225 build_incremental_map_msg missing incremental map 225 2019-12-08T17:37:07.613 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:37:07.521+0000 36278700 -1 osd.7 225 build_incremental_map_msg missing incremental map 225 2019-12-08T17:37:07.707 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:37:07.603+0000 36278700 -1 osd.5 225 build_incremental_map_msg missing incremental map 225 2019-12-08T17:37:07.752 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:37:07.610+0000 36278700 -1 osd.5 225 build_incremental_map_msg missing incremental map 225 2019-12-08T17:37:07.809 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:37:07.686+0000 3727a700 -1 osd.5 225 build_incremental_map_msg missing incremental map 225 2019-12-08T17:37:07.821 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:37:07.658+0000 3aa81700 -1 osd.0 225 build_incremental_map_msg missing incremental map 225 2019-12-08T17:37:07.854 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:37:07.739+0000 35276700 -1 osd.5 225 build_incremental_map_msg missing incremental map 225 2019-12-08T17:37:09.424 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:37:09.414+0000 3927e700 -1 osd.1 226 build_incremental_map_msg missing incremental map 226 2019-12-08T17:37:09.573 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:37:09.568+0000 3a280700 -1 osd.1 226 build_incremental_map_msg missing incremental map 226 2019-12-08T17:37:09.601 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:37:09.595+0000 38a7d700 -1 osd.1 226 build_incremental_map_msg missing incremental map 226 2019-12-08T17:37:09.773 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:37:09.698+0000 33a73700 -1 osd.1 226 build_incremental_map_msg missing incremental map 226 2019-12-08T17:37:09.828 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:37:09.767+0000 3a280700 -1 osd.1 226 build_incremental_map_msg missing incremental map 226 2019-12-08T17:37:09.831 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:37:09.778+0000 33a73700 -1 osd.1 226 build_incremental_map_msg missing incremental map 226 2019-12-08T17:37:13.823 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:37:13.814+0000 3727a700 -1 osd.1 227 build_incremental_map_msg missing incremental map 226 2019-12-08T17:38:28.472 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:38:28.467+0000 1694f700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:48.122880+0000 front 2019-12-08T17:37:45.817543+0000 (oldest deadline 2019-12-08T17:38:27.976580+0000) 2019-12-08T17:38:29.442 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:38:29.437+0000 1694f700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:48.122880+0000 front 2019-12-08T17:37:45.817543+0000 (oldest deadline 2019-12-08T17:38:27.976580+0000) 2019-12-08T17:38:29.957 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:38:29.952+0000 1694f700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.851477+0000 front 2019-12-08T17:37:46.847132+0000 (oldest deadline 2019-12-08T17:38:29.478055+0000) 2019-12-08T17:38:30.479 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:38:30.474+0000 1694f700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:48.122880+0000 front 2019-12-08T17:37:45.817543+0000 (oldest deadline 2019-12-08T17:38:27.976580+0000) 2019-12-08T17:38:30.517 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:38:30.511+0000 1694f700 -1 osd.4 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.638141+0000 front 2019-12-08T17:37:45.093187+0000 (oldest deadline 2019-12-08T17:38:30.352303+0000) 2019-12-08T17:38:30.643 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:38:30.641+0000 1694f700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.664858+0000 front 2019-12-08T17:37:46.857428+0000 (oldest deadline 2019-12-08T17:38:30.105899+0000) 2019-12-08T17:38:30.982 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:38:30.976+0000 1694f700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.851477+0000 front 2019-12-08T17:37:46.847132+0000 (oldest deadline 2019-12-08T17:38:29.478055+0000) 2019-12-08T17:38:31.477 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:38:31.472+0000 1694f700 -1 osd.4 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.638141+0000 front 2019-12-08T17:37:45.093187+0000 (oldest deadline 2019-12-08T17:38:30.352303+0000) 2019-12-08T17:38:31.494 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:38:31.489+0000 1694f700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:48.122880+0000 front 2019-12-08T17:37:45.817543+0000 (oldest deadline 2019-12-08T17:38:27.976580+0000) 2019-12-08T17:38:31.629 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:38:31.627+0000 1694f700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.664858+0000 front 2019-12-08T17:37:46.857428+0000 (oldest deadline 2019-12-08T17:38:30.105899+0000) 2019-12-08T17:38:31.992 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:38:31.988+0000 1694f700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.851477+0000 front 2019-12-08T17:37:46.847132+0000 (oldest deadline 2019-12-08T17:38:29.478055+0000) 2019-12-08T17:38:32.463 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:38:32.453+0000 1694f700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:48.122880+0000 front 2019-12-08T17:37:45.817543+0000 (oldest deadline 2019-12-08T17:38:27.976580+0000) 2019-12-08T17:38:32.476 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:38:32.471+0000 1694f700 -1 osd.4 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.638141+0000 front 2019-12-08T17:37:45.093187+0000 (oldest deadline 2019-12-08T17:38:30.352303+0000) 2019-12-08T17:38:32.673 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:38:32.671+0000 1694f700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.664858+0000 front 2019-12-08T17:37:46.857428+0000 (oldest deadline 2019-12-08T17:38:30.105899+0000) 2019-12-08T17:38:32.972 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:38:32.967+0000 1694f700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.851477+0000 front 2019-12-08T17:37:46.847132+0000 (oldest deadline 2019-12-08T17:38:29.478055+0000) 2019-12-08T17:38:33.433 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:38:33.428+0000 1694f700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:48.122880+0000 front 2019-12-08T17:37:45.817543+0000 (oldest deadline 2019-12-08T17:38:27.976580+0000) 2019-12-08T17:38:33.517 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:38:33.511+0000 1694f700 -1 osd.4 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.638141+0000 front 2019-12-08T17:37:45.093187+0000 (oldest deadline 2019-12-08T17:38:30.352303+0000) 2019-12-08T17:38:33.714 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:38:33.711+0000 1694f700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.664858+0000 front 2019-12-08T17:37:46.857428+0000 (oldest deadline 2019-12-08T17:38:30.105899+0000) 2019-12-08T17:38:33.989 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:38:33.984+0000 1694f700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.851477+0000 front 2019-12-08T17:37:46.847132+0000 (oldest deadline 2019-12-08T17:38:29.478055+0000) 2019-12-08T17:38:34.466 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:38:34.461+0000 1694f700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:48.122880+0000 front 2019-12-08T17:37:45.817543+0000 (oldest deadline 2019-12-08T17:38:27.976580+0000) 2019-12-08T17:38:34.536 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:38:34.531+0000 1694f700 -1 osd.4 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.638141+0000 front 2019-12-08T17:37:45.093187+0000 (oldest deadline 2019-12-08T17:38:30.352303+0000) 2019-12-08T17:38:34.690 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:38:34.686+0000 1694f700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.664858+0000 front 2019-12-08T17:37:46.857428+0000 (oldest deadline 2019-12-08T17:38:30.105899+0000) 2019-12-08T17:38:34.953 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:38:34.947+0000 1694f700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.851477+0000 front 2019-12-08T17:37:46.847132+0000 (oldest deadline 2019-12-08T17:38:29.478055+0000) 2019-12-08T17:38:35.491 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:38:35.486+0000 1694f700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:48.122880+0000 front 2019-12-08T17:37:45.817543+0000 (oldest deadline 2019-12-08T17:38:27.976580+0000) 2019-12-08T17:38:35.591 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:38:35.586+0000 1694f700 -1 osd.4 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.638141+0000 front 2019-12-08T17:37:45.093187+0000 (oldest deadline 2019-12-08T17:38:30.352303+0000) 2019-12-08T17:38:35.723 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:38:35.721+0000 1694f700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.664858+0000 front 2019-12-08T17:37:46.857428+0000 (oldest deadline 2019-12-08T17:38:30.105899+0000) 2019-12-08T17:38:35.996 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:38:35.991+0000 1694f700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.851477+0000 front 2019-12-08T17:37:46.847132+0000 (oldest deadline 2019-12-08T17:38:29.478055+0000) 2019-12-08T17:38:36.454 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:38:36.448+0000 1694f700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:48.122880+0000 front 2019-12-08T17:37:45.817543+0000 (oldest deadline 2019-12-08T17:38:27.976580+0000) 2019-12-08T17:38:36.576 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:38:36.569+0000 1694f700 -1 osd.4 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.638141+0000 front 2019-12-08T17:37:45.093187+0000 (oldest deadline 2019-12-08T17:38:30.352303+0000) 2019-12-08T17:38:36.767 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:38:36.767+0000 1694f700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.664858+0000 front 2019-12-08T17:37:46.857428+0000 (oldest deadline 2019-12-08T17:38:30.105899+0000) 2019-12-08T17:38:36.951 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:38:36.947+0000 1694f700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.851477+0000 front 2019-12-08T17:37:46.847132+0000 (oldest deadline 2019-12-08T17:38:29.478055+0000) 2019-12-08T17:38:37.467 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:38:37.459+0000 1694f700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:48.122880+0000 front 2019-12-08T17:37:45.817543+0000 (oldest deadline 2019-12-08T17:38:27.976580+0000) 2019-12-08T17:38:37.592 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:38:37.587+0000 1694f700 -1 osd.4 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.638141+0000 front 2019-12-08T17:37:45.093187+0000 (oldest deadline 2019-12-08T17:38:30.352303+0000) 2019-12-08T17:38:37.788 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:38:37.786+0000 1694f700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.664858+0000 front 2019-12-08T17:37:46.857428+0000 (oldest deadline 2019-12-08T17:38:30.105899+0000) 2019-12-08T17:38:37.988 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:38:37.984+0000 1694f700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.851477+0000 front 2019-12-08T17:37:46.847132+0000 (oldest deadline 2019-12-08T17:38:29.478055+0000) 2019-12-08T17:38:38.461 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:38:38.456+0000 1694f700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:48.122880+0000 front 2019-12-08T17:37:45.817543+0000 (oldest deadline 2019-12-08T17:38:27.976580+0000) 2019-12-08T17:38:38.581 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:38:38.574+0000 1694f700 -1 osd.4 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.638141+0000 front 2019-12-08T17:37:45.093187+0000 (oldest deadline 2019-12-08T17:38:30.352303+0000) 2019-12-08T17:38:38.768 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:38:38.767+0000 1694f700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.664858+0000 front 2019-12-08T17:37:46.857428+0000 (oldest deadline 2019-12-08T17:38:30.105899+0000) 2019-12-08T17:38:38.949 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:38:38.943+0000 1694f700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.851477+0000 front 2019-12-08T17:37:46.847132+0000 (oldest deadline 2019-12-08T17:38:29.478055+0000) 2019-12-08T17:38:39.439 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:38:39.435+0000 1694f700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:48.122880+0000 front 2019-12-08T17:37:45.817543+0000 (oldest deadline 2019-12-08T17:38:27.976580+0000) 2019-12-08T17:38:39.544 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:38:39.540+0000 1694f700 -1 osd.4 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.638141+0000 front 2019-12-08T17:37:45.093187+0000 (oldest deadline 2019-12-08T17:38:30.352303+0000) 2019-12-08T17:38:39.803 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:38:39.802+0000 1694f700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.664858+0000 front 2019-12-08T17:37:46.857428+0000 (oldest deadline 2019-12-08T17:38:30.105899+0000) 2019-12-08T17:38:39.992 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:38:39.988+0000 1694f700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.851477+0000 front 2019-12-08T17:37:46.847132+0000 (oldest deadline 2019-12-08T17:38:29.478055+0000) 2019-12-08T17:38:40.404 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:38:40.399+0000 1694f700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:48.122880+0000 front 2019-12-08T17:37:45.817543+0000 (oldest deadline 2019-12-08T17:38:27.976580+0000) 2019-12-08T17:38:40.526 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:38:40.520+0000 1694f700 -1 osd.4 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.638141+0000 front 2019-12-08T17:37:45.093187+0000 (oldest deadline 2019-12-08T17:38:30.352303+0000) 2019-12-08T17:38:40.788 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:38:40.786+0000 1694f700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.664858+0000 front 2019-12-08T17:37:46.857428+0000 (oldest deadline 2019-12-08T17:38:30.105899+0000) 2019-12-08T17:38:41.043 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:38:41.038+0000 1694f700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.851477+0000 front 2019-12-08T17:37:46.847132+0000 (oldest deadline 2019-12-08T17:38:29.478055+0000) 2019-12-08T17:38:41.390 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:38:41.384+0000 1694f700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:48.122880+0000 front 2019-12-08T17:37:45.817543+0000 (oldest deadline 2019-12-08T17:38:27.976580+0000) 2019-12-08T17:38:41.568 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:38:41.563+0000 1694f700 -1 osd.4 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.638141+0000 front 2019-12-08T17:37:45.093187+0000 (oldest deadline 2019-12-08T17:38:30.352303+0000) 2019-12-08T17:38:41.759 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:38:41.757+0000 1694f700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.664858+0000 front 2019-12-08T17:37:46.857428+0000 (oldest deadline 2019-12-08T17:38:30.105899+0000) 2019-12-08T17:38:42.085 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:38:42.079+0000 1694f700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.851477+0000 front 2019-12-08T17:37:46.847132+0000 (oldest deadline 2019-12-08T17:38:29.478055+0000) 2019-12-08T17:38:42.388 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:38:42.383+0000 1694f700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:48.122880+0000 front 2019-12-08T17:37:45.817543+0000 (oldest deadline 2019-12-08T17:38:27.976580+0000) 2019-12-08T17:38:42.616 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:38:42.611+0000 1694f700 -1 osd.4 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.638141+0000 front 2019-12-08T17:37:45.093187+0000 (oldest deadline 2019-12-08T17:38:30.352303+0000) 2019-12-08T17:38:42.729 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:38:42.725+0000 1694f700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.664858+0000 front 2019-12-08T17:37:46.857428+0000 (oldest deadline 2019-12-08T17:38:30.105899+0000) 2019-12-08T17:38:43.110 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:38:43.105+0000 1694f700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.851477+0000 front 2019-12-08T17:37:46.847132+0000 (oldest deadline 2019-12-08T17:38:29.478055+0000) 2019-12-08T17:38:43.441 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:38:43.435+0000 1694f700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:48.122880+0000 front 2019-12-08T17:37:45.817543+0000 (oldest deadline 2019-12-08T17:38:27.976580+0000) 2019-12-08T17:38:43.646 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:38:43.641+0000 1694f700 -1 osd.4 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.638141+0000 front 2019-12-08T17:37:45.093187+0000 (oldest deadline 2019-12-08T17:38:30.352303+0000) 2019-12-08T17:38:43.753 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:38:43.750+0000 1694f700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.664858+0000 front 2019-12-08T17:37:46.857428+0000 (oldest deadline 2019-12-08T17:38:30.105899+0000) 2019-12-08T17:38:44.108 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:38:44.103+0000 1694f700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.851477+0000 front 2019-12-08T17:37:46.847132+0000 (oldest deadline 2019-12-08T17:38:29.478055+0000) 2019-12-08T17:38:44.456 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:38:44.450+0000 1694f700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:48.122880+0000 front 2019-12-08T17:37:45.817543+0000 (oldest deadline 2019-12-08T17:38:27.976580+0000) 2019-12-08T17:38:44.695 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:38:44.691+0000 1694f700 -1 osd.4 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.638141+0000 front 2019-12-08T17:37:45.093187+0000 (oldest deadline 2019-12-08T17:38:30.352303+0000) 2019-12-08T17:38:44.731 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:38:44.730+0000 1694f700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.664858+0000 front 2019-12-08T17:37:46.857428+0000 (oldest deadline 2019-12-08T17:38:30.105899+0000) 2019-12-08T17:38:45.083 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:38:45.078+0000 1694f700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.851477+0000 front 2019-12-08T17:37:46.847132+0000 (oldest deadline 2019-12-08T17:38:29.478055+0000) 2019-12-08T17:38:45.439 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:38:45.434+0000 1694f700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:48.122880+0000 front 2019-12-08T17:37:45.817543+0000 (oldest deadline 2019-12-08T17:38:27.976580+0000) 2019-12-08T17:38:45.656 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:38:45.650+0000 1694f700 -1 osd.4 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.638141+0000 front 2019-12-08T17:37:45.093187+0000 (oldest deadline 2019-12-08T17:38:30.352303+0000) 2019-12-08T17:38:45.716 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:38:45.712+0000 1694f700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.664858+0000 front 2019-12-08T17:37:46.857428+0000 (oldest deadline 2019-12-08T17:38:30.105899+0000) 2019-12-08T17:38:46.122 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:38:46.116+0000 1694f700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.851477+0000 front 2019-12-08T17:37:46.847132+0000 (oldest deadline 2019-12-08T17:38:29.478055+0000) 2019-12-08T17:38:46.428 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:38:46.423+0000 1694f700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:48.122880+0000 front 2019-12-08T17:37:45.817543+0000 (oldest deadline 2019-12-08T17:38:27.976580+0000) 2019-12-08T17:38:46.676 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:38:46.671+0000 1694f700 -1 osd.4 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.638141+0000 front 2019-12-08T17:37:45.093187+0000 (oldest deadline 2019-12-08T17:38:30.352303+0000) 2019-12-08T17:38:46.711 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:38:46.709+0000 1694f700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.664858+0000 front 2019-12-08T17:37:46.857428+0000 (oldest deadline 2019-12-08T17:38:30.105899+0000) 2019-12-08T17:38:47.084 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:38:47.079+0000 1694f700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.851477+0000 front 2019-12-08T17:37:46.847132+0000 (oldest deadline 2019-12-08T17:38:29.478055+0000) 2019-12-08T17:38:47.410 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:38:47.404+0000 1694f700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:48.122880+0000 front 2019-12-08T17:37:45.817543+0000 (oldest deadline 2019-12-08T17:38:27.976580+0000) 2019-12-08T17:38:47.670 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:38:47.668+0000 1694f700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.664858+0000 front 2019-12-08T17:37:46.857428+0000 (oldest deadline 2019-12-08T17:38:30.105899+0000) 2019-12-08T17:38:47.719 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:38:47.712+0000 1694f700 -1 osd.4 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.638141+0000 front 2019-12-08T17:37:45.093187+0000 (oldest deadline 2019-12-08T17:38:30.352303+0000) 2019-12-08T17:38:48.052 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:38:48.048+0000 1694f700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.851477+0000 front 2019-12-08T17:37:46.847132+0000 (oldest deadline 2019-12-08T17:38:29.478055+0000) 2019-12-08T17:38:48.437 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:38:48.431+0000 1694f700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:48.122880+0000 front 2019-12-08T17:37:45.817543+0000 (oldest deadline 2019-12-08T17:38:27.976580+0000) 2019-12-08T17:38:48.637 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:38:48.636+0000 1694f700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.664858+0000 front 2019-12-08T17:37:46.857428+0000 (oldest deadline 2019-12-08T17:38:30.105899+0000) 2019-12-08T17:38:48.764 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:38:48.759+0000 1694f700 -1 osd.4 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.638141+0000 front 2019-12-08T17:37:45.093187+0000 (oldest deadline 2019-12-08T17:38:30.352303+0000) 2019-12-08T17:38:49.065 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:38:49.059+0000 1694f700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.851477+0000 front 2019-12-08T17:37:46.847132+0000 (oldest deadline 2019-12-08T17:38:29.478055+0000) 2019-12-08T17:38:49.415 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:38:49.410+0000 1694f700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:48.122880+0000 front 2019-12-08T17:37:45.817543+0000 (oldest deadline 2019-12-08T17:38:27.976580+0000) 2019-12-08T17:38:49.646 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:38:49.643+0000 1694f700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.664858+0000 front 2019-12-08T17:37:46.857428+0000 (oldest deadline 2019-12-08T17:38:30.105899+0000) 2019-12-08T17:38:49.728 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:38:49.722+0000 1694f700 -1 osd.4 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.638141+0000 front 2019-12-08T17:37:45.093187+0000 (oldest deadline 2019-12-08T17:38:30.352303+0000) 2019-12-08T17:38:50.047 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:38:50.042+0000 1694f700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.851477+0000 front 2019-12-08T17:37:46.847132+0000 (oldest deadline 2019-12-08T17:38:29.478055+0000) 2019-12-08T17:38:50.469 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:38:50.464+0000 1694f700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:48.122880+0000 front 2019-12-08T17:37:45.817543+0000 (oldest deadline 2019-12-08T17:38:27.976580+0000) 2019-12-08T17:38:50.663 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:38:50.660+0000 1694f700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.664858+0000 front 2019-12-08T17:37:46.857428+0000 (oldest deadline 2019-12-08T17:38:30.105899+0000) 2019-12-08T17:38:50.782 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:38:50.776+0000 1694f700 -1 osd.4 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.638141+0000 front 2019-12-08T17:37:45.093187+0000 (oldest deadline 2019-12-08T17:38:30.352303+0000) 2019-12-08T17:38:51.088 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:38:51.083+0000 1694f700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.851477+0000 front 2019-12-08T17:37:46.847132+0000 (oldest deadline 2019-12-08T17:38:29.478055+0000) 2019-12-08T17:38:51.153 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:38:51.146+0000 1694f700 -1 osd.6 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.638244+0000 front 2019-12-08T17:37:46.640393+0000 (oldest deadline 2019-12-08T17:38:50.787740+0000) 2019-12-08T17:38:51.457 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:38:51.452+0000 1694f700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:48.122880+0000 front 2019-12-08T17:37:45.817543+0000 (oldest deadline 2019-12-08T17:38:27.976580+0000) 2019-12-08T17:38:51.650 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:38:51.648+0000 1694f700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.664858+0000 front 2019-12-08T17:37:46.857428+0000 (oldest deadline 2019-12-08T17:38:30.105899+0000) 2019-12-08T17:38:51.751 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:38:51.745+0000 1694f700 -1 osd.4 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.638141+0000 front 2019-12-08T17:37:45.093187+0000 (oldest deadline 2019-12-08T17:38:30.352303+0000) 2019-12-08T17:38:52.129 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:38:52.123+0000 1694f700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.851477+0000 front 2019-12-08T17:37:46.847132+0000 (oldest deadline 2019-12-08T17:38:29.478055+0000) 2019-12-08T17:38:52.179 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:38:52.173+0000 1694f700 -1 osd.6 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.638244+0000 front 2019-12-08T17:37:46.640393+0000 (oldest deadline 2019-12-08T17:38:50.787740+0000) 2019-12-08T17:38:52.502 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:38:52.497+0000 1694f700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:48.122880+0000 front 2019-12-08T17:37:45.817543+0000 (oldest deadline 2019-12-08T17:38:27.976580+0000) 2019-12-08T17:38:52.684 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:38:52.681+0000 1694f700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.664858+0000 front 2019-12-08T17:37:46.857428+0000 (oldest deadline 2019-12-08T17:38:30.105899+0000) 2019-12-08T17:38:52.774 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:38:52.768+0000 1694f700 -1 osd.4 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.638141+0000 front 2019-12-08T17:37:45.093187+0000 (oldest deadline 2019-12-08T17:38:30.352303+0000) 2019-12-08T17:38:53.093 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:38:53.089+0000 1694f700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.851477+0000 front 2019-12-08T17:37:46.847132+0000 (oldest deadline 2019-12-08T17:38:29.478055+0000) 2019-12-08T17:38:53.158 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:38:53.149+0000 1694f700 -1 osd.6 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.638244+0000 front 2019-12-08T17:37:46.640393+0000 (oldest deadline 2019-12-08T17:38:50.787740+0000) 2019-12-08T17:38:53.542 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:38:53.537+0000 1694f700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:48.122880+0000 front 2019-12-08T17:37:45.817543+0000 (oldest deadline 2019-12-08T17:38:27.976580+0000) 2019-12-08T17:38:53.697 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:38:53.695+0000 1694f700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.664858+0000 front 2019-12-08T17:37:46.857428+0000 (oldest deadline 2019-12-08T17:38:30.105899+0000) 2019-12-08T17:38:53.740 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:38:53.734+0000 1694f700 -1 osd.4 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.638141+0000 front 2019-12-08T17:37:45.093187+0000 (oldest deadline 2019-12-08T17:38:30.352303+0000) 2019-12-08T17:38:54.121 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:38:54.117+0000 1694f700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.851477+0000 front 2019-12-08T17:37:46.847132+0000 (oldest deadline 2019-12-08T17:38:29.478055+0000) 2019-12-08T17:38:54.185 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:38:54.180+0000 1694f700 -1 osd.6 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.638244+0000 front 2019-12-08T17:37:46.640393+0000 (oldest deadline 2019-12-08T17:38:50.787740+0000) 2019-12-08T17:38:54.545 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:38:54.540+0000 1694f700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:48.122880+0000 front 2019-12-08T17:37:45.817543+0000 (oldest deadline 2019-12-08T17:38:27.976580+0000) 2019-12-08T17:38:54.702 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:38:54.699+0000 1694f700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.664858+0000 front 2019-12-08T17:37:46.857428+0000 (oldest deadline 2019-12-08T17:38:30.105899+0000) 2019-12-08T17:38:54.770 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:38:54.764+0000 1694f700 -1 osd.4 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.638141+0000 front 2019-12-08T17:37:45.093187+0000 (oldest deadline 2019-12-08T17:38:30.352303+0000) 2019-12-08T17:38:55.111 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:38:55.106+0000 1694f700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.851477+0000 front 2019-12-08T17:37:46.847132+0000 (oldest deadline 2019-12-08T17:38:29.478055+0000) 2019-12-08T17:38:55.196 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:38:55.192+0000 1694f700 -1 osd.6 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.638244+0000 front 2019-12-08T17:37:46.640393+0000 (oldest deadline 2019-12-08T17:38:50.787740+0000) 2019-12-08T17:38:55.557 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:38:55.552+0000 1694f700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:48.122880+0000 front 2019-12-08T17:37:45.817543+0000 (oldest deadline 2019-12-08T17:38:27.976580+0000) 2019-12-08T17:38:55.732 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:38:55.695+0000 1694f700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.664858+0000 front 2019-12-08T17:37:46.857428+0000 (oldest deadline 2019-12-08T17:38:30.105899+0000) 2019-12-08T17:38:55.776 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:38:55.772+0000 1694f700 -1 osd.4 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.638141+0000 front 2019-12-08T17:37:45.093187+0000 (oldest deadline 2019-12-08T17:38:30.352303+0000) 2019-12-08T17:38:56.083 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:38:56.078+0000 1694f700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.851477+0000 front 2019-12-08T17:37:46.847132+0000 (oldest deadline 2019-12-08T17:38:29.478055+0000) 2019-12-08T17:38:56.157 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:38:56.152+0000 1694f700 -1 osd.6 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.638244+0000 front 2019-12-08T17:37:46.640393+0000 (oldest deadline 2019-12-08T17:38:50.787740+0000) 2019-12-08T17:38:56.597 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:38:56.590+0000 1694f700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:48.122880+0000 front 2019-12-08T17:37:45.817543+0000 (oldest deadline 2019-12-08T17:38:27.976580+0000) 2019-12-08T17:38:56.676 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:38:56.674+0000 1694f700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.664858+0000 front 2019-12-08T17:37:46.857428+0000 (oldest deadline 2019-12-08T17:38:30.105899+0000) 2019-12-08T17:38:56.819 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:38:56.814+0000 1694f700 -1 osd.4 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.638141+0000 front 2019-12-08T17:37:45.093187+0000 (oldest deadline 2019-12-08T17:38:30.352303+0000) 2019-12-08T17:38:57.046 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:38:57.040+0000 1694f700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.851477+0000 front 2019-12-08T17:37:46.847132+0000 (oldest deadline 2019-12-08T17:38:29.478055+0000) 2019-12-08T17:38:57.196 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:38:57.192+0000 1694f700 -1 osd.6 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.638244+0000 front 2019-12-08T17:37:46.640393+0000 (oldest deadline 2019-12-08T17:38:50.787740+0000) 2019-12-08T17:38:57.631 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:38:57.627+0000 1694f700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:48.122880+0000 front 2019-12-08T17:37:45.817543+0000 (oldest deadline 2019-12-08T17:38:27.976580+0000) 2019-12-08T17:38:57.656 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:38:57.653+0000 1694f700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.664858+0000 front 2019-12-08T17:37:46.857428+0000 (oldest deadline 2019-12-08T17:38:30.105899+0000) 2019-12-08T17:38:57.830 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:38:57.825+0000 1694f700 -1 osd.4 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.638141+0000 front 2019-12-08T17:37:45.093187+0000 (oldest deadline 2019-12-08T17:38:30.352303+0000) 2019-12-08T17:38:58.076 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:38:58.071+0000 1694f700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.851477+0000 front 2019-12-08T17:37:46.847132+0000 (oldest deadline 2019-12-08T17:38:29.478055+0000) 2019-12-08T17:38:58.208 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:38:58.203+0000 1694f700 -1 osd.6 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.638244+0000 front 2019-12-08T17:37:46.640393+0000 (oldest deadline 2019-12-08T17:38:50.787740+0000) 2019-12-08T17:38:58.683 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:38:58.678+0000 1694f700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:48.122880+0000 front 2019-12-08T17:37:45.817543+0000 (oldest deadline 2019-12-08T17:38:27.976580+0000) 2019-12-08T17:38:58.687 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:38:58.685+0000 1694f700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.664858+0000 front 2019-12-08T17:37:46.857428+0000 (oldest deadline 2019-12-08T17:38:30.105899+0000) 2019-12-08T17:38:58.822 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:38:58.817+0000 1694f700 -1 osd.4 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.638141+0000 front 2019-12-08T17:37:45.093187+0000 (oldest deadline 2019-12-08T17:38:30.352303+0000) 2019-12-08T17:38:59.047 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:38:59.042+0000 1694f700 -1 osd.5 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.851477+0000 front 2019-12-08T17:37:46.847132+0000 (oldest deadline 2019-12-08T17:38:29.478055+0000) 2019-12-08T17:38:59.256 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:38:59.250+0000 1694f700 -1 osd.6 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.638244+0000 front 2019-12-08T17:37:46.640393+0000 (oldest deadline 2019-12-08T17:38:50.787740+0000) 2019-12-08T17:38:59.670 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:38:59.665+0000 1694f700 -1 osd.7 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:48.122880+0000 front 2019-12-08T17:37:45.817543+0000 (oldest deadline 2019-12-08T17:38:27.976580+0000) 2019-12-08T17:38:59.722 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:38:59.720+0000 1694f700 -1 osd.0 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.664858+0000 front 2019-12-08T17:37:46.857428+0000 (oldest deadline 2019-12-08T17:38:30.105899+0000) 2019-12-08T17:38:59.797 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:38:59.792+0000 1694f700 -1 osd.4 227 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:37:46.638141+0000 front 2019-12-08T17:37:45.093187+0000 (oldest deadline 2019-12-08T17:38:30.352303+0000) 2019-12-08T17:38:59.841 INFO:tasks.ceph.mon.b.smithi013.stderr:2019-12-08T17:38:59.836+0000 1a89c700 -1 mon.b@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.2 [v2:172.21.15.79:6802/10448,v1:172.21.15.79:6803/10448] for 43sec e227 v227) 2019-12-08T17:39:40.128 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:39:40.109+0000 36278700 -1 osd.2 232 build_incremental_map_msg missing incremental map 232 2019-12-08T17:39:40.324 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:39:40.318+0000 36278700 -1 osd.2 232 build_incremental_map_msg missing incremental map 232 2019-12-08T17:40:10.333 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:40:10.332+0000 1694f700 -1 osd.2 233 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:40:11.290 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:40:11.288+0000 1694f700 -1 osd.2 233 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:40:12.288 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:40:12.287+0000 1694f700 -1 osd.2 233 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:40:13.294 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:40:13.292+0000 1694f700 -1 osd.2 233 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:40:14.302 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:40:14.299+0000 1694f700 -1 osd.2 233 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:40:15.320 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:40:15.318+0000 1694f700 -1 osd.2 233 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:40:16.367 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:40:16.366+0000 1694f700 -1 osd.2 233 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:40:17.391 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:40:17.390+0000 1694f700 -1 osd.2 233 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:40:18.389 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:40:18.387+0000 1694f700 -1 osd.2 233 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:40:19.399 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:40:19.396+0000 1694f700 -1 osd.2 233 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:40:20.371 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:40:20.370+0000 1694f700 -1 osd.2 233 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:40:21.353 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:40:21.351+0000 1694f700 -1 osd.2 233 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:40:22.357 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:40:22.355+0000 1694f700 -1 osd.2 233 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:40:23.389 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:40:23.388+0000 1694f700 -1 osd.2 233 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:40:24.373 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:40:24.371+0000 1694f700 -1 osd.2 233 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:40:25.329 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:40:25.328+0000 1694f700 -1 osd.2 233 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:40:26.308 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:40:26.306+0000 1694f700 -1 osd.2 233 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:40:27.284 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:40:27.283+0000 1694f700 -1 osd.2 233 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:40:28.319 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:40:28.314+0000 1694f700 -1 osd.2 233 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:40:29.352 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:40:29.351+0000 1694f700 -1 osd.2 233 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:40:30.373 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:40:30.372+0000 1694f700 -1 osd.2 233 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:40:31.402 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:40:31.401+0000 1694f700 -1 osd.2 233 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:40:32.435 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:40:32.433+0000 1694f700 -1 osd.2 233 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:40:33.391 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:40:33.389+0000 1694f700 -1 osd.2 233 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:40:34.403 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:40:34.401+0000 1694f700 -1 osd.2 233 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:40:35.390 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:40:35.389+0000 1694f700 -1 osd.2 233 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:40:36.430 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:40:36.429+0000 1694f700 -1 osd.2 233 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:40:37.481 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:40:37.480+0000 1694f700 -1 osd.2 233 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:40:38.437 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:40:38.437+0000 1694f700 -1 osd.2 233 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:40:39.474 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:40:39.473+0000 1694f700 -1 osd.2 233 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:40:40.501 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:40:40.502+0000 1694f700 -1 osd.2 233 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:40:41.538 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:40:41.537+0000 1694f700 -1 osd.2 233 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:40:42.541 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:40:42.540+0000 1694f700 -1 osd.2 233 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:40:42.707 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:40:42.701+0000 1694f700 -1 osd.7 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:00.136464+0000 front 2019-12-08T17:40:00.808689+0000 (oldest deadline 2019-12-08T17:40:42.329933+0000) 2019-12-08T17:40:43.577 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:40:43.576+0000 1694f700 -1 osd.2 233 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:40:43.678 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:40:43.673+0000 1694f700 -1 osd.7 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:00.136464+0000 front 2019-12-08T17:40:00.808689+0000 (oldest deadline 2019-12-08T17:40:42.329933+0000) 2019-12-08T17:40:44.168 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:40:44.161+0000 1694f700 -1 osd.6 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:00.110261+0000 front 2019-12-08T17:40:00.136530+0000 (oldest deadline 2019-12-08T17:40:43.232030+0000) 2019-12-08T17:40:44.531 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:40:44.530+0000 1694f700 -1 osd.2 233 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:40:44.686 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:40:44.680+0000 1694f700 -1 osd.4 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:39:57.940109+0000 front 2019-12-08T17:39:58.003631+0000 (oldest deadline 2019-12-08T17:40:43.753017+0000) 2019-12-08T17:40:44.722 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:40:44.716+0000 1694f700 -1 osd.7 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:00.136464+0000 front 2019-12-08T17:40:00.808689+0000 (oldest deadline 2019-12-08T17:40:42.329933+0000) 2019-12-08T17:40:45.170 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:40:45.162+0000 1694f700 -1 osd.6 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:00.110261+0000 front 2019-12-08T17:40:00.136530+0000 (oldest deadline 2019-12-08T17:40:43.232030+0000) 2019-12-08T17:40:45.441 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:40:45.439+0000 1694f700 -1 osd.3 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:39:59.504420+0000 front 2019-12-08T17:39:59.503525+0000 (oldest deadline 2019-12-08T17:40:45.342251+0000) 2019-12-08T17:40:45.524 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:40:45.522+0000 1694f700 -1 osd.2 233 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:40:45.679 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:40:45.674+0000 1694f700 -1 osd.4 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:39:57.940109+0000 front 2019-12-08T17:39:58.003631+0000 (oldest deadline 2019-12-08T17:40:43.753017+0000) 2019-12-08T17:40:45.695 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:40:45.691+0000 1694f700 -1 osd.0 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:01.376706+0000 front 2019-12-08T17:40:01.521059+0000 (oldest deadline 2019-12-08T17:40:44.812982+0000) 2019-12-08T17:40:45.712 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:40:45.706+0000 1694f700 -1 osd.7 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:00.136464+0000 front 2019-12-08T17:40:00.808689+0000 (oldest deadline 2019-12-08T17:40:42.329933+0000) 2019-12-08T17:40:46.137 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:40:46.131+0000 1694f700 -1 osd.6 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:00.110261+0000 front 2019-12-08T17:40:00.136530+0000 (oldest deadline 2019-12-08T17:40:43.232030+0000) 2019-12-08T17:40:46.444 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:40:46.443+0000 1694f700 -1 osd.3 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:39:59.504420+0000 front 2019-12-08T17:39:59.503525+0000 (oldest deadline 2019-12-08T17:40:45.342251+0000) 2019-12-08T17:40:46.570 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:40:46.569+0000 1694f700 -1 osd.2 233 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:40:46.686 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:40:46.675+0000 1694f700 -1 osd.4 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:39:57.940109+0000 front 2019-12-08T17:39:58.003631+0000 (oldest deadline 2019-12-08T17:40:43.753017+0000) 2019-12-08T17:40:46.730 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:40:46.727+0000 1694f700 -1 osd.0 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:01.376706+0000 front 2019-12-08T17:40:01.521059+0000 (oldest deadline 2019-12-08T17:40:44.812982+0000) 2019-12-08T17:40:46.755 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:40:46.748+0000 1694f700 -1 osd.7 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:00.136464+0000 front 2019-12-08T17:40:00.808689+0000 (oldest deadline 2019-12-08T17:40:42.329933+0000) 2019-12-08T17:40:47.141 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:40:47.136+0000 1694f700 -1 osd.6 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:00.110261+0000 front 2019-12-08T17:40:00.136530+0000 (oldest deadline 2019-12-08T17:40:43.232030+0000) 2019-12-08T17:40:47.495 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:40:47.494+0000 1694f700 -1 osd.3 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:39:59.504420+0000 front 2019-12-08T17:39:59.503525+0000 (oldest deadline 2019-12-08T17:40:45.342251+0000) 2019-12-08T17:40:47.545 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:40:47.544+0000 1694f700 -1 osd.2 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:01.388861+0000 front 2019-12-08T17:40:01.393813+0000 (oldest deadline 2019-12-08T17:40:46.608587+0000) 2019-12-08T17:40:47.549 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:40:47.548+0000 1694f700 -1 osd.2 233 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:40:47.682 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:40:47.675+0000 1694f700 -1 osd.4 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:39:57.940109+0000 front 2019-12-08T17:39:58.003631+0000 (oldest deadline 2019-12-08T17:40:43.753017+0000) 2019-12-08T17:40:47.743 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:40:47.737+0000 1694f700 -1 osd.7 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:00.136464+0000 front 2019-12-08T17:40:00.808689+0000 (oldest deadline 2019-12-08T17:40:42.329933+0000) 2019-12-08T17:40:47.769 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:40:47.767+0000 1694f700 -1 osd.0 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:01.376706+0000 front 2019-12-08T17:40:01.521059+0000 (oldest deadline 2019-12-08T17:40:44.812982+0000) 2019-12-08T17:40:48.132 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:40:48.126+0000 1694f700 -1 osd.6 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:00.110261+0000 front 2019-12-08T17:40:00.136530+0000 (oldest deadline 2019-12-08T17:40:43.232030+0000) 2019-12-08T17:40:48.519 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:40:48.516+0000 1694f700 -1 osd.3 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:39:59.504420+0000 front 2019-12-08T17:39:59.503525+0000 (oldest deadline 2019-12-08T17:40:45.342251+0000) 2019-12-08T17:40:48.521 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:40:48.518+0000 1694f700 -1 osd.2 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:01.388861+0000 front 2019-12-08T17:40:01.393813+0000 (oldest deadline 2019-12-08T17:40:46.608587+0000) 2019-12-08T17:40:48.523 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:40:48.521+0000 1694f700 -1 osd.2 233 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:40:48.669 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:40:48.662+0000 1694f700 -1 osd.4 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:39:57.940109+0000 front 2019-12-08T17:39:58.003631+0000 (oldest deadline 2019-12-08T17:40:43.753017+0000) 2019-12-08T17:40:48.743 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:40:48.740+0000 1694f700 -1 osd.0 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:01.376706+0000 front 2019-12-08T17:40:01.521059+0000 (oldest deadline 2019-12-08T17:40:44.812982+0000) 2019-12-08T17:40:48.763 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:40:48.757+0000 1694f700 -1 osd.7 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:00.136464+0000 front 2019-12-08T17:40:00.808689+0000 (oldest deadline 2019-12-08T17:40:42.329933+0000) 2019-12-08T17:40:49.131 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:40:49.125+0000 1694f700 -1 osd.6 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:00.110261+0000 front 2019-12-08T17:40:00.136530+0000 (oldest deadline 2019-12-08T17:40:43.232030+0000) 2019-12-08T17:40:49.506 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:40:49.505+0000 1694f700 -1 osd.3 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:39:59.504420+0000 front 2019-12-08T17:39:59.503525+0000 (oldest deadline 2019-12-08T17:40:45.342251+0000) 2019-12-08T17:40:49.526 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:40:49.525+0000 1694f700 -1 osd.2 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:01.388861+0000 front 2019-12-08T17:40:01.393813+0000 (oldest deadline 2019-12-08T17:40:46.608587+0000) 2019-12-08T17:40:49.527 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:40:49.526+0000 1694f700 -1 osd.2 233 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:40:49.662 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:40:49.655+0000 1694f700 -1 osd.4 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:39:57.940109+0000 front 2019-12-08T17:39:58.003631+0000 (oldest deadline 2019-12-08T17:40:43.753017+0000) 2019-12-08T17:40:49.765 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:40:49.759+0000 1694f700 -1 osd.7 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:00.136464+0000 front 2019-12-08T17:40:00.808689+0000 (oldest deadline 2019-12-08T17:40:42.329933+0000) 2019-12-08T17:40:49.784 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:40:49.782+0000 1694f700 -1 osd.0 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:01.376706+0000 front 2019-12-08T17:40:01.521059+0000 (oldest deadline 2019-12-08T17:40:44.812982+0000) 2019-12-08T17:40:50.139 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:40:50.132+0000 1694f700 -1 osd.6 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:00.110261+0000 front 2019-12-08T17:40:00.136530+0000 (oldest deadline 2019-12-08T17:40:43.232030+0000) 2019-12-08T17:40:50.506 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:40:50.505+0000 1694f700 -1 osd.3 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:39:59.504420+0000 front 2019-12-08T17:39:59.503525+0000 (oldest deadline 2019-12-08T17:40:45.342251+0000) 2019-12-08T17:40:50.569 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:40:50.568+0000 1694f700 -1 osd.2 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:01.388861+0000 front 2019-12-08T17:40:01.393813+0000 (oldest deadline 2019-12-08T17:40:46.608587+0000) 2019-12-08T17:40:50.570 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:40:50.570+0000 1694f700 -1 osd.2 233 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:40:50.636 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:40:50.629+0000 1694f700 -1 osd.4 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:39:57.940109+0000 front 2019-12-08T17:39:58.003631+0000 (oldest deadline 2019-12-08T17:40:43.753017+0000) 2019-12-08T17:40:50.730 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:40:50.724+0000 1694f700 -1 osd.7 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:00.136464+0000 front 2019-12-08T17:40:00.808689+0000 (oldest deadline 2019-12-08T17:40:42.329933+0000) 2019-12-08T17:40:50.750 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:40:50.749+0000 1694f700 -1 osd.0 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:01.376706+0000 front 2019-12-08T17:40:01.521059+0000 (oldest deadline 2019-12-08T17:40:44.812982+0000) 2019-12-08T17:40:51.130 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:40:51.124+0000 1694f700 -1 osd.6 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:00.110261+0000 front 2019-12-08T17:40:00.136530+0000 (oldest deadline 2019-12-08T17:40:43.232030+0000) 2019-12-08T17:40:51.473 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:40:51.473+0000 1694f700 -1 osd.3 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:39:59.504420+0000 front 2019-12-08T17:39:59.503525+0000 (oldest deadline 2019-12-08T17:40:45.342251+0000) 2019-12-08T17:40:51.615 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:40:51.613+0000 1694f700 -1 osd.2 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:01.388861+0000 front 2019-12-08T17:40:01.393813+0000 (oldest deadline 2019-12-08T17:40:46.608587+0000) 2019-12-08T17:40:51.618 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:40:51.615+0000 1694f700 -1 osd.2 233 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:40:51.689 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:40:51.683+0000 1694f700 -1 osd.4 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:39:57.940109+0000 front 2019-12-08T17:39:58.003631+0000 (oldest deadline 2019-12-08T17:40:43.753017+0000) 2019-12-08T17:40:51.694 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:40:51.688+0000 1694f700 -1 osd.7 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:00.136464+0000 front 2019-12-08T17:40:00.808689+0000 (oldest deadline 2019-12-08T17:40:42.329933+0000) 2019-12-08T17:40:51.784 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:40:51.778+0000 1694f700 -1 osd.0 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:01.376706+0000 front 2019-12-08T17:40:01.521059+0000 (oldest deadline 2019-12-08T17:40:44.812982+0000) 2019-12-08T17:40:52.162 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:40:52.157+0000 1694f700 -1 osd.6 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:00.110261+0000 front 2019-12-08T17:40:00.136530+0000 (oldest deadline 2019-12-08T17:40:43.232030+0000) 2019-12-08T17:40:52.427 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:40:52.426+0000 1694f700 -1 osd.3 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:39:59.504420+0000 front 2019-12-08T17:39:59.503525+0000 (oldest deadline 2019-12-08T17:40:45.342251+0000) 2019-12-08T17:40:52.594 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:40:52.588+0000 1694f700 -1 osd.2 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:01.388861+0000 front 2019-12-08T17:40:01.393813+0000 (oldest deadline 2019-12-08T17:40:46.608587+0000) 2019-12-08T17:40:52.594 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:40:52.590+0000 1694f700 -1 osd.2 233 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:40:52.724 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:40:52.718+0000 1694f700 -1 osd.7 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:00.136464+0000 front 2019-12-08T17:40:00.808689+0000 (oldest deadline 2019-12-08T17:40:42.329933+0000) 2019-12-08T17:40:52.741 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:40:52.735+0000 1694f700 -1 osd.4 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:39:57.940109+0000 front 2019-12-08T17:39:58.003631+0000 (oldest deadline 2019-12-08T17:40:43.753017+0000) 2019-12-08T17:40:52.833 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:40:52.831+0000 1694f700 -1 osd.0 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:01.376706+0000 front 2019-12-08T17:40:01.521059+0000 (oldest deadline 2019-12-08T17:40:44.812982+0000) 2019-12-08T17:40:53.153 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:40:53.147+0000 1694f700 -1 osd.6 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:00.110261+0000 front 2019-12-08T17:40:00.136530+0000 (oldest deadline 2019-12-08T17:40:43.232030+0000) 2019-12-08T17:40:53.453 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:40:53.452+0000 1694f700 -1 osd.3 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:39:59.504420+0000 front 2019-12-08T17:39:59.503525+0000 (oldest deadline 2019-12-08T17:40:45.342251+0000) 2019-12-08T17:40:53.595 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:40:53.593+0000 1694f700 -1 osd.2 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:01.388861+0000 front 2019-12-08T17:40:01.393813+0000 (oldest deadline 2019-12-08T17:40:46.608587+0000) 2019-12-08T17:40:53.596 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:40:53.596+0000 1694f700 -1 osd.2 233 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:40:53.761 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:40:53.755+0000 1694f700 -1 osd.4 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:39:57.940109+0000 front 2019-12-08T17:39:58.003631+0000 (oldest deadline 2019-12-08T17:40:43.753017+0000) 2019-12-08T17:40:53.777 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:40:53.771+0000 1694f700 -1 osd.7 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:00.136464+0000 front 2019-12-08T17:40:00.808689+0000 (oldest deadline 2019-12-08T17:40:42.329933+0000) 2019-12-08T17:40:53.828 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:40:53.826+0000 1694f700 -1 osd.0 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:01.376706+0000 front 2019-12-08T17:40:01.521059+0000 (oldest deadline 2019-12-08T17:40:44.812982+0000) 2019-12-08T17:40:54.190 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:40:54.184+0000 1694f700 -1 osd.6 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:00.110261+0000 front 2019-12-08T17:40:00.136530+0000 (oldest deadline 2019-12-08T17:40:43.232030+0000) 2019-12-08T17:40:54.432 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:40:54.429+0000 1694f700 -1 osd.3 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:39:59.504420+0000 front 2019-12-08T17:39:59.503525+0000 (oldest deadline 2019-12-08T17:40:45.342251+0000) 2019-12-08T17:40:54.640 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:40:54.637+0000 1694f700 -1 osd.2 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:01.388861+0000 front 2019-12-08T17:40:01.393813+0000 (oldest deadline 2019-12-08T17:40:46.608587+0000) 2019-12-08T17:40:54.641 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:40:54.640+0000 1694f700 -1 osd.2 233 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:40:54.789 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:40:54.784+0000 1694f700 -1 osd.7 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:00.136464+0000 front 2019-12-08T17:40:00.808689+0000 (oldest deadline 2019-12-08T17:40:42.329933+0000) 2019-12-08T17:40:54.804 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:40:54.794+0000 1694f700 -1 osd.4 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:39:57.940109+0000 front 2019-12-08T17:39:58.003631+0000 (oldest deadline 2019-12-08T17:40:43.753017+0000) 2019-12-08T17:40:54.830 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:40:54.829+0000 1694f700 -1 osd.0 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:01.376706+0000 front 2019-12-08T17:40:01.521059+0000 (oldest deadline 2019-12-08T17:40:44.812982+0000) 2019-12-08T17:40:55.216 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:40:55.208+0000 1694f700 -1 osd.6 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:00.110261+0000 front 2019-12-08T17:40:00.136530+0000 (oldest deadline 2019-12-08T17:40:43.232030+0000) 2019-12-08T17:40:55.421 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:40:55.419+0000 1694f700 -1 osd.3 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:39:59.504420+0000 front 2019-12-08T17:39:59.503525+0000 (oldest deadline 2019-12-08T17:40:45.342251+0000) 2019-12-08T17:40:55.622 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:40:55.620+0000 1694f700 -1 osd.2 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:01.388861+0000 front 2019-12-08T17:40:01.393813+0000 (oldest deadline 2019-12-08T17:40:46.608587+0000) 2019-12-08T17:40:55.625 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:40:55.625+0000 1694f700 -1 osd.2 233 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:40:55.841 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:40:55.834+0000 1694f700 -1 osd.7 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:00.136464+0000 front 2019-12-08T17:40:00.808689+0000 (oldest deadline 2019-12-08T17:40:42.329933+0000) 2019-12-08T17:40:55.842 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:40:55.835+0000 1694f700 -1 osd.4 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:39:57.940109+0000 front 2019-12-08T17:39:58.003631+0000 (oldest deadline 2019-12-08T17:40:43.753017+0000) 2019-12-08T17:40:55.879 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:40:55.877+0000 1694f700 -1 osd.0 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:01.376706+0000 front 2019-12-08T17:40:01.521059+0000 (oldest deadline 2019-12-08T17:40:44.812982+0000) 2019-12-08T17:40:56.263 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:40:56.257+0000 1694f700 -1 osd.6 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:00.110261+0000 front 2019-12-08T17:40:00.136530+0000 (oldest deadline 2019-12-08T17:40:43.232030+0000) 2019-12-08T17:40:56.474 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:40:56.471+0000 1694f700 -1 osd.3 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:39:59.504420+0000 front 2019-12-08T17:39:59.503525+0000 (oldest deadline 2019-12-08T17:40:45.342251+0000) 2019-12-08T17:40:56.630 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:40:56.627+0000 1694f700 -1 osd.2 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:01.388861+0000 front 2019-12-08T17:40:01.393813+0000 (oldest deadline 2019-12-08T17:40:46.608587+0000) 2019-12-08T17:40:56.632 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:40:56.631+0000 1694f700 -1 osd.2 233 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:40:56.833 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:40:56.824+0000 1694f700 -1 osd.4 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:39:57.940109+0000 front 2019-12-08T17:39:58.003631+0000 (oldest deadline 2019-12-08T17:40:43.753017+0000) 2019-12-08T17:40:56.863 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:40:56.856+0000 1694f700 -1 osd.7 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:00.136464+0000 front 2019-12-08T17:40:00.808689+0000 (oldest deadline 2019-12-08T17:40:42.329933+0000) 2019-12-08T17:40:56.922 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:40:56.921+0000 1694f700 -1 osd.0 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:01.376706+0000 front 2019-12-08T17:40:01.521059+0000 (oldest deadline 2019-12-08T17:40:44.812982+0000) 2019-12-08T17:40:57.288 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:40:57.281+0000 1694f700 -1 osd.6 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:00.110261+0000 front 2019-12-08T17:40:00.136530+0000 (oldest deadline 2019-12-08T17:40:43.232030+0000) 2019-12-08T17:40:57.471 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:40:57.462+0000 1694f700 -1 osd.3 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:39:59.504420+0000 front 2019-12-08T17:39:59.503525+0000 (oldest deadline 2019-12-08T17:40:45.342251+0000) 2019-12-08T17:40:57.686 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:40:57.681+0000 1694f700 -1 osd.2 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:01.388861+0000 front 2019-12-08T17:40:01.393813+0000 (oldest deadline 2019-12-08T17:40:46.608587+0000) 2019-12-08T17:40:57.687 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:40:57.685+0000 1694f700 -1 osd.2 233 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:40:57.815 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:40:57.807+0000 1694f700 -1 osd.4 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:39:57.940109+0000 front 2019-12-08T17:39:58.003631+0000 (oldest deadline 2019-12-08T17:40:43.753017+0000) 2019-12-08T17:40:57.880 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:40:57.874+0000 1694f700 -1 osd.7 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:00.136464+0000 front 2019-12-08T17:40:00.808689+0000 (oldest deadline 2019-12-08T17:40:42.329933+0000) 2019-12-08T17:40:57.968 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:40:57.966+0000 1694f700 -1 osd.0 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:01.376706+0000 front 2019-12-08T17:40:01.521059+0000 (oldest deadline 2019-12-08T17:40:44.812982+0000) 2019-12-08T17:40:58.321 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:40:58.315+0000 1694f700 -1 osd.6 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:00.110261+0000 front 2019-12-08T17:40:00.136530+0000 (oldest deadline 2019-12-08T17:40:43.232030+0000) 2019-12-08T17:40:58.439 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:40:58.435+0000 1694f700 -1 osd.3 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:39:59.504420+0000 front 2019-12-08T17:39:59.503525+0000 (oldest deadline 2019-12-08T17:40:45.342251+0000) 2019-12-08T17:40:58.722 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:40:58.719+0000 1694f700 -1 osd.2 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:01.388861+0000 front 2019-12-08T17:40:01.393813+0000 (oldest deadline 2019-12-08T17:40:46.608587+0000) 2019-12-08T17:40:58.723 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:40:58.721+0000 1694f700 -1 osd.2 233 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:40:58.852 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:40:58.847+0000 1694f700 -1 osd.4 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:39:57.940109+0000 front 2019-12-08T17:39:58.003631+0000 (oldest deadline 2019-12-08T17:40:43.753017+0000) 2019-12-08T17:40:58.896 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:40:58.889+0000 1694f700 -1 osd.7 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:00.136464+0000 front 2019-12-08T17:40:00.808689+0000 (oldest deadline 2019-12-08T17:40:42.329933+0000) 2019-12-08T17:40:58.977 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:40:58.976+0000 1694f700 -1 osd.0 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:01.376706+0000 front 2019-12-08T17:40:01.521059+0000 (oldest deadline 2019-12-08T17:40:44.812982+0000) 2019-12-08T17:40:59.317 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:40:59.311+0000 1694f700 -1 osd.6 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:00.110261+0000 front 2019-12-08T17:40:00.136530+0000 (oldest deadline 2019-12-08T17:40:43.232030+0000) 2019-12-08T17:40:59.433 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:40:59.430+0000 1694f700 -1 osd.3 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:39:59.504420+0000 front 2019-12-08T17:39:59.503525+0000 (oldest deadline 2019-12-08T17:40:45.342251+0000) 2019-12-08T17:40:59.682 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:40:59.680+0000 1694f700 -1 osd.2 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:01.388861+0000 front 2019-12-08T17:40:01.393813+0000 (oldest deadline 2019-12-08T17:40:46.608587+0000) 2019-12-08T17:40:59.685 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:40:59.684+0000 1694f700 -1 osd.2 233 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:40:59.858 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:40:59.853+0000 1694f700 -1 osd.4 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:39:57.940109+0000 front 2019-12-08T17:39:58.003631+0000 (oldest deadline 2019-12-08T17:40:43.753017+0000) 2019-12-08T17:40:59.898 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:40:59.891+0000 1694f700 -1 osd.7 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:00.136464+0000 front 2019-12-08T17:40:00.808689+0000 (oldest deadline 2019-12-08T17:40:42.329933+0000) 2019-12-08T17:40:59.955 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:40:59.953+0000 1694f700 -1 osd.0 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:01.376706+0000 front 2019-12-08T17:40:01.521059+0000 (oldest deadline 2019-12-08T17:40:44.812982+0000) 2019-12-08T17:41:00.350 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:41:00.344+0000 1694f700 -1 osd.6 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:00.110261+0000 front 2019-12-08T17:40:00.136530+0000 (oldest deadline 2019-12-08T17:40:43.232030+0000) 2019-12-08T17:41:00.445 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:41:00.439+0000 1694f700 -1 osd.3 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:39:59.504420+0000 front 2019-12-08T17:39:59.503525+0000 (oldest deadline 2019-12-08T17:40:45.342251+0000) 2019-12-08T17:41:00.700 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:41:00.698+0000 1694f700 -1 osd.2 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:01.388861+0000 front 2019-12-08T17:40:01.393813+0000 (oldest deadline 2019-12-08T17:40:46.608587+0000) 2019-12-08T17:41:00.701 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:41:00.699+0000 1694f700 -1 osd.2 233 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:41:00.899 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:41:00.894+0000 1694f700 -1 osd.7 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:00.136464+0000 front 2019-12-08T17:40:00.808689+0000 (oldest deadline 2019-12-08T17:40:42.329933+0000) 2019-12-08T17:41:00.920 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:41:00.913+0000 1694f700 -1 osd.4 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:39:57.940109+0000 front 2019-12-08T17:39:58.003631+0000 (oldest deadline 2019-12-08T17:40:43.753017+0000) 2019-12-08T17:41:00.999 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:41:00.997+0000 1694f700 -1 osd.0 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:01.376706+0000 front 2019-12-08T17:40:01.521059+0000 (oldest deadline 2019-12-08T17:40:44.812982+0000) 2019-12-08T17:41:01.382 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:41:01.376+0000 1694f700 -1 osd.6 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:00.110261+0000 front 2019-12-08T17:40:00.136530+0000 (oldest deadline 2019-12-08T17:40:43.232030+0000) 2019-12-08T17:41:01.465 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:41:01.463+0000 1694f700 -1 osd.3 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:39:59.504420+0000 front 2019-12-08T17:39:59.503525+0000 (oldest deadline 2019-12-08T17:40:45.342251+0000) 2019-12-08T17:41:01.687 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:41:01.684+0000 1694f700 -1 osd.2 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:01.388861+0000 front 2019-12-08T17:40:01.393813+0000 (oldest deadline 2019-12-08T17:40:46.608587+0000) 2019-12-08T17:41:01.688 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:41:01.687+0000 1694f700 -1 osd.2 233 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:41:01.884 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:41:01.879+0000 1694f700 -1 osd.4 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:39:57.940109+0000 front 2019-12-08T17:39:58.003631+0000 (oldest deadline 2019-12-08T17:40:43.753017+0000) 2019-12-08T17:41:01.908 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:41:01.901+0000 1694f700 -1 osd.7 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:00.136464+0000 front 2019-12-08T17:40:00.808689+0000 (oldest deadline 2019-12-08T17:40:42.329933+0000) 2019-12-08T17:41:01.972 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:41:01.970+0000 1694f700 -1 osd.0 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:01.376706+0000 front 2019-12-08T17:40:01.521059+0000 (oldest deadline 2019-12-08T17:40:44.812982+0000) 2019-12-08T17:41:02.407 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:41:02.400+0000 1694f700 -1 osd.6 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:00.110261+0000 front 2019-12-08T17:40:00.136530+0000 (oldest deadline 2019-12-08T17:40:43.232030+0000) 2019-12-08T17:41:02.491 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:41:02.489+0000 1694f700 -1 osd.3 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:39:59.504420+0000 front 2019-12-08T17:39:59.503525+0000 (oldest deadline 2019-12-08T17:40:45.342251+0000) 2019-12-08T17:41:02.664 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:41:02.660+0000 1694f700 -1 osd.2 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:01.388861+0000 front 2019-12-08T17:40:01.393813+0000 (oldest deadline 2019-12-08T17:40:46.608587+0000) 2019-12-08T17:41:02.664 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:41:02.663+0000 1694f700 -1 osd.2 233 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:41:02.896 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:41:02.890+0000 1694f700 -1 osd.4 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:39:57.940109+0000 front 2019-12-08T17:39:58.003631+0000 (oldest deadline 2019-12-08T17:40:43.753017+0000) 2019-12-08T17:41:02.908 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:41:02.903+0000 1694f700 -1 osd.7 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:00.136464+0000 front 2019-12-08T17:40:00.808689+0000 (oldest deadline 2019-12-08T17:40:42.329933+0000) 2019-12-08T17:41:02.928 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:41:02.924+0000 1694f700 -1 osd.0 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:01.376706+0000 front 2019-12-08T17:40:01.521059+0000 (oldest deadline 2019-12-08T17:40:44.812982+0000) 2019-12-08T17:41:03.436 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:41:03.430+0000 1694f700 -1 osd.6 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:00.110261+0000 front 2019-12-08T17:40:00.136530+0000 (oldest deadline 2019-12-08T17:40:43.232030+0000) 2019-12-08T17:41:03.475 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:41:03.473+0000 1694f700 -1 osd.3 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:39:59.504420+0000 front 2019-12-08T17:39:59.503525+0000 (oldest deadline 2019-12-08T17:40:45.342251+0000) 2019-12-08T17:41:03.713 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:41:03.710+0000 1694f700 -1 osd.2 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:01.388861+0000 front 2019-12-08T17:40:01.393813+0000 (oldest deadline 2019-12-08T17:40:46.608587+0000) 2019-12-08T17:41:03.717 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:41:03.715+0000 1694f700 -1 osd.2 233 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:41:03.863 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:41:03.857+0000 1694f700 -1 osd.7 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:00.136464+0000 front 2019-12-08T17:40:00.808689+0000 (oldest deadline 2019-12-08T17:40:42.329933+0000) 2019-12-08T17:41:03.922 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:41:03.916+0000 1694f700 -1 osd.4 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:39:57.940109+0000 front 2019-12-08T17:39:58.003631+0000 (oldest deadline 2019-12-08T17:40:43.753017+0000) 2019-12-08T17:41:03.977 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:41:03.974+0000 1694f700 -1 osd.0 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:01.376706+0000 front 2019-12-08T17:40:01.521059+0000 (oldest deadline 2019-12-08T17:40:44.812982+0000) 2019-12-08T17:41:04.401 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:41:04.395+0000 1694f700 -1 osd.6 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:00.110261+0000 front 2019-12-08T17:40:00.136530+0000 (oldest deadline 2019-12-08T17:40:43.232030+0000) 2019-12-08T17:41:04.491 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:41:04.488+0000 1694f700 -1 osd.3 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:39:59.504420+0000 front 2019-12-08T17:39:59.503525+0000 (oldest deadline 2019-12-08T17:40:45.342251+0000) 2019-12-08T17:41:04.696 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:41:04.691+0000 1694f700 -1 osd.2 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:01.388861+0000 front 2019-12-08T17:40:01.393813+0000 (oldest deadline 2019-12-08T17:40:46.608587+0000) 2019-12-08T17:41:04.697 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:41:04.695+0000 1694f700 -1 osd.2 233 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:41:04.903 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:41:04.898+0000 1694f700 -1 osd.7 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:00.136464+0000 front 2019-12-08T17:40:00.808689+0000 (oldest deadline 2019-12-08T17:40:42.329933+0000) 2019-12-08T17:41:04.958 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:41:04.952+0000 1694f700 -1 osd.4 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:39:57.940109+0000 front 2019-12-08T17:39:58.003631+0000 (oldest deadline 2019-12-08T17:40:43.753017+0000) 2019-12-08T17:41:04.983 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:41:04.981+0000 1694f700 -1 osd.0 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:01.376706+0000 front 2019-12-08T17:40:01.521059+0000 (oldest deadline 2019-12-08T17:40:44.812982+0000) 2019-12-08T17:41:05.453 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:41:05.447+0000 1694f700 -1 osd.6 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:00.110261+0000 front 2019-12-08T17:40:00.136530+0000 (oldest deadline 2019-12-08T17:40:43.232030+0000) 2019-12-08T17:41:05.515 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:41:05.513+0000 1694f700 -1 osd.3 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:39:59.504420+0000 front 2019-12-08T17:39:59.503525+0000 (oldest deadline 2019-12-08T17:40:45.342251+0000) 2019-12-08T17:41:05.726 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:41:05.723+0000 1694f700 -1 osd.2 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:01.388861+0000 front 2019-12-08T17:40:01.393813+0000 (oldest deadline 2019-12-08T17:40:46.608587+0000) 2019-12-08T17:41:05.730 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:41:05.729+0000 1694f700 -1 osd.2 233 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:41:05.903 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:41:05.896+0000 1694f700 -1 osd.7 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:00.136464+0000 front 2019-12-08T17:40:00.808689+0000 (oldest deadline 2019-12-08T17:40:42.329933+0000) 2019-12-08T17:41:06.000 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:41:05.994+0000 1694f700 -1 osd.4 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:39:57.940109+0000 front 2019-12-08T17:39:58.003631+0000 (oldest deadline 2019-12-08T17:40:43.753017+0000) 2019-12-08T17:41:06.032 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:41:06.029+0000 1694f700 -1 osd.0 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:01.376706+0000 front 2019-12-08T17:40:01.521059+0000 (oldest deadline 2019-12-08T17:40:44.812982+0000) 2019-12-08T17:41:06.501 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:41:06.494+0000 1694f700 -1 osd.6 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:00.110261+0000 front 2019-12-08T17:40:00.136530+0000 (oldest deadline 2019-12-08T17:40:43.232030+0000) 2019-12-08T17:41:06.512 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:41:06.509+0000 1694f700 -1 osd.3 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:39:59.504420+0000 front 2019-12-08T17:39:59.503525+0000 (oldest deadline 2019-12-08T17:40:45.342251+0000) 2019-12-08T17:41:06.758 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:41:06.754+0000 1694f700 -1 osd.2 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:01.388861+0000 front 2019-12-08T17:40:01.393813+0000 (oldest deadline 2019-12-08T17:40:46.608587+0000) 2019-12-08T17:41:06.760 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:41:06.758+0000 1694f700 -1 osd.2 233 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:41:06.945 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:41:06.939+0000 1694f700 -1 osd.7 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:00.136464+0000 front 2019-12-08T17:40:00.808689+0000 (oldest deadline 2019-12-08T17:40:42.329933+0000) 2019-12-08T17:41:06.987 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:41:06.982+0000 1694f700 -1 osd.4 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:39:57.940109+0000 front 2019-12-08T17:39:58.003631+0000 (oldest deadline 2019-12-08T17:40:43.753017+0000) 2019-12-08T17:41:07.005 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:41:07.003+0000 1694f700 -1 osd.0 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:01.376706+0000 front 2019-12-08T17:40:01.521059+0000 (oldest deadline 2019-12-08T17:40:44.812982+0000) 2019-12-08T17:41:07.509 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:41:07.507+0000 1694f700 -1 osd.3 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:39:59.504420+0000 front 2019-12-08T17:39:59.503525+0000 (oldest deadline 2019-12-08T17:40:45.342251+0000) 2019-12-08T17:41:07.536 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:41:07.530+0000 1694f700 -1 osd.6 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:00.110261+0000 front 2019-12-08T17:40:00.136530+0000 (oldest deadline 2019-12-08T17:40:43.232030+0000) 2019-12-08T17:41:07.785 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:41:07.781+0000 1694f700 -1 osd.2 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:01.388861+0000 front 2019-12-08T17:40:01.393813+0000 (oldest deadline 2019-12-08T17:40:46.608587+0000) 2019-12-08T17:41:07.786 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:41:07.784+0000 1694f700 -1 osd.2 233 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:41:07.957 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:41:07.950+0000 1694f700 -1 osd.7 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:00.136464+0000 front 2019-12-08T17:40:00.808689+0000 (oldest deadline 2019-12-08T17:40:42.329933+0000) 2019-12-08T17:41:08.007 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:41:08.003+0000 1694f700 -1 osd.0 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:01.376706+0000 front 2019-12-08T17:40:01.521059+0000 (oldest deadline 2019-12-08T17:40:44.812982+0000) 2019-12-08T17:41:08.022 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:41:08.015+0000 1694f700 -1 osd.4 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:39:57.940109+0000 front 2019-12-08T17:39:58.003631+0000 (oldest deadline 2019-12-08T17:40:43.753017+0000) 2019-12-08T17:41:08.530 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:41:08.527+0000 1694f700 -1 osd.3 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:39:59.504420+0000 front 2019-12-08T17:39:59.503525+0000 (oldest deadline 2019-12-08T17:40:45.342251+0000) 2019-12-08T17:41:08.581 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:41:08.575+0000 1694f700 -1 osd.6 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:00.110261+0000 front 2019-12-08T17:40:00.136530+0000 (oldest deadline 2019-12-08T17:40:43.232030+0000) 2019-12-08T17:41:08.791 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:41:08.786+0000 1694f700 -1 osd.2 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:01.388861+0000 front 2019-12-08T17:40:01.393813+0000 (oldest deadline 2019-12-08T17:40:46.608587+0000) 2019-12-08T17:41:08.791 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:41:08.790+0000 1694f700 -1 osd.2 233 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:41:08.966 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:41:08.962+0000 1694f700 -1 osd.7 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:00.136464+0000 front 2019-12-08T17:40:00.808689+0000 (oldest deadline 2019-12-08T17:40:42.329933+0000) 2019-12-08T17:41:08.974 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:41:08.973+0000 1694f700 -1 osd.0 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:01.376706+0000 front 2019-12-08T17:40:01.521059+0000 (oldest deadline 2019-12-08T17:40:44.812982+0000) 2019-12-08T17:41:09.014 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:41:09.009+0000 1694f700 -1 osd.4 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:39:57.940109+0000 front 2019-12-08T17:39:58.003631+0000 (oldest deadline 2019-12-08T17:40:43.753017+0000) 2019-12-08T17:41:09.522 INFO:tasks.rgw.client.0.smithi079.stdout:2019-12-08T17:41:09.494+0000 20e25700 -1 RGWWatcher::handle_error cookie 900351040 err (107) Transport endpoint is not connected 2019-12-08T17:41:09.548 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:41:09.544+0000 1694f700 -1 osd.3 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:39:59.504420+0000 front 2019-12-08T17:39:59.503525+0000 (oldest deadline 2019-12-08T17:40:45.342251+0000) 2019-12-08T17:41:09.565 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:41:09.560+0000 1694f700 -1 osd.6 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:00.110261+0000 front 2019-12-08T17:40:00.136530+0000 (oldest deadline 2019-12-08T17:40:43.232030+0000) 2019-12-08T17:41:09.807 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:41:09.806+0000 1694f700 -1 osd.2 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:01.388861+0000 front 2019-12-08T17:40:01.393813+0000 (oldest deadline 2019-12-08T17:40:46.608587+0000) 2019-12-08T17:41:09.811 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:41:09.809+0000 1694f700 -1 osd.2 233 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:41:09.928 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:41:09.924+0000 1694f700 -1 osd.7 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:00.136464+0000 front 2019-12-08T17:40:00.808689+0000 (oldest deadline 2019-12-08T17:40:42.329933+0000) 2019-12-08T17:41:10.549 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:41:10.547+0000 1694f700 -1 osd.3 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:39:59.504420+0000 front 2019-12-08T17:39:59.503525+0000 (oldest deadline 2019-12-08T17:40:45.342251+0000) 2019-12-08T17:41:10.780 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:41:10.777+0000 1694f700 -1 osd.2 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:01.388861+0000 front 2019-12-08T17:40:01.393813+0000 (oldest deadline 2019-12-08T17:40:46.608587+0000) 2019-12-08T17:41:10.781 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:41:10.779+0000 1694f700 -1 osd.2 233 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:41:10.818 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:41:10.812+0000 1694f700 -1 osd.1 231 get_health_metrics reporting 34 slow ops, oldest is osd_op(client.4449.0:101675 7.1 7:8bea0b29:::2019-12-08-17-f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.636-%e1%a0%83%ed%88%8f%ef%84%92%ce%a9%e5%98%88%e5%98%87%e0%a4%81%e0%a4%82%e1%a0%84%e3%9c%85%eb%8c%8c%e0%a4%82%e9%90%8c%ed%88%8d%e8%94%8b:head [append 0~514 in=514b] snapc 0=[] RETRY=18 ondisk+retry+write+known_if_redirected e228) 2019-12-08T17:41:10.907 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:41:10.902+0000 1694f700 -1 osd.7 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:00.136464+0000 front 2019-12-08T17:40:00.808689+0000 (oldest deadline 2019-12-08T17:40:42.329933+0000) 2019-12-08T17:41:11.557 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:41:11.555+0000 1694f700 -1 osd.3 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:39:59.504420+0000 front 2019-12-08T17:39:59.503525+0000 (oldest deadline 2019-12-08T17:40:45.342251+0000) 2019-12-08T17:41:11.769 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:41:11.765+0000 1694f700 -1 osd.2 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:01.388861+0000 front 2019-12-08T17:40:01.393813+0000 (oldest deadline 2019-12-08T17:40:46.608587+0000) 2019-12-08T17:41:11.770 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:41:11.768+0000 1694f700 -1 osd.2 233 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:41:11.923 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:41:11.917+0000 1694f700 -1 osd.7 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:00.136464+0000 front 2019-12-08T17:40:00.808689+0000 (oldest deadline 2019-12-08T17:40:42.329933+0000) 2019-12-08T17:41:12.172 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:05:38:36.875 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T17:41:12.193 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:05:38:36.896 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T17:41:12.204 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:05:38:36.839 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T17:41:12.205 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:05:38:36.840 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T17:41:12.208 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:05:38:36.842 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T17:41:12.209 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:05:38:36.844 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T17:41:12.464 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:05:38:37.099 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T17:41:12.469 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:05:38:37.172 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T17:41:12.490 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:05:38:37.124 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T17:41:12.530 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:41:12.528+0000 1694f700 -1 osd.3 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:39:59.504420+0000 front 2019-12-08T17:39:59.503525+0000 (oldest deadline 2019-12-08T17:40:45.342251+0000) 2019-12-08T17:41:12.816 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:41:12.811+0000 1694f700 -1 osd.2 234 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:01.388861+0000 front 2019-12-08T17:40:01.393813+0000 (oldest deadline 2019-12-08T17:40:46.608587+0000) 2019-12-08T17:41:12.816 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:41:12.815+0000 1694f700 -1 osd.2 234 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:41:12.968 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:41:12.962+0000 1694f700 -1 osd.7 233 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:00.136464+0000 front 2019-12-08T17:41:12.944532+0000 (oldest deadline 2019-12-08T17:40:42.329933+0000) 2019-12-08T17:41:13.044 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:41:12.968+0000 1694f700 -1 osd.1 233 get_health_metrics reporting 34 slow ops, oldest is osd_op(client.4449.0:101675 7.1 7:8bea0b29:::2019-12-08-17-f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.636-%e1%a0%83%ed%88%8f%ef%84%92%ce%a9%e5%98%88%e5%98%87%e0%a4%81%e0%a4%82%e1%a0%84%e3%9c%85%eb%8c%8c%e0%a4%82%e9%90%8c%ed%88%8d%e8%94%8b:head [append 0~514 in=514b] snapc 0=[] RETRY=18 ondisk+retry+write+known_if_redirected e228) 2019-12-08T17:41:13.571 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:41:13.566+0000 1694f700 -1 osd.3 234 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:39:59.504420+0000 front 2019-12-08T17:39:59.503525+0000 (oldest deadline 2019-12-08T17:40:45.342251+0000) 2019-12-08T17:41:13.859 INFO:tasks.rgw.client.0.smithi079.stdout:2019-12-08T17:41:13.858+0000 20e25700 -1 RGWWatcher::handle_error cookie 1025622176 err (107) Transport endpoint is not connected 2019-12-08T17:41:13.870 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:41:13.865+0000 1694f700 -1 osd.2 234 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:01.388861+0000 front 2019-12-08T17:40:01.393813+0000 (oldest deadline 2019-12-08T17:40:46.608587+0000) 2019-12-08T17:41:13.877 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:41:13.867+0000 1694f700 -1 osd.2 234 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:41:14.049 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:41:14.011+0000 1694f700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:40:00.136464+0000 front 2019-12-08T17:41:12.944532+0000 (oldest deadline 2019-12-08T17:40:42.329933+0000) 2019-12-08T17:41:14.200 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:41:14.159+0000 1694f700 -1 osd.1 234 get_health_metrics reporting 34 slow ops, oldest is osd_op(client.4449.0:105036 5.9 5:93e5b521:::notify.7:head [watch ping cookie 900351040 gen 1] snapc 0=[] ondisk+write+known_if_redirected e229) 2019-12-08T17:41:14.725 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:41:14.715+0000 3827c700 -1 osd.2 234 build_incremental_map_msg missing incremental map 232 2019-12-08T17:41:14.896 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:41:14.893+0000 1694f700 -1 osd.2 234 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7:8bea0b29:::2019-12-08-17-f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.636-%e1%a0%83%ed%88%8f%ef%84%92%ce%a9%e5%98%88%e5%98%87%e0%a4%81%e0%a4%82%e1%a0%84%e3%9c%85%eb%8c%8c%e0%a4%82%e9%90%8c%ed%88%8d%e8%94%8b:head [append 0~508 in=508b] snapc 0=[] RETRY=21 ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:41:15.218 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:41:15.216+0000 1694f700 -1 osd.1 234 get_health_metrics reporting 20 slow ops, oldest is osd_op(client.4449.0:105036 5.9 5:93e5b521:::notify.7:head [watch ping cookie 900351040 gen 1] snapc 0=[] ondisk+write+known_if_redirected e229) 2019-12-08T17:41:15.883 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:41:15.883+0000 1694f700 -1 osd.2 234 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7:8bea0b29:::2019-12-08-17-f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.636-%e1%a0%83%ed%88%8f%ef%84%92%ce%a9%e5%98%88%e5%98%87%e0%a4%81%e0%a4%82%e1%a0%84%e3%9c%85%eb%8c%8c%e0%a4%82%e9%90%8c%ed%88%8d%e8%94%8b:head [append 0~508 in=508b] snapc 0=[] RETRY=21 ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:41:16.179 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:41:16.176+0000 1694f700 -1 osd.1 234 get_health_metrics reporting 20 slow ops, oldest is osd_op(client.4449.0:105036 5.9 5:93e5b521:::notify.7:head [watch ping cookie 900351040 gen 1] snapc 0=[] ondisk+write+known_if_redirected e229) 2019-12-08T17:41:16.850 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:41:16.849+0000 1694f700 -1 osd.2 234 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7:8bea0b29:::2019-12-08-17-f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.636-%e1%a0%83%ed%88%8f%ef%84%92%ce%a9%e5%98%88%e5%98%87%e0%a4%81%e0%a4%82%e1%a0%84%e3%9c%85%eb%8c%8c%e0%a4%82%e9%90%8c%ed%88%8d%e8%94%8b:head [append 0~508 in=508b] snapc 0=[] RETRY=21 ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:41:17.149 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:41:17.147+0000 1694f700 -1 osd.1 234 get_health_metrics reporting 20 slow ops, oldest is osd_op(client.4449.0:105036 5.9 5:93e5b521:::notify.7:head [watch ping cookie 900351040 gen 1] snapc 0=[] ondisk+write+known_if_redirected e229) 2019-12-08T17:41:17.811 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:41:17.810+0000 1694f700 -1 osd.2 234 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7:8bea0b29:::2019-12-08-17-f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.636-%e1%a0%83%ed%88%8f%ef%84%92%ce%a9%e5%98%88%e5%98%87%e0%a4%81%e0%a4%82%e1%a0%84%e3%9c%85%eb%8c%8c%e0%a4%82%e9%90%8c%ed%88%8d%e8%94%8b:head [append 0~508 in=508b] snapc 0=[] RETRY=21 ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:41:18.107 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:41:18.104+0000 1694f700 -1 osd.1 234 get_health_metrics reporting 20 slow ops, oldest is osd_op(client.4449.0:105036 5.9 5:93e5b521:::notify.7:head [watch ping cookie 900351040 gen 1] snapc 0=[] ondisk+write+known_if_redirected e229) 2019-12-08T17:41:18.808 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:41:18.806+0000 1694f700 -1 osd.2 234 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7:8bea0b29:::2019-12-08-17-f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.636-%e1%a0%83%ed%88%8f%ef%84%92%ce%a9%e5%98%88%e5%98%87%e0%a4%81%e0%a4%82%e1%a0%84%e3%9c%85%eb%8c%8c%e0%a4%82%e9%90%8c%ed%88%8d%e8%94%8b:head [append 0~508 in=508b] snapc 0=[] RETRY=21 ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:41:19.060 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:41:19.059+0000 1694f700 -1 osd.1 234 get_health_metrics reporting 21 slow ops, oldest is osd_op(client.4449.0:105036 5.9 5:93e5b521:::notify.7:head [watch ping cookie 900351040 gen 1] snapc 0=[] ondisk+write+known_if_redirected e229) 2019-12-08T17:41:19.829 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:41:19.826+0000 1694f700 -1 osd.2 234 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7:8bea0b29:::2019-12-08-17-f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.636-%e1%a0%83%ed%88%8f%ef%84%92%ce%a9%e5%98%88%e5%98%87%e0%a4%81%e0%a4%82%e1%a0%84%e3%9c%85%eb%8c%8c%e0%a4%82%e9%90%8c%ed%88%8d%e8%94%8b:head [append 0~508 in=508b] snapc 0=[] RETRY=21 ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:41:20.055 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:41:20.053+0000 1694f700 -1 osd.1 234 get_health_metrics reporting 21 slow ops, oldest is osd_op(client.4449.0:105036 5.9 5:93e5b521:::notify.7:head [watch ping cookie 900351040 gen 1] snapc 0=[] ondisk+write+known_if_redirected e229) 2019-12-08T17:41:20.798 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:41:20.796+0000 1694f700 -1 osd.2 234 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7:8bea0b29:::2019-12-08-17-f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.636-%e1%a0%83%ed%88%8f%ef%84%92%ce%a9%e5%98%88%e5%98%87%e0%a4%81%e0%a4%82%e1%a0%84%e3%9c%85%eb%8c%8c%e0%a4%82%e9%90%8c%ed%88%8d%e8%94%8b:head [append 0~508 in=508b] snapc 0=[] RETRY=21 ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:41:21.064 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:41:21.061+0000 1694f700 -1 osd.1 234 get_health_metrics reporting 21 slow ops, oldest is osd_op(client.4449.0:105036 5.9 5:93e5b521:::notify.7:head [watch ping cookie 900351040 gen 1] snapc 0=[] ondisk+write+known_if_redirected e229) 2019-12-08T17:41:21.783 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:41:21.783+0000 1694f700 -1 osd.2 234 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7:8bea0b29:::2019-12-08-17-f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.636-%e1%a0%83%ed%88%8f%ef%84%92%ce%a9%e5%98%88%e5%98%87%e0%a4%81%e0%a4%82%e1%a0%84%e3%9c%85%eb%8c%8c%e0%a4%82%e9%90%8c%ed%88%8d%e8%94%8b:head [append 0~508 in=508b] snapc 0=[] RETRY=21 ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:41:22.047 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:41:22.045+0000 1694f700 -1 osd.1 234 get_health_metrics reporting 21 slow ops, oldest is osd_op(client.4449.0:105036 5.9 5:93e5b521:::notify.7:head [watch ping cookie 900351040 gen 1] snapc 0=[] ondisk+write+known_if_redirected e229) 2019-12-08T17:41:22.826 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:41:22.825+0000 1694f700 -1 osd.2 234 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7:8bea0b29:::2019-12-08-17-f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.636-%e1%a0%83%ed%88%8f%ef%84%92%ce%a9%e5%98%88%e5%98%87%e0%a4%81%e0%a4%82%e1%a0%84%e3%9c%85%eb%8c%8c%e0%a4%82%e9%90%8c%ed%88%8d%e8%94%8b:head [append 0~508 in=508b] snapc 0=[] RETRY=21 ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:41:23.005 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:41:23.003+0000 1694f700 -1 osd.1 234 get_health_metrics reporting 21 slow ops, oldest is osd_op(client.4449.0:105036 5.9 5:93e5b521:::notify.7:head [watch ping cookie 900351040 gen 1] snapc 0=[] ondisk+write+known_if_redirected e229) 2019-12-08T17:41:23.882 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:41:23.882+0000 1694f700 -1 osd.2 234 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7:8bea0b29:::2019-12-08-17-f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.636-%e1%a0%83%ed%88%8f%ef%84%92%ce%a9%e5%98%88%e5%98%87%e0%a4%81%e0%a4%82%e1%a0%84%e3%9c%85%eb%8c%8c%e0%a4%82%e9%90%8c%ed%88%8d%e8%94%8b:head [append 0~508 in=508b] snapc 0=[] RETRY=21 ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:41:24.028 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:41:24.026+0000 1694f700 -1 osd.1 234 get_health_metrics reporting 21 slow ops, oldest is osd_op(client.4449.0:105036 5.9 5:93e5b521:::notify.7:head [watch ping cookie 900351040 gen 1] snapc 0=[] ondisk+write+known_if_redirected e229) 2019-12-08T17:41:24.836 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:41:24.836+0000 1694f700 -1 osd.2 234 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7:8bea0b29:::2019-12-08-17-f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.636-%e1%a0%83%ed%88%8f%ef%84%92%ce%a9%e5%98%88%e5%98%87%e0%a4%81%e0%a4%82%e1%a0%84%e3%9c%85%eb%8c%8c%e0%a4%82%e9%90%8c%ed%88%8d%e8%94%8b:head [append 0~508 in=508b] snapc 0=[] RETRY=21 ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:41:25.004 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:41:25.003+0000 1694f700 -1 osd.1 234 get_health_metrics reporting 22 slow ops, oldest is osd_op(client.4449.0:105036 5.9 5:93e5b521:::notify.7:head [watch ping cookie 900351040 gen 1] snapc 0=[] ondisk+write+known_if_redirected e229) 2019-12-08T17:41:25.846 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:41:25.846+0000 1694f700 -1 osd.2 234 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7:8bea0b29:::2019-12-08-17-f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.636-%e1%a0%83%ed%88%8f%ef%84%92%ce%a9%e5%98%88%e5%98%87%e0%a4%81%e0%a4%82%e1%a0%84%e3%9c%85%eb%8c%8c%e0%a4%82%e9%90%8c%ed%88%8d%e8%94%8b:head [append 0~508 in=508b] snapc 0=[] RETRY=21 ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:41:26.822 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:41:26.821+0000 1694f700 -1 osd.2 234 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7:8bea0b29:::2019-12-08-17-f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.636-%e1%a0%83%ed%88%8f%ef%84%92%ce%a9%e5%98%88%e5%98%87%e0%a4%81%e0%a4%82%e1%a0%84%e3%9c%85%eb%8c%8c%e0%a4%82%e9%90%8c%ed%88%8d%e8%94%8b:head [append 0~508 in=508b] snapc 0=[] RETRY=21 ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:41:27.790 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:41:27.788+0000 1694f700 -1 osd.2 234 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7:8bea0b29:::2019-12-08-17-f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.636-%e1%a0%83%ed%88%8f%ef%84%92%ce%a9%e5%98%88%e5%98%87%e0%a4%81%e0%a4%82%e1%a0%84%e3%9c%85%eb%8c%8c%e0%a4%82%e9%90%8c%ed%88%8d%e8%94%8b:head [append 0~508 in=508b] snapc 0=[] RETRY=21 ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:41:28.788 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:41:28.787+0000 1694f700 -1 osd.2 234 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7:8bea0b29:::2019-12-08-17-f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.636-%e1%a0%83%ed%88%8f%ef%84%92%ce%a9%e5%98%88%e5%98%87%e0%a4%81%e0%a4%82%e1%a0%84%e3%9c%85%eb%8c%8c%e0%a4%82%e9%90%8c%ed%88%8d%e8%94%8b:head [append 0~508 in=508b] snapc 0=[] RETRY=21 ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:41:29.799 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:41:29.798+0000 1694f700 -1 osd.2 234 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7:8bea0b29:::2019-12-08-17-f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.636-%e1%a0%83%ed%88%8f%ef%84%92%ce%a9%e5%98%88%e5%98%87%e0%a4%81%e0%a4%82%e1%a0%84%e3%9c%85%eb%8c%8c%e0%a4%82%e9%90%8c%ed%88%8d%e8%94%8b:head [append 0~508 in=508b] snapc 0=[] RETRY=21 ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:41:30.767 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:41:30.766+0000 1694f700 -1 osd.2 234 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7:8bea0b29:::2019-12-08-17-f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.636-%e1%a0%83%ed%88%8f%ef%84%92%ce%a9%e5%98%88%e5%98%87%e0%a4%81%e0%a4%82%e1%a0%84%e3%9c%85%eb%8c%8c%e0%a4%82%e9%90%8c%ed%88%8d%e8%94%8b:head [append 0~508 in=508b] snapc 0=[] RETRY=21 ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:41:31.794 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:41:31.792+0000 1694f700 -1 osd.2 234 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7:8bea0b29:::2019-12-08-17-f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.636-%e1%a0%83%ed%88%8f%ef%84%92%ce%a9%e5%98%88%e5%98%87%e0%a4%81%e0%a4%82%e1%a0%84%e3%9c%85%eb%8c%8c%e0%a4%82%e9%90%8c%ed%88%8d%e8%94%8b:head [append 0~508 in=508b] snapc 0=[] RETRY=21 ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:41:32.807 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:41:32.806+0000 1694f700 -1 osd.2 234 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7:8bea0b29:::2019-12-08-17-f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.636-%e1%a0%83%ed%88%8f%ef%84%92%ce%a9%e5%98%88%e5%98%87%e0%a4%81%e0%a4%82%e1%a0%84%e3%9c%85%eb%8c%8c%e0%a4%82%e9%90%8c%ed%88%8d%e8%94%8b:head [append 0~508 in=508b] snapc 0=[] RETRY=21 ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:41:33.863 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:41:33.862+0000 1694f700 -1 osd.2 234 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7:8bea0b29:::2019-12-08-17-f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.636-%e1%a0%83%ed%88%8f%ef%84%92%ce%a9%e5%98%88%e5%98%87%e0%a4%81%e0%a4%82%e1%a0%84%e3%9c%85%eb%8c%8c%e0%a4%82%e9%90%8c%ed%88%8d%e8%94%8b:head [append 0~508 in=508b] snapc 0=[] RETRY=21 ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:41:34.842 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:41:34.840+0000 1694f700 -1 osd.2 234 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7:8bea0b29:::2019-12-08-17-f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.636-%e1%a0%83%ed%88%8f%ef%84%92%ce%a9%e5%98%88%e5%98%87%e0%a4%81%e0%a4%82%e1%a0%84%e3%9c%85%eb%8c%8c%e0%a4%82%e9%90%8c%ed%88%8d%e8%94%8b:head [append 0~508 in=508b] snapc 0=[] RETRY=21 ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:41:35.805 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:41:35.804+0000 1694f700 -1 osd.2 234 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7:8bea0b29:::2019-12-08-17-f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.636-%e1%a0%83%ed%88%8f%ef%84%92%ce%a9%e5%98%88%e5%98%87%e0%a4%81%e0%a4%82%e1%a0%84%e3%9c%85%eb%8c%8c%e0%a4%82%e9%90%8c%ed%88%8d%e8%94%8b:head [append 0~508 in=508b] snapc 0=[] RETRY=21 ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:41:36.816 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:41:36.815+0000 1694f700 -1 osd.2 234 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7:8bea0b29:::2019-12-08-17-f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.636-%e1%a0%83%ed%88%8f%ef%84%92%ce%a9%e5%98%88%e5%98%87%e0%a4%81%e0%a4%82%e1%a0%84%e3%9c%85%eb%8c%8c%e0%a4%82%e9%90%8c%ed%88%8d%e8%94%8b:head [append 0~508 in=508b] snapc 0=[] RETRY=21 ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:41:37.872 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:41:37.871+0000 1694f700 -1 osd.2 234 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7:8bea0b29:::2019-12-08-17-f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.636-%e1%a0%83%ed%88%8f%ef%84%92%ce%a9%e5%98%88%e5%98%87%e0%a4%81%e0%a4%82%e1%a0%84%e3%9c%85%eb%8c%8c%e0%a4%82%e9%90%8c%ed%88%8d%e8%94%8b:head [append 0~508 in=508b] snapc 0=[] RETRY=21 ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:41:38.859 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:41:38.858+0000 1694f700 -1 osd.2 234 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7:8bea0b29:::2019-12-08-17-f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.636-%e1%a0%83%ed%88%8f%ef%84%92%ce%a9%e5%98%88%e5%98%87%e0%a4%81%e0%a4%82%e1%a0%84%e3%9c%85%eb%8c%8c%e0%a4%82%e9%90%8c%ed%88%8d%e8%94%8b:head [append 0~508 in=508b] snapc 0=[] RETRY=21 ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:41:39.874 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:41:39.873+0000 1694f700 -1 osd.2 234 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7:8bea0b29:::2019-12-08-17-f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.636-%e1%a0%83%ed%88%8f%ef%84%92%ce%a9%e5%98%88%e5%98%87%e0%a4%81%e0%a4%82%e1%a0%84%e3%9c%85%eb%8c%8c%e0%a4%82%e9%90%8c%ed%88%8d%e8%94%8b:head [append 0~508 in=508b] snapc 0=[] RETRY=21 ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:41:40.840 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:41:40.840+0000 1694f700 -1 osd.2 234 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7:8bea0b29:::2019-12-08-17-f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.636-%e1%a0%83%ed%88%8f%ef%84%92%ce%a9%e5%98%88%e5%98%87%e0%a4%81%e0%a4%82%e1%a0%84%e3%9c%85%eb%8c%8c%e0%a4%82%e9%90%8c%ed%88%8d%e8%94%8b:head [append 0~508 in=508b] snapc 0=[] RETRY=21 ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:41:42.097 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:41:41.921+0000 1694f700 -1 osd.2 234 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7:8bea0b29:::2019-12-08-17-f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.636-%e1%a0%83%ed%88%8f%ef%84%92%ce%a9%e5%98%88%e5%98%87%e0%a4%81%e0%a4%82%e1%a0%84%e3%9c%85%eb%8c%8c%e0%a4%82%e9%90%8c%ed%88%8d%e8%94%8b:head [append 0~508 in=508b] snapc 0=[] RETRY=21 ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:41:43.174 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:41:42.971+0000 1694f700 -1 osd.2 234 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7:8bea0b29:::2019-12-08-17-f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.636-%e1%a0%83%ed%88%8f%ef%84%92%ce%a9%e5%98%88%e5%98%87%e0%a4%81%e0%a4%82%e1%a0%84%e3%9c%85%eb%8c%8c%e0%a4%82%e9%90%8c%ed%88%8d%e8%94%8b:head [append 0~508 in=508b] snapc 0=[] RETRY=21 ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:41:44.086 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:41:44.056+0000 1694f700 -1 osd.2 234 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7:8bea0b29:::2019-12-08-17-f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.636-%e1%a0%83%ed%88%8f%ef%84%92%ce%a9%e5%98%88%e5%98%87%e0%a4%81%e0%a4%82%e1%a0%84%e3%9c%85%eb%8c%8c%e0%a4%82%e9%90%8c%ed%88%8d%e8%94%8b:head [append 0~508 in=508b] snapc 0=[] RETRY=21 ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:41:45.154 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:41:45.100+0000 1694f700 -1 osd.2 234 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7:8bea0b29:::2019-12-08-17-f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.636-%e1%a0%83%ed%88%8f%ef%84%92%ce%a9%e5%98%88%e5%98%87%e0%a4%81%e0%a4%82%e1%a0%84%e3%9c%85%eb%8c%8c%e0%a4%82%e9%90%8c%ed%88%8d%e8%94%8b:head [append 0~508 in=508b] snapc 0=[] RETRY=21 ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:41:46.361 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:41:46.276+0000 1694f700 -1 osd.2 234 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7:8bea0b29:::2019-12-08-17-f8ab349b-4577-410d-b524-4ecaf50bb1bd.4555.636-%e1%a0%83%ed%88%8f%ef%84%92%ce%a9%e5%98%88%e5%98%87%e0%a4%81%e0%a4%82%e1%a0%84%e3%9c%85%eb%8c%8c%e0%a4%82%e9%90%8c%ed%88%8d%e8%94%8b:head [append 0~508 in=508b] snapc 0=[] RETRY=21 ondisk+retry+write+known_if_redirected e231) 2019-12-08T17:42:37.450 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:42:37.446+0000 1694f700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:52.954542+0000 front 2019-12-08T17:41:52.626465+0000 (oldest deadline 2019-12-08T17:42:37.294399+0000) 2019-12-08T17:42:37.756 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:42:37.753+0000 1694f700 -1 osd.3 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:54.898703+0000 front 2019-12-08T17:41:55.081894+0000 (oldest deadline 2019-12-08T17:42:37.704781+0000) 2019-12-08T17:42:37.819 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:42:37.814+0000 1694f700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:55.504644+0000 front 2019-12-08T17:41:55.499921+0000 (oldest deadline 2019-12-08T17:42:37.171691+0000) 2019-12-08T17:42:38.087 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:42:38.081+0000 1694f700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:56.773740+0000 front 2019-12-08T17:41:56.451346+0000 (oldest deadline 2019-12-08T17:42:37.430025+0000) 2019-12-08T17:42:38.352 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:42:38.349+0000 1694f700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:52.080736+0000 front 2019-12-08T17:41:52.093290+0000 (oldest deadline 2019-12-08T17:42:37.365713+0000) 2019-12-08T17:42:38.444 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:42:38.438+0000 1694f700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:52.954542+0000 front 2019-12-08T17:41:52.626465+0000 (oldest deadline 2019-12-08T17:42:37.294399+0000) 2019-12-08T17:42:38.720 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:42:38.718+0000 1694f700 -1 osd.3 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:54.898703+0000 front 2019-12-08T17:41:55.081894+0000 (oldest deadline 2019-12-08T17:42:37.704781+0000) 2019-12-08T17:42:38.853 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:42:38.845+0000 1694f700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:55.504644+0000 front 2019-12-08T17:41:55.499921+0000 (oldest deadline 2019-12-08T17:42:37.171691+0000) 2019-12-08T17:42:39.082 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:42:39.078+0000 1694f700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:56.773740+0000 front 2019-12-08T17:41:56.451346+0000 (oldest deadline 2019-12-08T17:42:37.430025+0000) 2019-12-08T17:42:39.341 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:42:39.338+0000 1694f700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:52.080736+0000 front 2019-12-08T17:41:52.093290+0000 (oldest deadline 2019-12-08T17:42:37.365713+0000) 2019-12-08T17:42:39.492 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:42:39.489+0000 1694f700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:52.954542+0000 front 2019-12-08T17:41:52.626465+0000 (oldest deadline 2019-12-08T17:42:37.294399+0000) 2019-12-08T17:42:39.760 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:42:39.754+0000 1694f700 -1 osd.3 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:54.898703+0000 front 2019-12-08T17:41:55.081894+0000 (oldest deadline 2019-12-08T17:42:37.704781+0000) 2019-12-08T17:42:39.897 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:42:39.893+0000 1694f700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:55.504644+0000 front 2019-12-08T17:41:55.499921+0000 (oldest deadline 2019-12-08T17:42:37.171691+0000) 2019-12-08T17:42:40.135 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:42:40.129+0000 1694f700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:56.773740+0000 front 2019-12-08T17:41:56.451346+0000 (oldest deadline 2019-12-08T17:42:37.430025+0000) 2019-12-08T17:42:40.226 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:42:40.223+0000 1694f700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:54.909394+0000 front 2019-12-08T17:41:54.941825+0000 (oldest deadline 2019-12-08T17:42:39.340165+0000) 2019-12-08T17:42:40.342 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:42:40.340+0000 1694f700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:52.080736+0000 front 2019-12-08T17:41:52.093290+0000 (oldest deadline 2019-12-08T17:42:37.365713+0000) 2019-12-08T17:42:40.506 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:42:40.500+0000 1694f700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:52.954542+0000 front 2019-12-08T17:41:52.626465+0000 (oldest deadline 2019-12-08T17:42:37.294399+0000) 2019-12-08T17:42:40.775 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:42:40.772+0000 1694f700 -1 osd.3 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:54.898703+0000 front 2019-12-08T17:41:55.081894+0000 (oldest deadline 2019-12-08T17:42:37.704781+0000) 2019-12-08T17:42:40.898 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:42:40.892+0000 1694f700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:55.504644+0000 front 2019-12-08T17:41:55.499921+0000 (oldest deadline 2019-12-08T17:42:37.171691+0000) 2019-12-08T17:42:41.151 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:42:41.145+0000 1694f700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:56.773740+0000 front 2019-12-08T17:41:56.451346+0000 (oldest deadline 2019-12-08T17:42:37.430025+0000) 2019-12-08T17:42:41.176 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:42:41.172+0000 1694f700 -1 osd.5 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:56.870718+0000 front 2019-12-08T17:41:56.678751+0000 (oldest deadline 2019-12-08T17:42:40.504049+0000) 2019-12-08T17:42:41.212 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:42:41.210+0000 1694f700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:54.909394+0000 front 2019-12-08T17:41:54.941825+0000 (oldest deadline 2019-12-08T17:42:39.340165+0000) 2019-12-08T17:42:41.380 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:42:41.378+0000 1694f700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:52.080736+0000 front 2019-12-08T17:41:52.093290+0000 (oldest deadline 2019-12-08T17:42:37.365713+0000) 2019-12-08T17:42:41.550 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:42:41.545+0000 1694f700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:52.954542+0000 front 2019-12-08T17:41:52.626465+0000 (oldest deadline 2019-12-08T17:42:37.294399+0000) 2019-12-08T17:42:41.777 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:42:41.775+0000 1694f700 -1 osd.3 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:54.898703+0000 front 2019-12-08T17:41:55.081894+0000 (oldest deadline 2019-12-08T17:42:37.704781+0000) 2019-12-08T17:42:41.911 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:42:41.906+0000 1694f700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:55.504644+0000 front 2019-12-08T17:41:55.499921+0000 (oldest deadline 2019-12-08T17:42:37.171691+0000) 2019-12-08T17:42:42.139 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:42:42.134+0000 1694f700 -1 osd.5 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:56.870718+0000 front 2019-12-08T17:41:56.678751+0000 (oldest deadline 2019-12-08T17:42:40.504049+0000) 2019-12-08T17:42:42.145 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:42:42.139+0000 1694f700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:56.773740+0000 front 2019-12-08T17:41:56.451346+0000 (oldest deadline 2019-12-08T17:42:37.430025+0000) 2019-12-08T17:42:42.176 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:42:42.173+0000 1694f700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:54.909394+0000 front 2019-12-08T17:41:54.941825+0000 (oldest deadline 2019-12-08T17:42:39.340165+0000) 2019-12-08T17:42:42.424 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:42:42.422+0000 1694f700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:52.080736+0000 front 2019-12-08T17:41:52.093290+0000 (oldest deadline 2019-12-08T17:42:37.365713+0000) 2019-12-08T17:42:42.520 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:42:42.515+0000 1694f700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:52.954542+0000 front 2019-12-08T17:41:52.626465+0000 (oldest deadline 2019-12-08T17:42:37.294399+0000) 2019-12-08T17:42:42.750 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:42:42.748+0000 1694f700 -1 osd.3 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:54.898703+0000 front 2019-12-08T17:41:55.081894+0000 (oldest deadline 2019-12-08T17:42:37.704781+0000) 2019-12-08T17:42:42.891 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:42:42.886+0000 1694f700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:55.504644+0000 front 2019-12-08T17:41:55.499921+0000 (oldest deadline 2019-12-08T17:42:37.171691+0000) 2019-12-08T17:42:43.105 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:42:43.100+0000 1694f700 -1 osd.5 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:56.870718+0000 front 2019-12-08T17:41:56.678751+0000 (oldest deadline 2019-12-08T17:42:40.504049+0000) 2019-12-08T17:42:43.152 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:42:43.150+0000 1694f700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:54.909394+0000 front 2019-12-08T17:41:54.941825+0000 (oldest deadline 2019-12-08T17:42:39.340165+0000) 2019-12-08T17:42:43.155 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:42:43.150+0000 1694f700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:56.773740+0000 front 2019-12-08T17:41:56.451346+0000 (oldest deadline 2019-12-08T17:42:37.430025+0000) 2019-12-08T17:42:43.449 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:42:43.446+0000 1694f700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:52.080736+0000 front 2019-12-08T17:41:52.093290+0000 (oldest deadline 2019-12-08T17:42:37.365713+0000) 2019-12-08T17:42:43.520 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:42:43.515+0000 1694f700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:52.954542+0000 front 2019-12-08T17:41:52.626465+0000 (oldest deadline 2019-12-08T17:42:37.294399+0000) 2019-12-08T17:42:43.777 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:42:43.774+0000 1694f700 -1 osd.3 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:54.898703+0000 front 2019-12-08T17:41:55.081894+0000 (oldest deadline 2019-12-08T17:42:37.704781+0000) 2019-12-08T17:42:43.928 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:42:43.923+0000 1694f700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:55.504644+0000 front 2019-12-08T17:41:55.499921+0000 (oldest deadline 2019-12-08T17:42:37.171691+0000) 2019-12-08T17:42:44.119 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:42:44.115+0000 1694f700 -1 osd.5 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:56.870718+0000 front 2019-12-08T17:41:56.678751+0000 (oldest deadline 2019-12-08T17:42:40.504049+0000) 2019-12-08T17:42:44.120 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:42:44.116+0000 1694f700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:56.773740+0000 front 2019-12-08T17:41:56.451346+0000 (oldest deadline 2019-12-08T17:42:37.430025+0000) 2019-12-08T17:42:44.159 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:42:44.156+0000 1694f700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:54.909394+0000 front 2019-12-08T17:41:54.941825+0000 (oldest deadline 2019-12-08T17:42:39.340165+0000) 2019-12-08T17:42:44.479 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:42:44.476+0000 1694f700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:52.080736+0000 front 2019-12-08T17:41:52.093290+0000 (oldest deadline 2019-12-08T17:42:37.365713+0000) 2019-12-08T17:42:44.528 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:42:44.524+0000 1694f700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:52.954542+0000 front 2019-12-08T17:41:52.626465+0000 (oldest deadline 2019-12-08T17:42:37.294399+0000) 2019-12-08T17:42:44.753 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:42:44.751+0000 1694f700 -1 osd.3 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:54.898703+0000 front 2019-12-08T17:41:55.081894+0000 (oldest deadline 2019-12-08T17:42:37.704781+0000) 2019-12-08T17:42:44.983 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:42:44.977+0000 1694f700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:55.504644+0000 front 2019-12-08T17:41:55.499921+0000 (oldest deadline 2019-12-08T17:42:37.171691+0000) 2019-12-08T17:42:45.097 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:42:45.092+0000 1694f700 -1 osd.5 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:56.870718+0000 front 2019-12-08T17:41:56.678751+0000 (oldest deadline 2019-12-08T17:42:40.504049+0000) 2019-12-08T17:42:45.125 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:42:45.121+0000 1694f700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:56.773740+0000 front 2019-12-08T17:41:56.451346+0000 (oldest deadline 2019-12-08T17:42:37.430025+0000) 2019-12-08T17:42:45.144 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:42:45.139+0000 1694f700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:54.909394+0000 front 2019-12-08T17:41:54.941825+0000 (oldest deadline 2019-12-08T17:42:39.340165+0000) 2019-12-08T17:42:45.514 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:42:45.510+0000 1694f700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:52.954542+0000 front 2019-12-08T17:41:52.626465+0000 (oldest deadline 2019-12-08T17:42:37.294399+0000) 2019-12-08T17:42:45.529 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:42:45.526+0000 1694f700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:52.080736+0000 front 2019-12-08T17:41:52.093290+0000 (oldest deadline 2019-12-08T17:42:37.365713+0000) 2019-12-08T17:42:45.736 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:42:45.733+0000 1694f700 -1 osd.3 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:54.898703+0000 front 2019-12-08T17:41:55.081894+0000 (oldest deadline 2019-12-08T17:42:37.704781+0000) 2019-12-08T17:42:45.959 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:42:45.954+0000 1694f700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:55.504644+0000 front 2019-12-08T17:41:55.499921+0000 (oldest deadline 2019-12-08T17:42:37.171691+0000) 2019-12-08T17:42:46.064 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:42:46.053+0000 1694f700 -1 osd.5 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:56.870718+0000 front 2019-12-08T17:41:56.678751+0000 (oldest deadline 2019-12-08T17:42:40.504049+0000) 2019-12-08T17:42:46.142 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:42:46.139+0000 1694f700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:54.909394+0000 front 2019-12-08T17:41:54.941825+0000 (oldest deadline 2019-12-08T17:42:39.340165+0000) 2019-12-08T17:42:46.163 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:42:46.158+0000 1694f700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:56.773740+0000 front 2019-12-08T17:41:56.451346+0000 (oldest deadline 2019-12-08T17:42:37.430025+0000) 2019-12-08T17:42:46.564 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:42:46.559+0000 1694f700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:52.954542+0000 front 2019-12-08T17:41:52.626465+0000 (oldest deadline 2019-12-08T17:42:37.294399+0000) 2019-12-08T17:42:46.570 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:42:46.563+0000 1694f700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:52.080736+0000 front 2019-12-08T17:41:52.093290+0000 (oldest deadline 2019-12-08T17:42:37.365713+0000) 2019-12-08T17:42:46.709 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:42:46.707+0000 1694f700 -1 osd.3 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:54.898703+0000 front 2019-12-08T17:41:55.081894+0000 (oldest deadline 2019-12-08T17:42:37.704781+0000) 2019-12-08T17:42:47.011 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:42:47.006+0000 1694f700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:55.504644+0000 front 2019-12-08T17:41:55.499921+0000 (oldest deadline 2019-12-08T17:42:37.171691+0000) 2019-12-08T17:42:47.028 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:42:47.021+0000 1694f700 -1 osd.5 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:56.870718+0000 front 2019-12-08T17:41:56.678751+0000 (oldest deadline 2019-12-08T17:42:40.504049+0000) 2019-12-08T17:42:47.174 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:42:47.173+0000 1694f700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:54.909394+0000 front 2019-12-08T17:41:54.941825+0000 (oldest deadline 2019-12-08T17:42:39.340165+0000) 2019-12-08T17:42:47.188 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:42:47.184+0000 1694f700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:56.773740+0000 front 2019-12-08T17:41:56.451346+0000 (oldest deadline 2019-12-08T17:42:37.430025+0000) 2019-12-08T17:42:47.521 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:42:47.519+0000 1694f700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:52.080736+0000 front 2019-12-08T17:41:52.093290+0000 (oldest deadline 2019-12-08T17:42:37.365713+0000) 2019-12-08T17:42:47.614 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:42:47.609+0000 1694f700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:52.954542+0000 front 2019-12-08T17:41:52.626465+0000 (oldest deadline 2019-12-08T17:42:37.294399+0000) 2019-12-08T17:42:47.696 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:42:47.693+0000 1694f700 -1 osd.3 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:54.898703+0000 front 2019-12-08T17:41:55.081894+0000 (oldest deadline 2019-12-08T17:42:37.704781+0000) 2019-12-08T17:42:48.034 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:42:48.028+0000 1694f700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:55.504644+0000 front 2019-12-08T17:41:55.499921+0000 (oldest deadline 2019-12-08T17:42:37.171691+0000) 2019-12-08T17:42:48.170 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:42:48.073+0000 1694f700 -1 osd.5 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:56.870718+0000 front 2019-12-08T17:41:56.678751+0000 (oldest deadline 2019-12-08T17:42:40.504049+0000) 2019-12-08T17:42:48.215 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:42:48.213+0000 1694f700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:54.909394+0000 front 2019-12-08T17:41:54.941825+0000 (oldest deadline 2019-12-08T17:42:39.340165+0000) 2019-12-08T17:42:48.227 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:42:48.222+0000 1694f700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:56.773740+0000 front 2019-12-08T17:41:56.451346+0000 (oldest deadline 2019-12-08T17:42:37.430025+0000) 2019-12-08T17:42:48.545 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:42:48.543+0000 1694f700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:52.080736+0000 front 2019-12-08T17:41:52.093290+0000 (oldest deadline 2019-12-08T17:42:37.365713+0000) 2019-12-08T17:42:48.660 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:42:48.655+0000 1694f700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:52.954542+0000 front 2019-12-08T17:41:52.626465+0000 (oldest deadline 2019-12-08T17:42:37.294399+0000) 2019-12-08T17:42:48.745 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:42:48.741+0000 1694f700 -1 osd.3 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:54.898703+0000 front 2019-12-08T17:41:55.081894+0000 (oldest deadline 2019-12-08T17:42:37.704781+0000) 2019-12-08T17:42:48.999 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:42:48.994+0000 1694f700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:55.504644+0000 front 2019-12-08T17:41:55.499921+0000 (oldest deadline 2019-12-08T17:42:37.171691+0000) 2019-12-08T17:42:49.084 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:42:49.080+0000 1694f700 -1 osd.5 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:56.870718+0000 front 2019-12-08T17:41:56.678751+0000 (oldest deadline 2019-12-08T17:42:40.504049+0000) 2019-12-08T17:42:49.199 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:42:49.195+0000 1694f700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:54.909394+0000 front 2019-12-08T17:41:54.941825+0000 (oldest deadline 2019-12-08T17:42:39.340165+0000) 2019-12-08T17:42:49.242 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:42:49.237+0000 1694f700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:56.773740+0000 front 2019-12-08T17:41:56.451346+0000 (oldest deadline 2019-12-08T17:42:37.430025+0000) 2019-12-08T17:42:49.550 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:42:49.548+0000 1694f700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:52.080736+0000 front 2019-12-08T17:41:52.093290+0000 (oldest deadline 2019-12-08T17:42:37.365713+0000) 2019-12-08T17:42:49.687 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:42:49.682+0000 1694f700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:52.954542+0000 front 2019-12-08T17:41:52.626465+0000 (oldest deadline 2019-12-08T17:42:37.294399+0000) 2019-12-08T17:42:49.769 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:42:49.766+0000 1694f700 -1 osd.3 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:54.898703+0000 front 2019-12-08T17:41:55.081894+0000 (oldest deadline 2019-12-08T17:42:37.704781+0000) 2019-12-08T17:42:49.982 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:42:49.976+0000 1694f700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:55.504644+0000 front 2019-12-08T17:41:55.499921+0000 (oldest deadline 2019-12-08T17:42:37.171691+0000) 2019-12-08T17:42:50.107 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:42:50.102+0000 1694f700 -1 osd.5 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:56.870718+0000 front 2019-12-08T17:41:56.678751+0000 (oldest deadline 2019-12-08T17:42:40.504049+0000) 2019-12-08T17:42:50.216 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:42:50.211+0000 1694f700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:56.773740+0000 front 2019-12-08T17:41:56.451346+0000 (oldest deadline 2019-12-08T17:42:37.430025+0000) 2019-12-08T17:42:50.231 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:42:50.228+0000 1694f700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:54.909394+0000 front 2019-12-08T17:41:54.941825+0000 (oldest deadline 2019-12-08T17:42:39.340165+0000) 2019-12-08T17:42:50.530 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:42:50.526+0000 1694f700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:52.080736+0000 front 2019-12-08T17:41:52.093290+0000 (oldest deadline 2019-12-08T17:42:37.365713+0000) 2019-12-08T17:42:50.717 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:42:50.711+0000 1694f700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:52.954542+0000 front 2019-12-08T17:41:52.626465+0000 (oldest deadline 2019-12-08T17:42:37.294399+0000) 2019-12-08T17:42:50.789 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:42:50.786+0000 1694f700 -1 osd.3 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:54.898703+0000 front 2019-12-08T17:41:55.081894+0000 (oldest deadline 2019-12-08T17:42:37.704781+0000) 2019-12-08T17:42:51.003 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:42:50.999+0000 1694f700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:55.504644+0000 front 2019-12-08T17:41:55.499921+0000 (oldest deadline 2019-12-08T17:42:37.171691+0000) 2019-12-08T17:42:51.132 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:42:51.126+0000 1694f700 -1 osd.5 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:56.870718+0000 front 2019-12-08T17:41:56.678751+0000 (oldest deadline 2019-12-08T17:42:40.504049+0000) 2019-12-08T17:42:51.196 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:42:51.194+0000 1694f700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:54.909394+0000 front 2019-12-08T17:41:54.941825+0000 (oldest deadline 2019-12-08T17:42:39.340165+0000) 2019-12-08T17:42:51.253 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:42:51.247+0000 1694f700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:56.773740+0000 front 2019-12-08T17:41:56.451346+0000 (oldest deadline 2019-12-08T17:42:37.430025+0000) 2019-12-08T17:42:51.539 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:42:51.535+0000 1694f700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:52.080736+0000 front 2019-12-08T17:41:52.093290+0000 (oldest deadline 2019-12-08T17:42:37.365713+0000) 2019-12-08T17:42:51.741 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:42:51.736+0000 1694f700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:52.954542+0000 front 2019-12-08T17:41:52.626465+0000 (oldest deadline 2019-12-08T17:42:37.294399+0000) 2019-12-08T17:42:51.765 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:42:51.755+0000 1694f700 -1 osd.3 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:54.898703+0000 front 2019-12-08T17:41:55.081894+0000 (oldest deadline 2019-12-08T17:42:37.704781+0000) 2019-12-08T17:42:51.995 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:42:51.990+0000 1694f700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:55.504644+0000 front 2019-12-08T17:41:55.499921+0000 (oldest deadline 2019-12-08T17:42:37.171691+0000) 2019-12-08T17:42:52.120 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:42:52.117+0000 1694f700 -1 osd.5 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:56.870718+0000 front 2019-12-08T17:41:56.678751+0000 (oldest deadline 2019-12-08T17:42:40.504049+0000) 2019-12-08T17:42:52.176 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:42:52.175+0000 1694f700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:54.909394+0000 front 2019-12-08T17:41:54.941825+0000 (oldest deadline 2019-12-08T17:42:39.340165+0000) 2019-12-08T17:42:52.294 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:42:52.288+0000 1694f700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:56.773740+0000 front 2019-12-08T17:41:56.451346+0000 (oldest deadline 2019-12-08T17:42:37.430025+0000) 2019-12-08T17:42:52.589 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:42:52.584+0000 1694f700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:52.080736+0000 front 2019-12-08T17:41:52.093290+0000 (oldest deadline 2019-12-08T17:42:37.365713+0000) 2019-12-08T17:42:52.773 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:42:52.769+0000 1694f700 -1 osd.3 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:54.898703+0000 front 2019-12-08T17:41:55.081894+0000 (oldest deadline 2019-12-08T17:42:37.704781+0000) 2019-12-08T17:42:52.788 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:42:52.784+0000 1694f700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:52.954542+0000 front 2019-12-08T17:41:52.626465+0000 (oldest deadline 2019-12-08T17:42:37.294399+0000) 2019-12-08T17:42:53.042 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:42:53.038+0000 1694f700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:55.504644+0000 front 2019-12-08T17:41:55.499921+0000 (oldest deadline 2019-12-08T17:42:37.171691+0000) 2019-12-08T17:42:53.148 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:42:53.141+0000 1694f700 -1 osd.5 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:56.870718+0000 front 2019-12-08T17:41:56.678751+0000 (oldest deadline 2019-12-08T17:42:40.504049+0000) 2019-12-08T17:42:53.212 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:42:53.205+0000 1694f700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:54.909394+0000 front 2019-12-08T17:41:54.941825+0000 (oldest deadline 2019-12-08T17:42:39.340165+0000) 2019-12-08T17:42:53.285 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:42:53.281+0000 1694f700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:56.773740+0000 front 2019-12-08T17:41:56.451346+0000 (oldest deadline 2019-12-08T17:42:37.430025+0000) 2019-12-08T17:42:53.561 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:42:53.559+0000 1694f700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:52.080736+0000 front 2019-12-08T17:41:52.093290+0000 (oldest deadline 2019-12-08T17:42:37.365713+0000) 2019-12-08T17:42:53.803 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:42:53.798+0000 1694f700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:52.954542+0000 front 2019-12-08T17:41:52.626465+0000 (oldest deadline 2019-12-08T17:42:37.294399+0000) 2019-12-08T17:42:53.820 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:42:53.819+0000 1694f700 -1 osd.3 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:54.898703+0000 front 2019-12-08T17:41:55.081894+0000 (oldest deadline 2019-12-08T17:42:37.704781+0000) 2019-12-08T17:42:54.046 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:42:54.041+0000 1694f700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:55.504644+0000 front 2019-12-08T17:41:55.499921+0000 (oldest deadline 2019-12-08T17:42:37.171691+0000) 2019-12-08T17:42:54.194 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:42:54.193+0000 1694f700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:54.909394+0000 front 2019-12-08T17:41:54.941825+0000 (oldest deadline 2019-12-08T17:42:39.340165+0000) 2019-12-08T17:42:54.196 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:42:54.192+0000 1694f700 -1 osd.5 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:56.870718+0000 front 2019-12-08T17:41:56.678751+0000 (oldest deadline 2019-12-08T17:42:40.504049+0000) 2019-12-08T17:42:54.328 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:42:54.322+0000 1694f700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:56.773740+0000 front 2019-12-08T17:41:56.451346+0000 (oldest deadline 2019-12-08T17:42:37.430025+0000) 2019-12-08T17:42:54.514 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:42:54.513+0000 1694f700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:52.080736+0000 front 2019-12-08T17:41:52.093290+0000 (oldest deadline 2019-12-08T17:42:37.365713+0000) 2019-12-08T17:42:54.775 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:42:54.774+0000 1694f700 -1 osd.3 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:54.898703+0000 front 2019-12-08T17:41:55.081894+0000 (oldest deadline 2019-12-08T17:42:37.704781+0000) 2019-12-08T17:42:54.780 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:42:54.775+0000 1694f700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:52.954542+0000 front 2019-12-08T17:41:52.626465+0000 (oldest deadline 2019-12-08T17:42:37.294399+0000) 2019-12-08T17:42:55.065 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:42:55.060+0000 1694f700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:55.504644+0000 front 2019-12-08T17:41:55.499921+0000 (oldest deadline 2019-12-08T17:42:37.171691+0000) 2019-12-08T17:42:55.158 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:42:55.154+0000 1694f700 -1 osd.5 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:56.870718+0000 front 2019-12-08T17:41:56.678751+0000 (oldest deadline 2019-12-08T17:42:40.504049+0000) 2019-12-08T17:42:55.162 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:42:55.161+0000 1694f700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:54.909394+0000 front 2019-12-08T17:41:54.941825+0000 (oldest deadline 2019-12-08T17:42:39.340165+0000) 2019-12-08T17:42:55.316 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:42:55.308+0000 1694f700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:56.773740+0000 front 2019-12-08T17:41:56.451346+0000 (oldest deadline 2019-12-08T17:42:37.430025+0000) 2019-12-08T17:42:55.483 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:42:55.482+0000 1694f700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:52.080736+0000 front 2019-12-08T17:41:52.093290+0000 (oldest deadline 2019-12-08T17:42:37.365713+0000) 2019-12-08T17:42:55.777 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:42:55.773+0000 1694f700 -1 osd.3 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:54.898703+0000 front 2019-12-08T17:41:55.081894+0000 (oldest deadline 2019-12-08T17:42:37.704781+0000) 2019-12-08T17:42:55.786 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:42:55.774+0000 1694f700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:52.954542+0000 front 2019-12-08T17:41:52.626465+0000 (oldest deadline 2019-12-08T17:42:37.294399+0000) 2019-12-08T17:42:56.068 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:42:56.063+0000 1694f700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:55.504644+0000 front 2019-12-08T17:41:55.499921+0000 (oldest deadline 2019-12-08T17:42:37.171691+0000) 2019-12-08T17:42:56.159 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:42:56.159+0000 1694f700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:54.909394+0000 front 2019-12-08T17:41:54.941825+0000 (oldest deadline 2019-12-08T17:42:39.340165+0000) 2019-12-08T17:42:56.190 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:42:56.186+0000 1694f700 -1 osd.5 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:56.870718+0000 front 2019-12-08T17:41:56.678751+0000 (oldest deadline 2019-12-08T17:42:40.504049+0000) 2019-12-08T17:42:56.325 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:42:56.319+0000 1694f700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:56.773740+0000 front 2019-12-08T17:41:56.451346+0000 (oldest deadline 2019-12-08T17:42:37.430025+0000) 2019-12-08T17:42:56.511 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:42:56.509+0000 1694f700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:52.080736+0000 front 2019-12-08T17:41:52.093290+0000 (oldest deadline 2019-12-08T17:42:37.365713+0000) 2019-12-08T17:42:56.754 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:42:56.752+0000 1694f700 -1 osd.3 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:54.898703+0000 front 2019-12-08T17:41:55.081894+0000 (oldest deadline 2019-12-08T17:42:37.704781+0000) 2019-12-08T17:42:56.800 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:42:56.793+0000 1694f700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:52.954542+0000 front 2019-12-08T17:41:52.626465+0000 (oldest deadline 2019-12-08T17:42:37.294399+0000) 2019-12-08T17:42:57.027 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:42:57.022+0000 1694f700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:55.504644+0000 front 2019-12-08T17:41:55.499921+0000 (oldest deadline 2019-12-08T17:42:37.171691+0000) 2019-12-08T17:42:57.150 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:42:57.145+0000 1694f700 -1 osd.5 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:56.870718+0000 front 2019-12-08T17:41:56.678751+0000 (oldest deadline 2019-12-08T17:42:40.504049+0000) 2019-12-08T17:42:57.200 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:42:57.199+0000 1694f700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:54.909394+0000 front 2019-12-08T17:41:54.941825+0000 (oldest deadline 2019-12-08T17:42:39.340165+0000) 2019-12-08T17:42:57.304 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:42:57.299+0000 1694f700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:56.773740+0000 front 2019-12-08T17:41:56.451346+0000 (oldest deadline 2019-12-08T17:42:37.430025+0000) 2019-12-08T17:42:57.560 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:42:57.548+0000 1694f700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:52.080736+0000 front 2019-12-08T17:41:52.093290+0000 (oldest deadline 2019-12-08T17:42:37.365713+0000) 2019-12-08T17:42:57.800 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:42:57.798+0000 1694f700 -1 osd.3 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:54.898703+0000 front 2019-12-08T17:41:55.081894+0000 (oldest deadline 2019-12-08T17:42:37.704781+0000) 2019-12-08T17:42:57.829 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:42:57.824+0000 1694f700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:52.954542+0000 front 2019-12-08T17:41:52.626465+0000 (oldest deadline 2019-12-08T17:42:37.294399+0000) 2019-12-08T17:42:58.081 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:42:58.076+0000 1694f700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:55.504644+0000 front 2019-12-08T17:41:55.499921+0000 (oldest deadline 2019-12-08T17:42:37.171691+0000) 2019-12-08T17:42:58.157 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:42:58.152+0000 1694f700 -1 osd.5 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:56.870718+0000 front 2019-12-08T17:41:56.678751+0000 (oldest deadline 2019-12-08T17:42:40.504049+0000) 2019-12-08T17:42:58.234 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:42:58.233+0000 1694f700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:54.909394+0000 front 2019-12-08T17:41:54.941825+0000 (oldest deadline 2019-12-08T17:42:39.340165+0000) 2019-12-08T17:42:58.349 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:42:58.345+0000 1694f700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:56.773740+0000 front 2019-12-08T17:41:56.451346+0000 (oldest deadline 2019-12-08T17:42:37.430025+0000) 2019-12-08T17:42:58.584 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:42:58.583+0000 1694f700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:52.080736+0000 front 2019-12-08T17:41:52.093290+0000 (oldest deadline 2019-12-08T17:42:37.365713+0000) 2019-12-08T17:42:58.780 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:42:58.778+0000 1694f700 -1 osd.3 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:54.898703+0000 front 2019-12-08T17:41:55.081894+0000 (oldest deadline 2019-12-08T17:42:37.704781+0000) 2019-12-08T17:42:58.802 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:42:58.797+0000 1694f700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:52.954542+0000 front 2019-12-08T17:41:52.626465+0000 (oldest deadline 2019-12-08T17:42:37.294399+0000) 2019-12-08T17:42:59.120 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:42:59.115+0000 1694f700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:55.504644+0000 front 2019-12-08T17:41:55.499921+0000 (oldest deadline 2019-12-08T17:42:37.171691+0000) 2019-12-08T17:42:59.164 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:42:59.159+0000 1694f700 -1 osd.5 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:56.870718+0000 front 2019-12-08T17:41:56.678751+0000 (oldest deadline 2019-12-08T17:42:40.504049+0000) 2019-12-08T17:42:59.288 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:42:59.286+0000 1694f700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:54.909394+0000 front 2019-12-08T17:41:54.941825+0000 (oldest deadline 2019-12-08T17:42:39.340165+0000) 2019-12-08T17:42:59.392 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:42:59.387+0000 1694f700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:56.773740+0000 front 2019-12-08T17:41:56.451346+0000 (oldest deadline 2019-12-08T17:42:37.430025+0000) 2019-12-08T17:42:59.541 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:42:59.540+0000 1694f700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:52.080736+0000 front 2019-12-08T17:41:52.093290+0000 (oldest deadline 2019-12-08T17:42:37.365713+0000) 2019-12-08T17:42:59.775 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:42:59.769+0000 1694f700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:52.954542+0000 front 2019-12-08T17:41:52.626465+0000 (oldest deadline 2019-12-08T17:42:37.294399+0000) 2019-12-08T17:42:59.801 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:42:59.800+0000 1694f700 -1 osd.3 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:54.898703+0000 front 2019-12-08T17:41:55.081894+0000 (oldest deadline 2019-12-08T17:42:37.704781+0000) 2019-12-08T17:43:00.116 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:43:00.110+0000 1694f700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:55.504644+0000 front 2019-12-08T17:41:55.499921+0000 (oldest deadline 2019-12-08T17:42:37.171691+0000) 2019-12-08T17:43:00.190 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:43:00.185+0000 1694f700 -1 osd.5 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:56.870718+0000 front 2019-12-08T17:41:56.678751+0000 (oldest deadline 2019-12-08T17:42:40.504049+0000) 2019-12-08T17:43:00.331 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:43:00.329+0000 1694f700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:54.909394+0000 front 2019-12-08T17:41:54.941825+0000 (oldest deadline 2019-12-08T17:42:39.340165+0000) 2019-12-08T17:43:00.381 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:43:00.377+0000 1694f700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:56.773740+0000 front 2019-12-08T17:41:56.451346+0000 (oldest deadline 2019-12-08T17:42:37.430025+0000) 2019-12-08T17:43:00.496 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:43:00.494+0000 1694f700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:52.080736+0000 front 2019-12-08T17:41:52.093290+0000 (oldest deadline 2019-12-08T17:42:37.365713+0000) 2019-12-08T17:43:00.792 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:43:00.791+0000 1694f700 -1 osd.3 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:54.898703+0000 front 2019-12-08T17:41:55.081894+0000 (oldest deadline 2019-12-08T17:42:37.704781+0000) 2019-12-08T17:43:00.800 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:43:00.796+0000 1694f700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:52.954542+0000 front 2019-12-08T17:41:52.626465+0000 (oldest deadline 2019-12-08T17:42:37.294399+0000) 2019-12-08T17:43:01.098 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:43:01.094+0000 1694f700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:55.504644+0000 front 2019-12-08T17:41:55.499921+0000 (oldest deadline 2019-12-08T17:42:37.171691+0000) 2019-12-08T17:43:01.228 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:43:01.222+0000 1694f700 -1 osd.5 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:56.870718+0000 front 2019-12-08T17:41:56.678751+0000 (oldest deadline 2019-12-08T17:42:40.504049+0000) 2019-12-08T17:43:01.330 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:43:01.329+0000 1694f700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:54.909394+0000 front 2019-12-08T17:41:54.941825+0000 (oldest deadline 2019-12-08T17:42:39.340165+0000) 2019-12-08T17:43:01.416 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:43:01.411+0000 1694f700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:56.773740+0000 front 2019-12-08T17:41:56.451346+0000 (oldest deadline 2019-12-08T17:42:37.430025+0000) 2019-12-08T17:43:01.539 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:43:01.538+0000 1694f700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:52.080736+0000 front 2019-12-08T17:41:52.093290+0000 (oldest deadline 2019-12-08T17:42:37.365713+0000) 2019-12-08T17:43:01.759 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:43:01.758+0000 1694f700 -1 osd.3 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:54.898703+0000 front 2019-12-08T17:41:55.081894+0000 (oldest deadline 2019-12-08T17:42:37.704781+0000) 2019-12-08T17:43:01.793 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:43:01.789+0000 1694f700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:52.954542+0000 front 2019-12-08T17:41:52.626465+0000 (oldest deadline 2019-12-08T17:42:37.294399+0000) 2019-12-08T17:43:02.094 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:43:02.088+0000 1694f700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:55.504644+0000 front 2019-12-08T17:41:55.499921+0000 (oldest deadline 2019-12-08T17:42:37.171691+0000) 2019-12-08T17:43:02.197 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:43:02.192+0000 1694f700 -1 osd.5 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:56.870718+0000 front 2019-12-08T17:41:56.678751+0000 (oldest deadline 2019-12-08T17:42:40.504049+0000) 2019-12-08T17:43:02.326 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:43:02.324+0000 1694f700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:54.909394+0000 front 2019-12-08T17:41:54.941825+0000 (oldest deadline 2019-12-08T17:42:39.340165+0000) 2019-12-08T17:43:02.465 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:43:02.460+0000 1694f700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:56.773740+0000 front 2019-12-08T17:41:56.451346+0000 (oldest deadline 2019-12-08T17:42:37.430025+0000) 2019-12-08T17:43:02.586 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:43:02.585+0000 1694f700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:52.080736+0000 front 2019-12-08T17:41:52.093290+0000 (oldest deadline 2019-12-08T17:42:37.365713+0000) 2019-12-08T17:43:02.757 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:43:02.756+0000 1694f700 -1 osd.3 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:54.898703+0000 front 2019-12-08T17:41:55.081894+0000 (oldest deadline 2019-12-08T17:42:37.704781+0000) 2019-12-08T17:43:02.777 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:43:02.771+0000 1694f700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:52.954542+0000 front 2019-12-08T17:41:52.626465+0000 (oldest deadline 2019-12-08T17:42:37.294399+0000) 2019-12-08T17:43:03.100 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:43:03.095+0000 1694f700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:55.504644+0000 front 2019-12-08T17:41:55.499921+0000 (oldest deadline 2019-12-08T17:42:37.171691+0000) 2019-12-08T17:43:03.159 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:43:03.152+0000 1694f700 -1 osd.5 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:56.870718+0000 front 2019-12-08T17:41:56.678751+0000 (oldest deadline 2019-12-08T17:42:40.504049+0000) 2019-12-08T17:43:03.323 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:43:03.322+0000 1694f700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:54.909394+0000 front 2019-12-08T17:41:54.941825+0000 (oldest deadline 2019-12-08T17:42:39.340165+0000) 2019-12-08T17:43:03.506 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:43:03.501+0000 1694f700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:56.773740+0000 front 2019-12-08T17:41:56.451346+0000 (oldest deadline 2019-12-08T17:42:37.430025+0000) 2019-12-08T17:43:03.640 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:43:03.639+0000 1694f700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:52.080736+0000 front 2019-12-08T17:41:52.093290+0000 (oldest deadline 2019-12-08T17:42:37.365713+0000) 2019-12-08T17:43:03.744 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:43:03.739+0000 1694f700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:52.954542+0000 front 2019-12-08T17:41:52.626465+0000 (oldest deadline 2019-12-08T17:42:37.294399+0000) 2019-12-08T17:43:03.746 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:43:03.744+0000 1694f700 -1 osd.3 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:54.898703+0000 front 2019-12-08T17:41:55.081894+0000 (oldest deadline 2019-12-08T17:42:37.704781+0000) 2019-12-08T17:43:04.085 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:43:04.080+0000 1694f700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:55.504644+0000 front 2019-12-08T17:41:55.499921+0000 (oldest deadline 2019-12-08T17:42:37.171691+0000) 2019-12-08T17:43:04.143 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:43:04.138+0000 1694f700 -1 osd.5 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:56.870718+0000 front 2019-12-08T17:41:56.678751+0000 (oldest deadline 2019-12-08T17:42:40.504049+0000) 2019-12-08T17:43:04.362 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:43:04.360+0000 1694f700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:54.909394+0000 front 2019-12-08T17:41:54.941825+0000 (oldest deadline 2019-12-08T17:42:39.340165+0000) 2019-12-08T17:43:04.478 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:43:04.473+0000 1694f700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:56.773740+0000 front 2019-12-08T17:41:56.451346+0000 (oldest deadline 2019-12-08T17:42:37.430025+0000) 2019-12-08T17:43:04.649 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:43:04.647+0000 1694f700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:52.080736+0000 front 2019-12-08T17:41:52.093290+0000 (oldest deadline 2019-12-08T17:42:37.365713+0000) 2019-12-08T17:43:04.741 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:43:04.739+0000 1694f700 -1 osd.3 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:54.898703+0000 front 2019-12-08T17:41:55.081894+0000 (oldest deadline 2019-12-08T17:42:37.704781+0000) 2019-12-08T17:43:04.762 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:43:04.757+0000 1694f700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:52.954542+0000 front 2019-12-08T17:41:52.626465+0000 (oldest deadline 2019-12-08T17:42:37.294399+0000) 2019-12-08T17:43:05.059 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:43:05.054+0000 1694f700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:55.504644+0000 front 2019-12-08T17:41:55.499921+0000 (oldest deadline 2019-12-08T17:42:37.171691+0000) 2019-12-08T17:43:05.148 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:43:05.143+0000 1694f700 -1 osd.5 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:56.870718+0000 front 2019-12-08T17:41:56.678751+0000 (oldest deadline 2019-12-08T17:42:40.504049+0000) 2019-12-08T17:43:05.375 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:43:05.373+0000 1694f700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:54.909394+0000 front 2019-12-08T17:41:54.941825+0000 (oldest deadline 2019-12-08T17:42:39.340165+0000) 2019-12-08T17:43:05.499 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:43:05.494+0000 1694f700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:56.773740+0000 front 2019-12-08T17:41:56.451346+0000 (oldest deadline 2019-12-08T17:42:37.430025+0000) 2019-12-08T17:43:05.650 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:43:05.649+0000 1694f700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:52.080736+0000 front 2019-12-08T17:41:52.093290+0000 (oldest deadline 2019-12-08T17:42:37.365713+0000) 2019-12-08T17:43:05.745 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:43:05.739+0000 1694f700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:52.954542+0000 front 2019-12-08T17:41:52.626465+0000 (oldest deadline 2019-12-08T17:42:37.294399+0000) 2019-12-08T17:43:05.749 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:43:05.748+0000 1694f700 -1 osd.3 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:54.898703+0000 front 2019-12-08T17:41:55.081894+0000 (oldest deadline 2019-12-08T17:42:37.704781+0000) 2019-12-08T17:43:06.037 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:43:06.032+0000 1694f700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:55.504644+0000 front 2019-12-08T17:41:55.499921+0000 (oldest deadline 2019-12-08T17:42:37.171691+0000) 2019-12-08T17:43:06.115 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:43:06.108+0000 1694f700 -1 osd.5 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:56.870718+0000 front 2019-12-08T17:41:56.678751+0000 (oldest deadline 2019-12-08T17:42:40.504049+0000) 2019-12-08T17:43:06.335 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:43:06.334+0000 1694f700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:54.909394+0000 front 2019-12-08T17:41:54.941825+0000 (oldest deadline 2019-12-08T17:42:39.340165+0000) 2019-12-08T17:43:06.517 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:43:06.513+0000 1694f700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:56.773740+0000 front 2019-12-08T17:41:56.451346+0000 (oldest deadline 2019-12-08T17:42:37.430025+0000) 2019-12-08T17:43:06.678 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:43:06.676+0000 1694f700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:52.080736+0000 front 2019-12-08T17:41:52.093290+0000 (oldest deadline 2019-12-08T17:42:37.365713+0000) 2019-12-08T17:43:06.707 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:43:06.701+0000 1694f700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:52.954542+0000 front 2019-12-08T17:41:52.626465+0000 (oldest deadline 2019-12-08T17:42:37.294399+0000) 2019-12-08T17:43:06.716 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:43:06.715+0000 1694f700 -1 osd.3 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:54.898703+0000 front 2019-12-08T17:41:55.081894+0000 (oldest deadline 2019-12-08T17:42:37.704781+0000) 2019-12-08T17:43:07.009 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:43:07.004+0000 1694f700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:55.504644+0000 front 2019-12-08T17:41:55.499921+0000 (oldest deadline 2019-12-08T17:42:37.171691+0000) 2019-12-08T17:43:07.149 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:43:07.143+0000 1694f700 -1 osd.5 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:56.870718+0000 front 2019-12-08T17:41:56.678751+0000 (oldest deadline 2019-12-08T17:42:40.504049+0000) 2019-12-08T17:43:07.359 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:43:07.357+0000 1694f700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:54.909394+0000 front 2019-12-08T17:41:54.941825+0000 (oldest deadline 2019-12-08T17:42:39.340165+0000) 2019-12-08T17:43:07.507 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:43:07.502+0000 1694f700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:56.773740+0000 front 2019-12-08T17:41:56.451346+0000 (oldest deadline 2019-12-08T17:42:37.430025+0000) 2019-12-08T17:43:07.661 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:43:07.660+0000 1694f700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:52.080736+0000 front 2019-12-08T17:41:52.093290+0000 (oldest deadline 2019-12-08T17:42:37.365713+0000) 2019-12-08T17:43:07.671 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:43:07.669+0000 1694f700 -1 osd.3 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:54.898703+0000 front 2019-12-08T17:41:55.081894+0000 (oldest deadline 2019-12-08T17:42:37.704781+0000) 2019-12-08T17:43:07.682 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:43:07.676+0000 1694f700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:52.954542+0000 front 2019-12-08T17:41:52.626465+0000 (oldest deadline 2019-12-08T17:42:37.294399+0000) 2019-12-08T17:43:08.045 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:43:08.040+0000 1694f700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:55.504644+0000 front 2019-12-08T17:41:55.499921+0000 (oldest deadline 2019-12-08T17:42:37.171691+0000) 2019-12-08T17:43:08.132 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:43:08.127+0000 1694f700 -1 osd.5 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:56.870718+0000 front 2019-12-08T17:41:56.678751+0000 (oldest deadline 2019-12-08T17:42:40.504049+0000) 2019-12-08T17:43:08.378 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:43:08.378+0000 1694f700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:54.909394+0000 front 2019-12-08T17:41:54.941825+0000 (oldest deadline 2019-12-08T17:42:39.340165+0000) 2019-12-08T17:43:08.546 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:43:08.541+0000 1694f700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:56.773740+0000 front 2019-12-08T17:41:56.451346+0000 (oldest deadline 2019-12-08T17:42:37.430025+0000) 2019-12-08T17:43:08.648 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:43:08.646+0000 1694f700 -1 osd.3 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:54.898703+0000 front 2019-12-08T17:41:55.081894+0000 (oldest deadline 2019-12-08T17:42:37.704781+0000) 2019-12-08T17:43:08.667 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:43:08.665+0000 1694f700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:52.080736+0000 front 2019-12-08T17:41:52.093290+0000 (oldest deadline 2019-12-08T17:42:37.365713+0000) 2019-12-08T17:43:08.669 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:43:08.663+0000 1694f700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:52.954542+0000 front 2019-12-08T17:41:52.626465+0000 (oldest deadline 2019-12-08T17:42:37.294399+0000) 2019-12-08T17:43:09.036 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:43:09.031+0000 1694f700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:55.504644+0000 front 2019-12-08T17:41:55.499921+0000 (oldest deadline 2019-12-08T17:42:37.171691+0000) 2019-12-08T17:43:09.140 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:43:09.135+0000 1694f700 -1 osd.5 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:56.870718+0000 front 2019-12-08T17:41:56.678751+0000 (oldest deadline 2019-12-08T17:42:40.504049+0000) 2019-12-08T17:43:09.397 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:43:09.395+0000 1694f700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:54.909394+0000 front 2019-12-08T17:41:54.941825+0000 (oldest deadline 2019-12-08T17:42:39.340165+0000) 2019-12-08T17:43:09.526 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:43:09.521+0000 1694f700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:56.773740+0000 front 2019-12-08T17:41:56.451346+0000 (oldest deadline 2019-12-08T17:42:37.430025+0000) 2019-12-08T17:43:09.660 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:43:09.659+0000 1694f700 -1 osd.3 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:54.898703+0000 front 2019-12-08T17:41:55.081894+0000 (oldest deadline 2019-12-08T17:42:37.704781+0000) 2019-12-08T17:43:09.684 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:43:09.682+0000 1694f700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:52.080736+0000 front 2019-12-08T17:41:52.093290+0000 (oldest deadline 2019-12-08T17:42:37.365713+0000) 2019-12-08T17:43:09.698 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:43:09.693+0000 1694f700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:52.954542+0000 front 2019-12-08T17:41:52.626465+0000 (oldest deadline 2019-12-08T17:42:37.294399+0000) 2019-12-08T17:43:10.051 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:43:10.046+0000 1694f700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:55.504644+0000 front 2019-12-08T17:41:55.499921+0000 (oldest deadline 2019-12-08T17:42:37.171691+0000) 2019-12-08T17:43:10.146 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:43:10.140+0000 1694f700 -1 osd.5 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:56.870718+0000 front 2019-12-08T17:41:56.678751+0000 (oldest deadline 2019-12-08T17:42:40.504049+0000) 2019-12-08T17:43:10.386 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:43:10.386+0000 1694f700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:54.909394+0000 front 2019-12-08T17:41:54.941825+0000 (oldest deadline 2019-12-08T17:42:39.340165+0000) 2019-12-08T17:43:10.536 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:43:10.531+0000 1694f700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:56.773740+0000 front 2019-12-08T17:41:56.451346+0000 (oldest deadline 2019-12-08T17:42:37.430025+0000) 2019-12-08T17:43:10.625 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:43:10.624+0000 1694f700 -1 osd.3 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:54.898703+0000 front 2019-12-08T17:41:55.081894+0000 (oldest deadline 2019-12-08T17:42:37.704781+0000) 2019-12-08T17:43:10.673 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:43:10.668+0000 1694f700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:52.954542+0000 front 2019-12-08T17:41:52.626465+0000 (oldest deadline 2019-12-08T17:42:37.294399+0000) 2019-12-08T17:43:10.714 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:43:10.713+0000 1694f700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:52.080736+0000 front 2019-12-08T17:41:52.093290+0000 (oldest deadline 2019-12-08T17:42:37.365713+0000) 2019-12-08T17:43:10.892 INFO:tasks.ceph.mon.b.smithi013.stderr:2019-12-08T17:43:10.886+0000 1a89c700 -1 mon.b@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.2 [v2:172.21.15.79:6802/10448,v1:172.21.15.79:6803/10448] for 42sec e234 v234) 2019-12-08T17:43:11.060 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:43:11.056+0000 1694f700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:55.504644+0000 front 2019-12-08T17:41:55.499921+0000 (oldest deadline 2019-12-08T17:42:37.171691+0000) 2019-12-08T17:43:11.193 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:43:11.189+0000 1694f700 -1 osd.5 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:56.870718+0000 front 2019-12-08T17:41:56.678751+0000 (oldest deadline 2019-12-08T17:42:40.504049+0000) 2019-12-08T17:43:11.440 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:43:11.439+0000 1694f700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:54.909394+0000 front 2019-12-08T17:41:54.941825+0000 (oldest deadline 2019-12-08T17:42:39.340165+0000) 2019-12-08T17:43:11.499 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:43:11.496+0000 1694f700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:56.773740+0000 front 2019-12-08T17:41:56.451346+0000 (oldest deadline 2019-12-08T17:42:37.430025+0000) 2019-12-08T17:43:11.597 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:43:11.594+0000 1694f700 -1 osd.3 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:54.898703+0000 front 2019-12-08T17:41:55.081894+0000 (oldest deadline 2019-12-08T17:42:37.704781+0000) 2019-12-08T17:43:11.667 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:43:11.662+0000 1694f700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:52.954542+0000 front 2019-12-08T17:41:52.626465+0000 (oldest deadline 2019-12-08T17:42:37.294399+0000) 2019-12-08T17:43:11.722 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:43:11.720+0000 1694f700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:52.080736+0000 front 2019-12-08T17:41:52.093290+0000 (oldest deadline 2019-12-08T17:42:37.365713+0000) 2019-12-08T17:43:12.119 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:43:12.111+0000 1694f700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:55.504644+0000 front 2019-12-08T17:41:55.499921+0000 (oldest deadline 2019-12-08T17:42:37.171691+0000) 2019-12-08T17:43:12.183 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:43:12.177+0000 1694f700 -1 osd.5 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:56.870718+0000 front 2019-12-08T17:41:56.678751+0000 (oldest deadline 2019-12-08T17:42:40.504049+0000) 2019-12-08T17:43:12.416 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:43:12.415+0000 1694f700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:54.909394+0000 front 2019-12-08T17:41:54.941825+0000 (oldest deadline 2019-12-08T17:42:39.340165+0000) 2019-12-08T17:43:12.489 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:43:12.484+0000 1694f700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:56.773740+0000 front 2019-12-08T17:41:56.451346+0000 (oldest deadline 2019-12-08T17:42:37.430025+0000) 2019-12-08T17:43:12.577 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:43:12.576+0000 1694f700 -1 osd.3 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:54.898703+0000 front 2019-12-08T17:41:55.081894+0000 (oldest deadline 2019-12-08T17:42:37.704781+0000) 2019-12-08T17:43:12.692 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:43:12.687+0000 1694f700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:52.954542+0000 front 2019-12-08T17:41:52.626465+0000 (oldest deadline 2019-12-08T17:42:37.294399+0000) 2019-12-08T17:43:12.716 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:43:12.714+0000 1694f700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:52.080736+0000 front 2019-12-08T17:41:52.093290+0000 (oldest deadline 2019-12-08T17:42:37.365713+0000) 2019-12-08T17:43:13.122 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:43:13.116+0000 1694f700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:55.504644+0000 front 2019-12-08T17:41:55.499921+0000 (oldest deadline 2019-12-08T17:42:37.171691+0000) 2019-12-08T17:43:13.153 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:43:13.148+0000 1694f700 -1 osd.5 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:56.870718+0000 front 2019-12-08T17:41:56.678751+0000 (oldest deadline 2019-12-08T17:42:40.504049+0000) 2019-12-08T17:43:13.407 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:43:13.404+0000 1694f700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:54.909394+0000 front 2019-12-08T17:41:54.941825+0000 (oldest deadline 2019-12-08T17:42:39.340165+0000) 2019-12-08T17:43:13.466 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:43:13.461+0000 1694f700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:56.773740+0000 front 2019-12-08T17:41:56.451346+0000 (oldest deadline 2019-12-08T17:42:37.430025+0000) 2019-12-08T17:43:13.585 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:43:13.580+0000 1694f700 -1 osd.3 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:54.898703+0000 front 2019-12-08T17:41:55.081894+0000 (oldest deadline 2019-12-08T17:42:37.704781+0000) 2019-12-08T17:43:13.709 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:43:13.704+0000 1694f700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:52.954542+0000 front 2019-12-08T17:41:52.626465+0000 (oldest deadline 2019-12-08T17:42:37.294399+0000) 2019-12-08T17:43:13.802 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:43:13.720+0000 1694f700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:52.080736+0000 front 2019-12-08T17:41:52.093290+0000 (oldest deadline 2019-12-08T17:42:37.365713+0000) 2019-12-08T17:43:14.163 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:43:14.158+0000 1694f700 -1 osd.5 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:56.870718+0000 front 2019-12-08T17:41:56.678751+0000 (oldest deadline 2019-12-08T17:42:40.504049+0000) 2019-12-08T17:43:14.167 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:43:14.162+0000 1694f700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:55.504644+0000 front 2019-12-08T17:41:55.499921+0000 (oldest deadline 2019-12-08T17:42:37.171691+0000) 2019-12-08T17:43:14.430 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:43:14.428+0000 1694f700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:54.909394+0000 front 2019-12-08T17:41:54.941825+0000 (oldest deadline 2019-12-08T17:42:39.340165+0000) 2019-12-08T17:43:14.483 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:43:14.478+0000 1694f700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:56.773740+0000 front 2019-12-08T17:41:56.451346+0000 (oldest deadline 2019-12-08T17:42:37.430025+0000) 2019-12-08T17:43:14.637 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:43:14.634+0000 1694f700 -1 osd.3 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:54.898703+0000 front 2019-12-08T17:41:55.081894+0000 (oldest deadline 2019-12-08T17:42:37.704781+0000) 2019-12-08T17:43:14.740 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:43:14.733+0000 1694f700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:52.954542+0000 front 2019-12-08T17:41:52.626465+0000 (oldest deadline 2019-12-08T17:42:37.294399+0000) 2019-12-08T17:43:14.740 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:43:14.738+0000 1694f700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:52.080736+0000 front 2019-12-08T17:41:52.093290+0000 (oldest deadline 2019-12-08T17:42:37.365713+0000) 2019-12-08T17:43:15.155 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:43:15.149+0000 1694f700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:55.504644+0000 front 2019-12-08T17:41:55.499921+0000 (oldest deadline 2019-12-08T17:42:37.171691+0000) 2019-12-08T17:43:15.202 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:43:15.197+0000 1694f700 -1 osd.5 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:56.870718+0000 front 2019-12-08T17:41:56.678751+0000 (oldest deadline 2019-12-08T17:42:40.504049+0000) 2019-12-08T17:43:15.458 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:43:15.456+0000 1694f700 -1 osd.1 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:54.909394+0000 front 2019-12-08T17:41:54.941825+0000 (oldest deadline 2019-12-08T17:42:39.340165+0000) 2019-12-08T17:43:15.513 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:43:15.508+0000 1694f700 -1 osd.6 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:56.773740+0000 front 2019-12-08T17:41:56.451346+0000 (oldest deadline 2019-12-08T17:42:37.430025+0000) 2019-12-08T17:43:15.625 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:43:15.623+0000 1694f700 -1 osd.3 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:54.898703+0000 front 2019-12-08T17:41:55.081894+0000 (oldest deadline 2019-12-08T17:42:37.704781+0000) 2019-12-08T17:43:15.719 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:43:15.717+0000 1694f700 -1 osd.0 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:52.080736+0000 front 2019-12-08T17:41:52.093290+0000 (oldest deadline 2019-12-08T17:42:37.365713+0000) 2019-12-08T17:43:15.782 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:43:15.777+0000 1694f700 -1 osd.4 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:52.954542+0000 front 2019-12-08T17:41:52.626465+0000 (oldest deadline 2019-12-08T17:42:37.294399+0000) 2019-12-08T17:43:15.985 INFO:tasks.ceph.mon.b.smithi013.stderr:2019-12-08T17:43:15.979+0000 1a89c700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.2 [v2:172.21.15.79:6802/10448,v1:172.21.15.79:6803/10448] for 42sec e234 v234) 2019-12-08T17:43:16.123 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:43:16.117+0000 1694f700 -1 osd.7 234 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:41:55.504644+0000 front 2019-12-08T17:41:55.499921+0000 (oldest deadline 2019-12-08T17:42:37.171691+0000) 2019-12-08T17:44:13.536 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:44:13.531+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.574551+0000 front 2019-12-08T17:43:33.144314+0000 (oldest deadline 2019-12-08T17:44:12.973017+0000) 2019-12-08T17:44:13.948 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:44:13.946+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.949738+0000 front 2019-12-08T17:43:33.055901+0000 (oldest deadline 2019-12-08T17:44:13.438664+0000) 2019-12-08T17:44:14.462 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:44:14.456+0000 1694f700 -1 osd.5 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.603719+0000 front 2019-12-08T17:43:30.918560+0000 (oldest deadline 2019-12-08T17:44:14.356390+0000) 2019-12-08T17:44:14.573 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:44:14.567+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.574551+0000 front 2019-12-08T17:43:33.144314+0000 (oldest deadline 2019-12-08T17:44:12.973017+0000) 2019-12-08T17:44:14.975 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:44:14.973+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.949738+0000 front 2019-12-08T17:43:33.055901+0000 (oldest deadline 2019-12-08T17:44:13.438664+0000) 2019-12-08T17:44:15.427 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:44:15.423+0000 1694f700 -1 osd.5 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.603719+0000 front 2019-12-08T17:43:30.918560+0000 (oldest deadline 2019-12-08T17:44:14.356390+0000) 2019-12-08T17:44:15.612 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:44:15.607+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.574551+0000 front 2019-12-08T17:43:33.144314+0000 (oldest deadline 2019-12-08T17:44:12.973017+0000) 2019-12-08T17:44:15.945 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:44:15.943+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.949738+0000 front 2019-12-08T17:43:33.055901+0000 (oldest deadline 2019-12-08T17:44:13.438664+0000) 2019-12-08T17:44:16.474 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:44:16.469+0000 1694f700 -1 osd.5 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.603719+0000 front 2019-12-08T17:43:30.918560+0000 (oldest deadline 2019-12-08T17:44:14.356390+0000) 2019-12-08T17:44:16.628 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:44:16.625+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.770704+0000 front 2019-12-08T17:43:30.784192+0000 (oldest deadline 2019-12-08T17:44:16.059187+0000) 2019-12-08T17:44:16.656 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:44:16.649+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.574551+0000 front 2019-12-08T17:43:33.144314+0000 (oldest deadline 2019-12-08T17:44:12.973017+0000) 2019-12-08T17:44:16.929 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:44:16.926+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.949738+0000 front 2019-12-08T17:43:33.055901+0000 (oldest deadline 2019-12-08T17:44:13.438664+0000) 2019-12-08T17:44:17.013 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:44:17.006+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.686117+0000 front 2019-12-08T17:43:31.060173+0000 (oldest deadline 2019-12-08T17:44:16.453238+0000) 2019-12-08T17:44:17.521 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:44:17.516+0000 1694f700 -1 osd.5 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.603719+0000 front 2019-12-08T17:43:30.918560+0000 (oldest deadline 2019-12-08T17:44:14.356390+0000) 2019-12-08T17:44:17.674 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:44:17.672+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.770704+0000 front 2019-12-08T17:43:30.784192+0000 (oldest deadline 2019-12-08T17:44:16.059187+0000) 2019-12-08T17:44:17.697 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:44:17.692+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.574551+0000 front 2019-12-08T17:43:33.144314+0000 (oldest deadline 2019-12-08T17:44:12.973017+0000) 2019-12-08T17:44:17.950 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:44:17.946+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.949738+0000 front 2019-12-08T17:43:33.055901+0000 (oldest deadline 2019-12-08T17:44:13.438664+0000) 2019-12-08T17:44:18.035 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:44:18.030+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.686117+0000 front 2019-12-08T17:43:31.060173+0000 (oldest deadline 2019-12-08T17:44:16.453238+0000) 2019-12-08T17:44:18.510 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:44:18.505+0000 1694f700 -1 osd.5 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.603719+0000 front 2019-12-08T17:43:30.918560+0000 (oldest deadline 2019-12-08T17:44:14.356390+0000) 2019-12-08T17:44:18.666 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:44:18.660+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.574551+0000 front 2019-12-08T17:43:33.144314+0000 (oldest deadline 2019-12-08T17:44:12.973017+0000) 2019-12-08T17:44:18.669 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:44:18.667+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.770704+0000 front 2019-12-08T17:43:30.784192+0000 (oldest deadline 2019-12-08T17:44:16.059187+0000) 2019-12-08T17:44:18.700 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:44:18.693+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:31.985612+0000 front 2019-12-08T17:43:31.882546+0000 (oldest deadline 2019-12-08T17:44:17.758755+0000) 2019-12-08T17:44:18.950 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:44:18.947+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.949738+0000 front 2019-12-08T17:43:33.055901+0000 (oldest deadline 2019-12-08T17:44:13.438664+0000) 2019-12-08T17:44:19.040 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:44:19.035+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.686117+0000 front 2019-12-08T17:43:31.060173+0000 (oldest deadline 2019-12-08T17:44:16.453238+0000) 2019-12-08T17:44:19.492 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:44:19.487+0000 1694f700 -1 osd.5 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.603719+0000 front 2019-12-08T17:43:30.918560+0000 (oldest deadline 2019-12-08T17:44:14.356390+0000) 2019-12-08T17:44:19.554 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:44:19.552+0000 1694f700 -1 osd.2 240 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e238) 2019-12-08T17:44:19.669 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:44:19.664+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.574551+0000 front 2019-12-08T17:43:33.144314+0000 (oldest deadline 2019-12-08T17:44:12.973017+0000) 2019-12-08T17:44:19.690 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:44:19.687+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.770704+0000 front 2019-12-08T17:43:30.784192+0000 (oldest deadline 2019-12-08T17:44:16.059187+0000) 2019-12-08T17:44:19.700 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:44:19.695+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:31.985612+0000 front 2019-12-08T17:43:31.882546+0000 (oldest deadline 2019-12-08T17:44:17.758755+0000) 2019-12-08T17:44:19.972 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:44:19.970+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.949738+0000 front 2019-12-08T17:43:33.055901+0000 (oldest deadline 2019-12-08T17:44:13.438664+0000) 2019-12-08T17:44:20.005 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:44:19.999+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.686117+0000 front 2019-12-08T17:43:31.060173+0000 (oldest deadline 2019-12-08T17:44:16.453238+0000) 2019-12-08T17:44:20.471 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:44:20.466+0000 1694f700 -1 osd.5 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.603719+0000 front 2019-12-08T17:43:30.918560+0000 (oldest deadline 2019-12-08T17:44:14.356390+0000) 2019-12-08T17:44:20.535 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:44:20.533+0000 1694f700 -1 osd.2 240 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e238) 2019-12-08T17:44:20.628 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:44:20.623+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.574551+0000 front 2019-12-08T17:43:33.144314+0000 (oldest deadline 2019-12-08T17:44:12.973017+0000) 2019-12-08T17:44:20.676 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:44:20.671+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:31.985612+0000 front 2019-12-08T17:43:31.882546+0000 (oldest deadline 2019-12-08T17:44:17.758755+0000) 2019-12-08T17:44:20.684 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:44:20.683+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.770704+0000 front 2019-12-08T17:43:30.784192+0000 (oldest deadline 2019-12-08T17:44:16.059187+0000) 2019-12-08T17:44:20.955 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:44:20.954+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.949738+0000 front 2019-12-08T17:43:33.055901+0000 (oldest deadline 2019-12-08T17:44:13.438664+0000) 2019-12-08T17:44:20.977 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:44:20.973+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.686117+0000 front 2019-12-08T17:43:31.060173+0000 (oldest deadline 2019-12-08T17:44:16.453238+0000) 2019-12-08T17:44:21.435 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:44:21.431+0000 1694f700 -1 osd.5 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.603719+0000 front 2019-12-08T17:43:30.918560+0000 (oldest deadline 2019-12-08T17:44:14.356390+0000) 2019-12-08T17:44:21.553 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:44:21.550+0000 1694f700 -1 osd.2 240 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e238) 2019-12-08T17:44:21.604 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:44:21.599+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.574551+0000 front 2019-12-08T17:43:33.144314+0000 (oldest deadline 2019-12-08T17:44:12.973017+0000) 2019-12-08T17:44:21.653 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:44:21.646+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:31.985612+0000 front 2019-12-08T17:43:31.882546+0000 (oldest deadline 2019-12-08T17:44:17.758755+0000) 2019-12-08T17:44:21.715 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:44:21.713+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.770704+0000 front 2019-12-08T17:43:30.784192+0000 (oldest deadline 2019-12-08T17:44:16.059187+0000) 2019-12-08T17:44:21.928 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:44:21.927+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.949738+0000 front 2019-12-08T17:43:33.055901+0000 (oldest deadline 2019-12-08T17:44:13.438664+0000) 2019-12-08T17:44:22.003 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:44:21.996+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.686117+0000 front 2019-12-08T17:43:31.060173+0000 (oldest deadline 2019-12-08T17:44:16.453238+0000) 2019-12-08T17:44:22.439 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:44:22.435+0000 1694f700 -1 osd.5 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.603719+0000 front 2019-12-08T17:43:30.918560+0000 (oldest deadline 2019-12-08T17:44:14.356390+0000) 2019-12-08T17:44:22.576 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:44:22.571+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.574551+0000 front 2019-12-08T17:43:33.144314+0000 (oldest deadline 2019-12-08T17:44:12.973017+0000) 2019-12-08T17:44:22.601 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:44:22.600+0000 1694f700 -1 osd.2 240 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e238) 2019-12-08T17:44:22.617 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:44:22.612+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:31.985612+0000 front 2019-12-08T17:43:31.882546+0000 (oldest deadline 2019-12-08T17:44:17.758755+0000) 2019-12-08T17:44:22.767 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:44:22.766+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.770704+0000 front 2019-12-08T17:43:30.784192+0000 (oldest deadline 2019-12-08T17:44:16.059187+0000) 2019-12-08T17:44:22.909 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:44:22.908+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.949738+0000 front 2019-12-08T17:43:33.055901+0000 (oldest deadline 2019-12-08T17:44:13.438664+0000) 2019-12-08T17:44:22.957 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:44:22.952+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.686117+0000 front 2019-12-08T17:43:31.060173+0000 (oldest deadline 2019-12-08T17:44:16.453238+0000) 2019-12-08T17:44:23.477 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:44:23.472+0000 1694f700 -1 osd.5 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.603719+0000 front 2019-12-08T17:43:30.918560+0000 (oldest deadline 2019-12-08T17:44:14.356390+0000) 2019-12-08T17:44:23.590 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:44:23.585+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:31.985612+0000 front 2019-12-08T17:43:31.882546+0000 (oldest deadline 2019-12-08T17:44:17.758755+0000) 2019-12-08T17:44:23.595 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:44:23.595+0000 1694f700 -1 osd.2 240 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e238) 2019-12-08T17:44:23.631 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:44:23.625+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.574551+0000 front 2019-12-08T17:43:33.144314+0000 (oldest deadline 2019-12-08T17:44:12.973017+0000) 2019-12-08T17:44:23.805 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:44:23.804+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.770704+0000 front 2019-12-08T17:43:30.784192+0000 (oldest deadline 2019-12-08T17:44:16.059187+0000) 2019-12-08T17:44:23.957 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:44:23.956+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.949738+0000 front 2019-12-08T17:43:33.055901+0000 (oldest deadline 2019-12-08T17:44:13.438664+0000) 2019-12-08T17:44:23.963 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:44:23.958+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.686117+0000 front 2019-12-08T17:43:31.060173+0000 (oldest deadline 2019-12-08T17:44:16.453238+0000) 2019-12-08T17:44:24.439 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:44:24.434+0000 1694f700 -1 osd.5 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.603719+0000 front 2019-12-08T17:43:30.918560+0000 (oldest deadline 2019-12-08T17:44:14.356390+0000) 2019-12-08T17:44:24.592 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:44:24.587+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.574551+0000 front 2019-12-08T17:43:33.144314+0000 (oldest deadline 2019-12-08T17:44:12.973017+0000) 2019-12-08T17:44:24.605 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:44:24.600+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:31.985612+0000 front 2019-12-08T17:43:31.882546+0000 (oldest deadline 2019-12-08T17:44:17.758755+0000) 2019-12-08T17:44:24.637 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:44:24.636+0000 1694f700 -1 osd.2 240 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e238) 2019-12-08T17:44:24.806 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:44:24.804+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.770704+0000 front 2019-12-08T17:43:30.784192+0000 (oldest deadline 2019-12-08T17:44:16.059187+0000) 2019-12-08T17:44:24.998 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:44:24.996+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.949738+0000 front 2019-12-08T17:43:33.055901+0000 (oldest deadline 2019-12-08T17:44:13.438664+0000) 2019-12-08T17:44:25.005 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:44:24.999+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.686117+0000 front 2019-12-08T17:43:31.060173+0000 (oldest deadline 2019-12-08T17:44:16.453238+0000) 2019-12-08T17:44:25.421 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:44:25.416+0000 1694f700 -1 osd.5 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.603719+0000 front 2019-12-08T17:43:30.918560+0000 (oldest deadline 2019-12-08T17:44:14.356390+0000) 2019-12-08T17:44:25.581 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:44:25.576+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:31.985612+0000 front 2019-12-08T17:43:31.882546+0000 (oldest deadline 2019-12-08T17:44:17.758755+0000) 2019-12-08T17:44:25.644 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:44:25.639+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.574551+0000 front 2019-12-08T17:43:33.144314+0000 (oldest deadline 2019-12-08T17:44:12.973017+0000) 2019-12-08T17:44:25.671 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:44:25.670+0000 1694f700 -1 osd.2 240 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e238) 2019-12-08T17:44:25.823 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:44:25.821+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.770704+0000 front 2019-12-08T17:43:30.784192+0000 (oldest deadline 2019-12-08T17:44:16.059187+0000) 2019-12-08T17:44:26.035 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:44:26.029+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.686117+0000 front 2019-12-08T17:43:31.060173+0000 (oldest deadline 2019-12-08T17:44:16.453238+0000) 2019-12-08T17:44:26.045 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:44:26.044+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.949738+0000 front 2019-12-08T17:43:33.055901+0000 (oldest deadline 2019-12-08T17:44:13.438664+0000) 2019-12-08T17:44:26.440 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:44:26.436+0000 1694f700 -1 osd.5 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.603719+0000 front 2019-12-08T17:43:30.918560+0000 (oldest deadline 2019-12-08T17:44:14.356390+0000) 2019-12-08T17:44:26.590 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:44:26.585+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:31.985612+0000 front 2019-12-08T17:43:31.882546+0000 (oldest deadline 2019-12-08T17:44:17.758755+0000) 2019-12-08T17:44:26.647 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:44:26.642+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.574551+0000 front 2019-12-08T17:43:33.144314+0000 (oldest deadline 2019-12-08T17:44:12.973017+0000) 2019-12-08T17:44:26.655 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:44:26.652+0000 1694f700 -1 osd.2 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:43:45.792405+0000 (oldest deadline 2019-12-08T17:44:25.792405+0000) 2019-12-08T17:44:26.657 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:44:26.655+0000 1694f700 -1 osd.2 240 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e238) 2019-12-08T17:44:26.799 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:44:26.797+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.770704+0000 front 2019-12-08T17:43:30.784192+0000 (oldest deadline 2019-12-08T17:44:16.059187+0000) 2019-12-08T17:44:27.019 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:44:27.013+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.686117+0000 front 2019-12-08T17:43:31.060173+0000 (oldest deadline 2019-12-08T17:44:16.453238+0000) 2019-12-08T17:44:27.046 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:44:27.043+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.949738+0000 front 2019-12-08T17:43:33.055901+0000 (oldest deadline 2019-12-08T17:44:13.438664+0000) 2019-12-08T17:44:27.458 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:44:27.453+0000 1694f700 -1 osd.5 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.603719+0000 front 2019-12-08T17:43:30.918560+0000 (oldest deadline 2019-12-08T17:44:14.356390+0000) 2019-12-08T17:44:27.621 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:44:27.620+0000 1694f700 -1 osd.2 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:43:45.792405+0000 (oldest deadline 2019-12-08T17:44:25.792405+0000) 2019-12-08T17:44:27.622 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:44:27.622+0000 1694f700 -1 osd.2 240 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e238) 2019-12-08T17:44:27.645 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:44:27.640+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:31.985612+0000 front 2019-12-08T17:43:31.882546+0000 (oldest deadline 2019-12-08T17:44:17.758755+0000) 2019-12-08T17:44:27.647 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:44:27.643+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.574551+0000 front 2019-12-08T17:43:33.144314+0000 (oldest deadline 2019-12-08T17:44:12.973017+0000) 2019-12-08T17:44:27.756 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:44:27.755+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.770704+0000 front 2019-12-08T17:43:30.784192+0000 (oldest deadline 2019-12-08T17:44:16.059187+0000) 2019-12-08T17:44:28.006 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:44:28.004+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.949738+0000 front 2019-12-08T17:43:33.055901+0000 (oldest deadline 2019-12-08T17:44:13.438664+0000) 2019-12-08T17:44:28.055 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:44:28.051+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.686117+0000 front 2019-12-08T17:43:31.060173+0000 (oldest deadline 2019-12-08T17:44:16.453238+0000) 2019-12-08T17:44:28.464 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:44:28.459+0000 1694f700 -1 osd.5 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.603719+0000 front 2019-12-08T17:43:30.918560+0000 (oldest deadline 2019-12-08T17:44:14.356390+0000) 2019-12-08T17:44:28.609 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:44:28.603+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:31.985612+0000 front 2019-12-08T17:43:31.882546+0000 (oldest deadline 2019-12-08T17:44:17.758755+0000) 2019-12-08T17:44:28.630 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:44:28.624+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.574551+0000 front 2019-12-08T17:43:33.144314+0000 (oldest deadline 2019-12-08T17:44:12.973017+0000) 2019-12-08T17:44:28.640 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:44:28.637+0000 1694f700 -1 osd.2 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:43:45.792405+0000 (oldest deadline 2019-12-08T17:44:25.792405+0000) 2019-12-08T17:44:28.641 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:44:28.640+0000 1694f700 -1 osd.2 240 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e238) 2019-12-08T17:44:28.718 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:44:28.717+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.770704+0000 front 2019-12-08T17:43:30.784192+0000 (oldest deadline 2019-12-08T17:44:16.059187+0000) 2019-12-08T17:44:29.030 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:44:29.028+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.949738+0000 front 2019-12-08T17:43:33.055901+0000 (oldest deadline 2019-12-08T17:44:13.438664+0000) 2019-12-08T17:44:29.088 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:44:29.083+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.686117+0000 front 2019-12-08T17:43:31.060173+0000 (oldest deadline 2019-12-08T17:44:16.453238+0000) 2019-12-08T17:44:29.448 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:44:29.443+0000 1694f700 -1 osd.5 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.603719+0000 front 2019-12-08T17:43:30.918560+0000 (oldest deadline 2019-12-08T17:44:14.356390+0000) 2019-12-08T17:44:29.574 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:44:29.569+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:31.985612+0000 front 2019-12-08T17:43:31.882546+0000 (oldest deadline 2019-12-08T17:44:17.758755+0000) 2019-12-08T17:44:29.616 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:44:29.610+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.574551+0000 front 2019-12-08T17:43:33.144314+0000 (oldest deadline 2019-12-08T17:44:12.973017+0000) 2019-12-08T17:44:29.632 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:44:29.631+0000 1694f700 -1 osd.2 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:43:45.792405+0000 (oldest deadline 2019-12-08T17:44:25.792405+0000) 2019-12-08T17:44:29.634 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:44:29.634+0000 1694f700 -1 osd.2 240 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e238) 2019-12-08T17:44:29.765 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:44:29.763+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.770704+0000 front 2019-12-08T17:43:30.784192+0000 (oldest deadline 2019-12-08T17:44:16.059187+0000) 2019-12-08T17:44:30.068 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:44:30.065+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.949738+0000 front 2019-12-08T17:43:33.055901+0000 (oldest deadline 2019-12-08T17:44:13.438664+0000) 2019-12-08T17:44:30.137 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:44:30.131+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.686117+0000 front 2019-12-08T17:43:31.060173+0000 (oldest deadline 2019-12-08T17:44:16.453238+0000) 2019-12-08T17:44:30.416 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:44:30.411+0000 1694f700 -1 osd.5 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.603719+0000 front 2019-12-08T17:43:30.918560+0000 (oldest deadline 2019-12-08T17:44:14.356390+0000) 2019-12-08T17:44:30.534 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:44:30.529+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:31.985612+0000 front 2019-12-08T17:43:31.882546+0000 (oldest deadline 2019-12-08T17:44:17.758755+0000) 2019-12-08T17:44:30.621 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:44:30.615+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.574551+0000 front 2019-12-08T17:43:33.144314+0000 (oldest deadline 2019-12-08T17:44:12.973017+0000) 2019-12-08T17:44:30.643 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:44:30.642+0000 1694f700 -1 osd.2 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:43:45.792405+0000 (oldest deadline 2019-12-08T17:44:25.792405+0000) 2019-12-08T17:44:30.646 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:44:30.646+0000 1694f700 -1 osd.2 240 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e238) 2019-12-08T17:44:30.810 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:44:30.809+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.770704+0000 front 2019-12-08T17:43:30.784192+0000 (oldest deadline 2019-12-08T17:44:16.059187+0000) 2019-12-08T17:44:31.080 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:44:31.079+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.949738+0000 front 2019-12-08T17:43:33.055901+0000 (oldest deadline 2019-12-08T17:44:13.438664+0000) 2019-12-08T17:44:31.174 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:44:31.169+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.686117+0000 front 2019-12-08T17:43:31.060173+0000 (oldest deadline 2019-12-08T17:44:16.453238+0000) 2019-12-08T17:44:31.404 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:44:31.399+0000 1694f700 -1 osd.5 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.603719+0000 front 2019-12-08T17:43:30.918560+0000 (oldest deadline 2019-12-08T17:44:14.356390+0000) 2019-12-08T17:44:31.543 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:44:31.538+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:31.985612+0000 front 2019-12-08T17:43:31.882546+0000 (oldest deadline 2019-12-08T17:44:17.758755+0000) 2019-12-08T17:44:31.643 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:44:31.637+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.574551+0000 front 2019-12-08T17:43:33.144314+0000 (oldest deadline 2019-12-08T17:44:12.973017+0000) 2019-12-08T17:44:31.697 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:44:31.694+0000 1694f700 -1 osd.2 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:43:45.792405+0000 (oldest deadline 2019-12-08T17:44:25.792405+0000) 2019-12-08T17:44:31.699 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:44:31.697+0000 1694f700 -1 osd.2 240 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e238) 2019-12-08T17:44:31.785 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:44:31.783+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.770704+0000 front 2019-12-08T17:43:30.784192+0000 (oldest deadline 2019-12-08T17:44:16.059187+0000) 2019-12-08T17:44:32.104 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:44:32.103+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.949738+0000 front 2019-12-08T17:43:33.055901+0000 (oldest deadline 2019-12-08T17:44:13.438664+0000) 2019-12-08T17:44:32.187 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:44:32.181+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.686117+0000 front 2019-12-08T17:43:31.060173+0000 (oldest deadline 2019-12-08T17:44:16.453238+0000) 2019-12-08T17:44:32.372 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:44:32.366+0000 1694f700 -1 osd.5 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.603719+0000 front 2019-12-08T17:43:30.918560+0000 (oldest deadline 2019-12-08T17:44:14.356390+0000) 2019-12-08T17:44:32.585 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:44:32.580+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:31.985612+0000 front 2019-12-08T17:43:31.882546+0000 (oldest deadline 2019-12-08T17:44:17.758755+0000) 2019-12-08T17:44:32.694 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:44:32.689+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.574551+0000 front 2019-12-08T17:43:33.144314+0000 (oldest deadline 2019-12-08T17:44:12.973017+0000) 2019-12-08T17:44:32.741 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:44:32.733+0000 1694f700 -1 osd.2 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:43:45.792405+0000 (oldest deadline 2019-12-08T17:44:25.792405+0000) 2019-12-08T17:44:32.743 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:44:32.741+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.770704+0000 front 2019-12-08T17:43:30.784192+0000 (oldest deadline 2019-12-08T17:44:16.059187+0000) 2019-12-08T17:44:32.744 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:44:32.741+0000 1694f700 -1 osd.2 240 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e238) 2019-12-08T17:44:33.153 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:44:33.151+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.949738+0000 front 2019-12-08T17:43:33.055901+0000 (oldest deadline 2019-12-08T17:44:13.438664+0000) 2019-12-08T17:44:33.188 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:44:33.183+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.686117+0000 front 2019-12-08T17:43:31.060173+0000 (oldest deadline 2019-12-08T17:44:16.453238+0000) 2019-12-08T17:44:33.396 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:44:33.391+0000 1694f700 -1 osd.5 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.603719+0000 front 2019-12-08T17:43:30.918560+0000 (oldest deadline 2019-12-08T17:44:14.356390+0000) 2019-12-08T17:44:33.585 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:44:33.580+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:31.985612+0000 front 2019-12-08T17:43:31.882546+0000 (oldest deadline 2019-12-08T17:44:17.758755+0000) 2019-12-08T17:44:33.686 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:44:33.680+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.574551+0000 front 2019-12-08T17:43:33.144314+0000 (oldest deadline 2019-12-08T17:44:12.973017+0000) 2019-12-08T17:44:33.773 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:44:33.772+0000 1694f700 -1 osd.2 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:43:45.792405+0000 (oldest deadline 2019-12-08T17:44:25.792405+0000) 2019-12-08T17:44:33.777 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:44:33.777+0000 1694f700 -1 osd.2 240 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e238) 2019-12-08T17:44:33.789 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:44:33.787+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.770704+0000 front 2019-12-08T17:43:30.784192+0000 (oldest deadline 2019-12-08T17:44:16.059187+0000) 2019-12-08T17:44:34.151 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:44:34.146+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.686117+0000 front 2019-12-08T17:43:31.060173+0000 (oldest deadline 2019-12-08T17:44:16.453238+0000) 2019-12-08T17:44:34.190 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:44:34.187+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.949738+0000 front 2019-12-08T17:43:33.055901+0000 (oldest deadline 2019-12-08T17:44:13.438664+0000) 2019-12-08T17:44:34.429 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:44:34.425+0000 1694f700 -1 osd.5 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.603719+0000 front 2019-12-08T17:43:30.918560+0000 (oldest deadline 2019-12-08T17:44:14.356390+0000) 2019-12-08T17:44:34.641 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:44:34.636+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:31.985612+0000 front 2019-12-08T17:43:31.882546+0000 (oldest deadline 2019-12-08T17:44:17.758755+0000) 2019-12-08T17:44:34.688 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:44:34.683+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.574551+0000 front 2019-12-08T17:43:33.144314+0000 (oldest deadline 2019-12-08T17:44:12.973017+0000) 2019-12-08T17:44:34.760 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:44:34.756+0000 1694f700 -1 osd.2 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:43:45.792405+0000 (oldest deadline 2019-12-08T17:44:25.792405+0000) 2019-12-08T17:44:34.761 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:44:34.760+0000 1694f700 -1 osd.2 240 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e238) 2019-12-08T17:44:34.822 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:44:34.820+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.770704+0000 front 2019-12-08T17:43:30.784192+0000 (oldest deadline 2019-12-08T17:44:16.059187+0000) 2019-12-08T17:44:35.117 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:44:35.112+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.686117+0000 front 2019-12-08T17:43:31.060173+0000 (oldest deadline 2019-12-08T17:44:16.453238+0000) 2019-12-08T17:44:35.192 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:44:35.189+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.949738+0000 front 2019-12-08T17:43:33.055901+0000 (oldest deadline 2019-12-08T17:44:13.438664+0000) 2019-12-08T17:44:35.423 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:44:35.418+0000 1694f700 -1 osd.5 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.603719+0000 front 2019-12-08T17:43:30.918560+0000 (oldest deadline 2019-12-08T17:44:14.356390+0000) 2019-12-08T17:44:35.663 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:44:35.657+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:31.985612+0000 front 2019-12-08T17:43:31.882546+0000 (oldest deadline 2019-12-08T17:44:17.758755+0000) 2019-12-08T17:44:35.720 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:44:35.716+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.574551+0000 front 2019-12-08T17:43:33.144314+0000 (oldest deadline 2019-12-08T17:44:12.973017+0000) 2019-12-08T17:44:35.721 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:44:35.720+0000 1694f700 -1 osd.2 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:43:45.792405+0000 (oldest deadline 2019-12-08T17:44:25.792405+0000) 2019-12-08T17:44:35.726 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:44:35.725+0000 1694f700 -1 osd.2 240 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e238) 2019-12-08T17:44:35.782 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:44:35.781+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.770704+0000 front 2019-12-08T17:43:30.784192+0000 (oldest deadline 2019-12-08T17:44:16.059187+0000) 2019-12-08T17:44:36.130 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:44:36.124+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.686117+0000 front 2019-12-08T17:43:31.060173+0000 (oldest deadline 2019-12-08T17:44:16.453238+0000) 2019-12-08T17:44:36.192 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:44:36.191+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.949738+0000 front 2019-12-08T17:43:33.055901+0000 (oldest deadline 2019-12-08T17:44:13.438664+0000) 2019-12-08T17:44:36.429 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:44:36.424+0000 1694f700 -1 osd.5 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.603719+0000 front 2019-12-08T17:43:30.918560+0000 (oldest deadline 2019-12-08T17:44:14.356390+0000) 2019-12-08T17:44:36.690 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:44:36.684+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.574551+0000 front 2019-12-08T17:43:33.144314+0000 (oldest deadline 2019-12-08T17:44:12.973017+0000) 2019-12-08T17:44:36.716 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:44:36.710+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:31.985612+0000 front 2019-12-08T17:43:31.882546+0000 (oldest deadline 2019-12-08T17:44:17.758755+0000) 2019-12-08T17:44:36.784 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:44:36.733+0000 1694f700 -1 osd.2 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:43:45.792405+0000 (oldest deadline 2019-12-08T17:44:25.792405+0000) 2019-12-08T17:44:36.784 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:44:36.736+0000 1694f700 -1 osd.2 240 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e238) 2019-12-08T17:44:36.784 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:44:36.753+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.770704+0000 front 2019-12-08T17:43:30.784192+0000 (oldest deadline 2019-12-08T17:44:16.059187+0000) 2019-12-08T17:44:37.121 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:44:37.115+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.686117+0000 front 2019-12-08T17:43:31.060173+0000 (oldest deadline 2019-12-08T17:44:16.453238+0000) 2019-12-08T17:44:37.165 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:44:37.163+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.949738+0000 front 2019-12-08T17:43:33.055901+0000 (oldest deadline 2019-12-08T17:44:13.438664+0000) 2019-12-08T17:44:37.411 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:44:37.405+0000 1694f700 -1 osd.5 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.603719+0000 front 2019-12-08T17:43:30.918560+0000 (oldest deadline 2019-12-08T17:44:14.356390+0000) 2019-12-08T17:44:37.717 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:44:37.712+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.574551+0000 front 2019-12-08T17:43:33.144314+0000 (oldest deadline 2019-12-08T17:44:12.973017+0000) 2019-12-08T17:44:37.756 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:44:37.754+0000 1694f700 -1 osd.2 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:43:45.792405+0000 (oldest deadline 2019-12-08T17:44:25.792405+0000) 2019-12-08T17:44:37.757 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:44:37.756+0000 1694f700 -1 osd.2 240 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e238) 2019-12-08T17:44:37.774 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:44:37.774+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.770704+0000 front 2019-12-08T17:43:30.784192+0000 (oldest deadline 2019-12-08T17:44:16.059187+0000) 2019-12-08T17:44:37.775 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:44:37.766+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:31.985612+0000 front 2019-12-08T17:43:31.882546+0000 (oldest deadline 2019-12-08T17:44:17.758755+0000) 2019-12-08T17:44:38.084 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:44:38.078+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.686117+0000 front 2019-12-08T17:43:31.060173+0000 (oldest deadline 2019-12-08T17:44:16.453238+0000) 2019-12-08T17:44:38.201 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:44:38.200+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.949738+0000 front 2019-12-08T17:43:33.055901+0000 (oldest deadline 2019-12-08T17:44:13.438664+0000) 2019-12-08T17:44:38.398 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:44:38.393+0000 1694f700 -1 osd.5 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.603719+0000 front 2019-12-08T17:43:30.918560+0000 (oldest deadline 2019-12-08T17:44:14.356390+0000) 2019-12-08T17:44:38.735 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:44:38.728+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:31.985612+0000 front 2019-12-08T17:43:31.882546+0000 (oldest deadline 2019-12-08T17:44:17.758755+0000) 2019-12-08T17:44:38.739 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:44:38.733+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.574551+0000 front 2019-12-08T17:43:33.144314+0000 (oldest deadline 2019-12-08T17:44:12.973017+0000) 2019-12-08T17:44:38.807 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:44:38.805+0000 1694f700 -1 osd.2 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:43:45.792405+0000 (oldest deadline 2019-12-08T17:44:25.792405+0000) 2019-12-08T17:44:38.809 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:44:38.807+0000 1694f700 -1 osd.2 240 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e238) 2019-12-08T17:44:38.813 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:44:38.811+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.770704+0000 front 2019-12-08T17:43:30.784192+0000 (oldest deadline 2019-12-08T17:44:16.059187+0000) 2019-12-08T17:44:39.126 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:44:39.119+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.686117+0000 front 2019-12-08T17:43:31.060173+0000 (oldest deadline 2019-12-08T17:44:16.453238+0000) 2019-12-08T17:44:39.226 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:44:39.225+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.949738+0000 front 2019-12-08T17:43:33.055901+0000 (oldest deadline 2019-12-08T17:44:13.438664+0000) 2019-12-08T17:44:39.424 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:44:39.418+0000 1694f700 -1 osd.5 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.603719+0000 front 2019-12-08T17:43:30.918560+0000 (oldest deadline 2019-12-08T17:44:14.356390+0000) 2019-12-08T17:44:39.704 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:44:39.697+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:31.985612+0000 front 2019-12-08T17:43:31.882546+0000 (oldest deadline 2019-12-08T17:44:17.758755+0000) 2019-12-08T17:44:39.864 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:44:39.769+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.770704+0000 front 2019-12-08T17:43:30.784192+0000 (oldest deadline 2019-12-08T17:44:16.059187+0000) 2019-12-08T17:44:39.865 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:44:39.796+0000 1694f700 -1 osd.2 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:43:45.792405+0000 (oldest deadline 2019-12-08T17:44:25.792405+0000) 2019-12-08T17:44:39.865 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:44:39.799+0000 1694f700 -1 osd.2 240 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e238) 2019-12-08T17:44:39.865 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:44:39.735+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.574551+0000 front 2019-12-08T17:43:33.144314+0000 (oldest deadline 2019-12-08T17:44:12.973017+0000) 2019-12-08T17:44:40.126 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:44:40.119+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.686117+0000 front 2019-12-08T17:43:31.060173+0000 (oldest deadline 2019-12-08T17:44:16.453238+0000) 2019-12-08T17:44:40.231 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:44:40.229+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.949738+0000 front 2019-12-08T17:43:33.055901+0000 (oldest deadline 2019-12-08T17:44:13.438664+0000) 2019-12-08T17:44:40.426 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:44:40.419+0000 1694f700 -1 osd.5 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.603719+0000 front 2019-12-08T17:43:30.918560+0000 (oldest deadline 2019-12-08T17:44:14.356390+0000) 2019-12-08T17:44:40.726 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:44:40.720+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.574551+0000 front 2019-12-08T17:43:33.144314+0000 (oldest deadline 2019-12-08T17:44:12.973017+0000) 2019-12-08T17:44:40.734 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:44:40.727+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:31.985612+0000 front 2019-12-08T17:43:31.882546+0000 (oldest deadline 2019-12-08T17:44:17.758755+0000) 2019-12-08T17:44:40.788 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:44:40.786+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.770704+0000 front 2019-12-08T17:43:30.784192+0000 (oldest deadline 2019-12-08T17:44:16.059187+0000) 2019-12-08T17:44:40.812 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:44:40.810+0000 1694f700 -1 osd.2 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:43:45.792405+0000 (oldest deadline 2019-12-08T17:44:25.792405+0000) 2019-12-08T17:44:40.814 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:44:40.814+0000 1694f700 -1 osd.2 240 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e238) 2019-12-08T17:44:41.091 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:44:41.084+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.686117+0000 front 2019-12-08T17:43:31.060173+0000 (oldest deadline 2019-12-08T17:44:16.453238+0000) 2019-12-08T17:44:41.262 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:44:41.260+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.949738+0000 front 2019-12-08T17:43:33.055901+0000 (oldest deadline 2019-12-08T17:44:13.438664+0000) 2019-12-08T17:44:41.474 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:44:41.468+0000 1694f700 -1 osd.5 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.603719+0000 front 2019-12-08T17:43:30.918560+0000 (oldest deadline 2019-12-08T17:44:14.356390+0000) 2019-12-08T17:44:41.747 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:44:41.741+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.574551+0000 front 2019-12-08T17:43:33.144314+0000 (oldest deadline 2019-12-08T17:44:12.973017+0000) 2019-12-08T17:44:41.768 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:44:41.762+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:31.985612+0000 front 2019-12-08T17:43:31.882546+0000 (oldest deadline 2019-12-08T17:44:17.758755+0000) 2019-12-08T17:44:41.786 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:44:41.783+0000 1694f700 -1 osd.2 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:43:45.792405+0000 (oldest deadline 2019-12-08T17:44:25.792405+0000) 2019-12-08T17:44:41.787 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:44:41.786+0000 1694f700 -1 osd.2 240 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e238) 2019-12-08T17:44:41.792 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:44:41.790+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.770704+0000 front 2019-12-08T17:43:30.784192+0000 (oldest deadline 2019-12-08T17:44:16.059187+0000) 2019-12-08T17:44:42.116 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:44:42.109+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.686117+0000 front 2019-12-08T17:43:31.060173+0000 (oldest deadline 2019-12-08T17:44:16.453238+0000) 2019-12-08T17:44:42.307 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:44:42.302+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.949738+0000 front 2019-12-08T17:43:33.055901+0000 (oldest deadline 2019-12-08T17:44:13.438664+0000) 2019-12-08T17:44:42.510 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:44:42.504+0000 1694f700 -1 osd.5 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.603719+0000 front 2019-12-08T17:43:30.918560+0000 (oldest deadline 2019-12-08T17:44:14.356390+0000) 2019-12-08T17:44:42.762 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:44:42.762+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.770704+0000 front 2019-12-08T17:43:30.784192+0000 (oldest deadline 2019-12-08T17:44:16.059187+0000) 2019-12-08T17:44:42.768 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:44:42.762+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.574551+0000 front 2019-12-08T17:43:33.144314+0000 (oldest deadline 2019-12-08T17:44:12.973017+0000) 2019-12-08T17:44:42.798 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:44:42.795+0000 1694f700 -1 osd.2 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:43:45.792405+0000 (oldest deadline 2019-12-08T17:44:25.792405+0000) 2019-12-08T17:44:42.801 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:44:42.800+0000 1694f700 -1 osd.2 240 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e238) 2019-12-08T17:44:42.806 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:44:42.799+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:31.985612+0000 front 2019-12-08T17:43:31.882546+0000 (oldest deadline 2019-12-08T17:44:17.758755+0000) 2019-12-08T17:44:43.113 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:44:43.106+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.686117+0000 front 2019-12-08T17:43:31.060173+0000 (oldest deadline 2019-12-08T17:44:16.453238+0000) 2019-12-08T17:44:43.280 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:44:43.279+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.949738+0000 front 2019-12-08T17:43:33.055901+0000 (oldest deadline 2019-12-08T17:44:13.438664+0000) 2019-12-08T17:44:43.539 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:44:43.534+0000 1694f700 -1 osd.5 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.603719+0000 front 2019-12-08T17:43:30.918560+0000 (oldest deadline 2019-12-08T17:44:14.356390+0000) 2019-12-08T17:44:43.731 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:44:43.728+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.770704+0000 front 2019-12-08T17:43:30.784192+0000 (oldest deadline 2019-12-08T17:44:16.059187+0000) 2019-12-08T17:44:43.779 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:44:43.772+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.574551+0000 front 2019-12-08T17:43:33.144314+0000 (oldest deadline 2019-12-08T17:44:12.973017+0000) 2019-12-08T17:44:43.782 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:44:43.779+0000 1694f700 -1 osd.2 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:43:45.792405+0000 (oldest deadline 2019-12-08T17:44:25.792405+0000) 2019-12-08T17:44:43.784 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:44:43.782+0000 1694f700 -1 osd.2 240 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e238) 2019-12-08T17:44:43.821 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:44:43.815+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:31.985612+0000 front 2019-12-08T17:43:31.882546+0000 (oldest deadline 2019-12-08T17:44:17.758755+0000) 2019-12-08T17:44:44.142 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:44:44.136+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.686117+0000 front 2019-12-08T17:43:31.060173+0000 (oldest deadline 2019-12-08T17:44:16.453238+0000) 2019-12-08T17:44:44.280 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:44:44.277+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.949738+0000 front 2019-12-08T17:43:33.055901+0000 (oldest deadline 2019-12-08T17:44:13.438664+0000) 2019-12-08T17:44:44.595 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:44:44.589+0000 1694f700 -1 osd.5 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.603719+0000 front 2019-12-08T17:43:30.918560+0000 (oldest deadline 2019-12-08T17:44:14.356390+0000) 2019-12-08T17:44:44.695 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:44:44.693+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.770704+0000 front 2019-12-08T17:43:30.784192+0000 (oldest deadline 2019-12-08T17:44:16.059187+0000) 2019-12-08T17:44:44.737 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:44:44.735+0000 1694f700 -1 osd.2 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:43:45.792405+0000 (oldest deadline 2019-12-08T17:44:25.792405+0000) 2019-12-08T17:44:44.739 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:44:44.738+0000 1694f700 -1 osd.2 240 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e238) 2019-12-08T17:44:44.811 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:44:44.806+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.574551+0000 front 2019-12-08T17:43:33.144314+0000 (oldest deadline 2019-12-08T17:44:12.973017+0000) 2019-12-08T17:44:44.876 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:44:44.868+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:31.985612+0000 front 2019-12-08T17:43:31.882546+0000 (oldest deadline 2019-12-08T17:44:17.758755+0000) 2019-12-08T17:44:45.105 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:44:45.098+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.686117+0000 front 2019-12-08T17:43:31.060173+0000 (oldest deadline 2019-12-08T17:44:16.453238+0000) 2019-12-08T17:44:45.275 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:44:45.274+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.949738+0000 front 2019-12-08T17:43:33.055901+0000 (oldest deadline 2019-12-08T17:44:13.438664+0000) 2019-12-08T17:44:45.615 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:44:45.609+0000 1694f700 -1 osd.5 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.603719+0000 front 2019-12-08T17:43:30.918560+0000 (oldest deadline 2019-12-08T17:44:14.356390+0000) 2019-12-08T17:44:45.697 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:44:45.694+0000 1694f700 -1 osd.2 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:43:45.792405+0000 (oldest deadline 2019-12-08T17:44:25.792405+0000) 2019-12-08T17:44:45.701 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:44:45.699+0000 1694f700 -1 osd.2 240 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e238) 2019-12-08T17:44:45.739 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:44:45.737+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.770704+0000 front 2019-12-08T17:43:30.784192+0000 (oldest deadline 2019-12-08T17:44:16.059187+0000) 2019-12-08T17:44:45.866 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:44:45.860+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.574551+0000 front 2019-12-08T17:43:33.144314+0000 (oldest deadline 2019-12-08T17:44:12.973017+0000) 2019-12-08T17:44:45.914 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:44:45.908+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:31.985612+0000 front 2019-12-08T17:43:31.882546+0000 (oldest deadline 2019-12-08T17:44:17.758755+0000) 2019-12-08T17:44:46.120 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:44:46.113+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.686117+0000 front 2019-12-08T17:43:31.060173+0000 (oldest deadline 2019-12-08T17:44:16.453238+0000) 2019-12-08T17:44:46.239 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:44:46.236+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.949738+0000 front 2019-12-08T17:43:33.055901+0000 (oldest deadline 2019-12-08T17:44:13.438664+0000) 2019-12-08T17:44:46.580 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:44:46.573+0000 1694f700 -1 osd.5 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.603719+0000 front 2019-12-08T17:43:30.918560+0000 (oldest deadline 2019-12-08T17:44:14.356390+0000) 2019-12-08T17:44:46.666 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:44:46.662+0000 1694f700 -1 osd.2 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:43:45.792405+0000 (oldest deadline 2019-12-08T17:44:25.792405+0000) 2019-12-08T17:44:46.667 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:44:46.665+0000 1694f700 -1 osd.2 240 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e238) 2019-12-08T17:44:46.771 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:44:46.769+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.770704+0000 front 2019-12-08T17:43:30.784192+0000 (oldest deadline 2019-12-08T17:44:16.059187+0000) 2019-12-08T17:44:46.883 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:44:46.876+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.574551+0000 front 2019-12-08T17:43:33.144314+0000 (oldest deadline 2019-12-08T17:44:12.973017+0000) 2019-12-08T17:44:46.914 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:44:46.909+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:31.985612+0000 front 2019-12-08T17:43:31.882546+0000 (oldest deadline 2019-12-08T17:44:17.758755+0000) 2019-12-08T17:44:47.161 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:44:47.155+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.686117+0000 front 2019-12-08T17:43:31.060173+0000 (oldest deadline 2019-12-08T17:44:16.453238+0000) 2019-12-08T17:44:47.279 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:44:47.274+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.949738+0000 front 2019-12-08T17:43:33.055901+0000 (oldest deadline 2019-12-08T17:44:13.438664+0000) 2019-12-08T17:44:47.625 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:44:47.620+0000 1694f700 -1 osd.5 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.603719+0000 front 2019-12-08T17:43:30.918560+0000 (oldest deadline 2019-12-08T17:44:14.356390+0000) 2019-12-08T17:44:47.717 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:44:47.715+0000 1694f700 -1 osd.2 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:43:45.792405+0000 (oldest deadline 2019-12-08T17:44:25.792405+0000) 2019-12-08T17:44:47.717 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:44:47.716+0000 1694f700 -1 osd.2 240 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e238) 2019-12-08T17:44:47.729 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:44:47.727+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.770704+0000 front 2019-12-08T17:43:30.784192+0000 (oldest deadline 2019-12-08T17:44:16.059187+0000) 2019-12-08T17:44:47.867 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:44:47.860+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.574551+0000 front 2019-12-08T17:43:33.144314+0000 (oldest deadline 2019-12-08T17:44:12.973017+0000) 2019-12-08T17:44:47.906 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:44:47.899+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:31.985612+0000 front 2019-12-08T17:43:31.882546+0000 (oldest deadline 2019-12-08T17:44:17.758755+0000) 2019-12-08T17:44:48.135 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:44:48.129+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.686117+0000 front 2019-12-08T17:43:31.060173+0000 (oldest deadline 2019-12-08T17:44:16.453238+0000) 2019-12-08T17:44:48.309 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:44:48.307+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.949738+0000 front 2019-12-08T17:43:33.055901+0000 (oldest deadline 2019-12-08T17:44:13.438664+0000) 2019-12-08T17:44:48.616 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:44:48.610+0000 1694f700 -1 osd.5 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.603719+0000 front 2019-12-08T17:43:30.918560+0000 (oldest deadline 2019-12-08T17:44:14.356390+0000) 2019-12-08T17:44:48.719 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:44:48.716+0000 1694f700 -1 osd.2 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:43:45.792405+0000 (oldest deadline 2019-12-08T17:44:25.792405+0000) 2019-12-08T17:44:48.721 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:44:48.718+0000 1694f700 -1 osd.2 240 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e238) 2019-12-08T17:44:48.731 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:44:48.729+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.770704+0000 front 2019-12-08T17:43:30.784192+0000 (oldest deadline 2019-12-08T17:44:16.059187+0000) 2019-12-08T17:44:48.871 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:44:48.865+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:31.985612+0000 front 2019-12-08T17:43:31.882546+0000 (oldest deadline 2019-12-08T17:44:17.758755+0000) 2019-12-08T17:44:48.915 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:44:48.908+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.574551+0000 front 2019-12-08T17:43:33.144314+0000 (oldest deadline 2019-12-08T17:44:12.973017+0000) 2019-12-08T17:44:49.112 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:44:49.105+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.686117+0000 front 2019-12-08T17:43:31.060173+0000 (oldest deadline 2019-12-08T17:44:16.453238+0000) 2019-12-08T17:44:49.357 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:44:49.354+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.949738+0000 front 2019-12-08T17:43:33.055901+0000 (oldest deadline 2019-12-08T17:44:13.438664+0000) 2019-12-08T17:44:49.620 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:44:49.613+0000 1694f700 -1 osd.5 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.603719+0000 front 2019-12-08T17:43:30.918560+0000 (oldest deadline 2019-12-08T17:44:14.356390+0000) 2019-12-08T17:44:49.679 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:44:49.676+0000 1694f700 -1 osd.2 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:43:45.792405+0000 (oldest deadline 2019-12-08T17:44:25.792405+0000) 2019-12-08T17:44:49.683 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:44:49.681+0000 1694f700 -1 osd.2 240 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e238) 2019-12-08T17:44:49.735 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:44:49.732+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.770704+0000 front 2019-12-08T17:43:30.784192+0000 (oldest deadline 2019-12-08T17:44:16.059187+0000) 2019-12-08T17:44:49.849 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:44:49.831+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:31.985612+0000 front 2019-12-08T17:43:31.882546+0000 (oldest deadline 2019-12-08T17:44:17.758755+0000) 2019-12-08T17:44:49.960 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:44:49.953+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.574551+0000 front 2019-12-08T17:43:33.144314+0000 (oldest deadline 2019-12-08T17:44:12.973017+0000) 2019-12-08T17:44:50.100 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:44:50.093+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.686117+0000 front 2019-12-08T17:43:31.060173+0000 (oldest deadline 2019-12-08T17:44:16.453238+0000) 2019-12-08T17:44:50.386 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:44:50.384+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.949738+0000 front 2019-12-08T17:43:33.055901+0000 (oldest deadline 2019-12-08T17:44:13.438664+0000) 2019-12-08T17:44:50.607 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:44:50.601+0000 1694f700 -1 osd.5 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.603719+0000 front 2019-12-08T17:43:30.918560+0000 (oldest deadline 2019-12-08T17:44:14.356390+0000) 2019-12-08T17:44:50.699 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:44:50.694+0000 1694f700 -1 osd.2 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:43:45.792405+0000 (oldest deadline 2019-12-08T17:44:25.792405+0000) 2019-12-08T17:44:50.733 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:44:50.697+0000 1694f700 -1 osd.2 240 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e238) 2019-12-08T17:44:50.733 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:44:50.725+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.770704+0000 front 2019-12-08T17:43:30.784192+0000 (oldest deadline 2019-12-08T17:44:16.059187+0000) 2019-12-08T17:44:50.840 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:44:50.834+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:31.985612+0000 front 2019-12-08T17:43:31.882546+0000 (oldest deadline 2019-12-08T17:44:17.758755+0000) 2019-12-08T17:44:50.952 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:44:50.946+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.574551+0000 front 2019-12-08T17:43:33.144314+0000 (oldest deadline 2019-12-08T17:44:12.973017+0000) 2019-12-08T17:44:51.114 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:44:51.107+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.686117+0000 front 2019-12-08T17:43:31.060173+0000 (oldest deadline 2019-12-08T17:44:16.453238+0000) 2019-12-08T17:44:51.387 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:44:51.384+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.949738+0000 front 2019-12-08T17:43:33.055901+0000 (oldest deadline 2019-12-08T17:44:13.438664+0000) 2019-12-08T17:44:51.414 INFO:tasks.ceph.mon.b.smithi013.stderr:2019-12-08T17:44:51.409+0000 1a89c700 -1 mon.b@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.1 [v2:172.21.15.79:6810/10449,v1:172.21.15.79:6811/10449] for 44sec e240 v240) 2019-12-08T17:44:51.591 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:44:51.585+0000 1694f700 -1 osd.5 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.603719+0000 front 2019-12-08T17:43:30.918560+0000 (oldest deadline 2019-12-08T17:44:14.356390+0000) 2019-12-08T17:44:51.688 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:44:51.685+0000 1694f700 -1 osd.2 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:43:45.792405+0000 (oldest deadline 2019-12-08T17:44:25.792405+0000) 2019-12-08T17:44:51.689 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:44:51.687+0000 1694f700 -1 osd.2 240 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e238) 2019-12-08T17:44:51.758 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:44:51.756+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.770704+0000 front 2019-12-08T17:43:30.784192+0000 (oldest deadline 2019-12-08T17:44:16.059187+0000) 2019-12-08T17:44:51.812 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:44:51.806+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:31.985612+0000 front 2019-12-08T17:43:31.882546+0000 (oldest deadline 2019-12-08T17:44:17.758755+0000) 2019-12-08T17:44:51.992 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:44:51.985+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.574551+0000 front 2019-12-08T17:43:33.144314+0000 (oldest deadline 2019-12-08T17:44:12.973017+0000) 2019-12-08T17:44:52.072 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:44:52.065+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.686117+0000 front 2019-12-08T17:43:31.060173+0000 (oldest deadline 2019-12-08T17:44:16.453238+0000) 2019-12-08T17:44:52.397 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:44:52.395+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.949738+0000 front 2019-12-08T17:43:33.055901+0000 (oldest deadline 2019-12-08T17:44:13.438664+0000) 2019-12-08T17:44:52.593 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:44:52.588+0000 1694f700 -1 osd.5 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.603719+0000 front 2019-12-08T17:43:30.918560+0000 (oldest deadline 2019-12-08T17:44:14.356390+0000) 2019-12-08T17:44:52.649 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:44:52.645+0000 1694f700 -1 osd.2 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:43:45.792405+0000 (oldest deadline 2019-12-08T17:44:25.792405+0000) 2019-12-08T17:44:52.651 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:44:52.648+0000 1694f700 -1 osd.2 240 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e238) 2019-12-08T17:44:52.722 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:44:52.718+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.770704+0000 front 2019-12-08T17:43:30.784192+0000 (oldest deadline 2019-12-08T17:44:16.059187+0000) 2019-12-08T17:44:52.848 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:44:52.841+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:31.985612+0000 front 2019-12-08T17:43:31.882546+0000 (oldest deadline 2019-12-08T17:44:17.758755+0000) 2019-12-08T17:44:52.953 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:44:52.947+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.574551+0000 front 2019-12-08T17:43:33.144314+0000 (oldest deadline 2019-12-08T17:44:12.973017+0000) 2019-12-08T17:44:53.033 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:44:53.026+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.686117+0000 front 2019-12-08T17:43:31.060173+0000 (oldest deadline 2019-12-08T17:44:16.453238+0000) 2019-12-08T17:44:53.397 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:44:53.395+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.949738+0000 front 2019-12-08T17:43:33.055901+0000 (oldest deadline 2019-12-08T17:44:13.438664+0000) 2019-12-08T17:44:53.619 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:44:53.613+0000 1694f700 -1 osd.5 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.603719+0000 front 2019-12-08T17:43:30.918560+0000 (oldest deadline 2019-12-08T17:44:14.356390+0000) 2019-12-08T17:44:53.661 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:44:53.659+0000 1694f700 -1 osd.2 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:43:45.792405+0000 (oldest deadline 2019-12-08T17:44:25.792405+0000) 2019-12-08T17:44:53.666 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:44:53.664+0000 1694f700 -1 osd.2 240 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e238) 2019-12-08T17:44:53.738 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:44:53.736+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.770704+0000 front 2019-12-08T17:43:30.784192+0000 (oldest deadline 2019-12-08T17:44:16.059187+0000) 2019-12-08T17:44:53.808 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:44:53.802+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:31.985612+0000 front 2019-12-08T17:43:31.882546+0000 (oldest deadline 2019-12-08T17:44:17.758755+0000) 2019-12-08T17:44:53.985 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:44:53.980+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.574551+0000 front 2019-12-08T17:43:33.144314+0000 (oldest deadline 2019-12-08T17:44:12.973017+0000) 2019-12-08T17:44:54.072 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:44:54.066+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.686117+0000 front 2019-12-08T17:43:31.060173+0000 (oldest deadline 2019-12-08T17:44:16.453238+0000) 2019-12-08T17:44:54.412 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:44:54.409+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.949738+0000 front 2019-12-08T17:43:33.055901+0000 (oldest deadline 2019-12-08T17:44:13.438664+0000) 2019-12-08T17:44:54.661 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:44:54.659+0000 1694f700 -1 osd.2 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:43:45.792405+0000 (oldest deadline 2019-12-08T17:44:25.792405+0000) 2019-12-08T17:44:54.664 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:44:54.663+0000 1694f700 -1 osd.2 240 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e238) 2019-12-08T17:44:54.665 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:44:54.659+0000 1694f700 -1 osd.5 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.603719+0000 front 2019-12-08T17:43:30.918560+0000 (oldest deadline 2019-12-08T17:44:14.356390+0000) 2019-12-08T17:44:54.732 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:44:54.730+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.770704+0000 front 2019-12-08T17:43:30.784192+0000 (oldest deadline 2019-12-08T17:44:16.059187+0000) 2019-12-08T17:44:54.830 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:44:54.823+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:31.985612+0000 front 2019-12-08T17:43:31.882546+0000 (oldest deadline 2019-12-08T17:44:17.758755+0000) 2019-12-08T17:44:55.022 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:44:55.014+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.574551+0000 front 2019-12-08T17:43:33.144314+0000 (oldest deadline 2019-12-08T17:44:12.973017+0000) 2019-12-08T17:44:55.088 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:44:55.082+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.686117+0000 front 2019-12-08T17:43:31.060173+0000 (oldest deadline 2019-12-08T17:44:16.453238+0000) 2019-12-08T17:44:55.418 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:44:55.414+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.949738+0000 front 2019-12-08T17:43:33.055901+0000 (oldest deadline 2019-12-08T17:44:13.438664+0000) 2019-12-08T17:44:55.679 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:44:55.677+0000 1694f700 -1 osd.2 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:43:45.792405+0000 (oldest deadline 2019-12-08T17:44:25.792405+0000) 2019-12-08T17:44:55.682 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:44:55.676+0000 1694f700 -1 osd.5 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.603719+0000 front 2019-12-08T17:43:30.918560+0000 (oldest deadline 2019-12-08T17:44:14.356390+0000) 2019-12-08T17:44:55.682 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:44:55.681+0000 1694f700 -1 osd.2 240 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e238) 2019-12-08T17:44:55.686 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:44:55.684+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.770704+0000 front 2019-12-08T17:43:30.784192+0000 (oldest deadline 2019-12-08T17:44:16.059187+0000) 2019-12-08T17:44:55.830 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:44:55.824+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:31.985612+0000 front 2019-12-08T17:43:31.882546+0000 (oldest deadline 2019-12-08T17:44:17.758755+0000) 2019-12-08T17:44:56.023 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:44:56.017+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.574551+0000 front 2019-12-08T17:43:33.144314+0000 (oldest deadline 2019-12-08T17:44:12.973017+0000) 2019-12-08T17:44:56.092 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:44:56.085+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.686117+0000 front 2019-12-08T17:43:31.060173+0000 (oldest deadline 2019-12-08T17:44:16.453238+0000) 2019-12-08T17:44:56.431 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:44:56.428+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.949738+0000 front 2019-12-08T17:43:33.055901+0000 (oldest deadline 2019-12-08T17:44:13.438664+0000) 2019-12-08T17:44:56.436 INFO:tasks.ceph.mon.b.smithi013.stderr:2019-12-08T17:44:56.431+0000 1a89c700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.1 [v2:172.21.15.79:6810/10449,v1:172.21.15.79:6811/10449] for 44sec e240 v240) 2019-12-08T17:44:56.652 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:44:56.646+0000 1694f700 -1 osd.5 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.603719+0000 front 2019-12-08T17:43:30.918560+0000 (oldest deadline 2019-12-08T17:44:14.356390+0000) 2019-12-08T17:44:56.722 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:44:56.721+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.770704+0000 front 2019-12-08T17:43:30.784192+0000 (oldest deadline 2019-12-08T17:44:16.059187+0000) 2019-12-08T17:44:56.726 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:44:56.722+0000 1694f700 -1 osd.2 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:43:45.792405+0000 (oldest deadline 2019-12-08T17:44:25.792405+0000) 2019-12-08T17:44:56.728 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:44:56.725+0000 1694f700 -1 osd.2 240 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e238) 2019-12-08T17:44:56.795 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:44:56.789+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:31.985612+0000 front 2019-12-08T17:43:31.882546+0000 (oldest deadline 2019-12-08T17:44:17.758755+0000) 2019-12-08T17:44:57.057 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:44:57.051+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.574551+0000 front 2019-12-08T17:43:33.144314+0000 (oldest deadline 2019-12-08T17:44:12.973017+0000) 2019-12-08T17:44:57.122 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:44:57.116+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.686117+0000 front 2019-12-08T17:43:31.060173+0000 (oldest deadline 2019-12-08T17:44:16.453238+0000) 2019-12-08T17:44:57.395 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:44:57.393+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.949738+0000 front 2019-12-08T17:43:33.055901+0000 (oldest deadline 2019-12-08T17:44:13.438664+0000) 2019-12-08T17:44:57.635 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:44:57.628+0000 1694f700 -1 osd.5 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.603719+0000 front 2019-12-08T17:43:30.918560+0000 (oldest deadline 2019-12-08T17:44:14.356390+0000) 2019-12-08T17:44:57.730 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:44:57.727+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.770704+0000 front 2019-12-08T17:43:30.784192+0000 (oldest deadline 2019-12-08T17:44:16.059187+0000) 2019-12-08T17:44:57.762 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:44:57.761+0000 1694f700 -1 osd.2 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:43:45.792405+0000 (oldest deadline 2019-12-08T17:44:25.792405+0000) 2019-12-08T17:44:57.766 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:44:57.764+0000 1694f700 -1 osd.2 240 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e238) 2019-12-08T17:44:57.846 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:44:57.840+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:31.985612+0000 front 2019-12-08T17:43:31.882546+0000 (oldest deadline 2019-12-08T17:44:17.758755+0000) 2019-12-08T17:44:58.082 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:44:58.076+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.574551+0000 front 2019-12-08T17:43:33.144314+0000 (oldest deadline 2019-12-08T17:44:12.973017+0000) 2019-12-08T17:44:58.120 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:44:58.114+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.686117+0000 front 2019-12-08T17:43:31.060173+0000 (oldest deadline 2019-12-08T17:44:16.453238+0000) 2019-12-08T17:44:58.398 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:44:58.394+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.949738+0000 front 2019-12-08T17:43:33.055901+0000 (oldest deadline 2019-12-08T17:44:13.438664+0000) 2019-12-08T17:44:58.608 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:44:58.602+0000 1694f700 -1 osd.5 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.603719+0000 front 2019-12-08T17:43:30.918560+0000 (oldest deadline 2019-12-08T17:44:14.356390+0000) 2019-12-08T17:44:58.765 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:44:58.763+0000 1694f700 -1 osd.2 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:43:45.792405+0000 (oldest deadline 2019-12-08T17:44:25.792405+0000) 2019-12-08T17:44:58.770 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:44:58.768+0000 1694f700 -1 osd.2 240 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e238) 2019-12-08T17:44:58.771 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:44:58.767+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.770704+0000 front 2019-12-08T17:43:30.784192+0000 (oldest deadline 2019-12-08T17:44:16.059187+0000) 2019-12-08T17:44:58.864 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:44:58.858+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:31.985612+0000 front 2019-12-08T17:43:31.882546+0000 (oldest deadline 2019-12-08T17:44:17.758755+0000) 2019-12-08T17:44:59.047 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:44:59.040+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.574551+0000 front 2019-12-08T17:43:33.144314+0000 (oldest deadline 2019-12-08T17:44:12.973017+0000) 2019-12-08T17:44:59.164 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:44:59.157+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.686117+0000 front 2019-12-08T17:43:31.060173+0000 (oldest deadline 2019-12-08T17:44:16.453238+0000) 2019-12-08T17:44:59.391 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:44:59.389+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.949738+0000 front 2019-12-08T17:43:33.055901+0000 (oldest deadline 2019-12-08T17:44:13.438664+0000) 2019-12-08T17:44:59.572 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:44:59.565+0000 1694f700 -1 osd.5 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.603719+0000 front 2019-12-08T17:43:30.918560+0000 (oldest deadline 2019-12-08T17:44:14.356390+0000) 2019-12-08T17:44:59.728 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:44:59.725+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.770704+0000 front 2019-12-08T17:43:30.784192+0000 (oldest deadline 2019-12-08T17:44:16.059187+0000) 2019-12-08T17:44:59.815 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:44:59.811+0000 1694f700 -1 osd.2 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:43:45.792405+0000 (oldest deadline 2019-12-08T17:44:25.792405+0000) 2019-12-08T17:44:59.816 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:44:59.814+0000 1694f700 -1 osd.2 240 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e238) 2019-12-08T17:44:59.878 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:44:59.872+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:31.985612+0000 front 2019-12-08T17:43:31.882546+0000 (oldest deadline 2019-12-08T17:44:17.758755+0000) 2019-12-08T17:45:00.024 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:45:00.018+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.574551+0000 front 2019-12-08T17:43:33.144314+0000 (oldest deadline 2019-12-08T17:44:12.973017+0000) 2019-12-08T17:45:00.170 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:45:00.164+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.686117+0000 front 2019-12-08T17:43:31.060173+0000 (oldest deadline 2019-12-08T17:44:16.453238+0000) 2019-12-08T17:45:00.366 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:45:00.363+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.949738+0000 front 2019-12-08T17:43:33.055901+0000 (oldest deadline 2019-12-08T17:44:13.438664+0000) 2019-12-08T17:45:00.602 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:45:00.596+0000 1694f700 -1 osd.5 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.603719+0000 front 2019-12-08T17:43:30.918560+0000 (oldest deadline 2019-12-08T17:44:14.356390+0000) 2019-12-08T17:45:00.769 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:45:00.767+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.770704+0000 front 2019-12-08T17:43:30.784192+0000 (oldest deadline 2019-12-08T17:44:16.059187+0000) 2019-12-08T17:45:00.819 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:45:00.817+0000 1694f700 -1 osd.2 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:43:45.792405+0000 (oldest deadline 2019-12-08T17:44:25.792405+0000) 2019-12-08T17:45:00.822 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:45:00.821+0000 1694f700 -1 osd.2 240 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e238) 2019-12-08T17:45:00.865 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:45:00.859+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:31.985612+0000 front 2019-12-08T17:43:31.882546+0000 (oldest deadline 2019-12-08T17:44:17.758755+0000) 2019-12-08T17:45:01.080 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:45:01.072+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.574551+0000 front 2019-12-08T17:43:33.144314+0000 (oldest deadline 2019-12-08T17:44:12.973017+0000) 2019-12-08T17:45:01.174 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:45:01.161+0000 1694f700 -1 osd.6 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.686117+0000 front 2019-12-08T17:43:31.060173+0000 (oldest deadline 2019-12-08T17:44:16.453238+0000) 2019-12-08T17:45:01.343 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:45:01.341+0000 1694f700 -1 osd.0 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.949738+0000 front 2019-12-08T17:43:33.055901+0000 (oldest deadline 2019-12-08T17:44:13.438664+0000) 2019-12-08T17:45:01.543 INFO:tasks.ceph.mon.b.smithi013.stderr:2019-12-08T17:45:01.539+0000 1a89c700 -1 mon.b@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.1 [v2:172.21.15.79:6810/10449,v1:172.21.15.79:6811/10449] for 44sec e240 v240) 2019-12-08T17:45:01.583 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:45:01.576+0000 1694f700 -1 osd.5 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.603719+0000 front 2019-12-08T17:43:30.918560+0000 (oldest deadline 2019-12-08T17:44:14.356390+0000) 2019-12-08T17:45:01.733 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:45:01.731+0000 1694f700 -1 osd.3 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:30.770704+0000 front 2019-12-08T17:43:30.784192+0000 (oldest deadline 2019-12-08T17:44:16.059187+0000) 2019-12-08T17:45:01.820 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:45:01.815+0000 1694f700 -1 osd.7 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:31.985612+0000 front 2019-12-08T17:43:31.882546+0000 (oldest deadline 2019-12-08T17:44:17.758755+0000) 2019-12-08T17:45:02.118 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:45:02.114+0000 1694f700 -1 osd.4 240 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:43:32.574551+0000 front 2019-12-08T17:43:33.144314+0000 (oldest deadline 2019-12-08T17:44:12.973017+0000) 2019-12-08T17:45:04.192 INFO:tasks.rgw.client.0.smithi079.stdout:2019-12-08T17:45:04.167+0000 20e25700 -1 RGWWatcher::handle_error cookie 4679462080 err (107) Transport endpoint is not connected 2019-12-08T17:45:19.177 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:05:42:43.880 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T17:45:19.189 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:05:42:43.892 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T17:45:19.197 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:05:42:43.831 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T17:45:19.199 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:05:42:43.834 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T17:45:19.203 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:05:42:43.838 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T17:45:19.206 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:05:42:43.840 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T17:45:19.426 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:05:42:44.060 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T17:45:19.445 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:05:42:44.148 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T17:45:19.472 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:05:42:44.107 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T17:45:25.845 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:45:25.739+0000 1694f700 -1 osd.1 239 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4449.0:105486 5.9 5.84ada7c9 (undecoded) ondisk+write+known_if_redirected e240) 2019-12-08T17:45:27.077 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:45:27.065+0000 1694f700 -1 osd.1 240 get_health_metrics reporting 13 slow ops, oldest is osd_op(client.4449.0:105486 5.9 5.84ada7c9 (undecoded) ondisk+write+known_if_redirected e240) 2019-12-08T17:45:28.771 INFO:tasks.rgw.client.0.smithi079.stdout:2019-12-08T17:45:28.762+0000 20e25700 -1 RGWWatcher::handle_error cookie 900397392 err (107) Transport endpoint is not connected 2019-12-08T17:46:01.523 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:46:01.458+0000 1694f700 -1 osd.2 247 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] RETRY=29 ondisk+retry+read+known_if_redirected e245) 2019-12-08T17:46:47.120 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:05:44:11.823 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T17:46:47.161 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:05:44:11.792 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T17:46:47.161 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:05:44:11.794 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T17:46:47.184 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:05:44:11.886 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T17:46:47.212 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:05:44:11.845 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T17:46:47.220 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:05:44:11.855 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T17:46:47.228 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:05:44:11.862 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T17:46:47.315 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:05:44:12.018 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T17:46:47.334 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:05:44:11.969 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T17:46:52.729 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:46:52.727+0000 1694f700 -1 osd.1 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.715054+0000 front 2019-12-08T17:46:10.481371+0000 (oldest deadline 2019-12-08T17:46:52.463941+0000) 2019-12-08T17:46:53.707 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:46:53.706+0000 1694f700 -1 osd.1 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.715054+0000 front 2019-12-08T17:46:10.481371+0000 (oldest deadline 2019-12-08T17:46:52.463941+0000) 2019-12-08T17:46:53.772 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:46:53.766+0000 1694f700 -1 osd.6 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:07.255992+0000 front 2019-12-08T17:46:07.250579+0000 (oldest deadline 2019-12-08T17:46:53.102014+0000) 2019-12-08T17:46:54.429 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:46:54.427+0000 1694f700 -1 osd.0 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:10.612745+0000 front 2019-12-08T17:46:10.007340+0000 (oldest deadline 2019-12-08T17:46:54.301047+0000) 2019-12-08T17:46:54.743 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:46:54.741+0000 1694f700 -1 osd.1 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.715054+0000 front 2019-12-08T17:46:10.481371+0000 (oldest deadline 2019-12-08T17:46:52.463941+0000) 2019-12-08T17:46:54.801 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:46:54.786+0000 1694f700 -1 osd.6 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:07.255992+0000 front 2019-12-08T17:46:07.250579+0000 (oldest deadline 2019-12-08T17:46:53.102014+0000) 2019-12-08T17:46:54.965 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:46:54.964+0000 1694f700 -1 osd.3 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.201965+0000 front 2019-12-08T17:46:09.116781+0000 (oldest deadline 2019-12-08T17:46:54.911707+0000) 2019-12-08T17:46:55.451 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:46:55.449+0000 1694f700 -1 osd.0 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:10.612745+0000 front 2019-12-08T17:46:10.007340+0000 (oldest deadline 2019-12-08T17:46:54.301047+0000) 2019-12-08T17:46:55.554 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:46:55.548+0000 1694f700 -1 osd.4 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.988130+0000 front 2019-12-08T17:46:10.610443+0000 (oldest deadline 2019-12-08T17:46:54.544300+0000) 2019-12-08T17:46:55.606 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:46:55.601+0000 1694f700 -1 osd.5 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:10.244849+0000 front 2019-12-08T17:46:11.947493+0000 (oldest deadline 2019-12-08T17:46:54.886767+0000) 2019-12-08T17:46:55.788 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:46:55.783+0000 1694f700 -1 osd.6 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:07.255992+0000 front 2019-12-08T17:46:07.250579+0000 (oldest deadline 2019-12-08T17:46:53.102014+0000) 2019-12-08T17:46:55.792 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:46:55.789+0000 1694f700 -1 osd.1 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.715054+0000 front 2019-12-08T17:46:10.481371+0000 (oldest deadline 2019-12-08T17:46:52.463941+0000) 2019-12-08T17:46:55.958 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:46:55.957+0000 1694f700 -1 osd.3 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.201965+0000 front 2019-12-08T17:46:09.116781+0000 (oldest deadline 2019-12-08T17:46:54.911707+0000) 2019-12-08T17:46:56.497 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:46:56.496+0000 1694f700 -1 osd.0 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:10.612745+0000 front 2019-12-08T17:46:10.007340+0000 (oldest deadline 2019-12-08T17:46:54.301047+0000) 2019-12-08T17:46:56.546 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:46:56.542+0000 1694f700 -1 osd.4 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.988130+0000 front 2019-12-08T17:46:10.610443+0000 (oldest deadline 2019-12-08T17:46:54.544300+0000) 2019-12-08T17:46:56.599 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:46:56.592+0000 1694f700 -1 osd.5 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:10.244849+0000 front 2019-12-08T17:46:11.947493+0000 (oldest deadline 2019-12-08T17:46:54.886767+0000) 2019-12-08T17:46:56.740 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:46:56.735+0000 1694f700 -1 osd.7 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:12.035622+0000 front 2019-12-08T17:46:10.994113+0000 (oldest deadline 2019-12-08T17:46:56.243102+0000) 2019-12-08T17:46:56.761 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:46:56.755+0000 1694f700 -1 osd.6 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:07.255992+0000 front 2019-12-08T17:46:07.250579+0000 (oldest deadline 2019-12-08T17:46:53.102014+0000) 2019-12-08T17:46:56.775 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:46:56.772+0000 1694f700 -1 osd.1 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.715054+0000 front 2019-12-08T17:46:10.481371+0000 (oldest deadline 2019-12-08T17:46:52.463941+0000) 2019-12-08T17:46:57.009 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:46:57.002+0000 1694f700 -1 osd.3 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.201965+0000 front 2019-12-08T17:46:09.116781+0000 (oldest deadline 2019-12-08T17:46:54.911707+0000) 2019-12-08T17:46:57.463 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:46:57.462+0000 1694f700 -1 osd.0 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:10.612745+0000 front 2019-12-08T17:46:10.007340+0000 (oldest deadline 2019-12-08T17:46:54.301047+0000) 2019-12-08T17:46:57.558 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:46:57.553+0000 1694f700 -1 osd.5 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:10.244849+0000 front 2019-12-08T17:46:11.947493+0000 (oldest deadline 2019-12-08T17:46:54.886767+0000) 2019-12-08T17:46:57.571 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:46:57.565+0000 1694f700 -1 osd.4 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.988130+0000 front 2019-12-08T17:46:10.610443+0000 (oldest deadline 2019-12-08T17:46:54.544300+0000) 2019-12-08T17:46:57.717 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:46:57.711+0000 1694f700 -1 osd.6 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:07.255992+0000 front 2019-12-08T17:46:07.250579+0000 (oldest deadline 2019-12-08T17:46:53.102014+0000) 2019-12-08T17:46:57.787 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:46:57.783+0000 1694f700 -1 osd.7 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:12.035622+0000 front 2019-12-08T17:46:10.994113+0000 (oldest deadline 2019-12-08T17:46:56.243102+0000) 2019-12-08T17:46:57.794 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:46:57.792+0000 1694f700 -1 osd.1 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.715054+0000 front 2019-12-08T17:46:10.481371+0000 (oldest deadline 2019-12-08T17:46:52.463941+0000) 2019-12-08T17:46:58.011 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:46:58.009+0000 1694f700 -1 osd.3 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.201965+0000 front 2019-12-08T17:46:09.116781+0000 (oldest deadline 2019-12-08T17:46:54.911707+0000) 2019-12-08T17:46:58.471 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:46:58.468+0000 1694f700 -1 osd.0 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:10.612745+0000 front 2019-12-08T17:46:10.007340+0000 (oldest deadline 2019-12-08T17:46:54.301047+0000) 2019-12-08T17:46:58.528 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:46:58.523+0000 1694f700 -1 osd.4 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.988130+0000 front 2019-12-08T17:46:10.610443+0000 (oldest deadline 2019-12-08T17:46:54.544300+0000) 2019-12-08T17:46:58.540 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:46:58.535+0000 1694f700 -1 osd.5 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:10.244849+0000 front 2019-12-08T17:46:11.947493+0000 (oldest deadline 2019-12-08T17:46:54.886767+0000) 2019-12-08T17:46:58.694 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:46:58.688+0000 1694f700 -1 osd.6 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:07.255992+0000 front 2019-12-08T17:46:07.250579+0000 (oldest deadline 2019-12-08T17:46:53.102014+0000) 2019-12-08T17:46:58.752 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:46:58.748+0000 1694f700 -1 osd.1 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.715054+0000 front 2019-12-08T17:46:10.481371+0000 (oldest deadline 2019-12-08T17:46:52.463941+0000) 2019-12-08T17:46:58.834 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:46:58.830+0000 1694f700 -1 osd.7 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:12.035622+0000 front 2019-12-08T17:46:10.994113+0000 (oldest deadline 2019-12-08T17:46:56.243102+0000) 2019-12-08T17:46:58.989 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:46:58.987+0000 1694f700 -1 osd.3 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.201965+0000 front 2019-12-08T17:46:09.116781+0000 (oldest deadline 2019-12-08T17:46:54.911707+0000) 2019-12-08T17:46:59.512 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:46:59.508+0000 1694f700 -1 osd.0 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:10.612745+0000 front 2019-12-08T17:46:10.007340+0000 (oldest deadline 2019-12-08T17:46:54.301047+0000) 2019-12-08T17:46:59.539 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:46:59.534+0000 1694f700 -1 osd.5 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:10.244849+0000 front 2019-12-08T17:46:11.947493+0000 (oldest deadline 2019-12-08T17:46:54.886767+0000) 2019-12-08T17:46:59.570 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:46:59.564+0000 1694f700 -1 osd.4 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.988130+0000 front 2019-12-08T17:46:10.610443+0000 (oldest deadline 2019-12-08T17:46:54.544300+0000) 2019-12-08T17:46:59.705 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:46:59.700+0000 1694f700 -1 osd.6 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:07.255992+0000 front 2019-12-08T17:46:07.250579+0000 (oldest deadline 2019-12-08T17:46:53.102014+0000) 2019-12-08T17:46:59.738 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:46:59.735+0000 1694f700 -1 osd.1 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.715054+0000 front 2019-12-08T17:46:10.481371+0000 (oldest deadline 2019-12-08T17:46:52.463941+0000) 2019-12-08T17:46:59.819 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:46:59.812+0000 1694f700 -1 osd.7 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:12.035622+0000 front 2019-12-08T17:46:10.994113+0000 (oldest deadline 2019-12-08T17:46:56.243102+0000) 2019-12-08T17:46:59.978 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:46:59.976+0000 1694f700 -1 osd.3 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.201965+0000 front 2019-12-08T17:46:09.116781+0000 (oldest deadline 2019-12-08T17:46:54.911707+0000) 2019-12-08T17:47:00.517 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:47:00.515+0000 1694f700 -1 osd.0 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:10.612745+0000 front 2019-12-08T17:46:10.007340+0000 (oldest deadline 2019-12-08T17:46:54.301047+0000) 2019-12-08T17:47:00.565 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:47:00.555+0000 1694f700 -1 osd.5 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:10.244849+0000 front 2019-12-08T17:46:11.947493+0000 (oldest deadline 2019-12-08T17:46:54.886767+0000) 2019-12-08T17:47:00.613 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:47:00.608+0000 1694f700 -1 osd.4 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.988130+0000 front 2019-12-08T17:46:10.610443+0000 (oldest deadline 2019-12-08T17:46:54.544300+0000) 2019-12-08T17:47:00.681 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:47:00.676+0000 1694f700 -1 osd.6 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:07.255992+0000 front 2019-12-08T17:46:07.250579+0000 (oldest deadline 2019-12-08T17:46:53.102014+0000) 2019-12-08T17:47:00.726 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:47:00.723+0000 1694f700 -1 osd.1 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.715054+0000 front 2019-12-08T17:46:10.481371+0000 (oldest deadline 2019-12-08T17:46:52.463941+0000) 2019-12-08T17:47:00.824 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:47:00.818+0000 1694f700 -1 osd.7 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:12.035622+0000 front 2019-12-08T17:46:10.994113+0000 (oldest deadline 2019-12-08T17:46:56.243102+0000) 2019-12-08T17:47:00.975 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:47:00.973+0000 1694f700 -1 osd.3 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.201965+0000 front 2019-12-08T17:46:09.116781+0000 (oldest deadline 2019-12-08T17:46:54.911707+0000) 2019-12-08T17:47:01.495 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:47:01.493+0000 1694f700 -1 osd.0 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:10.612745+0000 front 2019-12-08T17:46:10.007340+0000 (oldest deadline 2019-12-08T17:46:54.301047+0000) 2019-12-08T17:47:01.597 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:47:01.594+0000 1694f700 -1 osd.5 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:10.244849+0000 front 2019-12-08T17:46:11.947493+0000 (oldest deadline 2019-12-08T17:46:54.886767+0000) 2019-12-08T17:47:01.631 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:47:01.626+0000 1694f700 -1 osd.4 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.988130+0000 front 2019-12-08T17:46:10.610443+0000 (oldest deadline 2019-12-08T17:46:54.544300+0000) 2019-12-08T17:47:01.725 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:47:01.720+0000 1694f700 -1 osd.6 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:07.255992+0000 front 2019-12-08T17:46:07.250579+0000 (oldest deadline 2019-12-08T17:46:53.102014+0000) 2019-12-08T17:47:01.739 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:47:01.736+0000 1694f700 -1 osd.1 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.715054+0000 front 2019-12-08T17:46:10.481371+0000 (oldest deadline 2019-12-08T17:46:52.463941+0000) 2019-12-08T17:47:01.819 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:47:01.814+0000 1694f700 -1 osd.7 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:12.035622+0000 front 2019-12-08T17:46:10.994113+0000 (oldest deadline 2019-12-08T17:46:56.243102+0000) 2019-12-08T17:47:01.939 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:47:01.937+0000 1694f700 -1 osd.3 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.201965+0000 front 2019-12-08T17:46:09.116781+0000 (oldest deadline 2019-12-08T17:46:54.911707+0000) 2019-12-08T17:47:02.540 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:47:02.532+0000 1694f700 -1 osd.0 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:10.612745+0000 front 2019-12-08T17:46:10.007340+0000 (oldest deadline 2019-12-08T17:46:54.301047+0000) 2019-12-08T17:47:02.590 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:47:02.585+0000 1694f700 -1 osd.5 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:10.244849+0000 front 2019-12-08T17:46:11.947493+0000 (oldest deadline 2019-12-08T17:46:54.886767+0000) 2019-12-08T17:47:02.602 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:47:02.597+0000 1694f700 -1 osd.4 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.988130+0000 front 2019-12-08T17:46:10.610443+0000 (oldest deadline 2019-12-08T17:46:54.544300+0000) 2019-12-08T17:47:02.696 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:47:02.692+0000 1694f700 -1 osd.6 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:07.255992+0000 front 2019-12-08T17:46:07.250579+0000 (oldest deadline 2019-12-08T17:46:53.102014+0000) 2019-12-08T17:47:02.739 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:47:02.736+0000 1694f700 -1 osd.1 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.715054+0000 front 2019-12-08T17:46:10.481371+0000 (oldest deadline 2019-12-08T17:46:52.463941+0000) 2019-12-08T17:47:02.843 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:47:02.837+0000 1694f700 -1 osd.7 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:12.035622+0000 front 2019-12-08T17:46:10.994113+0000 (oldest deadline 2019-12-08T17:46:56.243102+0000) 2019-12-08T17:47:02.991 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:47:02.989+0000 1694f700 -1 osd.3 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.201965+0000 front 2019-12-08T17:46:09.116781+0000 (oldest deadline 2019-12-08T17:46:54.911707+0000) 2019-12-08T17:47:03.573 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:47:03.570+0000 1694f700 -1 osd.0 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:10.612745+0000 front 2019-12-08T17:46:10.007340+0000 (oldest deadline 2019-12-08T17:46:54.301047+0000) 2019-12-08T17:47:03.584 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:47:03.579+0000 1694f700 -1 osd.4 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.988130+0000 front 2019-12-08T17:46:10.610443+0000 (oldest deadline 2019-12-08T17:46:54.544300+0000) 2019-12-08T17:47:03.608 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:47:03.603+0000 1694f700 -1 osd.5 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:10.244849+0000 front 2019-12-08T17:46:11.947493+0000 (oldest deadline 2019-12-08T17:46:54.886767+0000) 2019-12-08T17:47:03.697 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:47:03.692+0000 1694f700 -1 osd.6 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:07.255992+0000 front 2019-12-08T17:46:07.250579+0000 (oldest deadline 2019-12-08T17:46:53.102014+0000) 2019-12-08T17:47:03.725 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:47:03.723+0000 1694f700 -1 osd.1 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.715054+0000 front 2019-12-08T17:46:10.481371+0000 (oldest deadline 2019-12-08T17:46:52.463941+0000) 2019-12-08T17:47:03.826 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:47:03.821+0000 1694f700 -1 osd.7 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:12.035622+0000 front 2019-12-08T17:46:10.994113+0000 (oldest deadline 2019-12-08T17:46:56.243102+0000) 2019-12-08T17:47:03.996 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:47:03.993+0000 1694f700 -1 osd.3 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.201965+0000 front 2019-12-08T17:46:09.116781+0000 (oldest deadline 2019-12-08T17:46:54.911707+0000) 2019-12-08T17:47:04.558 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:47:04.553+0000 1694f700 -1 osd.4 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.988130+0000 front 2019-12-08T17:46:10.610443+0000 (oldest deadline 2019-12-08T17:46:54.544300+0000) 2019-12-08T17:47:04.581 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:47:04.576+0000 1694f700 -1 osd.5 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:10.244849+0000 front 2019-12-08T17:46:11.947493+0000 (oldest deadline 2019-12-08T17:46:54.886767+0000) 2019-12-08T17:47:04.596 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:47:04.595+0000 1694f700 -1 osd.0 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:10.612745+0000 front 2019-12-08T17:46:10.007340+0000 (oldest deadline 2019-12-08T17:46:54.301047+0000) 2019-12-08T17:47:04.662 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:47:04.657+0000 1694f700 -1 osd.6 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:07.255992+0000 front 2019-12-08T17:46:07.250579+0000 (oldest deadline 2019-12-08T17:46:53.102014+0000) 2019-12-08T17:47:04.771 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:47:04.768+0000 1694f700 -1 osd.1 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.715054+0000 front 2019-12-08T17:46:10.481371+0000 (oldest deadline 2019-12-08T17:46:52.463941+0000) 2019-12-08T17:47:04.802 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:47:04.796+0000 1694f700 -1 osd.7 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:12.035622+0000 front 2019-12-08T17:46:10.994113+0000 (oldest deadline 2019-12-08T17:46:56.243102+0000) 2019-12-08T17:47:05.027 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:47:05.025+0000 1694f700 -1 osd.3 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.201965+0000 front 2019-12-08T17:46:09.116781+0000 (oldest deadline 2019-12-08T17:46:54.911707+0000) 2019-12-08T17:47:05.554 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:47:05.548+0000 1694f700 -1 osd.5 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:10.244849+0000 front 2019-12-08T17:46:11.947493+0000 (oldest deadline 2019-12-08T17:46:54.886767+0000) 2019-12-08T17:47:05.610 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:47:05.598+0000 1694f700 -1 osd.4 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.988130+0000 front 2019-12-08T17:46:10.610443+0000 (oldest deadline 2019-12-08T17:46:54.544300+0000) 2019-12-08T17:47:05.621 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:47:05.616+0000 1694f700 -1 osd.0 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:10.612745+0000 front 2019-12-08T17:46:10.007340+0000 (oldest deadline 2019-12-08T17:46:54.301047+0000) 2019-12-08T17:47:05.667 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:47:05.662+0000 1694f700 -1 osd.6 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:07.255992+0000 front 2019-12-08T17:46:07.250579+0000 (oldest deadline 2019-12-08T17:46:53.102014+0000) 2019-12-08T17:47:05.801 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:47:05.796+0000 1694f700 -1 osd.7 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:12.035622+0000 front 2019-12-08T17:46:10.994113+0000 (oldest deadline 2019-12-08T17:46:56.243102+0000) 2019-12-08T17:47:05.821 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:47:05.817+0000 1694f700 -1 osd.1 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.715054+0000 front 2019-12-08T17:46:10.481371+0000 (oldest deadline 2019-12-08T17:46:52.463941+0000) 2019-12-08T17:47:05.991 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:47:05.989+0000 1694f700 -1 osd.3 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.201965+0000 front 2019-12-08T17:46:09.116781+0000 (oldest deadline 2019-12-08T17:46:54.911707+0000) 2019-12-08T17:47:06.575 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:47:06.573+0000 1694f700 -1 osd.0 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:10.612745+0000 front 2019-12-08T17:46:10.007340+0000 (oldest deadline 2019-12-08T17:46:54.301047+0000) 2019-12-08T17:47:06.583 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:47:06.578+0000 1694f700 -1 osd.5 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:10.244849+0000 front 2019-12-08T17:46:11.947493+0000 (oldest deadline 2019-12-08T17:46:54.886767+0000) 2019-12-08T17:47:06.620 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:47:06.615+0000 1694f700 -1 osd.4 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.988130+0000 front 2019-12-08T17:46:10.610443+0000 (oldest deadline 2019-12-08T17:46:54.544300+0000) 2019-12-08T17:47:06.688 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:47:06.683+0000 1694f700 -1 osd.6 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:07.255992+0000 front 2019-12-08T17:46:07.250579+0000 (oldest deadline 2019-12-08T17:46:53.102014+0000) 2019-12-08T17:47:06.759 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:47:06.753+0000 1694f700 -1 osd.7 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:12.035622+0000 front 2019-12-08T17:46:10.994113+0000 (oldest deadline 2019-12-08T17:46:56.243102+0000) 2019-12-08T17:47:06.856 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:47:06.853+0000 1694f700 -1 osd.1 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.715054+0000 front 2019-12-08T17:46:10.481371+0000 (oldest deadline 2019-12-08T17:46:52.463941+0000) 2019-12-08T17:47:07.024 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:47:07.021+0000 1694f700 -1 osd.3 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.201965+0000 front 2019-12-08T17:46:09.116781+0000 (oldest deadline 2019-12-08T17:46:54.911707+0000) 2019-12-08T17:47:07.616 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:47:07.614+0000 1694f700 -1 osd.0 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:10.612745+0000 front 2019-12-08T17:46:10.007340+0000 (oldest deadline 2019-12-08T17:46:54.301047+0000) 2019-12-08T17:47:07.625 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:47:07.620+0000 1694f700 -1 osd.5 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:10.244849+0000 front 2019-12-08T17:46:11.947493+0000 (oldest deadline 2019-12-08T17:46:54.886767+0000) 2019-12-08T17:47:07.662 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:47:07.657+0000 1694f700 -1 osd.6 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:07.255992+0000 front 2019-12-08T17:46:07.250579+0000 (oldest deadline 2019-12-08T17:46:53.102014+0000) 2019-12-08T17:47:07.664 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:47:07.659+0000 1694f700 -1 osd.4 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.988130+0000 front 2019-12-08T17:46:10.610443+0000 (oldest deadline 2019-12-08T17:46:54.544300+0000) 2019-12-08T17:47:07.755 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:47:07.751+0000 1694f700 -1 osd.7 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:12.035622+0000 front 2019-12-08T17:46:10.994113+0000 (oldest deadline 2019-12-08T17:46:56.243102+0000) 2019-12-08T17:47:07.845 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:47:07.842+0000 1694f700 -1 osd.1 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.715054+0000 front 2019-12-08T17:46:10.481371+0000 (oldest deadline 2019-12-08T17:46:52.463941+0000) 2019-12-08T17:47:08.033 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:47:08.030+0000 1694f700 -1 osd.3 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.201965+0000 front 2019-12-08T17:46:09.116781+0000 (oldest deadline 2019-12-08T17:46:54.911707+0000) 2019-12-08T17:47:08.622 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:47:08.617+0000 1694f700 -1 osd.4 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.988130+0000 front 2019-12-08T17:46:10.610443+0000 (oldest deadline 2019-12-08T17:46:54.544300+0000) 2019-12-08T17:47:08.655 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:47:08.654+0000 1694f700 -1 osd.0 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:10.612745+0000 front 2019-12-08T17:46:10.007340+0000 (oldest deadline 2019-12-08T17:46:54.301047+0000) 2019-12-08T17:47:08.663 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:47:08.659+0000 1694f700 -1 osd.5 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:10.244849+0000 front 2019-12-08T17:46:11.947493+0000 (oldest deadline 2019-12-08T17:46:54.886767+0000) 2019-12-08T17:47:08.706 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:47:08.700+0000 1694f700 -1 osd.6 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:07.255992+0000 front 2019-12-08T17:46:07.250579+0000 (oldest deadline 2019-12-08T17:46:53.102014+0000) 2019-12-08T17:47:08.792 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:47:08.787+0000 1694f700 -1 osd.7 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:12.035622+0000 front 2019-12-08T17:46:10.994113+0000 (oldest deadline 2019-12-08T17:46:56.243102+0000) 2019-12-08T17:47:08.807 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:47:08.806+0000 1694f700 -1 osd.1 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.715054+0000 front 2019-12-08T17:46:10.481371+0000 (oldest deadline 2019-12-08T17:46:52.463941+0000) 2019-12-08T17:47:09.063 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:47:09.060+0000 1694f700 -1 osd.3 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.201965+0000 front 2019-12-08T17:46:09.116781+0000 (oldest deadline 2019-12-08T17:46:54.911707+0000) 2019-12-08T17:47:09.607 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:47:09.602+0000 1694f700 -1 osd.4 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.988130+0000 front 2019-12-08T17:46:10.610443+0000 (oldest deadline 2019-12-08T17:46:54.544300+0000) 2019-12-08T17:47:10.472 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:47:09.627+0000 1694f700 -1 osd.0 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:10.612745+0000 front 2019-12-08T17:46:10.007340+0000 (oldest deadline 2019-12-08T17:46:54.301047+0000) 2019-12-08T17:47:10.472 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:47:09.768+0000 1694f700 -1 osd.1 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.715054+0000 front 2019-12-08T17:46:10.481371+0000 (oldest deadline 2019-12-08T17:46:52.463941+0000) 2019-12-08T17:47:10.472 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:47:10.115+0000 1694f700 -1 osd.3 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.201965+0000 front 2019-12-08T17:46:09.116781+0000 (oldest deadline 2019-12-08T17:46:54.911707+0000) 2019-12-08T17:47:10.472 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:47:09.666+0000 1694f700 -1 osd.5 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:10.244849+0000 front 2019-12-08T17:46:11.947493+0000 (oldest deadline 2019-12-08T17:46:54.886767+0000) 2019-12-08T17:47:10.473 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:47:09.745+0000 1694f700 -1 osd.6 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:07.255992+0000 front 2019-12-08T17:46:07.250579+0000 (oldest deadline 2019-12-08T17:46:53.102014+0000) 2019-12-08T17:47:10.473 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:47:09.789+0000 1694f700 -1 osd.7 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:12.035622+0000 front 2019-12-08T17:46:10.994113+0000 (oldest deadline 2019-12-08T17:46:56.243102+0000) 2019-12-08T17:47:10.600 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:47:10.595+0000 1694f700 -1 osd.4 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.988130+0000 front 2019-12-08T17:46:10.610443+0000 (oldest deadline 2019-12-08T17:46:54.544300+0000) 2019-12-08T17:47:10.629 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:47:10.627+0000 1694f700 -1 osd.0 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:10.612745+0000 front 2019-12-08T17:46:10.007340+0000 (oldest deadline 2019-12-08T17:46:54.301047+0000) 2019-12-08T17:47:10.706 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:47:10.700+0000 1694f700 -1 osd.5 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:10.244849+0000 front 2019-12-08T17:46:11.947493+0000 (oldest deadline 2019-12-08T17:46:54.886767+0000) 2019-12-08T17:47:10.734 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:47:10.729+0000 1694f700 -1 osd.6 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:07.255992+0000 front 2019-12-08T17:46:07.250579+0000 (oldest deadline 2019-12-08T17:46:53.102014+0000) 2019-12-08T17:47:10.781 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:47:10.776+0000 1694f700 -1 osd.7 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:12.035622+0000 front 2019-12-08T17:46:10.994113+0000 (oldest deadline 2019-12-08T17:46:56.243102+0000) 2019-12-08T17:47:10.790 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:47:10.788+0000 1694f700 -1 osd.1 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.715054+0000 front 2019-12-08T17:46:10.481371+0000 (oldest deadline 2019-12-08T17:46:52.463941+0000) 2019-12-08T17:47:11.149 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:47:11.147+0000 1694f700 -1 osd.3 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.201965+0000 front 2019-12-08T17:46:09.116781+0000 (oldest deadline 2019-12-08T17:46:54.911707+0000) 2019-12-08T17:47:11.610 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:47:11.604+0000 1694f700 -1 osd.4 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.988130+0000 front 2019-12-08T17:46:10.610443+0000 (oldest deadline 2019-12-08T17:46:54.544300+0000) 2019-12-08T17:47:11.671 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:47:11.667+0000 1694f700 -1 osd.0 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:10.612745+0000 front 2019-12-08T17:46:10.007340+0000 (oldest deadline 2019-12-08T17:46:54.301047+0000) 2019-12-08T17:47:11.730 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:47:11.716+0000 1694f700 -1 osd.6 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:07.255992+0000 front 2019-12-08T17:46:07.250579+0000 (oldest deadline 2019-12-08T17:46:53.102014+0000) 2019-12-08T17:47:11.738 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:47:11.733+0000 1694f700 -1 osd.5 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:10.244849+0000 front 2019-12-08T17:46:11.947493+0000 (oldest deadline 2019-12-08T17:46:54.886767+0000) 2019-12-08T17:47:11.780 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:47:11.778+0000 1694f700 -1 osd.1 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.715054+0000 front 2019-12-08T17:46:10.481371+0000 (oldest deadline 2019-12-08T17:46:52.463941+0000) 2019-12-08T17:47:11.837 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:47:11.832+0000 1694f700 -1 osd.7 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:12.035622+0000 front 2019-12-08T17:46:10.994113+0000 (oldest deadline 2019-12-08T17:46:56.243102+0000) 2019-12-08T17:47:12.134 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:47:12.131+0000 1694f700 -1 osd.3 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.201965+0000 front 2019-12-08T17:46:09.116781+0000 (oldest deadline 2019-12-08T17:46:54.911707+0000) 2019-12-08T17:47:12.564 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:47:12.559+0000 1694f700 -1 osd.4 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.988130+0000 front 2019-12-08T17:46:10.610443+0000 (oldest deadline 2019-12-08T17:46:54.544300+0000) 2019-12-08T17:47:12.665 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:47:12.662+0000 1694f700 -1 osd.0 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:10.612745+0000 front 2019-12-08T17:46:10.007340+0000 (oldest deadline 2019-12-08T17:46:54.301047+0000) 2019-12-08T17:47:12.696 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:47:12.692+0000 1694f700 -1 osd.6 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:07.255992+0000 front 2019-12-08T17:46:07.250579+0000 (oldest deadline 2019-12-08T17:46:53.102014+0000) 2019-12-08T17:47:12.746 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:47:12.744+0000 1694f700 -1 osd.1 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.715054+0000 front 2019-12-08T17:46:10.481371+0000 (oldest deadline 2019-12-08T17:46:52.463941+0000) 2019-12-08T17:47:12.767 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:47:12.762+0000 1694f700 -1 osd.5 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:10.244849+0000 front 2019-12-08T17:46:11.947493+0000 (oldest deadline 2019-12-08T17:46:54.886767+0000) 2019-12-08T17:47:12.801 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:47:12.796+0000 1694f700 -1 osd.7 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:12.035622+0000 front 2019-12-08T17:46:10.994113+0000 (oldest deadline 2019-12-08T17:46:56.243102+0000) 2019-12-08T17:47:13.145 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:47:13.142+0000 1694f700 -1 osd.3 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.201965+0000 front 2019-12-08T17:46:09.116781+0000 (oldest deadline 2019-12-08T17:46:54.911707+0000) 2019-12-08T17:47:13.520 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:47:13.516+0000 1694f700 -1 osd.4 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.988130+0000 front 2019-12-08T17:46:10.610443+0000 (oldest deadline 2019-12-08T17:46:54.544300+0000) 2019-12-08T17:47:13.674 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:47:13.671+0000 1694f700 -1 osd.0 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:10.612745+0000 front 2019-12-08T17:46:10.007340+0000 (oldest deadline 2019-12-08T17:46:54.301047+0000) 2019-12-08T17:47:13.732 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:47:13.726+0000 1694f700 -1 osd.6 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:07.255992+0000 front 2019-12-08T17:46:07.250579+0000 (oldest deadline 2019-12-08T17:46:53.102014+0000) 2019-12-08T17:47:13.751 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:47:13.748+0000 1694f700 -1 osd.1 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.715054+0000 front 2019-12-08T17:46:10.481371+0000 (oldest deadline 2019-12-08T17:46:52.463941+0000) 2019-12-08T17:47:13.783 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:47:13.779+0000 1694f700 -1 osd.7 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:12.035622+0000 front 2019-12-08T17:46:10.994113+0000 (oldest deadline 2019-12-08T17:46:56.243102+0000) 2019-12-08T17:47:13.821 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:47:13.816+0000 1694f700 -1 osd.5 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:10.244849+0000 front 2019-12-08T17:46:11.947493+0000 (oldest deadline 2019-12-08T17:46:54.886767+0000) 2019-12-08T17:47:14.179 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:47:14.177+0000 1694f700 -1 osd.3 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.201965+0000 front 2019-12-08T17:46:09.116781+0000 (oldest deadline 2019-12-08T17:46:54.911707+0000) 2019-12-08T17:47:14.482 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:47:14.477+0000 1694f700 -1 osd.4 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.988130+0000 front 2019-12-08T17:46:10.610443+0000 (oldest deadline 2019-12-08T17:46:54.544300+0000) 2019-12-08T17:47:14.702 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:47:14.697+0000 1694f700 -1 osd.6 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:07.255992+0000 front 2019-12-08T17:46:07.250579+0000 (oldest deadline 2019-12-08T17:46:53.102014+0000) 2019-12-08T17:47:14.718 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:47:14.716+0000 1694f700 -1 osd.0 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:10.612745+0000 front 2019-12-08T17:46:10.007340+0000 (oldest deadline 2019-12-08T17:46:54.301047+0000) 2019-12-08T17:47:14.753 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:47:14.750+0000 1694f700 -1 osd.1 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.715054+0000 front 2019-12-08T17:46:10.481371+0000 (oldest deadline 2019-12-08T17:46:52.463941+0000) 2019-12-08T17:47:14.806 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:47:14.801+0000 1694f700 -1 osd.7 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:12.035622+0000 front 2019-12-08T17:46:10.994113+0000 (oldest deadline 2019-12-08T17:46:56.243102+0000) 2019-12-08T17:47:14.840 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:47:14.834+0000 1694f700 -1 osd.5 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:10.244849+0000 front 2019-12-08T17:46:11.947493+0000 (oldest deadline 2019-12-08T17:46:54.886767+0000) 2019-12-08T17:47:15.160 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:47:15.159+0000 1694f700 -1 osd.3 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.201965+0000 front 2019-12-08T17:46:09.116781+0000 (oldest deadline 2019-12-08T17:46:54.911707+0000) 2019-12-08T17:47:15.439 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:47:15.434+0000 1694f700 -1 osd.4 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.988130+0000 front 2019-12-08T17:46:10.610443+0000 (oldest deadline 2019-12-08T17:46:54.544300+0000) 2019-12-08T17:47:15.728 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:47:15.723+0000 1694f700 -1 osd.6 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:07.255992+0000 front 2019-12-08T17:46:07.250579+0000 (oldest deadline 2019-12-08T17:46:53.102014+0000) 2019-12-08T17:47:15.752 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:47:15.748+0000 1694f700 -1 osd.0 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:10.612745+0000 front 2019-12-08T17:46:10.007340+0000 (oldest deadline 2019-12-08T17:46:54.301047+0000) 2019-12-08T17:47:15.806 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:47:15.803+0000 1694f700 -1 osd.1 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.715054+0000 front 2019-12-08T17:46:10.481371+0000 (oldest deadline 2019-12-08T17:46:52.463941+0000) 2019-12-08T17:47:15.810 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:47:15.805+0000 1694f700 -1 osd.7 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:12.035622+0000 front 2019-12-08T17:46:10.994113+0000 (oldest deadline 2019-12-08T17:46:56.243102+0000) 2019-12-08T17:47:15.815 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:47:15.811+0000 1694f700 -1 osd.5 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:10.244849+0000 front 2019-12-08T17:46:11.947493+0000 (oldest deadline 2019-12-08T17:46:54.886767+0000) 2019-12-08T17:47:16.184 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:47:16.181+0000 1694f700 -1 osd.3 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.201965+0000 front 2019-12-08T17:46:09.116781+0000 (oldest deadline 2019-12-08T17:46:54.911707+0000) 2019-12-08T17:47:16.437 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:47:16.431+0000 1694f700 -1 osd.4 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.988130+0000 front 2019-12-08T17:46:10.610443+0000 (oldest deadline 2019-12-08T17:46:54.544300+0000) 2019-12-08T17:47:16.711 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:47:16.709+0000 1694f700 -1 osd.0 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:10.612745+0000 front 2019-12-08T17:46:10.007340+0000 (oldest deadline 2019-12-08T17:46:54.301047+0000) 2019-12-08T17:47:16.745 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:47:16.739+0000 1694f700 -1 osd.6 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:07.255992+0000 front 2019-12-08T17:46:07.250579+0000 (oldest deadline 2019-12-08T17:46:53.102014+0000) 2019-12-08T17:47:16.811 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:47:16.808+0000 1694f700 -1 osd.1 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.715054+0000 front 2019-12-08T17:46:10.481371+0000 (oldest deadline 2019-12-08T17:46:52.463941+0000) 2019-12-08T17:47:16.848 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:47:16.842+0000 1694f700 -1 osd.5 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:10.244849+0000 front 2019-12-08T17:46:11.947493+0000 (oldest deadline 2019-12-08T17:46:54.886767+0000) 2019-12-08T17:47:16.860 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:47:16.854+0000 1694f700 -1 osd.7 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:12.035622+0000 front 2019-12-08T17:46:10.994113+0000 (oldest deadline 2019-12-08T17:46:56.243102+0000) 2019-12-08T17:47:17.188 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:47:17.187+0000 1694f700 -1 osd.3 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.201965+0000 front 2019-12-08T17:46:09.116781+0000 (oldest deadline 2019-12-08T17:46:54.911707+0000) 2019-12-08T17:47:17.399 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:47:17.394+0000 1694f700 -1 osd.4 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.988130+0000 front 2019-12-08T17:46:10.610443+0000 (oldest deadline 2019-12-08T17:46:54.544300+0000) 2019-12-08T17:47:17.721 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:47:17.714+0000 1694f700 -1 osd.6 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:07.255992+0000 front 2019-12-08T17:46:07.250579+0000 (oldest deadline 2019-12-08T17:46:53.102014+0000) 2019-12-08T17:47:17.760 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:47:17.757+0000 1694f700 -1 osd.0 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:10.612745+0000 front 2019-12-08T17:46:10.007340+0000 (oldest deadline 2019-12-08T17:46:54.301047+0000) 2019-12-08T17:47:17.786 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:47:17.783+0000 1694f700 -1 osd.1 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.715054+0000 front 2019-12-08T17:46:10.481371+0000 (oldest deadline 2019-12-08T17:46:52.463941+0000) 2019-12-08T17:47:17.839 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:47:17.832+0000 1694f700 -1 osd.7 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:12.035622+0000 front 2019-12-08T17:46:10.994113+0000 (oldest deadline 2019-12-08T17:46:56.243102+0000) 2019-12-08T17:47:17.877 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:47:17.862+0000 1694f700 -1 osd.5 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:10.244849+0000 front 2019-12-08T17:46:11.947493+0000 (oldest deadline 2019-12-08T17:46:54.886767+0000) 2019-12-08T17:47:18.217 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:47:18.215+0000 1694f700 -1 osd.3 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.201965+0000 front 2019-12-08T17:46:09.116781+0000 (oldest deadline 2019-12-08T17:46:54.911707+0000) 2019-12-08T17:47:18.454 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:47:18.449+0000 1694f700 -1 osd.4 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.988130+0000 front 2019-12-08T17:46:10.610443+0000 (oldest deadline 2019-12-08T17:46:54.544300+0000) 2019-12-08T17:47:18.739 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:47:18.732+0000 1694f700 -1 osd.6 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:07.255992+0000 front 2019-12-08T17:46:07.250579+0000 (oldest deadline 2019-12-08T17:46:53.102014+0000) 2019-12-08T17:47:18.778 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:47:18.775+0000 1694f700 -1 osd.1 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.715054+0000 front 2019-12-08T17:46:10.481371+0000 (oldest deadline 2019-12-08T17:46:52.463941+0000) 2019-12-08T17:47:18.799 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:47:18.793+0000 1694f700 -1 osd.7 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:12.035622+0000 front 2019-12-08T17:46:10.994113+0000 (oldest deadline 2019-12-08T17:46:56.243102+0000) 2019-12-08T17:47:18.808 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:47:18.807+0000 1694f700 -1 osd.0 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:10.612745+0000 front 2019-12-08T17:46:10.007340+0000 (oldest deadline 2019-12-08T17:46:54.301047+0000) 2019-12-08T17:47:18.900 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:47:18.895+0000 1694f700 -1 osd.5 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:10.244849+0000 front 2019-12-08T17:46:11.947493+0000 (oldest deadline 2019-12-08T17:46:54.886767+0000) 2019-12-08T17:47:19.215 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:47:19.213+0000 1694f700 -1 osd.3 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.201965+0000 front 2019-12-08T17:46:09.116781+0000 (oldest deadline 2019-12-08T17:46:54.911707+0000) 2019-12-08T17:47:19.461 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:47:19.455+0000 1694f700 -1 osd.4 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.988130+0000 front 2019-12-08T17:46:10.610443+0000 (oldest deadline 2019-12-08T17:46:54.544300+0000) 2019-12-08T17:47:19.743 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:47:19.737+0000 1694f700 -1 osd.6 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:07.255992+0000 front 2019-12-08T17:46:07.250579+0000 (oldest deadline 2019-12-08T17:46:53.102014+0000) 2019-12-08T17:47:19.824 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:47:19.822+0000 1694f700 -1 osd.1 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.715054+0000 front 2019-12-08T17:46:10.481371+0000 (oldest deadline 2019-12-08T17:46:52.463941+0000) 2019-12-08T17:47:19.831 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:47:19.825+0000 1694f700 -1 osd.0 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:10.612745+0000 front 2019-12-08T17:46:10.007340+0000 (oldest deadline 2019-12-08T17:46:54.301047+0000) 2019-12-08T17:47:19.851 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:47:19.844+0000 1694f700 -1 osd.7 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:12.035622+0000 front 2019-12-08T17:46:10.994113+0000 (oldest deadline 2019-12-08T17:46:56.243102+0000) 2019-12-08T17:47:19.880 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:47:19.875+0000 1694f700 -1 osd.5 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:10.244849+0000 front 2019-12-08T17:46:11.947493+0000 (oldest deadline 2019-12-08T17:46:54.886767+0000) 2019-12-08T17:47:20.256 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:47:20.253+0000 1694f700 -1 osd.3 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.201965+0000 front 2019-12-08T17:46:09.116781+0000 (oldest deadline 2019-12-08T17:46:54.911707+0000) 2019-12-08T17:47:20.453 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:47:20.447+0000 1694f700 -1 osd.4 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.988130+0000 front 2019-12-08T17:46:10.610443+0000 (oldest deadline 2019-12-08T17:46:54.544300+0000) 2019-12-08T17:47:20.770 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:47:20.764+0000 1694f700 -1 osd.6 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:07.255992+0000 front 2019-12-08T17:46:07.250579+0000 (oldest deadline 2019-12-08T17:46:53.102014+0000) 2019-12-08T17:47:20.829 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:47:20.826+0000 1694f700 -1 osd.0 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:10.612745+0000 front 2019-12-08T17:46:10.007340+0000 (oldest deadline 2019-12-08T17:46:54.301047+0000) 2019-12-08T17:47:20.853 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:47:20.847+0000 1694f700 -1 osd.5 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:10.244849+0000 front 2019-12-08T17:46:11.947493+0000 (oldest deadline 2019-12-08T17:46:54.886767+0000) 2019-12-08T17:47:20.855 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:47:20.852+0000 1694f700 -1 osd.1 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.715054+0000 front 2019-12-08T17:46:10.481371+0000 (oldest deadline 2019-12-08T17:46:52.463941+0000) 2019-12-08T17:47:20.855 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:47:20.847+0000 1694f700 -1 osd.7 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:12.035622+0000 front 2019-12-08T17:46:10.994113+0000 (oldest deadline 2019-12-08T17:46:56.243102+0000) 2019-12-08T17:47:21.246 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:47:21.244+0000 1694f700 -1 osd.3 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.201965+0000 front 2019-12-08T17:46:09.116781+0000 (oldest deadline 2019-12-08T17:46:54.911707+0000) 2019-12-08T17:47:21.461 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:47:21.455+0000 1694f700 -1 osd.4 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.988130+0000 front 2019-12-08T17:46:10.610443+0000 (oldest deadline 2019-12-08T17:46:54.544300+0000) 2019-12-08T17:47:21.772 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:47:21.766+0000 1694f700 -1 osd.6 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:07.255992+0000 front 2019-12-08T17:46:07.250579+0000 (oldest deadline 2019-12-08T17:46:53.102014+0000) 2019-12-08T17:47:21.787 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:47:21.784+0000 1694f700 -1 osd.0 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:10.612745+0000 front 2019-12-08T17:46:10.007340+0000 (oldest deadline 2019-12-08T17:46:54.301047+0000) 2019-12-08T17:47:21.818 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:47:21.815+0000 1694f700 -1 osd.1 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.715054+0000 front 2019-12-08T17:46:10.481371+0000 (oldest deadline 2019-12-08T17:46:52.463941+0000) 2019-12-08T17:47:21.836 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:47:21.830+0000 1694f700 -1 osd.7 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:12.035622+0000 front 2019-12-08T17:46:10.994113+0000 (oldest deadline 2019-12-08T17:46:56.243102+0000) 2019-12-08T17:47:21.843 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:47:21.837+0000 1694f700 -1 osd.5 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:10.244849+0000 front 2019-12-08T17:46:11.947493+0000 (oldest deadline 2019-12-08T17:46:54.886767+0000) 2019-12-08T17:47:22.255 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:47:22.254+0000 1694f700 -1 osd.3 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.201965+0000 front 2019-12-08T17:46:09.116781+0000 (oldest deadline 2019-12-08T17:46:54.911707+0000) 2019-12-08T17:47:22.426 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:47:22.420+0000 1694f700 -1 osd.4 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.988130+0000 front 2019-12-08T17:46:10.610443+0000 (oldest deadline 2019-12-08T17:46:54.544300+0000) 2019-12-08T17:47:22.751 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:47:22.745+0000 1694f700 -1 osd.6 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:07.255992+0000 front 2019-12-08T17:46:07.250579+0000 (oldest deadline 2019-12-08T17:46:53.102014+0000) 2019-12-08T17:47:22.761 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:47:22.750+0000 1694f700 -1 osd.0 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:10.612745+0000 front 2019-12-08T17:46:10.007340+0000 (oldest deadline 2019-12-08T17:46:54.301047+0000) 2019-12-08T17:47:22.855 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:47:22.848+0000 1694f700 -1 osd.7 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:12.035622+0000 front 2019-12-08T17:46:10.994113+0000 (oldest deadline 2019-12-08T17:46:56.243102+0000) 2019-12-08T17:47:22.866 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:47:22.864+0000 1694f700 -1 osd.1 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.715054+0000 front 2019-12-08T17:46:10.481371+0000 (oldest deadline 2019-12-08T17:46:52.463941+0000) 2019-12-08T17:47:22.872 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:47:22.866+0000 1694f700 -1 osd.5 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:10.244849+0000 front 2019-12-08T17:46:11.947493+0000 (oldest deadline 2019-12-08T17:46:54.886767+0000) 2019-12-08T17:47:23.226 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:47:23.225+0000 1694f700 -1 osd.3 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.201965+0000 front 2019-12-08T17:46:09.116781+0000 (oldest deadline 2019-12-08T17:46:54.911707+0000) 2019-12-08T17:47:23.391 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:47:23.385+0000 1694f700 -1 osd.4 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.988130+0000 front 2019-12-08T17:46:10.610443+0000 (oldest deadline 2019-12-08T17:46:54.544300+0000) 2019-12-08T17:47:23.795 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:47:23.790+0000 1694f700 -1 osd.6 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:07.255992+0000 front 2019-12-08T17:46:07.250579+0000 (oldest deadline 2019-12-08T17:46:53.102014+0000) 2019-12-08T17:47:23.808 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:47:23.806+0000 1694f700 -1 osd.0 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:10.612745+0000 front 2019-12-08T17:46:10.007340+0000 (oldest deadline 2019-12-08T17:46:54.301047+0000) 2019-12-08T17:47:23.822 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:47:23.821+0000 1694f700 -1 osd.1 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.715054+0000 front 2019-12-08T17:46:10.481371+0000 (oldest deadline 2019-12-08T17:46:52.463941+0000) 2019-12-08T17:47:23.875 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:47:23.869+0000 1694f700 -1 osd.7 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:12.035622+0000 front 2019-12-08T17:46:10.994113+0000 (oldest deadline 2019-12-08T17:46:56.243102+0000) 2019-12-08T17:47:23.902 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:47:23.895+0000 1694f700 -1 osd.5 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:10.244849+0000 front 2019-12-08T17:46:11.947493+0000 (oldest deadline 2019-12-08T17:46:54.886767+0000) 2019-12-08T17:47:24.248 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:47:24.246+0000 1694f700 -1 osd.3 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.201965+0000 front 2019-12-08T17:46:09.116781+0000 (oldest deadline 2019-12-08T17:46:54.911707+0000) 2019-12-08T17:47:24.361 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:47:24.355+0000 1694f700 -1 osd.4 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.988130+0000 front 2019-12-08T17:46:10.610443+0000 (oldest deadline 2019-12-08T17:46:54.544300+0000) 2019-12-08T17:47:24.805 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:47:24.800+0000 1694f700 -1 osd.6 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:07.255992+0000 front 2019-12-08T17:46:07.250579+0000 (oldest deadline 2019-12-08T17:46:53.102014+0000) 2019-12-08T17:47:24.847 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:47:24.845+0000 1694f700 -1 osd.0 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:10.612745+0000 front 2019-12-08T17:46:10.007340+0000 (oldest deadline 2019-12-08T17:46:54.301047+0000) 2019-12-08T17:47:24.852 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:47:24.851+0000 1694f700 -1 osd.1 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.715054+0000 front 2019-12-08T17:46:10.481371+0000 (oldest deadline 2019-12-08T17:46:52.463941+0000) 2019-12-08T17:47:24.921 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:47:24.914+0000 1694f700 -1 osd.7 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:12.035622+0000 front 2019-12-08T17:46:10.994113+0000 (oldest deadline 2019-12-08T17:46:56.243102+0000) 2019-12-08T17:47:24.929 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:47:24.924+0000 1694f700 -1 osd.5 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:10.244849+0000 front 2019-12-08T17:46:11.947493+0000 (oldest deadline 2019-12-08T17:46:54.886767+0000) 2019-12-08T17:47:25.286 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:47:25.286+0000 1694f700 -1 osd.3 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.201965+0000 front 2019-12-08T17:46:09.116781+0000 (oldest deadline 2019-12-08T17:46:54.911707+0000) 2019-12-08T17:47:25.413 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:47:25.405+0000 1694f700 -1 osd.4 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.988130+0000 front 2019-12-08T17:46:10.610443+0000 (oldest deadline 2019-12-08T17:46:54.544300+0000) 2019-12-08T17:47:25.769 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:47:25.762+0000 1694f700 -1 osd.6 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:07.255992+0000 front 2019-12-08T17:46:07.250579+0000 (oldest deadline 2019-12-08T17:46:53.102014+0000) 2019-12-08T17:47:25.809 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:47:25.808+0000 1694f700 -1 osd.1 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.715054+0000 front 2019-12-08T17:46:10.481371+0000 (oldest deadline 2019-12-08T17:46:52.463941+0000) 2019-12-08T17:47:25.881 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:47:25.870+0000 1694f700 -1 osd.7 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:12.035622+0000 front 2019-12-08T17:46:10.994113+0000 (oldest deadline 2019-12-08T17:46:56.243102+0000) 2019-12-08T17:47:25.894 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:47:25.892+0000 1694f700 -1 osd.0 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:10.612745+0000 front 2019-12-08T17:46:10.007340+0000 (oldest deadline 2019-12-08T17:46:54.301047+0000) 2019-12-08T17:47:25.923 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:47:25.917+0000 1694f700 -1 osd.5 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:10.244849+0000 front 2019-12-08T17:46:11.947493+0000 (oldest deadline 2019-12-08T17:46:54.886767+0000) 2019-12-08T17:47:26.274 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:47:26.273+0000 1694f700 -1 osd.3 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.201965+0000 front 2019-12-08T17:46:09.116781+0000 (oldest deadline 2019-12-08T17:46:54.911707+0000) 2019-12-08T17:47:26.385 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:47:26.379+0000 1694f700 -1 osd.4 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.988130+0000 front 2019-12-08T17:46:10.610443+0000 (oldest deadline 2019-12-08T17:46:54.544300+0000) 2019-12-08T17:47:26.754 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:47:26.748+0000 1694f700 -1 osd.6 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:07.255992+0000 front 2019-12-08T17:46:07.250579+0000 (oldest deadline 2019-12-08T17:46:53.102014+0000) 2019-12-08T17:47:26.839 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:47:26.837+0000 1694f700 -1 osd.1 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.715054+0000 front 2019-12-08T17:46:10.481371+0000 (oldest deadline 2019-12-08T17:46:52.463941+0000) 2019-12-08T17:47:26.882 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:47:26.881+0000 1694f700 -1 osd.0 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:10.612745+0000 front 2019-12-08T17:46:10.007340+0000 (oldest deadline 2019-12-08T17:46:54.301047+0000) 2019-12-08T17:47:26.896 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:47:26.891+0000 1694f700 -1 osd.7 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:12.035622+0000 front 2019-12-08T17:46:10.994113+0000 (oldest deadline 2019-12-08T17:46:56.243102+0000) 2019-12-08T17:47:26.970 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:47:26.965+0000 1694f700 -1 osd.5 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:10.244849+0000 front 2019-12-08T17:46:11.947493+0000 (oldest deadline 2019-12-08T17:46:54.886767+0000) 2019-12-08T17:47:27.243 INFO:tasks.ceph.mon.b.smithi013.stderr:2019-12-08T17:47:27.238+0000 1a89c700 -1 mon.b@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.2 [v2:172.21.15.79:6802/10448,v1:172.21.15.79:6803/10448] for 45sec e247 v247) 2019-12-08T17:47:27.294 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:47:27.293+0000 1694f700 -1 osd.3 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.201965+0000 front 2019-12-08T17:46:09.116781+0000 (oldest deadline 2019-12-08T17:46:54.911707+0000) 2019-12-08T17:47:27.437 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:47:27.430+0000 1694f700 -1 osd.4 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.988130+0000 front 2019-12-08T17:46:10.610443+0000 (oldest deadline 2019-12-08T17:46:54.544300+0000) 2019-12-08T17:47:27.719 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:47:27.714+0000 1694f700 -1 osd.6 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:07.255992+0000 front 2019-12-08T17:46:07.250579+0000 (oldest deadline 2019-12-08T17:46:53.102014+0000) 2019-12-08T17:47:27.857 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:47:27.856+0000 1694f700 -1 osd.1 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.715054+0000 front 2019-12-08T17:46:10.481371+0000 (oldest deadline 2019-12-08T17:46:52.463941+0000) 2019-12-08T17:47:27.882 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:47:27.880+0000 1694f700 -1 osd.0 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:10.612745+0000 front 2019-12-08T17:46:10.007340+0000 (oldest deadline 2019-12-08T17:46:54.301047+0000) 2019-12-08T17:47:27.893 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:47:27.887+0000 1694f700 -1 osd.7 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:12.035622+0000 front 2019-12-08T17:46:10.994113+0000 (oldest deadline 2019-12-08T17:46:56.243102+0000) 2019-12-08T17:47:27.983 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:47:27.977+0000 1694f700 -1 osd.5 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:10.244849+0000 front 2019-12-08T17:46:11.947493+0000 (oldest deadline 2019-12-08T17:46:54.886767+0000) 2019-12-08T17:47:28.252 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:47:28.250+0000 1694f700 -1 osd.3 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.201965+0000 front 2019-12-08T17:46:09.116781+0000 (oldest deadline 2019-12-08T17:46:54.911707+0000) 2019-12-08T17:47:28.415 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:47:28.408+0000 1694f700 -1 osd.4 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.988130+0000 front 2019-12-08T17:46:10.610443+0000 (oldest deadline 2019-12-08T17:46:54.544300+0000) 2019-12-08T17:47:28.716 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:47:28.710+0000 1694f700 -1 osd.6 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:07.255992+0000 front 2019-12-08T17:46:07.250579+0000 (oldest deadline 2019-12-08T17:46:53.102014+0000) 2019-12-08T17:47:28.856 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:47:28.854+0000 1694f700 -1 osd.0 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:10.612745+0000 front 2019-12-08T17:46:10.007340+0000 (oldest deadline 2019-12-08T17:46:54.301047+0000) 2019-12-08T17:47:28.864 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:47:28.858+0000 1694f700 -1 osd.7 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:12.035622+0000 front 2019-12-08T17:46:10.994113+0000 (oldest deadline 2019-12-08T17:46:56.243102+0000) 2019-12-08T17:47:28.908 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:47:28.906+0000 1694f700 -1 osd.1 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.715054+0000 front 2019-12-08T17:46:10.481371+0000 (oldest deadline 2019-12-08T17:46:52.463941+0000) 2019-12-08T17:47:28.998 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:47:28.991+0000 1694f700 -1 osd.5 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:10.244849+0000 front 2019-12-08T17:46:11.947493+0000 (oldest deadline 2019-12-08T17:46:54.886767+0000) 2019-12-08T17:47:29.208 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:47:29.207+0000 1694f700 -1 osd.3 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.201965+0000 front 2019-12-08T17:46:09.116781+0000 (oldest deadline 2019-12-08T17:46:54.911707+0000) 2019-12-08T17:47:29.453 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:47:29.447+0000 1694f700 -1 osd.4 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.988130+0000 front 2019-12-08T17:46:10.610443+0000 (oldest deadline 2019-12-08T17:46:54.544300+0000) 2019-12-08T17:47:29.771 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:47:29.764+0000 1694f700 -1 osd.6 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:07.255992+0000 front 2019-12-08T17:46:07.250579+0000 (oldest deadline 2019-12-08T17:46:53.102014+0000) 2019-12-08T17:47:29.818 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:47:29.817+0000 1694f700 -1 osd.0 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:10.612745+0000 front 2019-12-08T17:46:10.007340+0000 (oldest deadline 2019-12-08T17:46:54.301047+0000) 2019-12-08T17:47:29.820 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:47:29.814+0000 1694f700 -1 osd.7 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:12.035622+0000 front 2019-12-08T17:46:10.994113+0000 (oldest deadline 2019-12-08T17:46:56.243102+0000) 2019-12-08T17:47:29.905 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:47:29.903+0000 1694f700 -1 osd.1 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.715054+0000 front 2019-12-08T17:46:10.481371+0000 (oldest deadline 2019-12-08T17:46:52.463941+0000) 2019-12-08T17:47:30.001 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:47:29.994+0000 1694f700 -1 osd.5 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:10.244849+0000 front 2019-12-08T17:46:11.947493+0000 (oldest deadline 2019-12-08T17:46:54.886767+0000) 2019-12-08T17:47:30.218 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:47:30.216+0000 1694f700 -1 osd.3 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.201965+0000 front 2019-12-08T17:46:09.116781+0000 (oldest deadline 2019-12-08T17:46:54.911707+0000) 2019-12-08T17:47:30.437 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:47:30.432+0000 1694f700 -1 osd.4 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.988130+0000 front 2019-12-08T17:46:10.610443+0000 (oldest deadline 2019-12-08T17:46:54.544300+0000) 2019-12-08T17:47:30.792 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:47:30.785+0000 1694f700 -1 osd.6 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:07.255992+0000 front 2019-12-08T17:46:07.250579+0000 (oldest deadline 2019-12-08T17:46:53.102014+0000) 2019-12-08T17:47:30.815 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:47:30.814+0000 1694f700 -1 osd.0 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:10.612745+0000 front 2019-12-08T17:46:10.007340+0000 (oldest deadline 2019-12-08T17:46:54.301047+0000) 2019-12-08T17:47:30.818 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:47:30.811+0000 1694f700 -1 osd.7 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:12.035622+0000 front 2019-12-08T17:46:10.994113+0000 (oldest deadline 2019-12-08T17:46:56.243102+0000) 2019-12-08T17:47:30.935 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:47:30.933+0000 1694f700 -1 osd.1 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.715054+0000 front 2019-12-08T17:46:10.481371+0000 (oldest deadline 2019-12-08T17:46:52.463941+0000) 2019-12-08T17:47:31.018 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:47:31.013+0000 1694f700 -1 osd.5 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:10.244849+0000 front 2019-12-08T17:46:11.947493+0000 (oldest deadline 2019-12-08T17:46:54.886767+0000) 2019-12-08T17:47:31.195 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:47:31.194+0000 1694f700 -1 osd.3 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.201965+0000 front 2019-12-08T17:46:09.116781+0000 (oldest deadline 2019-12-08T17:46:54.911707+0000) 2019-12-08T17:47:31.428 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:47:31.421+0000 1694f700 -1 osd.4 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.988130+0000 front 2019-12-08T17:46:10.610443+0000 (oldest deadline 2019-12-08T17:46:54.544300+0000) 2019-12-08T17:47:31.798 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:47:31.792+0000 1694f700 -1 osd.7 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:12.035622+0000 front 2019-12-08T17:46:10.994113+0000 (oldest deadline 2019-12-08T17:46:56.243102+0000) 2019-12-08T17:47:31.808 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:47:31.806+0000 1694f700 -1 osd.0 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:10.612745+0000 front 2019-12-08T17:46:10.007340+0000 (oldest deadline 2019-12-08T17:46:54.301047+0000) 2019-12-08T17:47:31.831 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:47:31.825+0000 1694f700 -1 osd.6 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:07.255992+0000 front 2019-12-08T17:46:07.250579+0000 (oldest deadline 2019-12-08T17:46:53.102014+0000) 2019-12-08T17:47:31.905 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:47:31.904+0000 1694f700 -1 osd.1 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.715054+0000 front 2019-12-08T17:46:10.481371+0000 (oldest deadline 2019-12-08T17:46:52.463941+0000) 2019-12-08T17:47:32.034 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:47:32.028+0000 1694f700 -1 osd.5 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:10.244849+0000 front 2019-12-08T17:46:11.947493+0000 (oldest deadline 2019-12-08T17:46:54.886767+0000) 2019-12-08T17:47:32.247 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:47:32.246+0000 1694f700 -1 osd.3 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:09.201965+0000 front 2019-12-08T17:46:09.116781+0000 (oldest deadline 2019-12-08T17:46:54.911707+0000) 2019-12-08T17:47:32.335 INFO:tasks.ceph.mon.b.smithi013.stderr:2019-12-08T17:47:32.324+0000 1a89c700 -1 mon.b@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.2 [v2:172.21.15.79:6802/10448,v1:172.21.15.79:6803/10448] for 45sec e247 v247) 2019-12-08T17:47:32.842 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:47:32.837+0000 1694f700 -1 osd.7 247 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:46:12.035622+0000 front 2019-12-08T17:46:10.994113+0000 (oldest deadline 2019-12-08T17:46:56.243102+0000) 2019-12-08T17:48:30.927 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:48:30.920+0000 1694f700 -1 osd.0 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:47.350130+0000 front 2019-12-08T17:47:47.408539+0000 (oldest deadline 2019-12-08T17:48:30.195085+0000) 2019-12-08T17:48:31.419 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:48:31.414+0000 1694f700 -1 osd.7 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.476653+0000 front 2019-12-08T17:47:49.478271+0000 (oldest deadline 2019-12-08T17:48:30.418942+0000) 2019-12-08T17:48:31.913 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:48:31.911+0000 1694f700 -1 osd.0 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:47.350130+0000 front 2019-12-08T17:47:47.408539+0000 (oldest deadline 2019-12-08T17:48:30.195085+0000) 2019-12-08T17:48:32.468 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:48:32.463+0000 1694f700 -1 osd.7 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.476653+0000 front 2019-12-08T17:47:49.478271+0000 (oldest deadline 2019-12-08T17:48:30.418942+0000) 2019-12-08T17:48:32.555 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:48:32.553+0000 1694f700 -1 osd.2 253 get_health_metrics reporting 3 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e251) 2019-12-08T17:48:32.890 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:48:32.887+0000 1694f700 -1 osd.0 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:47.350130+0000 front 2019-12-08T17:47:47.408539+0000 (oldest deadline 2019-12-08T17:48:30.195085+0000) 2019-12-08T17:48:32.942 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:48:32.939+0000 1694f700 -1 osd.3 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.095169+0000 front 2019-12-08T17:47:49.087607+0000 (oldest deadline 2019-12-08T17:48:32.532709+0000) 2019-12-08T17:48:33.144 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:48:33.138+0000 1694f700 -1 osd.4 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:48.244074+0000 front 2019-12-08T17:47:48.242566+0000 (oldest deadline 2019-12-08T17:48:32.325899+0000) 2019-12-08T17:48:33.444 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:48:33.438+0000 1694f700 -1 osd.7 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.476653+0000 front 2019-12-08T17:47:49.478271+0000 (oldest deadline 2019-12-08T17:48:30.418942+0000) 2019-12-08T17:48:33.542 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:48:33.541+0000 1694f700 -1 osd.2 253 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e251) 2019-12-08T17:48:33.547 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:48:33.542+0000 1694f700 -1 osd.6 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.249287+0000 front 2019-12-08T17:47:49.138330+0000 (oldest deadline 2019-12-08T17:48:33.195944+0000) 2019-12-08T17:48:33.923 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:48:33.920+0000 1694f700 -1 osd.3 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.095169+0000 front 2019-12-08T17:47:49.087607+0000 (oldest deadline 2019-12-08T17:48:32.532709+0000) 2019-12-08T17:48:33.936 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:48:33.934+0000 1694f700 -1 osd.0 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:47.350130+0000 front 2019-12-08T17:47:47.408539+0000 (oldest deadline 2019-12-08T17:48:30.195085+0000) 2019-12-08T17:48:34.123 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:48:34.118+0000 1694f700 -1 osd.4 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:48.244074+0000 front 2019-12-08T17:47:48.242566+0000 (oldest deadline 2019-12-08T17:48:32.325899+0000) 2019-12-08T17:48:34.451 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:48:34.446+0000 1694f700 -1 osd.7 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.476653+0000 front 2019-12-08T17:47:49.478271+0000 (oldest deadline 2019-12-08T17:48:30.418942+0000) 2019-12-08T17:48:34.570 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:48:34.565+0000 1694f700 -1 osd.6 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.249287+0000 front 2019-12-08T17:47:49.138330+0000 (oldest deadline 2019-12-08T17:48:33.195944+0000) 2019-12-08T17:48:34.576 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:48:34.575+0000 1694f700 -1 osd.2 253 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e251) 2019-12-08T17:48:34.896 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:48:34.890+0000 1694f700 -1 osd.3 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.095169+0000 front 2019-12-08T17:47:49.087607+0000 (oldest deadline 2019-12-08T17:48:32.532709+0000) 2019-12-08T17:48:34.914 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:48:34.912+0000 1694f700 -1 osd.0 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:47.350130+0000 front 2019-12-08T17:47:47.408539+0000 (oldest deadline 2019-12-08T17:48:30.195085+0000) 2019-12-08T17:48:35.093 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:48:35.088+0000 1694f700 -1 osd.4 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:48.244074+0000 front 2019-12-08T17:47:48.242566+0000 (oldest deadline 2019-12-08T17:48:32.325899+0000) 2019-12-08T17:48:35.465 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:48:35.456+0000 1694f700 -1 osd.7 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.476653+0000 front 2019-12-08T17:47:49.478271+0000 (oldest deadline 2019-12-08T17:48:30.418942+0000) 2019-12-08T17:48:35.553 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:48:35.551+0000 1694f700 -1 osd.2 253 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e251) 2019-12-08T17:48:35.603 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:48:35.596+0000 1694f700 -1 osd.6 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.249287+0000 front 2019-12-08T17:47:49.138330+0000 (oldest deadline 2019-12-08T17:48:33.195944+0000) 2019-12-08T17:48:35.858 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:48:35.855+0000 1694f700 -1 osd.3 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.095169+0000 front 2019-12-08T17:47:49.087607+0000 (oldest deadline 2019-12-08T17:48:32.532709+0000) 2019-12-08T17:48:35.919 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:48:35.916+0000 1694f700 -1 osd.0 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:47.350130+0000 front 2019-12-08T17:47:47.408539+0000 (oldest deadline 2019-12-08T17:48:30.195085+0000) 2019-12-08T17:48:36.135 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:48:36.129+0000 1694f700 -1 osd.4 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:48.244074+0000 front 2019-12-08T17:47:48.242566+0000 (oldest deadline 2019-12-08T17:48:32.325899+0000) 2019-12-08T17:48:36.449 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:48:36.444+0000 1694f700 -1 osd.7 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.476653+0000 front 2019-12-08T17:47:49.478271+0000 (oldest deadline 2019-12-08T17:48:30.418942+0000) 2019-12-08T17:48:36.590 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:48:36.588+0000 1694f700 -1 osd.2 253 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e251) 2019-12-08T17:48:36.628 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:48:36.622+0000 1694f700 -1 osd.6 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.249287+0000 front 2019-12-08T17:47:49.138330+0000 (oldest deadline 2019-12-08T17:48:33.195944+0000) 2019-12-08T17:48:36.868 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:48:36.866+0000 1694f700 -1 osd.3 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.095169+0000 front 2019-12-08T17:47:49.087607+0000 (oldest deadline 2019-12-08T17:48:32.532709+0000) 2019-12-08T17:48:36.955 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:48:36.954+0000 1694f700 -1 osd.0 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:47.350130+0000 front 2019-12-08T17:47:47.408539+0000 (oldest deadline 2019-12-08T17:48:30.195085+0000) 2019-12-08T17:48:37.189 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:48:37.180+0000 1694f700 -1 osd.4 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:48.244074+0000 front 2019-12-08T17:47:48.242566+0000 (oldest deadline 2019-12-08T17:48:32.325899+0000) 2019-12-08T17:48:37.438 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:48:37.432+0000 1694f700 -1 osd.7 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.476653+0000 front 2019-12-08T17:47:49.478271+0000 (oldest deadline 2019-12-08T17:48:30.418942+0000) 2019-12-08T17:48:37.588 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:48:37.587+0000 1694f700 -1 osd.2 253 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e251) 2019-12-08T17:48:37.673 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:48:37.668+0000 1694f700 -1 osd.6 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.249287+0000 front 2019-12-08T17:47:49.138330+0000 (oldest deadline 2019-12-08T17:48:33.195944+0000) 2019-12-08T17:48:37.860 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:48:37.857+0000 1694f700 -1 osd.3 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.095169+0000 front 2019-12-08T17:47:49.087607+0000 (oldest deadline 2019-12-08T17:48:32.532709+0000) 2019-12-08T17:48:37.920 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:48:37.919+0000 1694f700 -1 osd.0 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:47.350130+0000 front 2019-12-08T17:47:47.408539+0000 (oldest deadline 2019-12-08T17:48:30.195085+0000) 2019-12-08T17:48:38.234 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:48:38.228+0000 1694f700 -1 osd.4 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:48.244074+0000 front 2019-12-08T17:47:48.242566+0000 (oldest deadline 2019-12-08T17:48:32.325899+0000) 2019-12-08T17:48:38.470 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:48:38.462+0000 1694f700 -1 osd.7 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.476653+0000 front 2019-12-08T17:47:49.478271+0000 (oldest deadline 2019-12-08T17:48:30.418942+0000) 2019-12-08T17:48:38.547 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:48:38.546+0000 1694f700 -1 osd.2 253 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e251) 2019-12-08T17:48:38.642 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:48:38.636+0000 1694f700 -1 osd.6 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.249287+0000 front 2019-12-08T17:47:49.138330+0000 (oldest deadline 2019-12-08T17:48:33.195944+0000) 2019-12-08T17:48:38.822 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:48:38.820+0000 1694f700 -1 osd.3 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.095169+0000 front 2019-12-08T17:47:49.087607+0000 (oldest deadline 2019-12-08T17:48:32.532709+0000) 2019-12-08T17:48:38.890 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:48:38.888+0000 1694f700 -1 osd.0 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:47.350130+0000 front 2019-12-08T17:47:47.408539+0000 (oldest deadline 2019-12-08T17:48:30.195085+0000) 2019-12-08T17:48:39.214 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:48:39.207+0000 1694f700 -1 osd.4 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:48.244074+0000 front 2019-12-08T17:47:48.242566+0000 (oldest deadline 2019-12-08T17:48:32.325899+0000) 2019-12-08T17:48:39.474 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:48:39.467+0000 1694f700 -1 osd.7 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.476653+0000 front 2019-12-08T17:47:49.478271+0000 (oldest deadline 2019-12-08T17:48:30.418942+0000) 2019-12-08T17:48:39.595 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:48:39.591+0000 1694f700 -1 osd.2 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:47:58.601891+0000 (oldest deadline 2019-12-08T17:48:38.601891+0000) 2019-12-08T17:48:39.596 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:48:39.593+0000 1694f700 -1 osd.2 253 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e251) 2019-12-08T17:48:39.623 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:48:39.614+0000 1694f700 -1 osd.6 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.249287+0000 front 2019-12-08T17:47:49.138330+0000 (oldest deadline 2019-12-08T17:48:33.195944+0000) 2019-12-08T17:48:39.860 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:48:39.857+0000 1694f700 -1 osd.3 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.095169+0000 front 2019-12-08T17:47:49.087607+0000 (oldest deadline 2019-12-08T17:48:32.532709+0000) 2019-12-08T17:48:39.878 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:48:39.876+0000 1694f700 -1 osd.0 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:47.350130+0000 front 2019-12-08T17:47:47.408539+0000 (oldest deadline 2019-12-08T17:48:30.195085+0000) 2019-12-08T17:48:40.179 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:48:40.173+0000 1694f700 -1 osd.4 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:48.244074+0000 front 2019-12-08T17:47:48.242566+0000 (oldest deadline 2019-12-08T17:48:32.325899+0000) 2019-12-08T17:48:40.452 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:48:40.446+0000 1694f700 -1 osd.7 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.476653+0000 front 2019-12-08T17:47:49.478271+0000 (oldest deadline 2019-12-08T17:48:30.418942+0000) 2019-12-08T17:48:40.628 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:48:40.622+0000 1694f700 -1 osd.2 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:47:58.601891+0000 (oldest deadline 2019-12-08T17:48:38.601891+0000) 2019-12-08T17:48:40.629 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:48:40.627+0000 1694f700 -1 osd.2 253 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e251) 2019-12-08T17:48:40.642 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:48:40.636+0000 1694f700 -1 osd.6 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.249287+0000 front 2019-12-08T17:47:49.138330+0000 (oldest deadline 2019-12-08T17:48:33.195944+0000) 2019-12-08T17:48:40.884 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:48:40.882+0000 1694f700 -1 osd.3 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.095169+0000 front 2019-12-08T17:47:49.087607+0000 (oldest deadline 2019-12-08T17:48:32.532709+0000) 2019-12-08T17:48:40.913 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:48:40.911+0000 1694f700 -1 osd.0 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:47.350130+0000 front 2019-12-08T17:47:47.408539+0000 (oldest deadline 2019-12-08T17:48:30.195085+0000) 2019-12-08T17:48:41.152 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:48:41.145+0000 1694f700 -1 osd.4 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:48.244074+0000 front 2019-12-08T17:47:48.242566+0000 (oldest deadline 2019-12-08T17:48:32.325899+0000) 2019-12-08T17:48:41.417 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:48:41.413+0000 1694f700 -1 osd.7 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.476653+0000 front 2019-12-08T17:47:49.478271+0000 (oldest deadline 2019-12-08T17:48:30.418942+0000) 2019-12-08T17:48:41.595 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:48:41.592+0000 1694f700 -1 osd.2 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:47:58.601891+0000 (oldest deadline 2019-12-08T17:48:38.601891+0000) 2019-12-08T17:48:41.596 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:48:41.595+0000 1694f700 -1 osd.2 253 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e251) 2019-12-08T17:48:41.668 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:48:41.661+0000 1694f700 -1 osd.6 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.249287+0000 front 2019-12-08T17:47:49.138330+0000 (oldest deadline 2019-12-08T17:48:33.195944+0000) 2019-12-08T17:48:41.890 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:48:41.889+0000 1694f700 -1 osd.0 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:47.350130+0000 front 2019-12-08T17:47:47.408539+0000 (oldest deadline 2019-12-08T17:48:30.195085+0000) 2019-12-08T17:48:41.931 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:48:41.927+0000 1694f700 -1 osd.3 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.095169+0000 front 2019-12-08T17:47:49.087607+0000 (oldest deadline 2019-12-08T17:48:32.532709+0000) 2019-12-08T17:48:42.197 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:48:42.186+0000 1694f700 -1 osd.4 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:48.244074+0000 front 2019-12-08T17:47:48.242566+0000 (oldest deadline 2019-12-08T17:48:32.325899+0000) 2019-12-08T17:48:42.448 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:48:42.441+0000 1694f700 -1 osd.7 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.476653+0000 front 2019-12-08T17:47:49.478271+0000 (oldest deadline 2019-12-08T17:48:30.418942+0000) 2019-12-08T17:48:42.595 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:48:42.592+0000 1694f700 -1 osd.2 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:47:58.601891+0000 (oldest deadline 2019-12-08T17:48:38.601891+0000) 2019-12-08T17:48:42.599 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:48:42.597+0000 1694f700 -1 osd.2 253 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e251) 2019-12-08T17:48:42.718 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:48:42.712+0000 1694f700 -1 osd.6 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.249287+0000 front 2019-12-08T17:47:49.138330+0000 (oldest deadline 2019-12-08T17:48:33.195944+0000) 2019-12-08T17:48:42.916 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:48:42.914+0000 1694f700 -1 osd.3 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.095169+0000 front 2019-12-08T17:47:49.087607+0000 (oldest deadline 2019-12-08T17:48:32.532709+0000) 2019-12-08T17:48:42.922 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:48:42.919+0000 1694f700 -1 osd.0 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:47.350130+0000 front 2019-12-08T17:47:47.408539+0000 (oldest deadline 2019-12-08T17:48:30.195085+0000) 2019-12-08T17:48:43.165 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:48:43.158+0000 1694f700 -1 osd.4 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:48.244074+0000 front 2019-12-08T17:47:48.242566+0000 (oldest deadline 2019-12-08T17:48:32.325899+0000) 2019-12-08T17:48:43.468 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:48:43.461+0000 1694f700 -1 osd.7 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.476653+0000 front 2019-12-08T17:47:49.478271+0000 (oldest deadline 2019-12-08T17:48:30.418942+0000) 2019-12-08T17:48:43.558 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:48:43.556+0000 1694f700 -1 osd.2 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:47:58.601891+0000 (oldest deadline 2019-12-08T17:48:38.601891+0000) 2019-12-08T17:48:43.559 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:48:43.558+0000 1694f700 -1 osd.2 253 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e251) 2019-12-08T17:48:43.701 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:48:43.694+0000 1694f700 -1 osd.6 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.249287+0000 front 2019-12-08T17:47:49.138330+0000 (oldest deadline 2019-12-08T17:48:33.195944+0000) 2019-12-08T17:48:43.878 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:48:43.875+0000 1694f700 -1 osd.0 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:47.350130+0000 front 2019-12-08T17:47:47.408539+0000 (oldest deadline 2019-12-08T17:48:30.195085+0000) 2019-12-08T17:48:43.887 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:48:43.884+0000 1694f700 -1 osd.3 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.095169+0000 front 2019-12-08T17:47:49.087607+0000 (oldest deadline 2019-12-08T17:48:32.532709+0000) 2019-12-08T17:48:44.178 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:48:44.172+0000 1694f700 -1 osd.4 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:48.244074+0000 front 2019-12-08T17:47:48.242566+0000 (oldest deadline 2019-12-08T17:48:32.325899+0000) 2019-12-08T17:48:44.454 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:48:44.447+0000 1694f700 -1 osd.7 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.476653+0000 front 2019-12-08T17:47:49.478271+0000 (oldest deadline 2019-12-08T17:48:30.418942+0000) 2019-12-08T17:48:44.537 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:48:44.532+0000 1694f700 -1 osd.2 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:47:58.601891+0000 (oldest deadline 2019-12-08T17:48:38.601891+0000) 2019-12-08T17:48:44.551 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:48:44.538+0000 1694f700 -1 osd.2 253 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e251) 2019-12-08T17:48:44.677 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:48:44.670+0000 1694f700 -1 osd.6 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.249287+0000 front 2019-12-08T17:47:49.138330+0000 (oldest deadline 2019-12-08T17:48:33.195944+0000) 2019-12-08T17:48:44.894 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:48:44.891+0000 1694f700 -1 osd.0 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:47.350130+0000 front 2019-12-08T17:47:47.408539+0000 (oldest deadline 2019-12-08T17:48:30.195085+0000) 2019-12-08T17:48:44.924 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:48:44.922+0000 1694f700 -1 osd.3 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.095169+0000 front 2019-12-08T17:47:49.087607+0000 (oldest deadline 2019-12-08T17:48:32.532709+0000) 2019-12-08T17:48:45.193 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:48:45.187+0000 1694f700 -1 osd.4 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:48.244074+0000 front 2019-12-08T17:47:48.242566+0000 (oldest deadline 2019-12-08T17:48:32.325899+0000) 2019-12-08T17:48:45.423 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:48:45.416+0000 1694f700 -1 osd.7 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.476653+0000 front 2019-12-08T17:47:49.478271+0000 (oldest deadline 2019-12-08T17:48:30.418942+0000) 2019-12-08T17:48:45.513 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:48:45.509+0000 1694f700 -1 osd.2 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:47:58.601891+0000 (oldest deadline 2019-12-08T17:48:38.601891+0000) 2019-12-08T17:48:45.514 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:48:45.512+0000 1694f700 -1 osd.2 253 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e251) 2019-12-08T17:48:45.729 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:48:45.722+0000 1694f700 -1 osd.6 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.249287+0000 front 2019-12-08T17:47:49.138330+0000 (oldest deadline 2019-12-08T17:48:33.195944+0000) 2019-12-08T17:48:45.886 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:48:45.883+0000 1694f700 -1 osd.3 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.095169+0000 front 2019-12-08T17:47:49.087607+0000 (oldest deadline 2019-12-08T17:48:32.532709+0000) 2019-12-08T17:48:45.902 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:48:45.899+0000 1694f700 -1 osd.0 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:47.350130+0000 front 2019-12-08T17:47:47.408539+0000 (oldest deadline 2019-12-08T17:48:30.195085+0000) 2019-12-08T17:48:46.210 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:48:46.203+0000 1694f700 -1 osd.4 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:48.244074+0000 front 2019-12-08T17:47:48.242566+0000 (oldest deadline 2019-12-08T17:48:32.325899+0000) 2019-12-08T17:48:46.437 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:48:46.431+0000 1694f700 -1 osd.7 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.476653+0000 front 2019-12-08T17:47:49.478271+0000 (oldest deadline 2019-12-08T17:48:30.418942+0000) 2019-12-08T17:48:46.471 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:48:46.469+0000 1694f700 -1 osd.2 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:47:58.601891+0000 (oldest deadline 2019-12-08T17:48:38.601891+0000) 2019-12-08T17:48:46.475 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:48:46.473+0000 1694f700 -1 osd.2 253 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e251) 2019-12-08T17:48:46.751 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:48:46.744+0000 1694f700 -1 osd.6 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.249287+0000 front 2019-12-08T17:47:49.138330+0000 (oldest deadline 2019-12-08T17:48:33.195944+0000) 2019-12-08T17:48:46.872 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:48:46.868+0000 1694f700 -1 osd.3 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.095169+0000 front 2019-12-08T17:47:49.087607+0000 (oldest deadline 2019-12-08T17:48:32.532709+0000) 2019-12-08T17:48:46.874 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:48:46.872+0000 1694f700 -1 osd.0 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:47.350130+0000 front 2019-12-08T17:47:47.408539+0000 (oldest deadline 2019-12-08T17:48:30.195085+0000) 2019-12-08T17:48:47.216 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:48:47.210+0000 1694f700 -1 osd.4 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:48.244074+0000 front 2019-12-08T17:47:48.242566+0000 (oldest deadline 2019-12-08T17:48:32.325899+0000) 2019-12-08T17:48:47.436 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:48:47.433+0000 1694f700 -1 osd.2 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:47:58.601891+0000 (oldest deadline 2019-12-08T17:48:38.601891+0000) 2019-12-08T17:48:47.437 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:48:47.435+0000 1694f700 -1 osd.2 253 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e251) 2019-12-08T17:48:47.472 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:48:47.466+0000 1694f700 -1 osd.7 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.476653+0000 front 2019-12-08T17:47:49.478271+0000 (oldest deadline 2019-12-08T17:48:30.418942+0000) 2019-12-08T17:48:47.789 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:48:47.783+0000 1694f700 -1 osd.6 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.249287+0000 front 2019-12-08T17:47:49.138330+0000 (oldest deadline 2019-12-08T17:48:33.195944+0000) 2019-12-08T17:48:47.830 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:48:47.828+0000 1694f700 -1 osd.3 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.095169+0000 front 2019-12-08T17:47:49.087607+0000 (oldest deadline 2019-12-08T17:48:32.532709+0000) 2019-12-08T17:48:47.899 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:48:47.895+0000 1694f700 -1 osd.0 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:47.350130+0000 front 2019-12-08T17:47:47.408539+0000 (oldest deadline 2019-12-08T17:48:30.195085+0000) 2019-12-08T17:48:48.180 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:48:48.173+0000 1694f700 -1 osd.4 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:48.244074+0000 front 2019-12-08T17:47:48.242566+0000 (oldest deadline 2019-12-08T17:48:32.325899+0000) 2019-12-08T17:48:48.480 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:48:48.476+0000 1694f700 -1 osd.2 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:47:58.601891+0000 (oldest deadline 2019-12-08T17:48:38.601891+0000) 2019-12-08T17:48:48.482 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:48:48.479+0000 1694f700 -1 osd.2 253 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e251) 2019-12-08T17:48:48.500 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:48:48.494+0000 1694f700 -1 osd.7 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.476653+0000 front 2019-12-08T17:47:49.478271+0000 (oldest deadline 2019-12-08T17:48:30.418942+0000) 2019-12-08T17:48:48.840 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:48:48.834+0000 1694f700 -1 osd.6 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.249287+0000 front 2019-12-08T17:47:49.138330+0000 (oldest deadline 2019-12-08T17:48:33.195944+0000) 2019-12-08T17:48:48.867 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:48:48.864+0000 1694f700 -1 osd.3 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.095169+0000 front 2019-12-08T17:47:49.087607+0000 (oldest deadline 2019-12-08T17:48:32.532709+0000) 2019-12-08T17:48:48.915 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:48:48.913+0000 1694f700 -1 osd.0 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:47.350130+0000 front 2019-12-08T17:47:47.408539+0000 (oldest deadline 2019-12-08T17:48:30.195085+0000) 2019-12-08T17:48:49.198 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:48:49.192+0000 1694f700 -1 osd.4 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:48.244074+0000 front 2019-12-08T17:47:48.242566+0000 (oldest deadline 2019-12-08T17:48:32.325899+0000) 2019-12-08T17:48:49.459 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:48:49.453+0000 1694f700 -1 osd.7 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.476653+0000 front 2019-12-08T17:47:49.478271+0000 (oldest deadline 2019-12-08T17:48:30.418942+0000) 2019-12-08T17:48:49.467 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:48:49.464+0000 1694f700 -1 osd.2 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:47:58.601891+0000 (oldest deadline 2019-12-08T17:48:38.601891+0000) 2019-12-08T17:48:49.468 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:48:49.466+0000 1694f700 -1 osd.2 253 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e251) 2019-12-08T17:48:49.830 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:48:49.828+0000 1694f700 -1 osd.3 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.095169+0000 front 2019-12-08T17:47:49.087607+0000 (oldest deadline 2019-12-08T17:48:32.532709+0000) 2019-12-08T17:48:49.860 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:48:49.853+0000 1694f700 -1 osd.6 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.249287+0000 front 2019-12-08T17:47:49.138330+0000 (oldest deadline 2019-12-08T17:48:33.195944+0000) 2019-12-08T17:48:49.914 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:48:49.912+0000 1694f700 -1 osd.0 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:47.350130+0000 front 2019-12-08T17:47:47.408539+0000 (oldest deadline 2019-12-08T17:48:30.195085+0000) 2019-12-08T17:48:50.237 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:48:50.231+0000 1694f700 -1 osd.4 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:48.244074+0000 front 2019-12-08T17:47:48.242566+0000 (oldest deadline 2019-12-08T17:48:32.325899+0000) 2019-12-08T17:48:50.453 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:48:50.450+0000 1694f700 -1 osd.2 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:47:58.601891+0000 (oldest deadline 2019-12-08T17:48:38.601891+0000) 2019-12-08T17:48:50.454 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:48:50.453+0000 1694f700 -1 osd.2 253 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e251) 2019-12-08T17:48:50.471 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:48:50.465+0000 1694f700 -1 osd.7 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.476653+0000 front 2019-12-08T17:47:49.478271+0000 (oldest deadline 2019-12-08T17:48:30.418942+0000) 2019-12-08T17:48:50.806 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:48:50.803+0000 1694f700 -1 osd.3 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.095169+0000 front 2019-12-08T17:47:49.087607+0000 (oldest deadline 2019-12-08T17:48:32.532709+0000) 2019-12-08T17:48:50.909 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:48:50.903+0000 1694f700 -1 osd.6 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.249287+0000 front 2019-12-08T17:47:49.138330+0000 (oldest deadline 2019-12-08T17:48:33.195944+0000) 2019-12-08T17:48:50.923 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:48:50.920+0000 1694f700 -1 osd.0 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:47.350130+0000 front 2019-12-08T17:47:47.408539+0000 (oldest deadline 2019-12-08T17:48:30.195085+0000) 2019-12-08T17:48:51.230 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:48:51.224+0000 1694f700 -1 osd.4 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:48.244074+0000 front 2019-12-08T17:47:48.242566+0000 (oldest deadline 2019-12-08T17:48:32.325899+0000) 2019-12-08T17:48:51.452 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:48:51.446+0000 1694f700 -1 osd.7 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.476653+0000 front 2019-12-08T17:47:49.478271+0000 (oldest deadline 2019-12-08T17:48:30.418942+0000) 2019-12-08T17:48:51.465 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:48:51.463+0000 1694f700 -1 osd.2 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:47:58.601891+0000 (oldest deadline 2019-12-08T17:48:38.601891+0000) 2019-12-08T17:48:51.465 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:48:51.464+0000 1694f700 -1 osd.2 253 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e251) 2019-12-08T17:48:51.831 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:48:51.830+0000 1694f700 -1 osd.3 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.095169+0000 front 2019-12-08T17:47:49.087607+0000 (oldest deadline 2019-12-08T17:48:32.532709+0000) 2019-12-08T17:48:51.876 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:48:51.870+0000 1694f700 -1 osd.6 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.249287+0000 front 2019-12-08T17:47:49.138330+0000 (oldest deadline 2019-12-08T17:48:33.195944+0000) 2019-12-08T17:48:51.905 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:48:51.901+0000 1694f700 -1 osd.0 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:47.350130+0000 front 2019-12-08T17:47:47.408539+0000 (oldest deadline 2019-12-08T17:48:30.195085+0000) 2019-12-08T17:48:52.277 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:48:52.270+0000 1694f700 -1 osd.4 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:48.244074+0000 front 2019-12-08T17:47:48.242566+0000 (oldest deadline 2019-12-08T17:48:32.325899+0000) 2019-12-08T17:48:52.430 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:48:52.424+0000 1694f700 -1 osd.7 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.476653+0000 front 2019-12-08T17:47:49.478271+0000 (oldest deadline 2019-12-08T17:48:30.418942+0000) 2019-12-08T17:48:52.458 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:48:52.456+0000 1694f700 -1 osd.2 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:47:58.601891+0000 (oldest deadline 2019-12-08T17:48:38.601891+0000) 2019-12-08T17:48:52.459 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:48:52.459+0000 1694f700 -1 osd.2 253 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e251) 2019-12-08T17:48:52.860 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:48:52.859+0000 1694f700 -1 osd.3 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.095169+0000 front 2019-12-08T17:47:49.087607+0000 (oldest deadline 2019-12-08T17:48:32.532709+0000) 2019-12-08T17:48:52.909 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:48:52.902+0000 1694f700 -1 osd.6 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.249287+0000 front 2019-12-08T17:47:49.138330+0000 (oldest deadline 2019-12-08T17:48:33.195944+0000) 2019-12-08T17:48:52.959 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:48:52.956+0000 1694f700 -1 osd.0 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:47.350130+0000 front 2019-12-08T17:47:47.408539+0000 (oldest deadline 2019-12-08T17:48:30.195085+0000) 2019-12-08T17:48:53.331 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:48:53.325+0000 1694f700 -1 osd.4 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:48.244074+0000 front 2019-12-08T17:47:48.242566+0000 (oldest deadline 2019-12-08T17:48:32.325899+0000) 2019-12-08T17:48:53.438 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:48:53.435+0000 1694f700 -1 osd.2 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:47:58.601891+0000 (oldest deadline 2019-12-08T17:48:38.601891+0000) 2019-12-08T17:48:53.439 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:48:53.438+0000 1694f700 -1 osd.2 253 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e251) 2019-12-08T17:48:53.468 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:48:53.462+0000 1694f700 -1 osd.7 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.476653+0000 front 2019-12-08T17:47:49.478271+0000 (oldest deadline 2019-12-08T17:48:30.418942+0000) 2019-12-08T17:48:53.884 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:48:53.882+0000 1694f700 -1 osd.3 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.095169+0000 front 2019-12-08T17:47:49.087607+0000 (oldest deadline 2019-12-08T17:48:32.532709+0000) 2019-12-08T17:48:53.939 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:48:53.933+0000 1694f700 -1 osd.6 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.249287+0000 front 2019-12-08T17:47:49.138330+0000 (oldest deadline 2019-12-08T17:48:33.195944+0000) 2019-12-08T17:48:53.994 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:48:53.992+0000 1694f700 -1 osd.0 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:47.350130+0000 front 2019-12-08T17:47:47.408539+0000 (oldest deadline 2019-12-08T17:48:30.195085+0000) 2019-12-08T17:48:54.333 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:48:54.324+0000 1694f700 -1 osd.4 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:48.244074+0000 front 2019-12-08T17:47:48.242566+0000 (oldest deadline 2019-12-08T17:48:32.325899+0000) 2019-12-08T17:48:54.400 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:48:54.398+0000 1694f700 -1 osd.2 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:47:58.601891+0000 (oldest deadline 2019-12-08T17:48:38.601891+0000) 2019-12-08T17:48:54.401 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:48:54.400+0000 1694f700 -1 osd.2 253 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e251) 2019-12-08T17:48:54.430 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:48:54.423+0000 1694f700 -1 osd.7 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.476653+0000 front 2019-12-08T17:47:49.478271+0000 (oldest deadline 2019-12-08T17:48:30.418942+0000) 2019-12-08T17:48:54.839 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:48:54.837+0000 1694f700 -1 osd.3 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.095169+0000 front 2019-12-08T17:47:49.087607+0000 (oldest deadline 2019-12-08T17:48:32.532709+0000) 2019-12-08T17:48:54.970 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:48:54.962+0000 1694f700 -1 osd.6 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.249287+0000 front 2019-12-08T17:47:49.138330+0000 (oldest deadline 2019-12-08T17:48:33.195944+0000) 2019-12-08T17:48:55.033 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:48:55.031+0000 1694f700 -1 osd.0 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:47.350130+0000 front 2019-12-08T17:47:47.408539+0000 (oldest deadline 2019-12-08T17:48:30.195085+0000) 2019-12-08T17:48:55.377 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:48:55.371+0000 1694f700 -1 osd.4 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:48.244074+0000 front 2019-12-08T17:47:48.242566+0000 (oldest deadline 2019-12-08T17:48:32.325899+0000) 2019-12-08T17:48:55.445 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:48:55.443+0000 1694f700 -1 osd.2 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:47:58.601891+0000 (oldest deadline 2019-12-08T17:48:38.601891+0000) 2019-12-08T17:48:55.446 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:48:55.445+0000 1694f700 -1 osd.2 253 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e251) 2019-12-08T17:48:55.448 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:48:55.442+0000 1694f700 -1 osd.7 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.476653+0000 front 2019-12-08T17:47:49.478271+0000 (oldest deadline 2019-12-08T17:48:30.418942+0000) 2019-12-08T17:48:55.859 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:48:55.857+0000 1694f700 -1 osd.3 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.095169+0000 front 2019-12-08T17:47:49.087607+0000 (oldest deadline 2019-12-08T17:48:32.532709+0000) 2019-12-08T17:48:56.021 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:48:56.014+0000 1694f700 -1 osd.6 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.249287+0000 front 2019-12-08T17:47:49.138330+0000 (oldest deadline 2019-12-08T17:48:33.195944+0000) 2019-12-08T17:48:56.074 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:48:56.072+0000 1694f700 -1 osd.0 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:47.350130+0000 front 2019-12-08T17:47:47.408539+0000 (oldest deadline 2019-12-08T17:48:30.195085+0000) 2019-12-08T17:48:56.381 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:48:56.375+0000 1694f700 -1 osd.4 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:48.244074+0000 front 2019-12-08T17:47:48.242566+0000 (oldest deadline 2019-12-08T17:48:32.325899+0000) 2019-12-08T17:48:56.411 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:48:56.409+0000 1694f700 -1 osd.2 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:47:58.601891+0000 (oldest deadline 2019-12-08T17:48:38.601891+0000) 2019-12-08T17:48:56.415 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:48:56.414+0000 1694f700 -1 osd.2 253 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e251) 2019-12-08T17:48:56.499 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:48:56.492+0000 1694f700 -1 osd.7 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.476653+0000 front 2019-12-08T17:47:49.478271+0000 (oldest deadline 2019-12-08T17:48:30.418942+0000) 2019-12-08T17:48:56.897 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:48:56.896+0000 1694f700 -1 osd.3 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.095169+0000 front 2019-12-08T17:47:49.087607+0000 (oldest deadline 2019-12-08T17:48:32.532709+0000) 2019-12-08T17:48:57.041 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:48:57.035+0000 1694f700 -1 osd.6 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.249287+0000 front 2019-12-08T17:47:49.138330+0000 (oldest deadline 2019-12-08T17:48:33.195944+0000) 2019-12-08T17:48:57.121 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:48:57.118+0000 1694f700 -1 osd.0 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:47.350130+0000 front 2019-12-08T17:47:47.408539+0000 (oldest deadline 2019-12-08T17:48:30.195085+0000) 2019-12-08T17:48:57.375 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:48:57.374+0000 1694f700 -1 osd.2 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:47:58.601891+0000 (oldest deadline 2019-12-08T17:48:38.601891+0000) 2019-12-08T17:48:57.376 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:48:57.376+0000 1694f700 -1 osd.2 253 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e251) 2019-12-08T17:48:57.426 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:48:57.420+0000 1694f700 -1 osd.4 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:48.244074+0000 front 2019-12-08T17:47:48.242566+0000 (oldest deadline 2019-12-08T17:48:32.325899+0000) 2019-12-08T17:48:57.501 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:48:57.496+0000 1694f700 -1 osd.7 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.476653+0000 front 2019-12-08T17:47:49.478271+0000 (oldest deadline 2019-12-08T17:48:30.418942+0000) 2019-12-08T17:48:57.897 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:48:57.895+0000 1694f700 -1 osd.3 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.095169+0000 front 2019-12-08T17:47:49.087607+0000 (oldest deadline 2019-12-08T17:48:32.532709+0000) 2019-12-08T17:48:58.006 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:48:58.000+0000 1694f700 -1 osd.6 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.249287+0000 front 2019-12-08T17:47:49.138330+0000 (oldest deadline 2019-12-08T17:48:33.195944+0000) 2019-12-08T17:48:58.089 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:48:58.087+0000 1694f700 -1 osd.0 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:47.350130+0000 front 2019-12-08T17:47:47.408539+0000 (oldest deadline 2019-12-08T17:48:30.195085+0000) 2019-12-08T17:48:58.402 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:48:58.401+0000 1694f700 -1 osd.2 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:47:58.601891+0000 (oldest deadline 2019-12-08T17:48:38.601891+0000) 2019-12-08T17:48:58.404 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:48:58.404+0000 1694f700 -1 osd.2 253 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e251) 2019-12-08T17:48:58.422 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:48:58.416+0000 1694f700 -1 osd.4 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:48.244074+0000 front 2019-12-08T17:47:48.242566+0000 (oldest deadline 2019-12-08T17:48:32.325899+0000) 2019-12-08T17:48:58.531 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:48:58.524+0000 1694f700 -1 osd.7 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.476653+0000 front 2019-12-08T17:47:49.478271+0000 (oldest deadline 2019-12-08T17:48:30.418942+0000) 2019-12-08T17:48:58.910 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:48:58.908+0000 1694f700 -1 osd.3 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.095169+0000 front 2019-12-08T17:47:49.087607+0000 (oldest deadline 2019-12-08T17:48:32.532709+0000) 2019-12-08T17:48:58.962 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:48:58.955+0000 1694f700 -1 osd.6 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.249287+0000 front 2019-12-08T17:47:49.138330+0000 (oldest deadline 2019-12-08T17:48:33.195944+0000) 2019-12-08T17:48:59.075 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:48:59.073+0000 1694f700 -1 osd.0 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:47.350130+0000 front 2019-12-08T17:47:47.408539+0000 (oldest deadline 2019-12-08T17:48:30.195085+0000) 2019-12-08T17:48:59.385 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:48:59.379+0000 1694f700 -1 osd.4 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:48.244074+0000 front 2019-12-08T17:47:48.242566+0000 (oldest deadline 2019-12-08T17:48:32.325899+0000) 2019-12-08T17:48:59.417 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:48:59.416+0000 1694f700 -1 osd.2 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:47:58.601891+0000 (oldest deadline 2019-12-08T17:48:38.601891+0000) 2019-12-08T17:48:59.418 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:48:59.418+0000 1694f700 -1 osd.2 253 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e251) 2019-12-08T17:48:59.484 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:48:59.479+0000 1694f700 -1 osd.7 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.476653+0000 front 2019-12-08T17:47:49.478271+0000 (oldest deadline 2019-12-08T17:48:30.418942+0000) 2019-12-08T17:48:59.913 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:48:59.912+0000 1694f700 -1 osd.3 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.095169+0000 front 2019-12-08T17:47:49.087607+0000 (oldest deadline 2019-12-08T17:48:32.532709+0000) 2019-12-08T17:48:59.997 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:48:59.992+0000 1694f700 -1 osd.6 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.249287+0000 front 2019-12-08T17:47:49.138330+0000 (oldest deadline 2019-12-08T17:48:33.195944+0000) 2019-12-08T17:49:00.108 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:49:00.106+0000 1694f700 -1 osd.0 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:47.350130+0000 front 2019-12-08T17:47:47.408539+0000 (oldest deadline 2019-12-08T17:48:30.195085+0000) 2019-12-08T17:49:00.365 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:49:00.360+0000 1694f700 -1 osd.4 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:48.244074+0000 front 2019-12-08T17:47:48.242566+0000 (oldest deadline 2019-12-08T17:48:32.325899+0000) 2019-12-08T17:49:00.379 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:49:00.377+0000 1694f700 -1 osd.2 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:47:58.601891+0000 (oldest deadline 2019-12-08T17:48:38.601891+0000) 2019-12-08T17:49:00.380 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:49:00.379+0000 1694f700 -1 osd.2 253 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e251) 2019-12-08T17:49:00.524 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:49:00.517+0000 1694f700 -1 osd.7 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.476653+0000 front 2019-12-08T17:47:49.478271+0000 (oldest deadline 2019-12-08T17:48:30.418942+0000) 2019-12-08T17:49:00.956 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:49:00.954+0000 1694f700 -1 osd.3 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.095169+0000 front 2019-12-08T17:47:49.087607+0000 (oldest deadline 2019-12-08T17:48:32.532709+0000) 2019-12-08T17:49:01.040 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:49:01.028+0000 1694f700 -1 osd.6 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.249287+0000 front 2019-12-08T17:47:49.138330+0000 (oldest deadline 2019-12-08T17:48:33.195944+0000) 2019-12-08T17:49:01.157 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:49:01.154+0000 1694f700 -1 osd.0 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:47.350130+0000 front 2019-12-08T17:47:47.408539+0000 (oldest deadline 2019-12-08T17:48:30.195085+0000) 2019-12-08T17:49:01.338 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:49:01.338+0000 1694f700 -1 osd.2 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:47:58.601891+0000 (oldest deadline 2019-12-08T17:48:38.601891+0000) 2019-12-08T17:49:01.339 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:49:01.340+0000 1694f700 -1 osd.2 253 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e251) 2019-12-08T17:49:01.345 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:49:01.340+0000 1694f700 -1 osd.4 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:48.244074+0000 front 2019-12-08T17:47:48.242566+0000 (oldest deadline 2019-12-08T17:48:32.325899+0000) 2019-12-08T17:49:01.572 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:49:01.566+0000 1694f700 -1 osd.7 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.476653+0000 front 2019-12-08T17:47:49.478271+0000 (oldest deadline 2019-12-08T17:48:30.418942+0000) 2019-12-08T17:49:01.983 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:49:01.975+0000 1694f700 -1 osd.3 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.095169+0000 front 2019-12-08T17:47:49.087607+0000 (oldest deadline 2019-12-08T17:48:32.532709+0000) 2019-12-08T17:49:02.066 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:49:02.059+0000 1694f700 -1 osd.6 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.249287+0000 front 2019-12-08T17:47:49.138330+0000 (oldest deadline 2019-12-08T17:48:33.195944+0000) 2019-12-08T17:49:02.137 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:49:02.136+0000 1694f700 -1 osd.0 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:47.350130+0000 front 2019-12-08T17:47:47.408539+0000 (oldest deadline 2019-12-08T17:48:30.195085+0000) 2019-12-08T17:49:02.333 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:49:02.327+0000 1694f700 -1 osd.4 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:48.244074+0000 front 2019-12-08T17:47:48.242566+0000 (oldest deadline 2019-12-08T17:48:32.325899+0000) 2019-12-08T17:49:02.360 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:49:02.358+0000 1694f700 -1 osd.2 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:47:58.601891+0000 (oldest deadline 2019-12-08T17:48:38.601891+0000) 2019-12-08T17:49:02.361 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:49:02.360+0000 1694f700 -1 osd.2 253 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e251) 2019-12-08T17:49:02.541 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:49:02.534+0000 1694f700 -1 osd.7 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.476653+0000 front 2019-12-08T17:47:49.478271+0000 (oldest deadline 2019-12-08T17:48:30.418942+0000) 2019-12-08T17:49:02.703 INFO:tasks.ceph.mon.b.smithi013.stderr:2019-12-08T17:49:02.696+0000 1a89c700 -1 mon.b@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.1 [v2:172.21.15.79:6810/10449,v1:172.21.15.79:6811/10449] for 41sec e253 v253) 2019-12-08T17:49:02.983 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:49:02.982+0000 1694f700 -1 osd.3 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.095169+0000 front 2019-12-08T17:47:49.087607+0000 (oldest deadline 2019-12-08T17:48:32.532709+0000) 2019-12-08T17:49:03.072 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:49:03.065+0000 1694f700 -1 osd.6 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.249287+0000 front 2019-12-08T17:47:49.138330+0000 (oldest deadline 2019-12-08T17:48:33.195944+0000) 2019-12-08T17:49:03.116 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:49:03.115+0000 1694f700 -1 osd.0 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:47.350130+0000 front 2019-12-08T17:47:47.408539+0000 (oldest deadline 2019-12-08T17:48:30.195085+0000) 2019-12-08T17:49:03.301 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:49:03.293+0000 1694f700 -1 osd.4 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:48.244074+0000 front 2019-12-08T17:47:48.242566+0000 (oldest deadline 2019-12-08T17:48:32.325899+0000) 2019-12-08T17:49:03.348 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:49:03.346+0000 1694f700 -1 osd.2 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:47:58.601891+0000 (oldest deadline 2019-12-08T17:48:38.601891+0000) 2019-12-08T17:49:03.349 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:49:03.349+0000 1694f700 -1 osd.2 253 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e251) 2019-12-08T17:49:03.559 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:49:03.548+0000 1694f700 -1 osd.7 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.476653+0000 front 2019-12-08T17:47:49.478271+0000 (oldest deadline 2019-12-08T17:48:30.418942+0000) 2019-12-08T17:49:03.937 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:49:03.937+0000 1694f700 -1 osd.3 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.095169+0000 front 2019-12-08T17:47:49.087607+0000 (oldest deadline 2019-12-08T17:48:32.532709+0000) 2019-12-08T17:49:04.064 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:49:04.059+0000 1694f700 -1 osd.6 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.249287+0000 front 2019-12-08T17:47:49.138330+0000 (oldest deadline 2019-12-08T17:48:33.195944+0000) 2019-12-08T17:49:04.141 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:49:04.140+0000 1694f700 -1 osd.0 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:47.350130+0000 front 2019-12-08T17:47:47.408539+0000 (oldest deadline 2019-12-08T17:48:30.195085+0000) 2019-12-08T17:49:04.343 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:49:04.342+0000 1694f700 -1 osd.2 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:47:58.601891+0000 (oldest deadline 2019-12-08T17:48:38.601891+0000) 2019-12-08T17:49:04.344 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:49:04.344+0000 1694f700 -1 osd.2 253 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e251) 2019-12-08T17:49:04.348 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:49:04.341+0000 1694f700 -1 osd.4 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:48.244074+0000 front 2019-12-08T17:47:48.242566+0000 (oldest deadline 2019-12-08T17:48:32.325899+0000) 2019-12-08T17:49:04.547 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:49:04.541+0000 1694f700 -1 osd.7 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.476653+0000 front 2019-12-08T17:47:49.478271+0000 (oldest deadline 2019-12-08T17:48:30.418942+0000) 2019-12-08T17:49:04.949 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:49:04.948+0000 1694f700 -1 osd.3 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.095169+0000 front 2019-12-08T17:47:49.087607+0000 (oldest deadline 2019-12-08T17:48:32.532709+0000) 2019-12-08T17:49:05.095 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:49:05.088+0000 1694f700 -1 osd.6 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.249287+0000 front 2019-12-08T17:47:49.138330+0000 (oldest deadline 2019-12-08T17:48:33.195944+0000) 2019-12-08T17:49:05.175 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:49:05.174+0000 1694f700 -1 osd.0 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:47.350130+0000 front 2019-12-08T17:47:47.408539+0000 (oldest deadline 2019-12-08T17:48:30.195085+0000) 2019-12-08T17:49:05.345 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:49:05.338+0000 1694f700 -1 osd.4 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:48.244074+0000 front 2019-12-08T17:47:48.242566+0000 (oldest deadline 2019-12-08T17:48:32.325899+0000) 2019-12-08T17:49:05.395 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:49:05.393+0000 1694f700 -1 osd.2 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:47:58.601891+0000 (oldest deadline 2019-12-08T17:48:38.601891+0000) 2019-12-08T17:49:05.397 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:49:05.395+0000 1694f700 -1 osd.2 253 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e251) 2019-12-08T17:49:05.553 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:49:05.547+0000 1694f700 -1 osd.7 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.476653+0000 front 2019-12-08T17:47:49.478271+0000 (oldest deadline 2019-12-08T17:48:30.418942+0000) 2019-12-08T17:49:05.995 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:49:05.992+0000 1694f700 -1 osd.3 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.095169+0000 front 2019-12-08T17:47:49.087607+0000 (oldest deadline 2019-12-08T17:48:32.532709+0000) 2019-12-08T17:49:06.057 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:49:06.050+0000 1694f700 -1 osd.6 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.249287+0000 front 2019-12-08T17:47:49.138330+0000 (oldest deadline 2019-12-08T17:48:33.195944+0000) 2019-12-08T17:49:06.212 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:49:06.209+0000 1694f700 -1 osd.0 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:47.350130+0000 front 2019-12-08T17:47:47.408539+0000 (oldest deadline 2019-12-08T17:48:30.195085+0000) 2019-12-08T17:49:06.384 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:49:06.379+0000 1694f700 -1 osd.4 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:48.244074+0000 front 2019-12-08T17:47:48.242566+0000 (oldest deadline 2019-12-08T17:48:32.325899+0000) 2019-12-08T17:49:06.419 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:49:06.418+0000 1694f700 -1 osd.2 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:47:58.601891+0000 (oldest deadline 2019-12-08T17:48:38.601891+0000) 2019-12-08T17:49:06.422 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:49:06.422+0000 1694f700 -1 osd.2 253 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e251) 2019-12-08T17:49:06.557 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:49:06.550+0000 1694f700 -1 osd.7 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.476653+0000 front 2019-12-08T17:47:49.478271+0000 (oldest deadline 2019-12-08T17:48:30.418942+0000) 2019-12-08T17:49:07.041 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:49:07.041+0000 1694f700 -1 osd.3 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.095169+0000 front 2019-12-08T17:47:49.087607+0000 (oldest deadline 2019-12-08T17:48:32.532709+0000) 2019-12-08T17:49:07.087 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:49:07.081+0000 1694f700 -1 osd.6 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.249287+0000 front 2019-12-08T17:47:49.138330+0000 (oldest deadline 2019-12-08T17:48:33.195944+0000) 2019-12-08T17:49:07.239 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:49:07.239+0000 1694f700 -1 osd.0 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:47.350130+0000 front 2019-12-08T17:47:47.408539+0000 (oldest deadline 2019-12-08T17:48:30.195085+0000) 2019-12-08T17:49:07.388 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:49:07.382+0000 1694f700 -1 osd.4 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:48.244074+0000 front 2019-12-08T17:47:48.242566+0000 (oldest deadline 2019-12-08T17:48:32.325899+0000) 2019-12-08T17:49:07.445 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:49:07.440+0000 1694f700 -1 osd.2 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:47:58.601891+0000 (oldest deadline 2019-12-08T17:48:38.601891+0000) 2019-12-08T17:49:07.446 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:49:07.443+0000 1694f700 -1 osd.2 253 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e251) 2019-12-08T17:49:07.600 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:49:07.583+0000 1694f700 -1 osd.7 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.476653+0000 front 2019-12-08T17:47:49.478271+0000 (oldest deadline 2019-12-08T17:48:30.418942+0000) 2019-12-08T17:49:07.728 INFO:tasks.ceph.mon.b.smithi013.stderr:2019-12-08T17:49:07.720+0000 1a89c700 -1 mon.b@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.1 [v2:172.21.15.79:6810/10449,v1:172.21.15.79:6811/10449] for 41sec e253 v253) 2019-12-08T17:49:08.063 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:49:08.063+0000 1694f700 -1 osd.3 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.095169+0000 front 2019-12-08T17:47:49.087607+0000 (oldest deadline 2019-12-08T17:48:32.532709+0000) 2019-12-08T17:49:08.264 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:49:08.059+0000 1694f700 -1 osd.6 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.249287+0000 front 2019-12-08T17:47:49.138330+0000 (oldest deadline 2019-12-08T17:48:33.195944+0000) 2019-12-08T17:49:08.264 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:49:08.251+0000 1694f700 -1 osd.0 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:47.350130+0000 front 2019-12-08T17:47:47.408539+0000 (oldest deadline 2019-12-08T17:48:30.195085+0000) 2019-12-08T17:49:08.362 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:49:08.355+0000 1694f700 -1 osd.4 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:48.244074+0000 front 2019-12-08T17:47:48.242566+0000 (oldest deadline 2019-12-08T17:48:32.325899+0000) 2019-12-08T17:49:08.409 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:49:08.407+0000 1694f700 -1 osd.2 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:47:58.601891+0000 (oldest deadline 2019-12-08T17:48:38.601891+0000) 2019-12-08T17:49:08.410 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:49:08.409+0000 1694f700 -1 osd.2 253 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e251) 2019-12-08T17:49:08.635 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:49:08.629+0000 1694f700 -1 osd.7 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.476653+0000 front 2019-12-08T17:47:49.478271+0000 (oldest deadline 2019-12-08T17:48:30.418942+0000) 2019-12-08T17:49:09.054 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:49:09.053+0000 1694f700 -1 osd.3 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.095169+0000 front 2019-12-08T17:47:49.087607+0000 (oldest deadline 2019-12-08T17:48:32.532709+0000) 2019-12-08T17:49:09.063 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:49:09.059+0000 1694f700 -1 osd.6 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.249287+0000 front 2019-12-08T17:47:49.138330+0000 (oldest deadline 2019-12-08T17:48:33.195944+0000) 2019-12-08T17:49:09.244 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:49:09.242+0000 1694f700 -1 osd.0 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:47.350130+0000 front 2019-12-08T17:47:47.408539+0000 (oldest deadline 2019-12-08T17:48:30.195085+0000) 2019-12-08T17:49:09.367 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:49:09.363+0000 1694f700 -1 osd.4 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:48.244074+0000 front 2019-12-08T17:47:48.242566+0000 (oldest deadline 2019-12-08T17:48:32.325899+0000) 2019-12-08T17:49:09.454 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:49:09.452+0000 1694f700 -1 osd.2 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:47:58.601891+0000 (oldest deadline 2019-12-08T17:48:38.601891+0000) 2019-12-08T17:49:09.459 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:49:09.458+0000 1694f700 -1 osd.2 253 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e251) 2019-12-08T17:49:09.652 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:49:09.646+0000 1694f700 -1 osd.7 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.476653+0000 front 2019-12-08T17:47:49.478271+0000 (oldest deadline 2019-12-08T17:48:30.418942+0000) 2019-12-08T17:49:10.031 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:49:10.026+0000 1694f700 -1 osd.6 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.249287+0000 front 2019-12-08T17:47:49.138330+0000 (oldest deadline 2019-12-08T17:48:33.195944+0000) 2019-12-08T17:49:10.096 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:49:10.094+0000 1694f700 -1 osd.3 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.095169+0000 front 2019-12-08T17:47:49.087607+0000 (oldest deadline 2019-12-08T17:48:32.532709+0000) 2019-12-08T17:49:10.218 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:49:10.216+0000 1694f700 -1 osd.0 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:47.350130+0000 front 2019-12-08T17:47:47.408539+0000 (oldest deadline 2019-12-08T17:48:30.195085+0000) 2019-12-08T17:49:10.408 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:49:10.403+0000 1694f700 -1 osd.4 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:48.244074+0000 front 2019-12-08T17:47:48.242566+0000 (oldest deadline 2019-12-08T17:48:32.325899+0000) 2019-12-08T17:49:10.470 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:49:10.469+0000 1694f700 -1 osd.2 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:47:58.601891+0000 (oldest deadline 2019-12-08T17:48:38.601891+0000) 2019-12-08T17:49:10.473 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:49:10.472+0000 1694f700 -1 osd.2 253 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e251) 2019-12-08T17:49:10.649 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:49:10.643+0000 1694f700 -1 osd.7 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.476653+0000 front 2019-12-08T17:47:49.478271+0000 (oldest deadline 2019-12-08T17:48:30.418942+0000) 2019-12-08T17:49:11.038 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:49:11.033+0000 1694f700 -1 osd.6 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.249287+0000 front 2019-12-08T17:47:49.138330+0000 (oldest deadline 2019-12-08T17:48:33.195944+0000) 2019-12-08T17:49:11.099 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:49:11.098+0000 1694f700 -1 osd.3 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.095169+0000 front 2019-12-08T17:47:49.087607+0000 (oldest deadline 2019-12-08T17:48:32.532709+0000) 2019-12-08T17:49:11.264 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:49:11.263+0000 1694f700 -1 osd.0 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:47.350130+0000 front 2019-12-08T17:47:47.408539+0000 (oldest deadline 2019-12-08T17:48:30.195085+0000) 2019-12-08T17:49:11.445 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:49:11.439+0000 1694f700 -1 osd.4 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:48.244074+0000 front 2019-12-08T17:47:48.242566+0000 (oldest deadline 2019-12-08T17:48:32.325899+0000) 2019-12-08T17:49:11.458 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:49:11.457+0000 1694f700 -1 osd.2 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:47:58.601891+0000 (oldest deadline 2019-12-08T17:48:38.601891+0000) 2019-12-08T17:49:11.459 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:49:11.459+0000 1694f700 -1 osd.2 253 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e251) 2019-12-08T17:49:11.634 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:49:11.628+0000 1694f700 -1 osd.7 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.476653+0000 front 2019-12-08T17:47:49.478271+0000 (oldest deadline 2019-12-08T17:48:30.418942+0000) 2019-12-08T17:49:12.036 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:49:12.031+0000 1694f700 -1 osd.6 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.249287+0000 front 2019-12-08T17:47:49.138330+0000 (oldest deadline 2019-12-08T17:48:33.195944+0000) 2019-12-08T17:49:12.116 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:49:12.115+0000 1694f700 -1 osd.3 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.095169+0000 front 2019-12-08T17:47:49.087607+0000 (oldest deadline 2019-12-08T17:48:32.532709+0000) 2019-12-08T17:49:12.284 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:49:12.278+0000 1694f700 -1 osd.0 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:47.350130+0000 front 2019-12-08T17:47:47.408539+0000 (oldest deadline 2019-12-08T17:48:30.195085+0000) 2019-12-08T17:49:12.415 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:49:12.409+0000 1694f700 -1 osd.4 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:48.244074+0000 front 2019-12-08T17:47:48.242566+0000 (oldest deadline 2019-12-08T17:48:32.325899+0000) 2019-12-08T17:49:12.488 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:49:12.485+0000 1694f700 -1 osd.2 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:47:58.601891+0000 (oldest deadline 2019-12-08T17:48:38.601891+0000) 2019-12-08T17:49:12.586 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:49:12.488+0000 1694f700 -1 osd.2 253 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e251) 2019-12-08T17:49:12.662 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:49:12.657+0000 1694f700 -1 osd.7 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.476653+0000 front 2019-12-08T17:47:49.478271+0000 (oldest deadline 2019-12-08T17:48:30.418942+0000) 2019-12-08T17:49:13.048 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:49:13.043+0000 1694f700 -1 osd.6 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.249287+0000 front 2019-12-08T17:47:49.138330+0000 (oldest deadline 2019-12-08T17:48:33.195944+0000) 2019-12-08T17:49:13.117 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:49:13.114+0000 1694f700 -1 osd.5 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.578323+0000 front 2019-12-08T17:47:49.567927+0000 (oldest deadline 2019-12-08T17:49:12.133656+0000) 2019-12-08T17:49:13.120 INFO:tasks.ceph.mon.b.smithi013.stderr:2019-12-08T17:49:13.117+0000 1a89c700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.1 [v2:172.21.15.79:6810/10449,v1:172.21.15.79:6811/10449] for 41sec e253 v253) 2019-12-08T17:49:13.121 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:49:13.117+0000 1694f700 -1 osd.3 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:47:49.095169+0000 front 2019-12-08T17:47:49.087607+0000 (oldest deadline 2019-12-08T17:48:32.532709+0000) 2019-12-08T17:49:13.439 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:05:46:38.142 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T17:49:13.468 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:05:46:38.170 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T17:49:13.477 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:05:46:38.111 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T17:49:13.497 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:05:46:38.132 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T17:49:13.498 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:05:46:38.133 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T17:49:13.515 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:49:13.512+0000 1694f700 -1 osd.2 253 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:47:58.601891+0000 (oldest deadline 2019-12-08T17:48:38.601891+0000) 2019-12-08T17:49:13.515 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:49:13.514+0000 1694f700 -1 osd.2 253 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4449.0:101520 7.1 7.94d057d1 (undecoded) ondisk+retry+write+known_if_redirected e251) 2019-12-08T17:49:13.516 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:05:46:38.151 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T17:49:13.679 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:05:46:38.382 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T17:49:13.763 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:05:46:38.329 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T17:49:13.763 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:05:46:38.344 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T17:49:15.799 INFO:tasks.rgw.client.0.smithi079.stdout:2019-12-08T17:49:15.779+0000 20e25700 -1 RGWWatcher::handle_error cookie 823744960 err (107) Transport endpoint is not connected 2019-12-08T17:49:19.360 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:05:46:44.062 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T17:49:19.365 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:05:46:44.068 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T17:49:19.370 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:05:46:44.005 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T17:49:19.371 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:05:46:44.006 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T17:49:19.378 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:05:46:44.012 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T17:49:19.379 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:05:46:44.013 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T17:49:19.406 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:05:46:44.040 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T17:49:19.420 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:05:46:44.055 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T17:49:19.430 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:05:46:44.133 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T17:49:37.226 INFO:tasks.rgw.client.0.smithi079.stdout:2019-12-08T17:49:37.216+0000 20e25700 -1 RGWWatcher::handle_error cookie 1025558544 err (107) Transport endpoint is not connected 2019-12-08T17:49:39.676 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:49:39.548+0000 1694f700 -1 osd.1 251 get_health_metrics reporting 26 slow ops, oldest is osd_op(client.4449.0:105892 5.9 5.84ada7c9 (undecoded) ondisk+write+known_if_redirected e253) 2019-12-08T17:51:06.407 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:51:06.401+0000 1694f700 -1 osd.7 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:22.026647+0000 front 2019-12-08T17:50:26.167127+0000 (oldest deadline 2019-12-08T17:51:06.031465+0000) 2019-12-08T17:51:07.459 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:51:07.455+0000 1694f700 -1 osd.7 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:22.026647+0000 front 2019-12-08T17:50:26.167127+0000 (oldest deadline 2019-12-08T17:51:06.031465+0000) 2019-12-08T17:51:07.662 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:51:07.660+0000 1694f700 -1 osd.1 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:22.512354+0000 front 2019-12-08T17:50:22.546608+0000 (oldest deadline 2019-12-08T17:51:07.171322+0000) 2019-12-08T17:51:07.808 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:51:07.802+0000 1694f700 -1 osd.6 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:21.948355+0000 front 2019-12-08T17:50:21.895069+0000 (oldest deadline 2019-12-08T17:51:07.172164+0000) 2019-12-08T17:51:08.031 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:51:08.026+0000 1694f700 -1 osd.4 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:25.325277+0000 front 2019-12-08T17:50:25.345058+0000 (oldest deadline 2019-12-08T17:51:07.324439+0000) 2019-12-08T17:51:08.450 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:51:08.447+0000 1694f700 -1 osd.0 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:23.909877+0000 front 2019-12-08T17:50:24.101980+0000 (oldest deadline 2019-12-08T17:51:07.927674+0000) 2019-12-08T17:51:08.452 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:51:08.446+0000 1694f700 -1 osd.7 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:22.026647+0000 front 2019-12-08T17:50:26.167127+0000 (oldest deadline 2019-12-08T17:51:06.031465+0000) 2019-12-08T17:51:08.680 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:51:08.679+0000 1694f700 -1 osd.1 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:22.512354+0000 front 2019-12-08T17:50:22.546608+0000 (oldest deadline 2019-12-08T17:51:07.171322+0000) 2019-12-08T17:51:08.831 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:51:08.826+0000 1694f700 -1 osd.6 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:21.948355+0000 front 2019-12-08T17:50:21.895069+0000 (oldest deadline 2019-12-08T17:51:07.172164+0000) 2019-12-08T17:51:09.007 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:51:09.002+0000 1694f700 -1 osd.4 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:25.325277+0000 front 2019-12-08T17:50:25.345058+0000 (oldest deadline 2019-12-08T17:51:07.324439+0000) 2019-12-08T17:51:09.207 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:51:09.204+0000 1694f700 -1 osd.5 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:24.071534+0000 front 2019-12-08T17:50:23.820629+0000 (oldest deadline 2019-12-08T17:51:09.027019+0000) 2019-12-08T17:51:09.454 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:51:09.453+0000 1694f700 -1 osd.0 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:23.909877+0000 front 2019-12-08T17:50:24.101980+0000 (oldest deadline 2019-12-08T17:51:07.927674+0000) 2019-12-08T17:51:09.479 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:51:09.465+0000 1694f700 -1 osd.7 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:22.026647+0000 front 2019-12-08T17:50:26.167127+0000 (oldest deadline 2019-12-08T17:51:06.031465+0000) 2019-12-08T17:51:09.643 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:51:09.641+0000 1694f700 -1 osd.1 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:22.512354+0000 front 2019-12-08T17:50:22.546608+0000 (oldest deadline 2019-12-08T17:51:07.171322+0000) 2019-12-08T17:51:09.865 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:51:09.859+0000 1694f700 -1 osd.6 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:21.948355+0000 front 2019-12-08T17:50:21.895069+0000 (oldest deadline 2019-12-08T17:51:07.172164+0000) 2019-12-08T17:51:10.041 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:51:10.035+0000 1694f700 -1 osd.4 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:25.325277+0000 front 2019-12-08T17:50:25.345058+0000 (oldest deadline 2019-12-08T17:51:07.324439+0000) 2019-12-08T17:51:10.166 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:51:10.161+0000 1694f700 -1 osd.5 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:24.071534+0000 front 2019-12-08T17:50:23.820629+0000 (oldest deadline 2019-12-08T17:51:09.027019+0000) 2019-12-08T17:51:10.492 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:51:10.487+0000 1694f700 -1 osd.7 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:22.026647+0000 front 2019-12-08T17:50:26.167127+0000 (oldest deadline 2019-12-08T17:51:06.031465+0000) 2019-12-08T17:51:10.498 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:51:10.496+0000 1694f700 -1 osd.0 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:23.909877+0000 front 2019-12-08T17:50:24.101980+0000 (oldest deadline 2019-12-08T17:51:07.927674+0000) 2019-12-08T17:51:10.621 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:51:10.620+0000 1694f700 -1 osd.1 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:22.512354+0000 front 2019-12-08T17:50:22.546608+0000 (oldest deadline 2019-12-08T17:51:07.171322+0000) 2019-12-08T17:51:10.875 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:51:10.871+0000 1694f700 -1 osd.6 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:21.948355+0000 front 2019-12-08T17:50:21.895069+0000 (oldest deadline 2019-12-08T17:51:07.172164+0000) 2019-12-08T17:51:11.061 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:51:11.055+0000 1694f700 -1 osd.4 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:25.325277+0000 front 2019-12-08T17:50:25.345058+0000 (oldest deadline 2019-12-08T17:51:07.324439+0000) 2019-12-08T17:51:11.140 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:51:11.135+0000 1694f700 -1 osd.5 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:24.071534+0000 front 2019-12-08T17:50:23.820629+0000 (oldest deadline 2019-12-08T17:51:09.027019+0000) 2019-12-08T17:51:11.274 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:51:11.272+0000 1694f700 -1 osd.3 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:26.167789+0000 front 2019-12-08T17:50:26.051812+0000 (oldest deadline 2019-12-08T17:51:10.651666+0000) 2019-12-08T17:51:11.513 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:51:11.508+0000 1694f700 -1 osd.7 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:22.026647+0000 front 2019-12-08T17:50:26.167127+0000 (oldest deadline 2019-12-08T17:51:06.031465+0000) 2019-12-08T17:51:11.539 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:51:11.538+0000 1694f700 -1 osd.0 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:23.909877+0000 front 2019-12-08T17:50:24.101980+0000 (oldest deadline 2019-12-08T17:51:07.927674+0000) 2019-12-08T17:51:11.631 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:51:11.629+0000 1694f700 -1 osd.1 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:22.512354+0000 front 2019-12-08T17:50:22.546608+0000 (oldest deadline 2019-12-08T17:51:07.171322+0000) 2019-12-08T17:51:11.908 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:51:11.904+0000 1694f700 -1 osd.6 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:21.948355+0000 front 2019-12-08T17:50:21.895069+0000 (oldest deadline 2019-12-08T17:51:07.172164+0000) 2019-12-08T17:51:12.093 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:51:12.090+0000 1694f700 -1 osd.4 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:25.325277+0000 front 2019-12-08T17:50:25.345058+0000 (oldest deadline 2019-12-08T17:51:07.324439+0000) 2019-12-08T17:51:12.157 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:51:12.151+0000 1694f700 -1 osd.5 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:24.071534+0000 front 2019-12-08T17:50:23.820629+0000 (oldest deadline 2019-12-08T17:51:09.027019+0000) 2019-12-08T17:51:12.275 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:51:12.273+0000 1694f700 -1 osd.3 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:26.167789+0000 front 2019-12-08T17:50:26.051812+0000 (oldest deadline 2019-12-08T17:51:10.651666+0000) 2019-12-08T17:51:12.525 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:51:12.523+0000 1694f700 -1 osd.0 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:23.909877+0000 front 2019-12-08T17:50:24.101980+0000 (oldest deadline 2019-12-08T17:51:07.927674+0000) 2019-12-08T17:51:12.540 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:51:12.535+0000 1694f700 -1 osd.7 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:22.026647+0000 front 2019-12-08T17:50:26.167127+0000 (oldest deadline 2019-12-08T17:51:06.031465+0000) 2019-12-08T17:51:12.628 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:51:12.626+0000 1694f700 -1 osd.1 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:22.512354+0000 front 2019-12-08T17:50:22.546608+0000 (oldest deadline 2019-12-08T17:51:07.171322+0000) 2019-12-08T17:51:12.921 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:51:12.916+0000 1694f700 -1 osd.6 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:21.948355+0000 front 2019-12-08T17:50:21.895069+0000 (oldest deadline 2019-12-08T17:51:07.172164+0000) 2019-12-08T17:51:13.080 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:51:13.075+0000 1694f700 -1 osd.4 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:25.325277+0000 front 2019-12-08T17:50:25.345058+0000 (oldest deadline 2019-12-08T17:51:07.324439+0000) 2019-12-08T17:51:13.166 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:51:13.160+0000 1694f700 -1 osd.5 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:24.071534+0000 front 2019-12-08T17:50:23.820629+0000 (oldest deadline 2019-12-08T17:51:09.027019+0000) 2019-12-08T17:51:13.262 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:51:13.261+0000 1694f700 -1 osd.3 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:26.167789+0000 front 2019-12-08T17:50:26.051812+0000 (oldest deadline 2019-12-08T17:51:10.651666+0000) 2019-12-08T17:51:13.485 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:51:13.483+0000 1694f700 -1 osd.0 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:23.909877+0000 front 2019-12-08T17:50:24.101980+0000 (oldest deadline 2019-12-08T17:51:07.927674+0000) 2019-12-08T17:51:13.571 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:51:13.566+0000 1694f700 -1 osd.7 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:22.026647+0000 front 2019-12-08T17:50:26.167127+0000 (oldest deadline 2019-12-08T17:51:06.031465+0000) 2019-12-08T17:51:13.645 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:51:13.642+0000 1694f700 -1 osd.1 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:22.512354+0000 front 2019-12-08T17:50:22.546608+0000 (oldest deadline 2019-12-08T17:51:07.171322+0000) 2019-12-08T17:51:13.889 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:51:13.885+0000 1694f700 -1 osd.6 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:21.948355+0000 front 2019-12-08T17:50:21.895069+0000 (oldest deadline 2019-12-08T17:51:07.172164+0000) 2019-12-08T17:51:14.121 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:51:14.113+0000 1694f700 -1 osd.4 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:25.325277+0000 front 2019-12-08T17:50:25.345058+0000 (oldest deadline 2019-12-08T17:51:07.324439+0000) 2019-12-08T17:51:14.146 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:51:14.141+0000 1694f700 -1 osd.5 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:24.071534+0000 front 2019-12-08T17:50:23.820629+0000 (oldest deadline 2019-12-08T17:51:09.027019+0000) 2019-12-08T17:51:14.237 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:51:14.234+0000 1694f700 -1 osd.3 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:26.167789+0000 front 2019-12-08T17:50:26.051812+0000 (oldest deadline 2019-12-08T17:51:10.651666+0000) 2019-12-08T17:51:14.484 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:51:14.483+0000 1694f700 -1 osd.0 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:23.909877+0000 front 2019-12-08T17:50:24.101980+0000 (oldest deadline 2019-12-08T17:51:07.927674+0000) 2019-12-08T17:51:14.592 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:51:14.586+0000 1694f700 -1 osd.7 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:22.026647+0000 front 2019-12-08T17:50:26.167127+0000 (oldest deadline 2019-12-08T17:51:06.031465+0000) 2019-12-08T17:51:14.619 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:51:14.619+0000 1694f700 -1 osd.1 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:22.512354+0000 front 2019-12-08T17:50:22.546608+0000 (oldest deadline 2019-12-08T17:51:07.171322+0000) 2019-12-08T17:51:14.908 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:51:14.903+0000 1694f700 -1 osd.6 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:21.948355+0000 front 2019-12-08T17:50:21.895069+0000 (oldest deadline 2019-12-08T17:51:07.172164+0000) 2019-12-08T17:51:15.106 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:51:15.101+0000 1694f700 -1 osd.4 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:25.325277+0000 front 2019-12-08T17:50:25.345058+0000 (oldest deadline 2019-12-08T17:51:07.324439+0000) 2019-12-08T17:51:15.176 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:51:15.171+0000 1694f700 -1 osd.5 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:24.071534+0000 front 2019-12-08T17:50:23.820629+0000 (oldest deadline 2019-12-08T17:51:09.027019+0000) 2019-12-08T17:51:15.258 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:51:15.257+0000 1694f700 -1 osd.3 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:26.167789+0000 front 2019-12-08T17:50:26.051812+0000 (oldest deadline 2019-12-08T17:51:10.651666+0000) 2019-12-08T17:51:15.460 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:51:15.460+0000 1694f700 -1 osd.0 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:23.909877+0000 front 2019-12-08T17:50:24.101980+0000 (oldest deadline 2019-12-08T17:51:07.927674+0000) 2019-12-08T17:51:15.592 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:51:15.587+0000 1694f700 -1 osd.1 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:22.512354+0000 front 2019-12-08T17:50:22.546608+0000 (oldest deadline 2019-12-08T17:51:07.171322+0000) 2019-12-08T17:51:15.606 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:51:15.601+0000 1694f700 -1 osd.7 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:22.026647+0000 front 2019-12-08T17:50:26.167127+0000 (oldest deadline 2019-12-08T17:51:06.031465+0000) 2019-12-08T17:51:15.904 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:51:15.897+0000 1694f700 -1 osd.6 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:21.948355+0000 front 2019-12-08T17:50:21.895069+0000 (oldest deadline 2019-12-08T17:51:07.172164+0000) 2019-12-08T17:51:16.135 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:51:16.129+0000 1694f700 -1 osd.4 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:25.325277+0000 front 2019-12-08T17:50:25.345058+0000 (oldest deadline 2019-12-08T17:51:07.324439+0000) 2019-12-08T17:51:16.153 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:51:16.147+0000 1694f700 -1 osd.5 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:24.071534+0000 front 2019-12-08T17:50:23.820629+0000 (oldest deadline 2019-12-08T17:51:09.027019+0000) 2019-12-08T17:51:16.275 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:51:16.275+0000 1694f700 -1 osd.3 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:26.167789+0000 front 2019-12-08T17:50:26.051812+0000 (oldest deadline 2019-12-08T17:51:10.651666+0000) 2019-12-08T17:51:16.485 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:51:16.484+0000 1694f700 -1 osd.0 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:23.909877+0000 front 2019-12-08T17:50:24.101980+0000 (oldest deadline 2019-12-08T17:51:07.927674+0000) 2019-12-08T17:51:16.560 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:51:16.558+0000 1694f700 -1 osd.1 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:22.512354+0000 front 2019-12-08T17:50:22.546608+0000 (oldest deadline 2019-12-08T17:51:07.171322+0000) 2019-12-08T17:51:16.635 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:51:16.629+0000 1694f700 -1 osd.7 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:22.026647+0000 front 2019-12-08T17:50:26.167127+0000 (oldest deadline 2019-12-08T17:51:06.031465+0000) 2019-12-08T17:51:16.884 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:51:16.878+0000 1694f700 -1 osd.6 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:21.948355+0000 front 2019-12-08T17:50:21.895069+0000 (oldest deadline 2019-12-08T17:51:07.172164+0000) 2019-12-08T17:51:17.137 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:51:17.131+0000 1694f700 -1 osd.4 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:25.325277+0000 front 2019-12-08T17:50:25.345058+0000 (oldest deadline 2019-12-08T17:51:07.324439+0000) 2019-12-08T17:51:17.137 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:51:17.132+0000 1694f700 -1 osd.5 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:24.071534+0000 front 2019-12-08T17:50:23.820629+0000 (oldest deadline 2019-12-08T17:51:09.027019+0000) 2019-12-08T17:51:17.284 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:51:17.283+0000 1694f700 -1 osd.3 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:26.167789+0000 front 2019-12-08T17:50:26.051812+0000 (oldest deadline 2019-12-08T17:51:10.651666+0000) 2019-12-08T17:51:17.521 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:51:17.520+0000 1694f700 -1 osd.0 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:23.909877+0000 front 2019-12-08T17:50:24.101980+0000 (oldest deadline 2019-12-08T17:51:07.927674+0000) 2019-12-08T17:51:17.556 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:51:17.556+0000 1694f700 -1 osd.1 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:22.512354+0000 front 2019-12-08T17:50:22.546608+0000 (oldest deadline 2019-12-08T17:51:07.171322+0000) 2019-12-08T17:51:17.595 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:51:17.590+0000 1694f700 -1 osd.7 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:22.026647+0000 front 2019-12-08T17:50:26.167127+0000 (oldest deadline 2019-12-08T17:51:06.031465+0000) 2019-12-08T17:51:17.868 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:51:17.860+0000 1694f700 -1 osd.6 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:21.948355+0000 front 2019-12-08T17:50:21.895069+0000 (oldest deadline 2019-12-08T17:51:07.172164+0000) 2019-12-08T17:51:18.095 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:51:18.089+0000 1694f700 -1 osd.4 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:25.325277+0000 front 2019-12-08T17:50:25.345058+0000 (oldest deadline 2019-12-08T17:51:07.324439+0000) 2019-12-08T17:51:18.110 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:51:18.104+0000 1694f700 -1 osd.5 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:24.071534+0000 front 2019-12-08T17:50:23.820629+0000 (oldest deadline 2019-12-08T17:51:09.027019+0000) 2019-12-08T17:51:18.264 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:51:18.263+0000 1694f700 -1 osd.3 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:26.167789+0000 front 2019-12-08T17:50:26.051812+0000 (oldest deadline 2019-12-08T17:51:10.651666+0000) 2019-12-08T17:51:18.499 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:51:18.497+0000 1694f700 -1 osd.0 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:23.909877+0000 front 2019-12-08T17:50:24.101980+0000 (oldest deadline 2019-12-08T17:51:07.927674+0000) 2019-12-08T17:51:18.606 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:51:18.605+0000 1694f700 -1 osd.1 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:22.512354+0000 front 2019-12-08T17:50:22.546608+0000 (oldest deadline 2019-12-08T17:51:07.171322+0000) 2019-12-08T17:51:18.649 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:51:18.644+0000 1694f700 -1 osd.7 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:22.026647+0000 front 2019-12-08T17:50:26.167127+0000 (oldest deadline 2019-12-08T17:51:06.031465+0000) 2019-12-08T17:51:18.878 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:51:18.872+0000 1694f700 -1 osd.6 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:21.948355+0000 front 2019-12-08T17:50:21.895069+0000 (oldest deadline 2019-12-08T17:51:07.172164+0000) 2019-12-08T17:51:19.062 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:51:19.057+0000 1694f700 -1 osd.4 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:25.325277+0000 front 2019-12-08T17:50:25.345058+0000 (oldest deadline 2019-12-08T17:51:07.324439+0000) 2019-12-08T17:51:19.075 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:51:19.069+0000 1694f700 -1 osd.5 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:24.071534+0000 front 2019-12-08T17:50:23.820629+0000 (oldest deadline 2019-12-08T17:51:09.027019+0000) 2019-12-08T17:51:19.292 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:51:19.291+0000 1694f700 -1 osd.3 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:26.167789+0000 front 2019-12-08T17:50:26.051812+0000 (oldest deadline 2019-12-08T17:51:10.651666+0000) 2019-12-08T17:51:19.484 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:51:19.480+0000 1694f700 -1 osd.0 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:23.909877+0000 front 2019-12-08T17:50:24.101980+0000 (oldest deadline 2019-12-08T17:51:07.927674+0000) 2019-12-08T17:51:19.608 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:51:19.606+0000 1694f700 -1 osd.1 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:22.512354+0000 front 2019-12-08T17:50:22.546608+0000 (oldest deadline 2019-12-08T17:51:07.171322+0000) 2019-12-08T17:51:19.632 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:51:19.626+0000 1694f700 -1 osd.7 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:22.026647+0000 front 2019-12-08T17:50:26.167127+0000 (oldest deadline 2019-12-08T17:51:06.031465+0000) 2019-12-08T17:51:19.910 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:51:19.903+0000 1694f700 -1 osd.6 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:21.948355+0000 front 2019-12-08T17:50:21.895069+0000 (oldest deadline 2019-12-08T17:51:07.172164+0000) 2019-12-08T17:51:20.022 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:51:20.016+0000 1694f700 -1 osd.4 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:25.325277+0000 front 2019-12-08T17:50:25.345058+0000 (oldest deadline 2019-12-08T17:51:07.324439+0000) 2019-12-08T17:51:20.054 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:51:20.047+0000 1694f700 -1 osd.5 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:24.071534+0000 front 2019-12-08T17:50:23.820629+0000 (oldest deadline 2019-12-08T17:51:09.027019+0000) 2019-12-08T17:51:20.339 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:51:20.337+0000 1694f700 -1 osd.3 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:26.167789+0000 front 2019-12-08T17:50:26.051812+0000 (oldest deadline 2019-12-08T17:51:10.651666+0000) 2019-12-08T17:51:20.489 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:51:20.487+0000 1694f700 -1 osd.0 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:23.909877+0000 front 2019-12-08T17:50:24.101980+0000 (oldest deadline 2019-12-08T17:51:07.927674+0000) 2019-12-08T17:51:20.643 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:51:20.642+0000 1694f700 -1 osd.1 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:22.512354+0000 front 2019-12-08T17:50:22.546608+0000 (oldest deadline 2019-12-08T17:51:07.171322+0000) 2019-12-08T17:51:20.653 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:51:20.647+0000 1694f700 -1 osd.7 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:22.026647+0000 front 2019-12-08T17:50:26.167127+0000 (oldest deadline 2019-12-08T17:51:06.031465+0000) 2019-12-08T17:51:20.928 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:51:20.922+0000 1694f700 -1 osd.6 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:21.948355+0000 front 2019-12-08T17:50:21.895069+0000 (oldest deadline 2019-12-08T17:51:07.172164+0000) 2019-12-08T17:51:20.985 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:51:20.979+0000 1694f700 -1 osd.4 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:25.325277+0000 front 2019-12-08T17:50:25.345058+0000 (oldest deadline 2019-12-08T17:51:07.324439+0000) 2019-12-08T17:51:21.074 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:51:21.068+0000 1694f700 -1 osd.5 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:24.071534+0000 front 2019-12-08T17:50:23.820629+0000 (oldest deadline 2019-12-08T17:51:09.027019+0000) 2019-12-08T17:51:21.360 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:51:21.355+0000 1694f700 -1 osd.3 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:26.167789+0000 front 2019-12-08T17:50:26.051812+0000 (oldest deadline 2019-12-08T17:51:10.651666+0000) 2019-12-08T17:51:21.482 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:51:21.480+0000 1694f700 -1 osd.0 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:23.909877+0000 front 2019-12-08T17:50:24.101980+0000 (oldest deadline 2019-12-08T17:51:07.927674+0000) 2019-12-08T17:51:21.655 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:51:21.652+0000 1694f700 -1 osd.1 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:22.512354+0000 front 2019-12-08T17:50:22.546608+0000 (oldest deadline 2019-12-08T17:51:07.171322+0000) 2019-12-08T17:51:21.664 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:51:21.658+0000 1694f700 -1 osd.7 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:22.026647+0000 front 2019-12-08T17:50:26.167127+0000 (oldest deadline 2019-12-08T17:51:06.031465+0000) 2019-12-08T17:51:21.906 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:51:21.900+0000 1694f700 -1 osd.6 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:21.948355+0000 front 2019-12-08T17:50:21.895069+0000 (oldest deadline 2019-12-08T17:51:07.172164+0000) 2019-12-08T17:51:22.017 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:51:22.011+0000 1694f700 -1 osd.4 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:25.325277+0000 front 2019-12-08T17:50:25.345058+0000 (oldest deadline 2019-12-08T17:51:07.324439+0000) 2019-12-08T17:51:22.066 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:51:22.061+0000 1694f700 -1 osd.5 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:24.071534+0000 front 2019-12-08T17:50:23.820629+0000 (oldest deadline 2019-12-08T17:51:09.027019+0000) 2019-12-08T17:51:22.316 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:51:22.315+0000 1694f700 -1 osd.3 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:26.167789+0000 front 2019-12-08T17:50:26.051812+0000 (oldest deadline 2019-12-08T17:51:10.651666+0000) 2019-12-08T17:51:22.449 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:51:22.442+0000 1694f700 -1 osd.0 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:23.909877+0000 front 2019-12-08T17:50:24.101980+0000 (oldest deadline 2019-12-08T17:51:07.927674+0000) 2019-12-08T17:51:22.638 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:51:22.637+0000 1694f700 -1 osd.1 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:22.512354+0000 front 2019-12-08T17:50:22.546608+0000 (oldest deadline 2019-12-08T17:51:07.171322+0000) 2019-12-08T17:51:22.639 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:51:22.634+0000 1694f700 -1 osd.7 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:22.026647+0000 front 2019-12-08T17:50:26.167127+0000 (oldest deadline 2019-12-08T17:51:06.031465+0000) 2019-12-08T17:51:22.943 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:51:22.937+0000 1694f700 -1 osd.6 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:21.948355+0000 front 2019-12-08T17:50:21.895069+0000 (oldest deadline 2019-12-08T17:51:07.172164+0000) 2019-12-08T17:51:22.986 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:51:22.980+0000 1694f700 -1 osd.4 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:25.325277+0000 front 2019-12-08T17:50:25.345058+0000 (oldest deadline 2019-12-08T17:51:07.324439+0000) 2019-12-08T17:51:23.116 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:51:23.112+0000 1694f700 -1 osd.5 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:24.071534+0000 front 2019-12-08T17:50:23.820629+0000 (oldest deadline 2019-12-08T17:51:09.027019+0000) 2019-12-08T17:51:23.314 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:51:23.313+0000 1694f700 -1 osd.3 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:26.167789+0000 front 2019-12-08T17:50:26.051812+0000 (oldest deadline 2019-12-08T17:51:10.651666+0000) 2019-12-08T17:51:23.449 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:51:23.449+0000 1694f700 -1 osd.0 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:23.909877+0000 front 2019-12-08T17:50:24.101980+0000 (oldest deadline 2019-12-08T17:51:07.927674+0000) 2019-12-08T17:51:23.626 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:51:23.619+0000 1694f700 -1 osd.7 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:22.026647+0000 front 2019-12-08T17:50:26.167127+0000 (oldest deadline 2019-12-08T17:51:06.031465+0000) 2019-12-08T17:51:23.665 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:51:23.664+0000 1694f700 -1 osd.1 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:22.512354+0000 front 2019-12-08T17:50:22.546608+0000 (oldest deadline 2019-12-08T17:51:07.171322+0000) 2019-12-08T17:51:23.920 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:51:23.914+0000 1694f700 -1 osd.6 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:21.948355+0000 front 2019-12-08T17:50:21.895069+0000 (oldest deadline 2019-12-08T17:51:07.172164+0000) 2019-12-08T17:51:23.997 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:51:23.989+0000 1694f700 -1 osd.4 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:25.325277+0000 front 2019-12-08T17:50:25.345058+0000 (oldest deadline 2019-12-08T17:51:07.324439+0000) 2019-12-08T17:51:24.141 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:51:24.135+0000 1694f700 -1 osd.5 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:24.071534+0000 front 2019-12-08T17:50:23.820629+0000 (oldest deadline 2019-12-08T17:51:09.027019+0000) 2019-12-08T17:51:24.297 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:51:24.296+0000 1694f700 -1 osd.3 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:26.167789+0000 front 2019-12-08T17:50:26.051812+0000 (oldest deadline 2019-12-08T17:51:10.651666+0000) 2019-12-08T17:51:24.463 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:51:24.460+0000 1694f700 -1 osd.0 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:23.909877+0000 front 2019-12-08T17:50:24.101980+0000 (oldest deadline 2019-12-08T17:51:07.927674+0000) 2019-12-08T17:51:24.611 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:51:24.605+0000 1694f700 -1 osd.7 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:22.026647+0000 front 2019-12-08T17:50:26.167127+0000 (oldest deadline 2019-12-08T17:51:06.031465+0000) 2019-12-08T17:51:24.646 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:51:24.645+0000 1694f700 -1 osd.1 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:22.512354+0000 front 2019-12-08T17:50:22.546608+0000 (oldest deadline 2019-12-08T17:51:07.171322+0000) 2019-12-08T17:51:24.953 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:51:24.947+0000 1694f700 -1 osd.6 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:21.948355+0000 front 2019-12-08T17:50:21.895069+0000 (oldest deadline 2019-12-08T17:51:07.172164+0000) 2019-12-08T17:51:24.971 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:51:24.965+0000 1694f700 -1 osd.4 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:25.325277+0000 front 2019-12-08T17:50:25.345058+0000 (oldest deadline 2019-12-08T17:51:07.324439+0000) 2019-12-08T17:51:25.126 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:51:25.121+0000 1694f700 -1 osd.5 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:24.071534+0000 front 2019-12-08T17:50:23.820629+0000 (oldest deadline 2019-12-08T17:51:09.027019+0000) 2019-12-08T17:51:25.300 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:51:25.299+0000 1694f700 -1 osd.3 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:26.167789+0000 front 2019-12-08T17:50:26.051812+0000 (oldest deadline 2019-12-08T17:51:10.651666+0000) 2019-12-08T17:51:25.489 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:51:25.488+0000 1694f700 -1 osd.0 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:23.909877+0000 front 2019-12-08T17:50:24.101980+0000 (oldest deadline 2019-12-08T17:51:07.927674+0000) 2019-12-08T17:51:25.640 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:51:25.633+0000 1694f700 -1 osd.7 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:22.026647+0000 front 2019-12-08T17:50:26.167127+0000 (oldest deadline 2019-12-08T17:51:06.031465+0000) 2019-12-08T17:51:25.667 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:51:25.666+0000 1694f700 -1 osd.1 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:22.512354+0000 front 2019-12-08T17:50:22.546608+0000 (oldest deadline 2019-12-08T17:51:07.171322+0000) 2019-12-08T17:51:25.970 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:51:25.964+0000 1694f700 -1 osd.6 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:21.948355+0000 front 2019-12-08T17:50:21.895069+0000 (oldest deadline 2019-12-08T17:51:07.172164+0000) 2019-12-08T17:51:26.015 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:51:26.009+0000 1694f700 -1 osd.4 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:25.325277+0000 front 2019-12-08T17:50:25.345058+0000 (oldest deadline 2019-12-08T17:51:07.324439+0000) 2019-12-08T17:51:26.106 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:51:26.100+0000 1694f700 -1 osd.5 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:24.071534+0000 front 2019-12-08T17:50:23.820629+0000 (oldest deadline 2019-12-08T17:51:09.027019+0000) 2019-12-08T17:51:26.334 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:51:26.332+0000 1694f700 -1 osd.3 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:26.167789+0000 front 2019-12-08T17:50:26.051812+0000 (oldest deadline 2019-12-08T17:51:10.651666+0000) 2019-12-08T17:51:26.505 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:51:26.503+0000 1694f700 -1 osd.0 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:23.909877+0000 front 2019-12-08T17:50:24.101980+0000 (oldest deadline 2019-12-08T17:51:07.927674+0000) 2019-12-08T17:51:26.595 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:51:26.589+0000 1694f700 -1 osd.7 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:22.026647+0000 front 2019-12-08T17:50:26.167127+0000 (oldest deadline 2019-12-08T17:51:06.031465+0000) 2019-12-08T17:51:26.635 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:51:26.633+0000 1694f700 -1 osd.1 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:22.512354+0000 front 2019-12-08T17:50:22.546608+0000 (oldest deadline 2019-12-08T17:51:07.171322+0000) 2019-12-08T17:51:26.936 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:51:26.931+0000 1694f700 -1 osd.6 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:21.948355+0000 front 2019-12-08T17:50:21.895069+0000 (oldest deadline 2019-12-08T17:51:07.172164+0000) 2019-12-08T17:51:26.994 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:51:26.988+0000 1694f700 -1 osd.4 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:25.325277+0000 front 2019-12-08T17:50:25.345058+0000 (oldest deadline 2019-12-08T17:51:07.324439+0000) 2019-12-08T17:51:27.145 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:51:27.139+0000 1694f700 -1 osd.5 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:24.071534+0000 front 2019-12-08T17:50:23.820629+0000 (oldest deadline 2019-12-08T17:51:09.027019+0000) 2019-12-08T17:51:27.313 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:51:27.312+0000 1694f700 -1 osd.3 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:26.167789+0000 front 2019-12-08T17:50:26.051812+0000 (oldest deadline 2019-12-08T17:51:10.651666+0000) 2019-12-08T17:51:27.506 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:51:27.505+0000 1694f700 -1 osd.0 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:23.909877+0000 front 2019-12-08T17:50:24.101980+0000 (oldest deadline 2019-12-08T17:51:07.927674+0000) 2019-12-08T17:51:27.570 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:51:27.563+0000 1694f700 -1 osd.7 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:22.026647+0000 front 2019-12-08T17:50:26.167127+0000 (oldest deadline 2019-12-08T17:51:06.031465+0000) 2019-12-08T17:51:27.599 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:51:27.597+0000 1694f700 -1 osd.1 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:22.512354+0000 front 2019-12-08T17:50:22.546608+0000 (oldest deadline 2019-12-08T17:51:07.171322+0000) 2019-12-08T17:51:27.910 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:51:27.904+0000 1694f700 -1 osd.6 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:21.948355+0000 front 2019-12-08T17:50:21.895069+0000 (oldest deadline 2019-12-08T17:51:07.172164+0000) 2019-12-08T17:51:27.983 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:51:27.978+0000 1694f700 -1 osd.4 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:25.325277+0000 front 2019-12-08T17:50:25.345058+0000 (oldest deadline 2019-12-08T17:51:07.324439+0000) 2019-12-08T17:51:28.132 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:51:28.126+0000 1694f700 -1 osd.5 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:24.071534+0000 front 2019-12-08T17:50:23.820629+0000 (oldest deadline 2019-12-08T17:51:09.027019+0000) 2019-12-08T17:51:28.354 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:51:28.353+0000 1694f700 -1 osd.3 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:26.167789+0000 front 2019-12-08T17:50:26.051812+0000 (oldest deadline 2019-12-08T17:51:10.651666+0000) 2019-12-08T17:51:28.477 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:51:28.475+0000 1694f700 -1 osd.0 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:23.909877+0000 front 2019-12-08T17:50:24.101980+0000 (oldest deadline 2019-12-08T17:51:07.927674+0000) 2019-12-08T17:51:28.568 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:51:28.567+0000 1694f700 -1 osd.1 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:22.512354+0000 front 2019-12-08T17:50:22.546608+0000 (oldest deadline 2019-12-08T17:51:07.171322+0000) 2019-12-08T17:51:28.609 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:51:28.603+0000 1694f700 -1 osd.7 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:22.026647+0000 front 2019-12-08T17:50:26.167127+0000 (oldest deadline 2019-12-08T17:51:06.031465+0000) 2019-12-08T17:51:28.950 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:51:28.944+0000 1694f700 -1 osd.4 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:25.325277+0000 front 2019-12-08T17:50:25.345058+0000 (oldest deadline 2019-12-08T17:51:07.324439+0000) 2019-12-08T17:51:28.956 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:51:28.949+0000 1694f700 -1 osd.6 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:21.948355+0000 front 2019-12-08T17:50:21.895069+0000 (oldest deadline 2019-12-08T17:51:07.172164+0000) 2019-12-08T17:51:29.164 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:51:29.158+0000 1694f700 -1 osd.5 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:24.071534+0000 front 2019-12-08T17:50:23.820629+0000 (oldest deadline 2019-12-08T17:51:09.027019+0000) 2019-12-08T17:51:29.337 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:51:29.335+0000 1694f700 -1 osd.3 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:26.167789+0000 front 2019-12-08T17:50:26.051812+0000 (oldest deadline 2019-12-08T17:51:10.651666+0000) 2019-12-08T17:51:29.510 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:51:29.507+0000 1694f700 -1 osd.0 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:23.909877+0000 front 2019-12-08T17:50:24.101980+0000 (oldest deadline 2019-12-08T17:51:07.927674+0000) 2019-12-08T17:51:29.580 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:51:29.577+0000 1694f700 -1 osd.1 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:22.512354+0000 front 2019-12-08T17:50:22.546608+0000 (oldest deadline 2019-12-08T17:51:07.171322+0000) 2019-12-08T17:51:29.595 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:51:29.588+0000 1694f700 -1 osd.7 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:22.026647+0000 front 2019-12-08T17:50:26.167127+0000 (oldest deadline 2019-12-08T17:51:06.031465+0000) 2019-12-08T17:51:29.926 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:51:29.920+0000 1694f700 -1 osd.4 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:25.325277+0000 front 2019-12-08T17:50:25.345058+0000 (oldest deadline 2019-12-08T17:51:07.324439+0000) 2019-12-08T17:51:29.946 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:51:29.939+0000 1694f700 -1 osd.6 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:21.948355+0000 front 2019-12-08T17:50:21.895069+0000 (oldest deadline 2019-12-08T17:51:07.172164+0000) 2019-12-08T17:51:30.121 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:51:30.115+0000 1694f700 -1 osd.5 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:24.071534+0000 front 2019-12-08T17:50:23.820629+0000 (oldest deadline 2019-12-08T17:51:09.027019+0000) 2019-12-08T17:51:30.344 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:51:30.342+0000 1694f700 -1 osd.3 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:26.167789+0000 front 2019-12-08T17:50:26.051812+0000 (oldest deadline 2019-12-08T17:51:10.651666+0000) 2019-12-08T17:51:30.528 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:51:30.526+0000 1694f700 -1 osd.0 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:23.909877+0000 front 2019-12-08T17:50:24.101980+0000 (oldest deadline 2019-12-08T17:51:07.927674+0000) 2019-12-08T17:51:30.574 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:51:30.568+0000 1694f700 -1 osd.7 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:22.026647+0000 front 2019-12-08T17:50:26.167127+0000 (oldest deadline 2019-12-08T17:51:06.031465+0000) 2019-12-08T17:51:30.597 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:51:30.593+0000 1694f700 -1 osd.1 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:22.512354+0000 front 2019-12-08T17:50:22.546608+0000 (oldest deadline 2019-12-08T17:51:07.171322+0000) 2019-12-08T17:51:30.941 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:51:30.934+0000 1694f700 -1 osd.6 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:21.948355+0000 front 2019-12-08T17:50:21.895069+0000 (oldest deadline 2019-12-08T17:51:07.172164+0000) 2019-12-08T17:51:30.960 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:51:30.954+0000 1694f700 -1 osd.4 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:25.325277+0000 front 2019-12-08T17:50:25.345058+0000 (oldest deadline 2019-12-08T17:51:07.324439+0000) 2019-12-08T17:51:31.090 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:51:31.084+0000 1694f700 -1 osd.5 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:24.071534+0000 front 2019-12-08T17:50:23.820629+0000 (oldest deadline 2019-12-08T17:51:09.027019+0000) 2019-12-08T17:51:31.300 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:51:31.299+0000 1694f700 -1 osd.3 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:26.167789+0000 front 2019-12-08T17:50:26.051812+0000 (oldest deadline 2019-12-08T17:51:10.651666+0000) 2019-12-08T17:51:31.507 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:51:31.505+0000 1694f700 -1 osd.0 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:23.909877+0000 front 2019-12-08T17:50:24.101980+0000 (oldest deadline 2019-12-08T17:51:07.927674+0000) 2019-12-08T17:51:31.593 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:51:31.587+0000 1694f700 -1 osd.7 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:22.026647+0000 front 2019-12-08T17:50:26.167127+0000 (oldest deadline 2019-12-08T17:51:06.031465+0000) 2019-12-08T17:51:31.594 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:51:31.593+0000 1694f700 -1 osd.1 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:22.512354+0000 front 2019-12-08T17:50:22.546608+0000 (oldest deadline 2019-12-08T17:51:07.171322+0000) 2019-12-08T17:51:31.935 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:51:31.929+0000 1694f700 -1 osd.6 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:21.948355+0000 front 2019-12-08T17:50:21.895069+0000 (oldest deadline 2019-12-08T17:51:07.172164+0000) 2019-12-08T17:51:31.960 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:51:31.954+0000 1694f700 -1 osd.4 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:25.325277+0000 front 2019-12-08T17:50:25.345058+0000 (oldest deadline 2019-12-08T17:51:07.324439+0000) 2019-12-08T17:51:32.080 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:51:32.074+0000 1694f700 -1 osd.5 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:24.071534+0000 front 2019-12-08T17:50:23.820629+0000 (oldest deadline 2019-12-08T17:51:09.027019+0000) 2019-12-08T17:51:32.307 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:51:32.305+0000 1694f700 -1 osd.3 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:26.167789+0000 front 2019-12-08T17:50:26.051812+0000 (oldest deadline 2019-12-08T17:51:10.651666+0000) 2019-12-08T17:51:32.476 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:51:32.472+0000 1694f700 -1 osd.0 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:23.909877+0000 front 2019-12-08T17:50:24.101980+0000 (oldest deadline 2019-12-08T17:51:07.927674+0000) 2019-12-08T17:51:32.605 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:51:32.598+0000 1694f700 -1 osd.1 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:22.512354+0000 front 2019-12-08T17:50:22.546608+0000 (oldest deadline 2019-12-08T17:51:07.171322+0000) 2019-12-08T17:51:32.640 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:51:32.632+0000 1694f700 -1 osd.7 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:22.026647+0000 front 2019-12-08T17:50:26.167127+0000 (oldest deadline 2019-12-08T17:51:06.031465+0000) 2019-12-08T17:51:32.922 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:51:32.917+0000 1694f700 -1 osd.6 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:21.948355+0000 front 2019-12-08T17:50:21.895069+0000 (oldest deadline 2019-12-08T17:51:07.172164+0000) 2019-12-08T17:51:32.994 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:51:32.988+0000 1694f700 -1 osd.4 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:25.325277+0000 front 2019-12-08T17:50:25.345058+0000 (oldest deadline 2019-12-08T17:51:07.324439+0000) 2019-12-08T17:51:33.103 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:51:33.097+0000 1694f700 -1 osd.5 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:24.071534+0000 front 2019-12-08T17:50:23.820629+0000 (oldest deadline 2019-12-08T17:51:09.027019+0000) 2019-12-08T17:51:33.285 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:51:33.283+0000 1694f700 -1 osd.3 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:26.167789+0000 front 2019-12-08T17:50:26.051812+0000 (oldest deadline 2019-12-08T17:51:10.651666+0000) 2019-12-08T17:51:33.431 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:51:33.430+0000 1694f700 -1 osd.0 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:23.909877+0000 front 2019-12-08T17:50:24.101980+0000 (oldest deadline 2019-12-08T17:51:07.927674+0000) 2019-12-08T17:51:33.571 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:51:33.570+0000 1694f700 -1 osd.1 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:22.512354+0000 front 2019-12-08T17:50:22.546608+0000 (oldest deadline 2019-12-08T17:51:07.171322+0000) 2019-12-08T17:51:33.701 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:51:33.695+0000 1694f700 -1 osd.7 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:22.026647+0000 front 2019-12-08T17:50:26.167127+0000 (oldest deadline 2019-12-08T17:51:06.031465+0000) 2019-12-08T17:51:33.956 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:51:33.950+0000 1694f700 -1 osd.6 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:21.948355+0000 front 2019-12-08T17:50:21.895069+0000 (oldest deadline 2019-12-08T17:51:07.172164+0000) 2019-12-08T17:51:33.997 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:51:33.992+0000 1694f700 -1 osd.4 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:25.325277+0000 front 2019-12-08T17:50:25.345058+0000 (oldest deadline 2019-12-08T17:51:07.324439+0000) 2019-12-08T17:51:34.081 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:51:34.072+0000 1694f700 -1 osd.5 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:24.071534+0000 front 2019-12-08T17:50:23.820629+0000 (oldest deadline 2019-12-08T17:51:09.027019+0000) 2019-12-08T17:51:34.319 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:51:34.317+0000 1694f700 -1 osd.3 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:26.167789+0000 front 2019-12-08T17:50:26.051812+0000 (oldest deadline 2019-12-08T17:51:10.651666+0000) 2019-12-08T17:51:34.441 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:51:34.438+0000 1694f700 -1 osd.0 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:23.909877+0000 front 2019-12-08T17:50:24.101980+0000 (oldest deadline 2019-12-08T17:51:07.927674+0000) 2019-12-08T17:51:34.555 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:51:34.552+0000 1694f700 -1 osd.1 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:22.512354+0000 front 2019-12-08T17:50:22.546608+0000 (oldest deadline 2019-12-08T17:51:07.171322+0000) 2019-12-08T17:51:34.661 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:51:34.656+0000 1694f700 -1 osd.7 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:22.026647+0000 front 2019-12-08T17:50:26.167127+0000 (oldest deadline 2019-12-08T17:51:06.031465+0000) 2019-12-08T17:51:34.972 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:51:34.966+0000 1694f700 -1 osd.6 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:21.948355+0000 front 2019-12-08T17:50:21.895069+0000 (oldest deadline 2019-12-08T17:51:07.172164+0000) 2019-12-08T17:51:35.035 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:51:35.028+0000 1694f700 -1 osd.4 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:25.325277+0000 front 2019-12-08T17:50:25.345058+0000 (oldest deadline 2019-12-08T17:51:07.324439+0000) 2019-12-08T17:51:35.132 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:51:35.127+0000 1694f700 -1 osd.5 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:24.071534+0000 front 2019-12-08T17:50:23.820629+0000 (oldest deadline 2019-12-08T17:51:09.027019+0000) 2019-12-08T17:51:35.370 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:51:35.368+0000 1694f700 -1 osd.3 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:26.167789+0000 front 2019-12-08T17:50:26.051812+0000 (oldest deadline 2019-12-08T17:51:10.651666+0000) 2019-12-08T17:51:35.396 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:51:35.394+0000 1694f700 -1 osd.0 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:23.909877+0000 front 2019-12-08T17:50:24.101980+0000 (oldest deadline 2019-12-08T17:51:07.927674+0000) 2019-12-08T17:51:35.583 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:51:35.580+0000 1694f700 -1 osd.1 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:22.512354+0000 front 2019-12-08T17:50:22.546608+0000 (oldest deadline 2019-12-08T17:51:07.171322+0000) 2019-12-08T17:51:35.679 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:51:35.673+0000 1694f700 -1 osd.7 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:22.026647+0000 front 2019-12-08T17:50:26.167127+0000 (oldest deadline 2019-12-08T17:51:06.031465+0000) 2019-12-08T17:51:35.987 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:51:35.981+0000 1694f700 -1 osd.6 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:21.948355+0000 front 2019-12-08T17:50:21.895069+0000 (oldest deadline 2019-12-08T17:51:07.172164+0000) 2019-12-08T17:51:36.023 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:51:36.010+0000 1694f700 -1 osd.4 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:25.325277+0000 front 2019-12-08T17:50:25.345058+0000 (oldest deadline 2019-12-08T17:51:07.324439+0000) 2019-12-08T17:51:36.118 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:51:36.112+0000 1694f700 -1 osd.5 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:24.071534+0000 front 2019-12-08T17:50:23.820629+0000 (oldest deadline 2019-12-08T17:51:09.027019+0000) 2019-12-08T17:51:36.369 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:51:36.366+0000 1694f700 -1 osd.0 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:23.909877+0000 front 2019-12-08T17:50:24.101980+0000 (oldest deadline 2019-12-08T17:51:07.927674+0000) 2019-12-08T17:51:36.426 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:51:36.424+0000 1694f700 -1 osd.3 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:26.167789+0000 front 2019-12-08T17:50:26.051812+0000 (oldest deadline 2019-12-08T17:51:10.651666+0000) 2019-12-08T17:51:36.548 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:51:36.545+0000 1694f700 -1 osd.1 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:22.512354+0000 front 2019-12-08T17:50:22.546608+0000 (oldest deadline 2019-12-08T17:51:07.171322+0000) 2019-12-08T17:51:36.668 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:51:36.662+0000 1694f700 -1 osd.7 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:22.026647+0000 front 2019-12-08T17:50:26.167127+0000 (oldest deadline 2019-12-08T17:51:06.031465+0000) 2019-12-08T17:51:36.954 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:51:36.948+0000 1694f700 -1 osd.6 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:21.948355+0000 front 2019-12-08T17:50:21.895069+0000 (oldest deadline 2019-12-08T17:51:07.172164+0000) 2019-12-08T17:51:37.009 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:51:37.003+0000 1694f700 -1 osd.4 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:25.325277+0000 front 2019-12-08T17:50:25.345058+0000 (oldest deadline 2019-12-08T17:51:07.324439+0000) 2019-12-08T17:51:37.077 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:51:37.068+0000 1694f700 -1 osd.5 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:24.071534+0000 front 2019-12-08T17:50:23.820629+0000 (oldest deadline 2019-12-08T17:51:09.027019+0000) 2019-12-08T17:51:37.383 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:51:37.379+0000 1694f700 -1 osd.3 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:26.167789+0000 front 2019-12-08T17:50:26.051812+0000 (oldest deadline 2019-12-08T17:51:10.651666+0000) 2019-12-08T17:51:37.419 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:51:37.417+0000 1694f700 -1 osd.0 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:23.909877+0000 front 2019-12-08T17:50:24.101980+0000 (oldest deadline 2019-12-08T17:51:07.927674+0000) 2019-12-08T17:51:37.540 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:51:37.537+0000 1694f700 -1 osd.1 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:22.512354+0000 front 2019-12-08T17:50:22.546608+0000 (oldest deadline 2019-12-08T17:51:07.171322+0000) 2019-12-08T17:51:37.624 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:51:37.618+0000 1694f700 -1 osd.7 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:22.026647+0000 front 2019-12-08T17:50:26.167127+0000 (oldest deadline 2019-12-08T17:51:06.031465+0000) 2019-12-08T17:51:38.009 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:51:38.003+0000 1694f700 -1 osd.6 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:21.948355+0000 front 2019-12-08T17:50:21.895069+0000 (oldest deadline 2019-12-08T17:51:07.172164+0000) 2019-12-08T17:51:38.036 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:51:38.030+0000 1694f700 -1 osd.4 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:25.325277+0000 front 2019-12-08T17:50:25.345058+0000 (oldest deadline 2019-12-08T17:51:07.324439+0000) 2019-12-08T17:51:38.090 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:51:38.084+0000 1694f700 -1 osd.5 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:24.071534+0000 front 2019-12-08T17:50:23.820629+0000 (oldest deadline 2019-12-08T17:51:09.027019+0000) 2019-12-08T17:51:38.401 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:51:38.400+0000 1694f700 -1 osd.3 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:26.167789+0000 front 2019-12-08T17:50:26.051812+0000 (oldest deadline 2019-12-08T17:51:10.651666+0000) 2019-12-08T17:51:38.421 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:51:38.419+0000 1694f700 -1 osd.0 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:23.909877+0000 front 2019-12-08T17:50:24.101980+0000 (oldest deadline 2019-12-08T17:51:07.927674+0000) 2019-12-08T17:51:38.537 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:51:38.536+0000 1694f700 -1 osd.1 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:22.512354+0000 front 2019-12-08T17:50:22.546608+0000 (oldest deadline 2019-12-08T17:51:07.171322+0000) 2019-12-08T17:51:38.673 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:51:38.668+0000 1694f700 -1 osd.7 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:22.026647+0000 front 2019-12-08T17:50:26.167127+0000 (oldest deadline 2019-12-08T17:51:06.031465+0000) 2019-12-08T17:51:38.822 INFO:tasks.ceph.mon.b.smithi013.stderr:2019-12-08T17:51:38.818+0000 1a89c700 -1 mon.b@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.2 [v2:172.21.15.79:6802/10448,v1:172.21.15.79:6803/10448] for 45sec e260 v260) 2019-12-08T17:51:38.974 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:51:38.968+0000 1694f700 -1 osd.6 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:21.948355+0000 front 2019-12-08T17:50:21.895069+0000 (oldest deadline 2019-12-08T17:51:07.172164+0000) 2019-12-08T17:51:39.004 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:51:38.998+0000 1694f700 -1 osd.4 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:25.325277+0000 front 2019-12-08T17:50:25.345058+0000 (oldest deadline 2019-12-08T17:51:07.324439+0000) 2019-12-08T17:51:39.111 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:51:39.107+0000 1694f700 -1 osd.5 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:24.071534+0000 front 2019-12-08T17:50:23.820629+0000 (oldest deadline 2019-12-08T17:51:09.027019+0000) 2019-12-08T17:51:39.432 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:51:39.428+0000 1694f700 -1 osd.3 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:26.167789+0000 front 2019-12-08T17:50:26.051812+0000 (oldest deadline 2019-12-08T17:51:10.651666+0000) 2019-12-08T17:51:39.463 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:51:39.458+0000 1694f700 -1 osd.0 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:23.909877+0000 front 2019-12-08T17:50:24.101980+0000 (oldest deadline 2019-12-08T17:51:07.927674+0000) 2019-12-08T17:51:39.536 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:51:39.534+0000 1694f700 -1 osd.1 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:22.512354+0000 front 2019-12-08T17:50:22.546608+0000 (oldest deadline 2019-12-08T17:51:07.171322+0000) 2019-12-08T17:51:39.707 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:51:39.698+0000 1694f700 -1 osd.7 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:22.026647+0000 front 2019-12-08T17:50:26.167127+0000 (oldest deadline 2019-12-08T17:51:06.031465+0000) 2019-12-08T17:51:39.943 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:51:39.933+0000 1694f700 -1 osd.6 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:21.948355+0000 front 2019-12-08T17:50:21.895069+0000 (oldest deadline 2019-12-08T17:51:07.172164+0000) 2019-12-08T17:51:40.044 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:51:40.037+0000 1694f700 -1 osd.4 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:25.325277+0000 front 2019-12-08T17:50:25.345058+0000 (oldest deadline 2019-12-08T17:51:07.324439+0000) 2019-12-08T17:51:40.143 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:51:40.138+0000 1694f700 -1 osd.5 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:24.071534+0000 front 2019-12-08T17:50:23.820629+0000 (oldest deadline 2019-12-08T17:51:09.027019+0000) 2019-12-08T17:51:40.464 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:51:40.462+0000 1694f700 -1 osd.3 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:26.167789+0000 front 2019-12-08T17:50:26.051812+0000 (oldest deadline 2019-12-08T17:51:10.651666+0000) 2019-12-08T17:51:40.468 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:51:40.466+0000 1694f700 -1 osd.0 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:23.909877+0000 front 2019-12-08T17:50:24.101980+0000 (oldest deadline 2019-12-08T17:51:07.927674+0000) 2019-12-08T17:51:40.501 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:51:40.498+0000 1694f700 -1 osd.1 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:22.512354+0000 front 2019-12-08T17:50:22.546608+0000 (oldest deadline 2019-12-08T17:51:07.171322+0000) 2019-12-08T17:51:40.708 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:51:40.701+0000 1694f700 -1 osd.7 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:22.026647+0000 front 2019-12-08T17:50:26.167127+0000 (oldest deadline 2019-12-08T17:51:06.031465+0000) 2019-12-08T17:51:40.906 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:51:40.900+0000 1694f700 -1 osd.6 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:21.948355+0000 front 2019-12-08T17:50:21.895069+0000 (oldest deadline 2019-12-08T17:51:07.172164+0000) 2019-12-08T17:51:41.092 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:51:41.087+0000 1694f700 -1 osd.4 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:25.325277+0000 front 2019-12-08T17:50:25.345058+0000 (oldest deadline 2019-12-08T17:51:07.324439+0000) 2019-12-08T17:51:41.124 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:51:41.118+0000 1694f700 -1 osd.5 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:24.071534+0000 front 2019-12-08T17:50:23.820629+0000 (oldest deadline 2019-12-08T17:51:09.027019+0000) 2019-12-08T17:51:41.457 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:51:41.456+0000 1694f700 -1 osd.3 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:26.167789+0000 front 2019-12-08T17:50:26.051812+0000 (oldest deadline 2019-12-08T17:51:10.651666+0000) 2019-12-08T17:51:41.497 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:51:41.496+0000 1694f700 -1 osd.1 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:22.512354+0000 front 2019-12-08T17:50:22.546608+0000 (oldest deadline 2019-12-08T17:51:07.171322+0000) 2019-12-08T17:51:41.507 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:51:41.505+0000 1694f700 -1 osd.0 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:23.909877+0000 front 2019-12-08T17:50:24.101980+0000 (oldest deadline 2019-12-08T17:51:07.927674+0000) 2019-12-08T17:51:41.762 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:51:41.755+0000 1694f700 -1 osd.7 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:22.026647+0000 front 2019-12-08T17:50:26.167127+0000 (oldest deadline 2019-12-08T17:51:06.031465+0000) 2019-12-08T17:51:41.913 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:51:41.907+0000 1694f700 -1 osd.6 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:21.948355+0000 front 2019-12-08T17:50:21.895069+0000 (oldest deadline 2019-12-08T17:51:07.172164+0000) 2019-12-08T17:51:42.130 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:51:42.125+0000 1694f700 -1 osd.4 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:25.325277+0000 front 2019-12-08T17:50:25.345058+0000 (oldest deadline 2019-12-08T17:51:07.324439+0000) 2019-12-08T17:51:42.155 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:51:42.149+0000 1694f700 -1 osd.5 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:24.071534+0000 front 2019-12-08T17:50:23.820629+0000 (oldest deadline 2019-12-08T17:51:09.027019+0000) 2019-12-08T17:51:42.483 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:51:42.481+0000 1694f700 -1 osd.3 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:26.167789+0000 front 2019-12-08T17:50:26.051812+0000 (oldest deadline 2019-12-08T17:51:10.651666+0000) 2019-12-08T17:51:42.518 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:51:42.516+0000 1694f700 -1 osd.0 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:23.909877+0000 front 2019-12-08T17:50:24.101980+0000 (oldest deadline 2019-12-08T17:51:07.927674+0000) 2019-12-08T17:51:42.528 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:51:42.526+0000 1694f700 -1 osd.1 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:22.512354+0000 front 2019-12-08T17:50:22.546608+0000 (oldest deadline 2019-12-08T17:51:07.171322+0000) 2019-12-08T17:51:42.781 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:51:42.775+0000 1694f700 -1 osd.7 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:22.026647+0000 front 2019-12-08T17:50:26.167127+0000 (oldest deadline 2019-12-08T17:51:06.031465+0000) 2019-12-08T17:51:42.911 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:51:42.905+0000 1694f700 -1 osd.6 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:21.948355+0000 front 2019-12-08T17:50:21.895069+0000 (oldest deadline 2019-12-08T17:51:07.172164+0000) 2019-12-08T17:51:43.169 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:51:43.164+0000 1694f700 -1 osd.4 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:25.325277+0000 front 2019-12-08T17:50:25.345058+0000 (oldest deadline 2019-12-08T17:51:07.324439+0000) 2019-12-08T17:51:43.183 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:51:43.176+0000 1694f700 -1 osd.5 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:24.071534+0000 front 2019-12-08T17:50:23.820629+0000 (oldest deadline 2019-12-08T17:51:09.027019+0000) 2019-12-08T17:51:43.465 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:51:43.463+0000 1694f700 -1 osd.3 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:26.167789+0000 front 2019-12-08T17:50:26.051812+0000 (oldest deadline 2019-12-08T17:51:10.651666+0000) 2019-12-08T17:51:43.517 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:51:43.515+0000 1694f700 -1 osd.0 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:23.909877+0000 front 2019-12-08T17:50:24.101980+0000 (oldest deadline 2019-12-08T17:51:07.927674+0000) 2019-12-08T17:51:43.559 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:51:43.556+0000 1694f700 -1 osd.1 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:22.512354+0000 front 2019-12-08T17:50:22.546608+0000 (oldest deadline 2019-12-08T17:51:07.171322+0000) 2019-12-08T17:51:43.815 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:51:43.809+0000 1694f700 -1 osd.7 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:22.026647+0000 front 2019-12-08T17:50:26.167127+0000 (oldest deadline 2019-12-08T17:51:06.031465+0000) 2019-12-08T17:51:43.891 INFO:tasks.ceph.mon.b.smithi013.stderr:2019-12-08T17:51:43.878+0000 1a89c700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.2 [v2:172.21.15.79:6802/10448,v1:172.21.15.79:6803/10448] for 45sec e260 v260) 2019-12-08T17:51:43.917 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:51:43.911+0000 1694f700 -1 osd.6 260 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:50:21.948355+0000 front 2019-12-08T17:50:21.895069+0000 (oldest deadline 2019-12-08T17:51:07.172164+0000) 2019-12-08T17:52:41.831 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:52:41.825+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:55.656743+0000 front 2019-12-08T17:51:55.655283+0000 (oldest deadline 2019-12-08T17:52:41.316741+0000) 2019-12-08T17:52:41.988 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:52:41.981+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:58.368348+0000 front 2019-12-08T17:51:57.888374+0000 (oldest deadline 2019-12-08T17:52:41.304357+0000) 2019-12-08T17:52:42.704 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:52:42.702+0000 1694f700 -1 osd.0 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:58.203956+0000 front 2019-12-08T17:51:58.485849+0000 (oldest deadline 2019-12-08T17:52:42.095254+0000) 2019-12-08T17:52:42.886 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:52:42.880+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:55.656743+0000 front 2019-12-08T17:51:55.655283+0000 (oldest deadline 2019-12-08T17:52:41.316741+0000) 2019-12-08T17:52:42.977 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:52:42.971+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:58.368348+0000 front 2019-12-08T17:51:57.888374+0000 (oldest deadline 2019-12-08T17:52:41.304357+0000) 2019-12-08T17:52:43.363 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:52:43.362+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:57.436400+0000 front 2019-12-08T17:51:57.434512+0000 (oldest deadline 2019-12-08T17:52:43.154497+0000) 2019-12-08T17:52:43.742 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:52:43.741+0000 1694f700 -1 osd.0 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:58.203956+0000 front 2019-12-08T17:51:58.485849+0000 (oldest deadline 2019-12-08T17:52:42.095254+0000) 2019-12-08T17:52:43.847 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:52:43.841+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:55.656743+0000 front 2019-12-08T17:51:55.655283+0000 (oldest deadline 2019-12-08T17:52:41.316741+0000) 2019-12-08T17:52:43.997 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:52:43.988+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:58.368348+0000 front 2019-12-08T17:51:57.888374+0000 (oldest deadline 2019-12-08T17:52:41.304357+0000) 2019-12-08T17:52:44.327 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:52:44.326+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:57.436400+0000 front 2019-12-08T17:51:57.434512+0000 (oldest deadline 2019-12-08T17:52:43.154497+0000) 2019-12-08T17:52:44.758 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:52:44.757+0000 1694f700 -1 osd.0 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:58.203956+0000 front 2019-12-08T17:51:58.485849+0000 (oldest deadline 2019-12-08T17:52:42.095254+0000) 2019-12-08T17:52:44.861 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:52:44.856+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:55.656743+0000 front 2019-12-08T17:51:55.655283+0000 (oldest deadline 2019-12-08T17:52:41.316741+0000) 2019-12-08T17:52:44.996 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:52:44.990+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:58.368348+0000 front 2019-12-08T17:51:57.888374+0000 (oldest deadline 2019-12-08T17:52:41.304357+0000) 2019-12-08T17:52:45.302 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:52:45.298+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:57.436400+0000 front 2019-12-08T17:51:57.434512+0000 (oldest deadline 2019-12-08T17:52:43.154497+0000) 2019-12-08T17:52:45.355 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:52:45.349+0000 1694f700 -1 osd.6 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.166500+0000 front 2019-12-08T17:52:01.034178+0000 (oldest deadline 2019-12-08T17:52:44.870861+0000) 2019-12-08T17:52:45.744 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:52:45.743+0000 1694f700 -1 osd.0 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:58.203956+0000 front 2019-12-08T17:51:58.485849+0000 (oldest deadline 2019-12-08T17:52:42.095254+0000) 2019-12-08T17:52:45.868 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:52:45.861+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:55.656743+0000 front 2019-12-08T17:51:55.655283+0000 (oldest deadline 2019-12-08T17:52:41.316741+0000) 2019-12-08T17:52:45.998 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:52:45.993+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:58.368348+0000 front 2019-12-08T17:51:57.888374+0000 (oldest deadline 2019-12-08T17:52:41.304357+0000) 2019-12-08T17:52:46.287 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:52:46.286+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:57.436400+0000 front 2019-12-08T17:51:57.434512+0000 (oldest deadline 2019-12-08T17:52:43.154497+0000) 2019-12-08T17:52:46.330 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:52:46.324+0000 1694f700 -1 osd.6 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.166500+0000 front 2019-12-08T17:52:01.034178+0000 (oldest deadline 2019-12-08T17:52:44.870861+0000) 2019-12-08T17:52:46.388 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:52:46.382+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.169633+0000 front 2019-12-08T17:52:01.117742+0000 (oldest deadline 2019-12-08T17:52:46.252207+0000) 2019-12-08T17:52:46.734 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:52:46.733+0000 1694f700 -1 osd.0 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:58.203956+0000 front 2019-12-08T17:51:58.485849+0000 (oldest deadline 2019-12-08T17:52:42.095254+0000) 2019-12-08T17:52:46.854 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:52:46.854+0000 1694f700 -1 osd.2 265 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e264) 2019-12-08T17:52:46.919 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:52:46.913+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:55.656743+0000 front 2019-12-08T17:51:55.655283+0000 (oldest deadline 2019-12-08T17:52:41.316741+0000) 2019-12-08T17:52:46.991 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:52:46.985+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:58.368348+0000 front 2019-12-08T17:51:57.888374+0000 (oldest deadline 2019-12-08T17:52:41.304357+0000) 2019-12-08T17:52:47.291 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:52:47.288+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:57.436400+0000 front 2019-12-08T17:51:57.434512+0000 (oldest deadline 2019-12-08T17:52:43.154497+0000) 2019-12-08T17:52:47.335 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:52:47.328+0000 1694f700 -1 osd.6 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.166500+0000 front 2019-12-08T17:52:01.034178+0000 (oldest deadline 2019-12-08T17:52:44.870861+0000) 2019-12-08T17:52:47.428 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:52:47.423+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.169633+0000 front 2019-12-08T17:52:01.117742+0000 (oldest deadline 2019-12-08T17:52:46.252207+0000) 2019-12-08T17:52:47.714 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:52:47.712+0000 1694f700 -1 osd.0 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:58.203956+0000 front 2019-12-08T17:51:58.485849+0000 (oldest deadline 2019-12-08T17:52:42.095254+0000) 2019-12-08T17:52:47.882 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:52:47.882+0000 1694f700 -1 osd.2 265 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e264) 2019-12-08T17:52:47.921 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:52:47.915+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:55.656743+0000 front 2019-12-08T17:51:55.655283+0000 (oldest deadline 2019-12-08T17:52:41.316741+0000) 2019-12-08T17:52:47.964 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:52:47.958+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:58.368348+0000 front 2019-12-08T17:51:57.888374+0000 (oldest deadline 2019-12-08T17:52:41.304357+0000) 2019-12-08T17:52:48.316 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:52:48.315+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:57.436400+0000 front 2019-12-08T17:51:57.434512+0000 (oldest deadline 2019-12-08T17:52:43.154497+0000) 2019-12-08T17:52:48.355 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:52:48.349+0000 1694f700 -1 osd.6 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.166500+0000 front 2019-12-08T17:52:01.034178+0000 (oldest deadline 2019-12-08T17:52:44.870861+0000) 2019-12-08T17:52:48.431 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:52:48.425+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.169633+0000 front 2019-12-08T17:52:01.117742+0000 (oldest deadline 2019-12-08T17:52:46.252207+0000) 2019-12-08T17:52:48.721 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:52:48.720+0000 1694f700 -1 osd.0 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:58.203956+0000 front 2019-12-08T17:51:58.485849+0000 (oldest deadline 2019-12-08T17:52:42.095254+0000) 2019-12-08T17:52:48.885 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:52:48.879+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:55.656743+0000 front 2019-12-08T17:51:55.655283+0000 (oldest deadline 2019-12-08T17:52:41.316741+0000) 2019-12-08T17:52:48.897 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:52:48.897+0000 1694f700 -1 osd.2 265 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e264) 2019-12-08T17:52:49.001 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:52:48.996+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:58.368348+0000 front 2019-12-08T17:51:57.888374+0000 (oldest deadline 2019-12-08T17:52:41.304357+0000) 2019-12-08T17:52:49.280 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:52:49.278+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:57.436400+0000 front 2019-12-08T17:51:57.434512+0000 (oldest deadline 2019-12-08T17:52:43.154497+0000) 2019-12-08T17:52:49.396 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:52:49.389+0000 1694f700 -1 osd.6 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.166500+0000 front 2019-12-08T17:52:01.034178+0000 (oldest deadline 2019-12-08T17:52:44.870861+0000) 2019-12-08T17:52:49.481 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:52:49.475+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.169633+0000 front 2019-12-08T17:52:01.117742+0000 (oldest deadline 2019-12-08T17:52:46.252207+0000) 2019-12-08T17:52:49.767 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:52:49.765+0000 1694f700 -1 osd.0 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:58.203956+0000 front 2019-12-08T17:51:58.485849+0000 (oldest deadline 2019-12-08T17:52:42.095254+0000) 2019-12-08T17:52:49.902 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:52:49.897+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:55.656743+0000 front 2019-12-08T17:51:55.655283+0000 (oldest deadline 2019-12-08T17:52:41.316741+0000) 2019-12-08T17:52:49.938 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:52:49.937+0000 1694f700 -1 osd.2 265 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e264) 2019-12-08T17:52:50.026 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:52:50.022+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:58.368348+0000 front 2019-12-08T17:51:57.888374+0000 (oldest deadline 2019-12-08T17:52:41.304357+0000) 2019-12-08T17:52:50.240 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:52:50.240+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:57.436400+0000 front 2019-12-08T17:51:57.434512+0000 (oldest deadline 2019-12-08T17:52:43.154497+0000) 2019-12-08T17:52:50.410 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:52:50.404+0000 1694f700 -1 osd.6 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.166500+0000 front 2019-12-08T17:52:01.034178+0000 (oldest deadline 2019-12-08T17:52:44.870861+0000) 2019-12-08T17:52:50.481 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:52:50.475+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.169633+0000 front 2019-12-08T17:52:01.117742+0000 (oldest deadline 2019-12-08T17:52:46.252207+0000) 2019-12-08T17:52:50.804 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:52:50.802+0000 1694f700 -1 osd.0 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:58.203956+0000 front 2019-12-08T17:51:58.485849+0000 (oldest deadline 2019-12-08T17:52:42.095254+0000) 2019-12-08T17:52:50.907 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:52:50.907+0000 1694f700 -1 osd.2 265 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e264) 2019-12-08T17:52:50.941 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:52:50.928+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:55.656743+0000 front 2019-12-08T17:51:55.655283+0000 (oldest deadline 2019-12-08T17:52:41.316741+0000) 2019-12-08T17:52:51.040 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:52:51.033+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:58.368348+0000 front 2019-12-08T17:51:57.888374+0000 (oldest deadline 2019-12-08T17:52:41.304357+0000) 2019-12-08T17:52:51.270 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:52:51.269+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:57.436400+0000 front 2019-12-08T17:51:57.434512+0000 (oldest deadline 2019-12-08T17:52:43.154497+0000) 2019-12-08T17:52:51.382 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:52:51.377+0000 1694f700 -1 osd.6 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.166500+0000 front 2019-12-08T17:52:01.034178+0000 (oldest deadline 2019-12-08T17:52:44.870861+0000) 2019-12-08T17:52:51.462 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:52:51.456+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.169633+0000 front 2019-12-08T17:52:01.117742+0000 (oldest deadline 2019-12-08T17:52:46.252207+0000) 2019-12-08T17:52:51.783 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:52:51.782+0000 1694f700 -1 osd.0 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:58.203956+0000 front 2019-12-08T17:51:58.485849+0000 (oldest deadline 2019-12-08T17:52:42.095254+0000) 2019-12-08T17:52:51.880 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:52:51.879+0000 1694f700 -1 osd.2 265 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e264) 2019-12-08T17:52:51.934 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:52:51.928+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:55.656743+0000 front 2019-12-08T17:51:55.655283+0000 (oldest deadline 2019-12-08T17:52:41.316741+0000) 2019-12-08T17:52:52.045 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:52:52.039+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:58.368348+0000 front 2019-12-08T17:51:57.888374+0000 (oldest deadline 2019-12-08T17:52:41.304357+0000) 2019-12-08T17:52:52.273 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:52:52.271+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:57.436400+0000 front 2019-12-08T17:51:57.434512+0000 (oldest deadline 2019-12-08T17:52:43.154497+0000) 2019-12-08T17:52:52.420 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:52:52.414+0000 1694f700 -1 osd.6 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.166500+0000 front 2019-12-08T17:52:01.034178+0000 (oldest deadline 2019-12-08T17:52:44.870861+0000) 2019-12-08T17:52:52.446 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:52:52.441+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.169633+0000 front 2019-12-08T17:52:01.117742+0000 (oldest deadline 2019-12-08T17:52:46.252207+0000) 2019-12-08T17:52:52.833 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:52:52.832+0000 1694f700 -1 osd.0 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:58.203956+0000 front 2019-12-08T17:51:58.485849+0000 (oldest deadline 2019-12-08T17:52:42.095254+0000) 2019-12-08T17:52:52.909 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:52:52.908+0000 1694f700 -1 osd.2 265 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e264) 2019-12-08T17:52:52.922 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:52:52.916+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:55.656743+0000 front 2019-12-08T17:51:55.655283+0000 (oldest deadline 2019-12-08T17:52:41.316741+0000) 2019-12-08T17:52:53.036 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:52:53.029+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:58.368348+0000 front 2019-12-08T17:51:57.888374+0000 (oldest deadline 2019-12-08T17:52:41.304357+0000) 2019-12-08T17:52:53.241 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:52:53.240+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:57.436400+0000 front 2019-12-08T17:51:57.434512+0000 (oldest deadline 2019-12-08T17:52:43.154497+0000) 2019-12-08T17:52:53.411 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:52:53.405+0000 1694f700 -1 osd.6 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.166500+0000 front 2019-12-08T17:52:01.034178+0000 (oldest deadline 2019-12-08T17:52:44.870861+0000) 2019-12-08T17:52:53.468 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:52:53.462+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.169633+0000 front 2019-12-08T17:52:01.117742+0000 (oldest deadline 2019-12-08T17:52:46.252207+0000) 2019-12-08T17:52:53.870 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:52:53.868+0000 1694f700 -1 osd.2 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:52:13.538740+0000 (oldest deadline 2019-12-08T17:52:53.538740+0000) 2019-12-08T17:52:53.871 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:52:53.870+0000 1694f700 -1 osd.2 265 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e264) 2019-12-08T17:52:53.888 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:52:53.882+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:55.656743+0000 front 2019-12-08T17:51:55.655283+0000 (oldest deadline 2019-12-08T17:52:41.316741+0000) 2019-12-08T17:52:53.999 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:52:53.990+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:58.368348+0000 front 2019-12-08T17:51:57.888374+0000 (oldest deadline 2019-12-08T17:52:41.304357+0000) 2019-12-08T17:52:54.226 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:52:54.224+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:57.436400+0000 front 2019-12-08T17:51:57.434512+0000 (oldest deadline 2019-12-08T17:52:43.154497+0000) 2019-12-08T17:52:54.448 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:52:54.442+0000 1694f700 -1 osd.6 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.166500+0000 front 2019-12-08T17:52:01.034178+0000 (oldest deadline 2019-12-08T17:52:44.870861+0000) 2019-12-08T17:52:54.463 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:52:54.458+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.169633+0000 front 2019-12-08T17:52:01.117742+0000 (oldest deadline 2019-12-08T17:52:46.252207+0000) 2019-12-08T17:52:54.849 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:52:54.843+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:55.656743+0000 front 2019-12-08T17:51:55.655283+0000 (oldest deadline 2019-12-08T17:52:41.316741+0000) 2019-12-08T17:52:54.897 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:52:54.895+0000 1694f700 -1 osd.2 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:52:13.538740+0000 (oldest deadline 2019-12-08T17:52:53.538740+0000) 2019-12-08T17:52:54.898 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:52:54.897+0000 1694f700 -1 osd.2 265 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e264) 2019-12-08T17:52:55.043 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:52:55.036+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:58.368348+0000 front 2019-12-08T17:51:57.888374+0000 (oldest deadline 2019-12-08T17:52:41.304357+0000) 2019-12-08T17:52:55.186 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:52:55.185+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:57.436400+0000 front 2019-12-08T17:51:57.434512+0000 (oldest deadline 2019-12-08T17:52:43.154497+0000) 2019-12-08T17:52:55.441 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:52:55.435+0000 1694f700 -1 osd.6 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.166500+0000 front 2019-12-08T17:52:01.034178+0000 (oldest deadline 2019-12-08T17:52:44.870861+0000) 2019-12-08T17:52:55.468 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:52:55.462+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.169633+0000 front 2019-12-08T17:52:01.117742+0000 (oldest deadline 2019-12-08T17:52:46.252207+0000) 2019-12-08T17:52:55.885 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:52:55.882+0000 1694f700 -1 osd.2 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:52:13.538740+0000 (oldest deadline 2019-12-08T17:52:53.538740+0000) 2019-12-08T17:52:55.886 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:52:55.885+0000 1694f700 -1 osd.2 265 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e264) 2019-12-08T17:52:55.886 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:52:55.881+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:55.656743+0000 front 2019-12-08T17:51:55.655283+0000 (oldest deadline 2019-12-08T17:52:41.316741+0000) 2019-12-08T17:52:56.028 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:52:56.022+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:58.368348+0000 front 2019-12-08T17:51:57.888374+0000 (oldest deadline 2019-12-08T17:52:41.304357+0000) 2019-12-08T17:52:56.224 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:52:56.223+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:57.436400+0000 front 2019-12-08T17:51:57.434512+0000 (oldest deadline 2019-12-08T17:52:43.154497+0000) 2019-12-08T17:52:56.454 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:52:56.448+0000 1694f700 -1 osd.6 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.166500+0000 front 2019-12-08T17:52:01.034178+0000 (oldest deadline 2019-12-08T17:52:44.870861+0000) 2019-12-08T17:52:56.474 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:52:56.467+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.169633+0000 front 2019-12-08T17:52:01.117742+0000 (oldest deadline 2019-12-08T17:52:46.252207+0000) 2019-12-08T17:52:56.864 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:52:56.857+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:55.656743+0000 front 2019-12-08T17:51:55.655283+0000 (oldest deadline 2019-12-08T17:52:41.316741+0000) 2019-12-08T17:52:56.935 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:52:56.933+0000 1694f700 -1 osd.2 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:52:13.538740+0000 (oldest deadline 2019-12-08T17:52:53.538740+0000) 2019-12-08T17:52:56.936 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:52:56.936+0000 1694f700 -1 osd.2 265 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e264) 2019-12-08T17:52:57.067 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:52:57.062+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:58.368348+0000 front 2019-12-08T17:51:57.888374+0000 (oldest deadline 2019-12-08T17:52:41.304357+0000) 2019-12-08T17:52:57.201 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:52:57.201+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:57.436400+0000 front 2019-12-08T17:51:57.434512+0000 (oldest deadline 2019-12-08T17:52:43.154497+0000) 2019-12-08T17:52:57.435 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:52:57.429+0000 1694f700 -1 osd.6 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.166500+0000 front 2019-12-08T17:52:01.034178+0000 (oldest deadline 2019-12-08T17:52:44.870861+0000) 2019-12-08T17:52:57.463 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:52:57.458+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.169633+0000 front 2019-12-08T17:52:01.117742+0000 (oldest deadline 2019-12-08T17:52:46.252207+0000) 2019-12-08T17:52:57.880 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:52:57.873+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:55.656743+0000 front 2019-12-08T17:51:55.655283+0000 (oldest deadline 2019-12-08T17:52:41.316741+0000) 2019-12-08T17:52:57.950 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:52:57.945+0000 1694f700 -1 osd.2 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:52:13.538740+0000 (oldest deadline 2019-12-08T17:52:53.538740+0000) 2019-12-08T17:52:57.951 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:52:57.946+0000 1694f700 -1 osd.2 265 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e264) 2019-12-08T17:52:58.069 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:52:58.063+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:58.368348+0000 front 2019-12-08T17:51:57.888374+0000 (oldest deadline 2019-12-08T17:52:41.304357+0000) 2019-12-08T17:52:58.250 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:52:58.250+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:57.436400+0000 front 2019-12-08T17:51:57.434512+0000 (oldest deadline 2019-12-08T17:52:43.154497+0000) 2019-12-08T17:52:58.426 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:52:58.420+0000 1694f700 -1 osd.6 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.166500+0000 front 2019-12-08T17:52:01.034178+0000 (oldest deadline 2019-12-08T17:52:44.870861+0000) 2019-12-08T17:52:58.509 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:52:58.499+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.169633+0000 front 2019-12-08T17:52:01.117742+0000 (oldest deadline 2019-12-08T17:52:46.252207+0000) 2019-12-08T17:52:58.910 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:52:58.906+0000 1694f700 -1 osd.2 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:52:13.538740+0000 (oldest deadline 2019-12-08T17:52:53.538740+0000) 2019-12-08T17:52:58.913 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:52:58.910+0000 1694f700 -1 osd.2 265 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e264) 2019-12-08T17:52:58.920 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:52:58.912+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:55.656743+0000 front 2019-12-08T17:51:55.655283+0000 (oldest deadline 2019-12-08T17:52:41.316741+0000) 2019-12-08T17:52:59.040 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:52:59.034+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:58.368348+0000 front 2019-12-08T17:51:57.888374+0000 (oldest deadline 2019-12-08T17:52:41.304357+0000) 2019-12-08T17:52:59.245 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:52:59.243+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:57.436400+0000 front 2019-12-08T17:51:57.434512+0000 (oldest deadline 2019-12-08T17:52:43.154497+0000) 2019-12-08T17:52:59.431 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:52:59.420+0000 1694f700 -1 osd.6 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.166500+0000 front 2019-12-08T17:52:01.034178+0000 (oldest deadline 2019-12-08T17:52:44.870861+0000) 2019-12-08T17:52:59.476 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:52:59.471+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.169633+0000 front 2019-12-08T17:52:01.117742+0000 (oldest deadline 2019-12-08T17:52:46.252207+0000) 2019-12-08T17:52:59.912 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:52:59.908+0000 1694f700 -1 osd.2 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:52:13.538740+0000 (oldest deadline 2019-12-08T17:52:53.538740+0000) 2019-12-08T17:52:59.913 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:52:59.911+0000 1694f700 -1 osd.2 265 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e264) 2019-12-08T17:52:59.916 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:52:59.910+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:55.656743+0000 front 2019-12-08T17:51:55.655283+0000 (oldest deadline 2019-12-08T17:52:41.316741+0000) 2019-12-08T17:53:00.030 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:53:00.025+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:58.368348+0000 front 2019-12-08T17:51:57.888374+0000 (oldest deadline 2019-12-08T17:52:41.304357+0000) 2019-12-08T17:53:00.217 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:53:00.214+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:57.436400+0000 front 2019-12-08T17:51:57.434512+0000 (oldest deadline 2019-12-08T17:52:43.154497+0000) 2019-12-08T17:53:00.470 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:53:00.464+0000 1694f700 -1 osd.6 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.166500+0000 front 2019-12-08T17:52:01.034178+0000 (oldest deadline 2019-12-08T17:52:44.870861+0000) 2019-12-08T17:53:00.475 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:53:00.468+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.169633+0000 front 2019-12-08T17:52:01.117742+0000 (oldest deadline 2019-12-08T17:52:46.252207+0000) 2019-12-08T17:53:00.876 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:53:00.868+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:55.656743+0000 front 2019-12-08T17:51:55.655283+0000 (oldest deadline 2019-12-08T17:52:41.316741+0000) 2019-12-08T17:53:00.893 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:53:00.889+0000 1694f700 -1 osd.2 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:52:13.538740+0000 (oldest deadline 2019-12-08T17:52:53.538740+0000) 2019-12-08T17:53:00.895 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:53:00.893+0000 1694f700 -1 osd.2 265 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e264) 2019-12-08T17:53:01.018 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:53:01.012+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:58.368348+0000 front 2019-12-08T17:51:57.888374+0000 (oldest deadline 2019-12-08T17:52:41.304357+0000) 2019-12-08T17:53:01.228 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:53:01.226+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:57.436400+0000 front 2019-12-08T17:51:57.434512+0000 (oldest deadline 2019-12-08T17:52:43.154497+0000) 2019-12-08T17:53:01.471 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:53:01.464+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.169633+0000 front 2019-12-08T17:52:01.117742+0000 (oldest deadline 2019-12-08T17:52:46.252207+0000) 2019-12-08T17:53:01.486 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:53:01.479+0000 1694f700 -1 osd.6 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.166500+0000 front 2019-12-08T17:52:01.034178+0000 (oldest deadline 2019-12-08T17:52:44.870861+0000) 2019-12-08T17:53:01.896 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:53:01.892+0000 1694f700 -1 osd.2 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:52:13.538740+0000 (oldest deadline 2019-12-08T17:52:53.538740+0000) 2019-12-08T17:53:01.898 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:53:01.895+0000 1694f700 -1 osd.2 265 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e264) 2019-12-08T17:53:01.919 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:53:01.913+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:55.656743+0000 front 2019-12-08T17:51:55.655283+0000 (oldest deadline 2019-12-08T17:52:41.316741+0000) 2019-12-08T17:53:01.990 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:53:01.984+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:58.368348+0000 front 2019-12-08T17:51:57.888374+0000 (oldest deadline 2019-12-08T17:52:41.304357+0000) 2019-12-08T17:53:02.191 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:53:02.189+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:57.436400+0000 front 2019-12-08T17:51:57.434512+0000 (oldest deadline 2019-12-08T17:52:43.154497+0000) 2019-12-08T17:53:02.458 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:53:02.452+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.169633+0000 front 2019-12-08T17:52:01.117742+0000 (oldest deadline 2019-12-08T17:52:46.252207+0000) 2019-12-08T17:53:02.526 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:53:02.520+0000 1694f700 -1 osd.6 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.166500+0000 front 2019-12-08T17:52:01.034178+0000 (oldest deadline 2019-12-08T17:52:44.870861+0000) 2019-12-08T17:53:02.926 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:53:02.920+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:55.656743+0000 front 2019-12-08T17:51:55.655283+0000 (oldest deadline 2019-12-08T17:52:41.316741+0000) 2019-12-08T17:53:02.933 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:53:02.931+0000 1694f700 -1 osd.2 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:52:13.538740+0000 (oldest deadline 2019-12-08T17:52:53.538740+0000) 2019-12-08T17:53:02.934 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:53:02.932+0000 1694f700 -1 osd.2 265 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e264) 2019-12-08T17:53:03.025 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:53:03.018+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:58.368348+0000 front 2019-12-08T17:51:57.888374+0000 (oldest deadline 2019-12-08T17:52:41.304357+0000) 2019-12-08T17:53:03.211 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:53:03.209+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:57.436400+0000 front 2019-12-08T17:51:57.434512+0000 (oldest deadline 2019-12-08T17:52:43.154497+0000) 2019-12-08T17:53:03.457 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:53:03.451+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.169633+0000 front 2019-12-08T17:52:01.117742+0000 (oldest deadline 2019-12-08T17:52:46.252207+0000) 2019-12-08T17:53:03.554 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:53:03.548+0000 1694f700 -1 osd.6 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.166500+0000 front 2019-12-08T17:52:01.034178+0000 (oldest deadline 2019-12-08T17:52:44.870861+0000) 2019-12-08T17:53:03.883 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:53:03.877+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:55.656743+0000 front 2019-12-08T17:51:55.655283+0000 (oldest deadline 2019-12-08T17:52:41.316741+0000) 2019-12-08T17:53:03.916 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:53:03.914+0000 1694f700 -1 osd.2 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:52:13.538740+0000 (oldest deadline 2019-12-08T17:52:53.538740+0000) 2019-12-08T17:53:03.919 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:53:03.918+0000 1694f700 -1 osd.2 265 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e264) 2019-12-08T17:53:04.078 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:53:04.071+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:58.368348+0000 front 2019-12-08T17:51:57.888374+0000 (oldest deadline 2019-12-08T17:52:41.304357+0000) 2019-12-08T17:53:04.189 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:53:04.186+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:57.436400+0000 front 2019-12-08T17:51:57.434512+0000 (oldest deadline 2019-12-08T17:52:43.154497+0000) 2019-12-08T17:53:04.442 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:53:04.437+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.169633+0000 front 2019-12-08T17:52:01.117742+0000 (oldest deadline 2019-12-08T17:52:46.252207+0000) 2019-12-08T17:53:04.583 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:53:04.577+0000 1694f700 -1 osd.6 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.166500+0000 front 2019-12-08T17:52:01.034178+0000 (oldest deadline 2019-12-08T17:52:44.870861+0000) 2019-12-08T17:53:04.896 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:53:04.890+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:55.656743+0000 front 2019-12-08T17:51:55.655283+0000 (oldest deadline 2019-12-08T17:52:41.316741+0000) 2019-12-08T17:53:04.940 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:53:04.937+0000 1694f700 -1 osd.2 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:52:13.538740+0000 (oldest deadline 2019-12-08T17:52:53.538740+0000) 2019-12-08T17:53:04.942 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:53:04.939+0000 1694f700 -1 osd.2 265 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e264) 2019-12-08T17:53:05.062 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:53:05.057+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:58.368348+0000 front 2019-12-08T17:51:57.888374+0000 (oldest deadline 2019-12-08T17:52:41.304357+0000) 2019-12-08T17:53:05.237 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:53:05.235+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:57.436400+0000 front 2019-12-08T17:51:57.434512+0000 (oldest deadline 2019-12-08T17:52:43.154497+0000) 2019-12-08T17:53:05.446 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:53:05.440+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.169633+0000 front 2019-12-08T17:52:01.117742+0000 (oldest deadline 2019-12-08T17:52:46.252207+0000) 2019-12-08T17:53:05.594 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:53:05.588+0000 1694f700 -1 osd.6 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.166500+0000 front 2019-12-08T17:52:01.034178+0000 (oldest deadline 2019-12-08T17:52:44.870861+0000) 2019-12-08T17:53:05.893 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:53:05.886+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:55.656743+0000 front 2019-12-08T17:51:55.655283+0000 (oldest deadline 2019-12-08T17:52:41.316741+0000) 2019-12-08T17:53:05.966 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:53:05.963+0000 1694f700 -1 osd.2 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:52:13.538740+0000 (oldest deadline 2019-12-08T17:52:53.538740+0000) 2019-12-08T17:53:05.967 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:53:05.965+0000 1694f700 -1 osd.2 265 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e264) 2019-12-08T17:53:06.110 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:53:06.103+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:58.368348+0000 front 2019-12-08T17:51:57.888374+0000 (oldest deadline 2019-12-08T17:52:41.304357+0000) 2019-12-08T17:53:06.262 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:53:06.260+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:57.436400+0000 front 2019-12-08T17:51:57.434512+0000 (oldest deadline 2019-12-08T17:52:43.154497+0000) 2019-12-08T17:53:06.464 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:53:06.458+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.169633+0000 front 2019-12-08T17:52:01.117742+0000 (oldest deadline 2019-12-08T17:52:46.252207+0000) 2019-12-08T17:53:06.632 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:53:06.626+0000 1694f700 -1 osd.6 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.166500+0000 front 2019-12-08T17:52:01.034178+0000 (oldest deadline 2019-12-08T17:52:44.870861+0000) 2019-12-08T17:53:06.880 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:53:06.874+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:55.656743+0000 front 2019-12-08T17:51:55.655283+0000 (oldest deadline 2019-12-08T17:52:41.316741+0000) 2019-12-08T17:53:06.936 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:53:06.931+0000 1694f700 -1 osd.2 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:52:13.538740+0000 (oldest deadline 2019-12-08T17:52:53.538740+0000) 2019-12-08T17:53:06.938 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:53:06.935+0000 1694f700 -1 osd.2 265 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e264) 2019-12-08T17:53:07.099 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:53:07.092+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:58.368348+0000 front 2019-12-08T17:51:57.888374+0000 (oldest deadline 2019-12-08T17:52:41.304357+0000) 2019-12-08T17:53:07.228 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:53:07.226+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:57.436400+0000 front 2019-12-08T17:51:57.434512+0000 (oldest deadline 2019-12-08T17:52:43.154497+0000) 2019-12-08T17:53:07.508 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:53:07.503+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.169633+0000 front 2019-12-08T17:52:01.117742+0000 (oldest deadline 2019-12-08T17:52:46.252207+0000) 2019-12-08T17:53:07.678 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:53:07.671+0000 1694f700 -1 osd.6 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.166500+0000 front 2019-12-08T17:52:01.034178+0000 (oldest deadline 2019-12-08T17:52:44.870861+0000) 2019-12-08T17:53:07.862 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:53:07.855+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:55.656743+0000 front 2019-12-08T17:51:55.655283+0000 (oldest deadline 2019-12-08T17:52:41.316741+0000) 2019-12-08T17:53:07.957 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:53:07.933+0000 1694f700 -1 osd.2 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:52:13.538740+0000 (oldest deadline 2019-12-08T17:52:53.538740+0000) 2019-12-08T17:53:07.957 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:53:07.936+0000 1694f700 -1 osd.2 265 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e264) 2019-12-08T17:53:08.147 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:53:08.141+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:58.368348+0000 front 2019-12-08T17:51:57.888374+0000 (oldest deadline 2019-12-08T17:52:41.304357+0000) 2019-12-08T17:53:08.194 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:53:08.193+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:57.436400+0000 front 2019-12-08T17:51:57.434512+0000 (oldest deadline 2019-12-08T17:52:43.154497+0000) 2019-12-08T17:53:08.538 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:53:08.532+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.169633+0000 front 2019-12-08T17:52:01.117742+0000 (oldest deadline 2019-12-08T17:52:46.252207+0000) 2019-12-08T17:53:08.670 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:53:08.665+0000 1694f700 -1 osd.6 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.166500+0000 front 2019-12-08T17:52:01.034178+0000 (oldest deadline 2019-12-08T17:52:44.870861+0000) 2019-12-08T17:53:08.867 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:53:08.862+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:55.656743+0000 front 2019-12-08T17:51:55.655283+0000 (oldest deadline 2019-12-08T17:52:41.316741+0000) 2019-12-08T17:53:08.964 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:53:08.960+0000 1694f700 -1 osd.2 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:52:13.538740+0000 (oldest deadline 2019-12-08T17:52:53.538740+0000) 2019-12-08T17:53:08.965 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:53:08.964+0000 1694f700 -1 osd.2 265 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e264) 2019-12-08T17:53:09.127 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:53:09.123+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:58.368348+0000 front 2019-12-08T17:51:57.888374+0000 (oldest deadline 2019-12-08T17:52:41.304357+0000) 2019-12-08T17:53:09.203 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:53:09.201+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:57.436400+0000 front 2019-12-08T17:51:57.434512+0000 (oldest deadline 2019-12-08T17:52:43.154497+0000) 2019-12-08T17:53:09.502 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:53:09.499+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.169633+0000 front 2019-12-08T17:52:01.117742+0000 (oldest deadline 2019-12-08T17:52:46.252207+0000) 2019-12-08T17:53:09.637 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:53:09.631+0000 1694f700 -1 osd.6 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.166500+0000 front 2019-12-08T17:52:01.034178+0000 (oldest deadline 2019-12-08T17:52:44.870861+0000) 2019-12-08T17:53:09.862 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:53:09.858+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:55.656743+0000 front 2019-12-08T17:51:55.655283+0000 (oldest deadline 2019-12-08T17:52:41.316741+0000) 2019-12-08T17:53:09.927 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:53:09.923+0000 1694f700 -1 osd.2 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:52:13.538740+0000 (oldest deadline 2019-12-08T17:52:53.538740+0000) 2019-12-08T17:53:09.928 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:53:09.926+0000 1694f700 -1 osd.2 265 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e264) 2019-12-08T17:53:10.124 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:53:10.118+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:58.368348+0000 front 2019-12-08T17:51:57.888374+0000 (oldest deadline 2019-12-08T17:52:41.304357+0000) 2019-12-08T17:53:10.163 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:53:10.160+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:57.436400+0000 front 2019-12-08T17:51:57.434512+0000 (oldest deadline 2019-12-08T17:52:43.154497+0000) 2019-12-08T17:53:10.474 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:53:10.465+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.169633+0000 front 2019-12-08T17:52:01.117742+0000 (oldest deadline 2019-12-08T17:52:46.252207+0000) 2019-12-08T17:53:10.657 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:53:10.652+0000 1694f700 -1 osd.6 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.166500+0000 front 2019-12-08T17:52:01.034178+0000 (oldest deadline 2019-12-08T17:52:44.870861+0000) 2019-12-08T17:53:10.870 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:53:10.865+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:55.656743+0000 front 2019-12-08T17:51:55.655283+0000 (oldest deadline 2019-12-08T17:52:41.316741+0000) 2019-12-08T17:53:10.934 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:53:10.930+0000 1694f700 -1 osd.2 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:52:13.538740+0000 (oldest deadline 2019-12-08T17:52:53.538740+0000) 2019-12-08T17:53:10.935 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:53:10.933+0000 1694f700 -1 osd.2 265 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e264) 2019-12-08T17:53:11.100 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:53:11.094+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:58.368348+0000 front 2019-12-08T17:51:57.888374+0000 (oldest deadline 2019-12-08T17:52:41.304357+0000) 2019-12-08T17:53:11.181 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:53:11.179+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:57.436400+0000 front 2019-12-08T17:51:57.434512+0000 (oldest deadline 2019-12-08T17:52:43.154497+0000) 2019-12-08T17:53:11.522 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:53:11.517+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.169633+0000 front 2019-12-08T17:52:01.117742+0000 (oldest deadline 2019-12-08T17:52:46.252207+0000) 2019-12-08T17:53:11.631 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:53:11.625+0000 1694f700 -1 osd.6 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.166500+0000 front 2019-12-08T17:52:01.034178+0000 (oldest deadline 2019-12-08T17:52:44.870861+0000) 2019-12-08T17:53:11.876 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:53:11.871+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:55.656743+0000 front 2019-12-08T17:51:55.655283+0000 (oldest deadline 2019-12-08T17:52:41.316741+0000) 2019-12-08T17:53:11.966 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:53:11.963+0000 1694f700 -1 osd.2 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:52:13.538740+0000 (oldest deadline 2019-12-08T17:52:53.538740+0000) 2019-12-08T17:53:11.967 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:53:11.965+0000 1694f700 -1 osd.2 265 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e264) 2019-12-08T17:53:12.122 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:53:12.118+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:58.368348+0000 front 2019-12-08T17:51:57.888374+0000 (oldest deadline 2019-12-08T17:52:41.304357+0000) 2019-12-08T17:53:12.134 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:53:12.132+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:57.436400+0000 front 2019-12-08T17:51:57.434512+0000 (oldest deadline 2019-12-08T17:52:43.154497+0000) 2019-12-08T17:53:12.519 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:53:12.514+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.169633+0000 front 2019-12-08T17:52:01.117742+0000 (oldest deadline 2019-12-08T17:52:46.252207+0000) 2019-12-08T17:53:12.608 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:53:12.602+0000 1694f700 -1 osd.6 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.166500+0000 front 2019-12-08T17:52:01.034178+0000 (oldest deadline 2019-12-08T17:52:44.870861+0000) 2019-12-08T17:53:12.921 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:53:12.915+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:55.656743+0000 front 2019-12-08T17:51:55.655283+0000 (oldest deadline 2019-12-08T17:52:41.316741+0000) 2019-12-08T17:53:12.969 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:53:12.966+0000 1694f700 -1 osd.2 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:52:13.538740+0000 (oldest deadline 2019-12-08T17:52:53.538740+0000) 2019-12-08T17:53:12.971 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:53:12.968+0000 1694f700 -1 osd.2 265 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e264) 2019-12-08T17:53:13.108 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:53:13.102+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:58.368348+0000 front 2019-12-08T17:51:57.888374+0000 (oldest deadline 2019-12-08T17:52:41.304357+0000) 2019-12-08T17:53:13.140 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:53:13.138+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:57.436400+0000 front 2019-12-08T17:51:57.434512+0000 (oldest deadline 2019-12-08T17:52:43.154497+0000) 2019-12-08T17:53:13.546 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:53:13.539+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.169633+0000 front 2019-12-08T17:52:01.117742+0000 (oldest deadline 2019-12-08T17:52:46.252207+0000) 2019-12-08T17:53:13.583 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:53:13.579+0000 1694f700 -1 osd.6 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.166500+0000 front 2019-12-08T17:52:01.034178+0000 (oldest deadline 2019-12-08T17:52:44.870861+0000) 2019-12-08T17:53:13.896 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:53:13.891+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:55.656743+0000 front 2019-12-08T17:51:55.655283+0000 (oldest deadline 2019-12-08T17:52:41.316741+0000) 2019-12-08T17:53:13.933 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:53:13.930+0000 1694f700 -1 osd.2 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:52:13.538740+0000 (oldest deadline 2019-12-08T17:52:53.538740+0000) 2019-12-08T17:53:13.935 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:53:13.933+0000 1694f700 -1 osd.2 265 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e264) 2019-12-08T17:53:14.095 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:53:14.093+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:57.436400+0000 front 2019-12-08T17:51:57.434512+0000 (oldest deadline 2019-12-08T17:52:43.154497+0000) 2019-12-08T17:53:14.098 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:53:14.093+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:58.368348+0000 front 2019-12-08T17:51:57.888374+0000 (oldest deadline 2019-12-08T17:52:41.304357+0000) 2019-12-08T17:53:14.313 INFO:tasks.ceph.mon.b.smithi013.stderr:2019-12-08T17:53:14.306+0000 1a89c700 -1 mon.b@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.1 [v2:172.21.15.79:6810/10449,v1:172.21.15.79:6811/10449] for 46sec e265 v265) 2019-12-08T17:53:14.546 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:53:14.542+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.169633+0000 front 2019-12-08T17:52:01.117742+0000 (oldest deadline 2019-12-08T17:52:46.252207+0000) 2019-12-08T17:53:14.576 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:53:14.570+0000 1694f700 -1 osd.6 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.166500+0000 front 2019-12-08T17:52:01.034178+0000 (oldest deadline 2019-12-08T17:52:44.870861+0000) 2019-12-08T17:53:14.932 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:53:14.926+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:55.656743+0000 front 2019-12-08T17:51:55.655283+0000 (oldest deadline 2019-12-08T17:52:41.316741+0000) 2019-12-08T17:53:14.934 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:53:14.931+0000 1694f700 -1 osd.2 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:52:13.538740+0000 (oldest deadline 2019-12-08T17:52:53.538740+0000) 2019-12-08T17:53:14.935 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:53:14.933+0000 1694f700 -1 osd.2 265 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e264) 2019-12-08T17:53:15.054 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:53:15.052+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:57.436400+0000 front 2019-12-08T17:51:57.434512+0000 (oldest deadline 2019-12-08T17:52:43.154497+0000) 2019-12-08T17:53:15.081 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:53:15.076+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:58.368348+0000 front 2019-12-08T17:51:57.888374+0000 (oldest deadline 2019-12-08T17:52:41.304357+0000) 2019-12-08T17:53:15.507 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:53:15.502+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.169633+0000 front 2019-12-08T17:52:01.117742+0000 (oldest deadline 2019-12-08T17:52:46.252207+0000) 2019-12-08T17:53:15.570 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:53:15.566+0000 1694f700 -1 osd.6 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.166500+0000 front 2019-12-08T17:52:01.034178+0000 (oldest deadline 2019-12-08T17:52:44.870861+0000) 2019-12-08T17:53:15.908 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:53:15.903+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:55.656743+0000 front 2019-12-08T17:51:55.655283+0000 (oldest deadline 2019-12-08T17:52:41.316741+0000) 2019-12-08T17:53:15.923 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:53:15.918+0000 1694f700 -1 osd.2 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:52:13.538740+0000 (oldest deadline 2019-12-08T17:52:53.538740+0000) 2019-12-08T17:53:15.924 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:53:15.922+0000 1694f700 -1 osd.2 265 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e264) 2019-12-08T17:53:16.024 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:53:16.022+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:57.436400+0000 front 2019-12-08T17:51:57.434512+0000 (oldest deadline 2019-12-08T17:52:43.154497+0000) 2019-12-08T17:53:16.083 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:53:16.077+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:58.368348+0000 front 2019-12-08T17:51:57.888374+0000 (oldest deadline 2019-12-08T17:52:41.304357+0000) 2019-12-08T17:53:16.504 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:53:16.499+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.169633+0000 front 2019-12-08T17:52:01.117742+0000 (oldest deadline 2019-12-08T17:52:46.252207+0000) 2019-12-08T17:53:16.590 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:53:16.584+0000 1694f700 -1 osd.6 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.166500+0000 front 2019-12-08T17:52:01.034178+0000 (oldest deadline 2019-12-08T17:52:44.870861+0000) 2019-12-08T17:53:16.890 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:53:16.886+0000 1694f700 -1 osd.2 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:52:13.538740+0000 (oldest deadline 2019-12-08T17:52:53.538740+0000) 2019-12-08T17:53:16.892 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:53:16.889+0000 1694f700 -1 osd.2 265 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e264) 2019-12-08T17:53:16.933 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:53:16.927+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:55.656743+0000 front 2019-12-08T17:51:55.655283+0000 (oldest deadline 2019-12-08T17:52:41.316741+0000) 2019-12-08T17:53:16.990 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:53:16.987+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:57.436400+0000 front 2019-12-08T17:51:57.434512+0000 (oldest deadline 2019-12-08T17:52:43.154497+0000) 2019-12-08T17:53:17.115 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:53:17.111+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:58.368348+0000 front 2019-12-08T17:51:57.888374+0000 (oldest deadline 2019-12-08T17:52:41.304357+0000) 2019-12-08T17:53:17.501 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:53:17.496+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.169633+0000 front 2019-12-08T17:52:01.117742+0000 (oldest deadline 2019-12-08T17:52:46.252207+0000) 2019-12-08T17:53:17.570 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:53:17.566+0000 1694f700 -1 osd.6 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.166500+0000 front 2019-12-08T17:52:01.034178+0000 (oldest deadline 2019-12-08T17:52:44.870861+0000) 2019-12-08T17:53:17.895 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:53:17.893+0000 1694f700 -1 osd.2 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:52:13.538740+0000 (oldest deadline 2019-12-08T17:52:53.538740+0000) 2019-12-08T17:53:17.896 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:53:17.895+0000 1694f700 -1 osd.2 265 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e264) 2019-12-08T17:53:17.952 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:53:17.947+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:55.656743+0000 front 2019-12-08T17:51:55.655283+0000 (oldest deadline 2019-12-08T17:52:41.316741+0000) 2019-12-08T17:53:18.016 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:53:18.014+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:57.436400+0000 front 2019-12-08T17:51:57.434512+0000 (oldest deadline 2019-12-08T17:52:43.154497+0000) 2019-12-08T17:53:18.168 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:53:18.163+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:58.368348+0000 front 2019-12-08T17:51:57.888374+0000 (oldest deadline 2019-12-08T17:52:41.304357+0000) 2019-12-08T17:53:18.499 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:53:18.494+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.169633+0000 front 2019-12-08T17:52:01.117742+0000 (oldest deadline 2019-12-08T17:52:46.252207+0000) 2019-12-08T17:53:18.569 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:53:18.564+0000 1694f700 -1 osd.6 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.166500+0000 front 2019-12-08T17:52:01.034178+0000 (oldest deadline 2019-12-08T17:52:44.870861+0000) 2019-12-08T17:53:18.883 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:53:18.880+0000 1694f700 -1 osd.2 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:52:13.538740+0000 (oldest deadline 2019-12-08T17:52:53.538740+0000) 2019-12-08T17:53:18.883 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:53:18.882+0000 1694f700 -1 osd.2 265 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e264) 2019-12-08T17:53:18.928 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:53:18.922+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:55.656743+0000 front 2019-12-08T17:51:55.655283+0000 (oldest deadline 2019-12-08T17:52:41.316741+0000) 2019-12-08T17:53:19.071 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:53:19.069+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:57.436400+0000 front 2019-12-08T17:51:57.434512+0000 (oldest deadline 2019-12-08T17:52:43.154497+0000) 2019-12-08T17:53:19.198 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:53:19.195+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:58.368348+0000 front 2019-12-08T17:51:57.888374+0000 (oldest deadline 2019-12-08T17:52:41.304357+0000) 2019-12-08T17:53:19.372 INFO:tasks.ceph.mon.b.smithi013.stderr:2019-12-08T17:53:19.359+0000 1a89c700 -1 mon.b@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.1 [v2:172.21.15.79:6810/10449,v1:172.21.15.79:6811/10449] for 46sec e265 v265) 2019-12-08T17:53:19.533 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:53:19.528+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.169633+0000 front 2019-12-08T17:52:01.117742+0000 (oldest deadline 2019-12-08T17:52:46.252207+0000) 2019-12-08T17:53:19.584 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:53:19.580+0000 1694f700 -1 osd.6 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.166500+0000 front 2019-12-08T17:52:01.034178+0000 (oldest deadline 2019-12-08T17:52:44.870861+0000) 2019-12-08T17:53:19.886 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:53:19.882+0000 1694f700 -1 osd.2 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:52:13.538740+0000 (oldest deadline 2019-12-08T17:52:53.538740+0000) 2019-12-08T17:53:19.887 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:53:19.885+0000 1694f700 -1 osd.2 265 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e264) 2019-12-08T17:53:19.939 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:53:19.933+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:55.656743+0000 front 2019-12-08T17:51:55.655283+0000 (oldest deadline 2019-12-08T17:52:41.316741+0000) 2019-12-08T17:53:20.056 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:53:20.054+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:57.436400+0000 front 2019-12-08T17:51:57.434512+0000 (oldest deadline 2019-12-08T17:52:43.154497+0000) 2019-12-08T17:53:20.163 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:53:20.158+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:58.368348+0000 front 2019-12-08T17:51:57.888374+0000 (oldest deadline 2019-12-08T17:52:41.304357+0000) 2019-12-08T17:53:20.534 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:53:20.530+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.169633+0000 front 2019-12-08T17:52:01.117742+0000 (oldest deadline 2019-12-08T17:52:46.252207+0000) 2019-12-08T17:53:20.570 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:53:20.565+0000 1694f700 -1 osd.6 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.166500+0000 front 2019-12-08T17:52:01.034178+0000 (oldest deadline 2019-12-08T17:52:44.870861+0000) 2019-12-08T17:53:20.910 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:53:20.908+0000 1694f700 -1 osd.2 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:52:13.538740+0000 (oldest deadline 2019-12-08T17:52:53.538740+0000) 2019-12-08T17:53:20.911 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:53:20.910+0000 1694f700 -1 osd.2 265 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e264) 2019-12-08T17:53:20.983 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:53:20.978+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:55.656743+0000 front 2019-12-08T17:51:55.655283+0000 (oldest deadline 2019-12-08T17:52:41.316741+0000) 2019-12-08T17:53:21.025 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:53:21.023+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:57.436400+0000 front 2019-12-08T17:51:57.434512+0000 (oldest deadline 2019-12-08T17:52:43.154497+0000) 2019-12-08T17:53:21.213 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:53:21.204+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:58.368348+0000 front 2019-12-08T17:51:57.888374+0000 (oldest deadline 2019-12-08T17:52:41.304357+0000) 2019-12-08T17:53:21.590 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:53:21.584+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.169633+0000 front 2019-12-08T17:52:01.117742+0000 (oldest deadline 2019-12-08T17:52:46.252207+0000) 2019-12-08T17:53:21.627 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:53:21.620+0000 1694f700 -1 osd.6 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.166500+0000 front 2019-12-08T17:52:01.034178+0000 (oldest deadline 2019-12-08T17:52:44.870861+0000) 2019-12-08T17:53:21.869 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:53:21.865+0000 1694f700 -1 osd.2 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:52:13.538740+0000 (oldest deadline 2019-12-08T17:52:53.538740+0000) 2019-12-08T17:53:21.870 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:53:21.868+0000 1694f700 -1 osd.2 265 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e264) 2019-12-08T17:53:21.939 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:53:21.934+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:55.656743+0000 front 2019-12-08T17:51:55.655283+0000 (oldest deadline 2019-12-08T17:52:41.316741+0000) 2019-12-08T17:53:22.012 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:53:22.011+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:57.436400+0000 front 2019-12-08T17:51:57.434512+0000 (oldest deadline 2019-12-08T17:52:43.154497+0000) 2019-12-08T17:53:22.172 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:53:22.167+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:58.368348+0000 front 2019-12-08T17:51:57.888374+0000 (oldest deadline 2019-12-08T17:52:41.304357+0000) 2019-12-08T17:53:22.584 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:53:22.578+0000 1694f700 -1 osd.6 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.166500+0000 front 2019-12-08T17:52:01.034178+0000 (oldest deadline 2019-12-08T17:52:44.870861+0000) 2019-12-08T17:53:22.630 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:53:22.625+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.169633+0000 front 2019-12-08T17:52:01.117742+0000 (oldest deadline 2019-12-08T17:52:46.252207+0000) 2019-12-08T17:53:22.872 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:53:22.868+0000 1694f700 -1 osd.2 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:52:13.538740+0000 (oldest deadline 2019-12-08T17:52:53.538740+0000) 2019-12-08T17:53:22.873 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:53:22.871+0000 1694f700 -1 osd.2 265 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e264) 2019-12-08T17:53:22.956 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:53:22.952+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:55.656743+0000 front 2019-12-08T17:51:55.655283+0000 (oldest deadline 2019-12-08T17:52:41.316741+0000) 2019-12-08T17:53:23.007 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:53:23.004+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:57.436400+0000 front 2019-12-08T17:51:57.434512+0000 (oldest deadline 2019-12-08T17:52:43.154497+0000) 2019-12-08T17:53:23.152 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:53:23.146+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:58.368348+0000 front 2019-12-08T17:51:57.888374+0000 (oldest deadline 2019-12-08T17:52:41.304357+0000) 2019-12-08T17:53:23.572 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:53:23.567+0000 1694f700 -1 osd.6 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.166500+0000 front 2019-12-08T17:52:01.034178+0000 (oldest deadline 2019-12-08T17:52:44.870861+0000) 2019-12-08T17:53:23.592 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:53:23.587+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.169633+0000 front 2019-12-08T17:52:01.117742+0000 (oldest deadline 2019-12-08T17:52:46.252207+0000) 2019-12-08T17:53:23.903 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:53:23.901+0000 1694f700 -1 osd.2 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:52:13.538740+0000 (oldest deadline 2019-12-08T17:52:53.538740+0000) 2019-12-08T17:53:23.904 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:53:23.903+0000 1694f700 -1 osd.2 265 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e264) 2019-12-08T17:53:23.945 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:53:23.939+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:55.656743+0000 front 2019-12-08T17:51:55.655283+0000 (oldest deadline 2019-12-08T17:52:41.316741+0000) 2019-12-08T17:53:24.047 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:53:24.046+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:57.436400+0000 front 2019-12-08T17:51:57.434512+0000 (oldest deadline 2019-12-08T17:52:43.154497+0000) 2019-12-08T17:53:24.172 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:53:24.166+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:58.368348+0000 front 2019-12-08T17:51:57.888374+0000 (oldest deadline 2019-12-08T17:52:41.304357+0000) 2019-12-08T17:53:24.390 INFO:tasks.ceph.mon.b.smithi013.stderr:2019-12-08T17:53:24.383+0000 1a89c700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.1 [v2:172.21.15.79:6810/10449,v1:172.21.15.79:6811/10449] for 46sec e265 v265) 2019-12-08T17:53:24.596 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:53:24.590+0000 1694f700 -1 osd.6 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.166500+0000 front 2019-12-08T17:52:01.034178+0000 (oldest deadline 2019-12-08T17:52:44.870861+0000) 2019-12-08T17:53:24.792 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:53:24.602+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.169633+0000 front 2019-12-08T17:52:01.117742+0000 (oldest deadline 2019-12-08T17:52:46.252207+0000) 2019-12-08T17:53:24.924 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:53:24.919+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:55.656743+0000 front 2019-12-08T17:51:55.655283+0000 (oldest deadline 2019-12-08T17:52:41.316741+0000) 2019-12-08T17:53:24.948 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:53:24.945+0000 1694f700 -1 osd.2 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:52:13.538740+0000 (oldest deadline 2019-12-08T17:52:53.538740+0000) 2019-12-08T17:53:24.950 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:53:24.948+0000 1694f700 -1 osd.2 265 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e264) 2019-12-08T17:53:25.036 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:53:25.034+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:57.436400+0000 front 2019-12-08T17:51:57.434512+0000 (oldest deadline 2019-12-08T17:52:43.154497+0000) 2019-12-08T17:53:25.158 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:53:25.152+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:58.368348+0000 front 2019-12-08T17:51:57.888374+0000 (oldest deadline 2019-12-08T17:52:41.304357+0000) 2019-12-08T17:53:25.573 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:53:25.568+0000 1694f700 -1 osd.6 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.166500+0000 front 2019-12-08T17:52:01.034178+0000 (oldest deadline 2019-12-08T17:52:44.870861+0000) 2019-12-08T17:53:25.600 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:53:25.594+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.169633+0000 front 2019-12-08T17:52:01.117742+0000 (oldest deadline 2019-12-08T17:52:46.252207+0000) 2019-12-08T17:53:25.914 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:53:25.908+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:55.656743+0000 front 2019-12-08T17:51:55.655283+0000 (oldest deadline 2019-12-08T17:52:41.316741+0000) 2019-12-08T17:53:25.975 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:53:25.973+0000 1694f700 -1 osd.2 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:52:13.538740+0000 (oldest deadline 2019-12-08T17:52:53.538740+0000) 2019-12-08T17:53:25.976 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:53:25.976+0000 1694f700 -1 osd.2 265 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e264) 2019-12-08T17:53:26.018 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:53:26.016+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:57.436400+0000 front 2019-12-08T17:51:57.434512+0000 (oldest deadline 2019-12-08T17:52:43.154497+0000) 2019-12-08T17:53:26.199 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:53:26.194+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:58.368348+0000 front 2019-12-08T17:51:57.888374+0000 (oldest deadline 2019-12-08T17:52:41.304357+0000) 2019-12-08T17:53:26.538 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:53:26.533+0000 1694f700 -1 osd.6 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.166500+0000 front 2019-12-08T17:52:01.034178+0000 (oldest deadline 2019-12-08T17:52:44.870861+0000) 2019-12-08T17:53:26.568 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:53:26.563+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.169633+0000 front 2019-12-08T17:52:01.117742+0000 (oldest deadline 2019-12-08T17:52:46.252207+0000) 2019-12-08T17:53:26.883 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:53:26.876+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:55.656743+0000 front 2019-12-08T17:51:55.655283+0000 (oldest deadline 2019-12-08T17:52:41.316741+0000) 2019-12-08T17:53:26.959 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:53:26.958+0000 1694f700 -1 osd.2 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:52:13.538740+0000 (oldest deadline 2019-12-08T17:52:53.538740+0000) 2019-12-08T17:53:26.962 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:53:26.962+0000 1694f700 -1 osd.2 265 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e264) 2019-12-08T17:53:26.992 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:53:26.990+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:57.436400+0000 front 2019-12-08T17:51:57.434512+0000 (oldest deadline 2019-12-08T17:52:43.154497+0000) 2019-12-08T17:53:27.189 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:53:27.185+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:58.368348+0000 front 2019-12-08T17:51:57.888374+0000 (oldest deadline 2019-12-08T17:52:41.304357+0000) 2019-12-08T17:53:27.569 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:53:27.564+0000 1694f700 -1 osd.6 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.166500+0000 front 2019-12-08T17:52:01.034178+0000 (oldest deadline 2019-12-08T17:52:44.870861+0000) 2019-12-08T17:53:27.574 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:53:27.569+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.169633+0000 front 2019-12-08T17:52:01.117742+0000 (oldest deadline 2019-12-08T17:52:46.252207+0000) 2019-12-08T17:53:27.869 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:53:27.863+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:55.656743+0000 front 2019-12-08T17:51:55.655283+0000 (oldest deadline 2019-12-08T17:52:41.316741+0000) 2019-12-08T17:53:27.971 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:53:27.967+0000 1694f700 -1 osd.2 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:52:13.538740+0000 (oldest deadline 2019-12-08T17:52:53.538740+0000) 2019-12-08T17:53:27.972 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:53:27.969+0000 1694f700 -1 osd.2 265 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e264) 2019-12-08T17:53:27.992 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:53:27.991+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:57.436400+0000 front 2019-12-08T17:51:57.434512+0000 (oldest deadline 2019-12-08T17:52:43.154497+0000) 2019-12-08T17:53:28.185 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:53:28.181+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:58.368348+0000 front 2019-12-08T17:51:57.888374+0000 (oldest deadline 2019-12-08T17:52:41.304357+0000) 2019-12-08T17:53:28.587 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:53:28.582+0000 1694f700 -1 osd.6 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.166500+0000 front 2019-12-08T17:52:01.034178+0000 (oldest deadline 2019-12-08T17:52:44.870861+0000) 2019-12-08T17:53:28.603 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:53:28.597+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.169633+0000 front 2019-12-08T17:52:01.117742+0000 (oldest deadline 2019-12-08T17:52:46.252207+0000) 2019-12-08T17:53:28.860 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:53:28.855+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:55.656743+0000 front 2019-12-08T17:51:55.655283+0000 (oldest deadline 2019-12-08T17:52:41.316741+0000) 2019-12-08T17:53:28.995 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:53:28.994+0000 1694f700 -1 osd.2 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:52:13.538740+0000 (oldest deadline 2019-12-08T17:52:53.538740+0000) 2019-12-08T17:53:28.998 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:53:28.998+0000 1694f700 -1 osd.2 265 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e264) 2019-12-08T17:53:29.021 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:53:29.020+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:57.436400+0000 front 2019-12-08T17:51:57.434512+0000 (oldest deadline 2019-12-08T17:52:43.154497+0000) 2019-12-08T17:53:29.157 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:53:29.152+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:58.368348+0000 front 2019-12-08T17:51:57.888374+0000 (oldest deadline 2019-12-08T17:52:41.304357+0000) 2019-12-08T17:53:29.467 INFO:tasks.ceph.mon.b.smithi013.stderr:2019-12-08T17:53:29.461+0000 1a89c700 -1 mon.b@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.1 [v2:172.21.15.79:6810/10449,v1:172.21.15.79:6811/10449] for 46sec e265 v265) 2019-12-08T17:53:29.516 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:05:50:54.219 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T17:53:29.524 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:05:50:54.227 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T17:53:29.527 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:05:50:54.161 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T17:53:29.528 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:05:50:54.163 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T17:53:29.530 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:05:50:54.165 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T17:53:29.532 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:05:50:54.167 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T17:53:29.607 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:53:29.603+0000 1694f700 -1 osd.6 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.166500+0000 front 2019-12-08T17:52:01.034178+0000 (oldest deadline 2019-12-08T17:52:44.870861+0000) 2019-12-08T17:53:29.646 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:53:29.641+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.169633+0000 front 2019-12-08T17:52:01.117742+0000 (oldest deadline 2019-12-08T17:52:46.252207+0000) 2019-12-08T17:53:29.743 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:05:50:54.378 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T17:53:29.783 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:05:50:54.418 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T17:53:29.819 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:05:50:54.522 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T17:53:29.866 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:53:29.860+0000 1694f700 -1 osd.7 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:55.656743+0000 front 2019-12-08T17:51:55.655283+0000 (oldest deadline 2019-12-08T17:52:41.316741+0000) 2019-12-08T17:53:30.000 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:53:29.999+0000 1694f700 -1 osd.2 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T17:52:13.538740+0000 (oldest deadline 2019-12-08T17:52:53.538740+0000) 2019-12-08T17:53:30.001 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:53:30.001+0000 1694f700 -1 osd.2 265 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e264) 2019-12-08T17:53:30.007 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:53:30.006+0000 1694f700 -1 osd.3 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:57.436400+0000 front 2019-12-08T17:51:57.434512+0000 (oldest deadline 2019-12-08T17:52:43.154497+0000) 2019-12-08T17:53:30.177 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:53:30.172+0000 1694f700 -1 osd.5 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:51:58.368348+0000 front 2019-12-08T17:51:57.888374+0000 (oldest deadline 2019-12-08T17:52:41.304357+0000) 2019-12-08T17:53:30.611 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:53:30.606+0000 1694f700 -1 osd.6 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.166500+0000 front 2019-12-08T17:52:01.034178+0000 (oldest deadline 2019-12-08T17:52:44.870861+0000) 2019-12-08T17:53:30.620 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:53:30.617+0000 1694f700 -1 osd.4 265 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:52:01.169633+0000 front 2019-12-08T17:52:01.117742+0000 (oldest deadline 2019-12-08T17:52:46.252207+0000) 2019-12-08T17:53:32.999 INFO:tasks.rgw.client.0.smithi079.stdout:2019-12-08T17:53:32.950+0000 20e25700 -1 RGWWatcher::handle_error cookie 363279152 err (107) Transport endpoint is not connected 2019-12-08T17:53:52.398 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:53:52.290+0000 1694f700 -1 osd.1 265 get_health_metrics reporting 24 slow ops, oldest is osd_op(client.4449.0:106304 5.9 5.84ada7c9 (undecoded) ondisk+write+known_if_redirected e265) 2019-12-08T17:53:53.771 INFO:tasks.rgw.client.0.smithi079.stdout:2019-12-08T17:53:53.729+0000 20e25700 -1 RGWWatcher::handle_error cookie 384008544 err (107) Transport endpoint is not connected 2019-12-08T17:53:58.826 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:53:58.817+0000 38a7d700 -1 osd.1 271 build_incremental_map_msg missing incremental map 271 2019-12-08T17:53:58.850 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:53:58.846+0000 36278700 -1 osd.1 271 build_incremental_map_msg missing incremental map 271 2019-12-08T17:54:01.946 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:54:01.943+0000 3827c700 -1 osd.1 271 build_incremental_map_msg missing incremental map 271 2019-12-08T17:55:10.074 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:05:52:34.777 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T17:55:10.114 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:05:52:34.721 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T17:55:10.114 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:05:52:34.781 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T17:55:10.127 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:05:52:34.762 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T17:55:10.133 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:05:52:34.767 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T17:55:10.140 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:05:52:34.775 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T17:55:10.207 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:05:52:34.841 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T17:55:10.227 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:05:52:34.862 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T17:55:10.332 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:05:52:35.035 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T17:55:18.361 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:55:18.358+0000 1694f700 -1 osd.3 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:35.872722+0000 front 2019-12-08T17:54:35.873320+0000 (oldest deadline 2019-12-08T17:55:18.182843+0000) 2019-12-08T17:55:19.333 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:55:19.330+0000 1694f700 -1 osd.3 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:35.872722+0000 front 2019-12-08T17:54:35.873320+0000 (oldest deadline 2019-12-08T17:55:18.182843+0000) 2019-12-08T17:55:19.387 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:55:19.381+0000 1694f700 -1 osd.7 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:35.300691+0000 front 2019-12-08T17:54:35.302496+0000 (oldest deadline 2019-12-08T17:55:18.521129+0000) 2019-12-08T17:55:19.475 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:55:19.470+0000 1694f700 -1 osd.4 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:37.203542+0000 front 2019-12-08T17:54:37.329551+0000 (oldest deadline 2019-12-08T17:55:18.494172+0000) 2019-12-08T17:55:20.370 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:55:20.368+0000 1694f700 -1 osd.3 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:35.872722+0000 front 2019-12-08T17:54:35.873320+0000 (oldest deadline 2019-12-08T17:55:18.182843+0000) 2019-12-08T17:55:20.402 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:55:20.396+0000 1694f700 -1 osd.7 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:35.300691+0000 front 2019-12-08T17:54:35.302496+0000 (oldest deadline 2019-12-08T17:55:18.521129+0000) 2019-12-08T17:55:20.477 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:55:20.470+0000 1694f700 -1 osd.4 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:37.203542+0000 front 2019-12-08T17:54:37.329551+0000 (oldest deadline 2019-12-08T17:55:18.494172+0000) 2019-12-08T17:55:20.644 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:55:20.641+0000 1694f700 -1 osd.1 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:37.995664+0000 front 2019-12-08T17:54:37.994391+0000 (oldest deadline 2019-12-08T17:55:20.274096+0000) 2019-12-08T17:55:21.365 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:55:21.359+0000 1694f700 -1 osd.7 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:35.300691+0000 front 2019-12-08T17:54:35.302496+0000 (oldest deadline 2019-12-08T17:55:18.521129+0000) 2019-12-08T17:55:21.380 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:55:21.378+0000 1694f700 -1 osd.3 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:35.872722+0000 front 2019-12-08T17:54:35.873320+0000 (oldest deadline 2019-12-08T17:55:18.182843+0000) 2019-12-08T17:55:21.510 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:55:21.505+0000 1694f700 -1 osd.4 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:37.203542+0000 front 2019-12-08T17:54:37.329551+0000 (oldest deadline 2019-12-08T17:55:18.494172+0000) 2019-12-08T17:55:21.634 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:55:21.632+0000 1694f700 -1 osd.1 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:37.995664+0000 front 2019-12-08T17:54:37.994391+0000 (oldest deadline 2019-12-08T17:55:20.274096+0000) 2019-12-08T17:55:22.142 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:55:22.134+0000 1694f700 -1 osd.5 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.691399+0000 front 2019-12-08T17:54:36.196099+0000 (oldest deadline 2019-12-08T17:55:21.487032+0000) 2019-12-08T17:55:22.350 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:55:22.343+0000 1694f700 -1 osd.7 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:35.300691+0000 front 2019-12-08T17:54:35.302496+0000 (oldest deadline 2019-12-08T17:55:18.521129+0000) 2019-12-08T17:55:22.388 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:55:22.386+0000 1694f700 -1 osd.3 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:35.872722+0000 front 2019-12-08T17:54:35.873320+0000 (oldest deadline 2019-12-08T17:55:18.182843+0000) 2019-12-08T17:55:22.461 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:55:22.460+0000 1694f700 -1 osd.0 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.166962+0000 front 2019-12-08T17:54:36.693921+0000 (oldest deadline 2019-12-08T17:55:21.982056+0000) 2019-12-08T17:55:22.504 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:55:22.498+0000 1694f700 -1 osd.4 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:37.203542+0000 front 2019-12-08T17:54:37.329551+0000 (oldest deadline 2019-12-08T17:55:18.494172+0000) 2019-12-08T17:55:22.606 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:55:22.601+0000 1694f700 -1 osd.1 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:37.995664+0000 front 2019-12-08T17:54:37.994391+0000 (oldest deadline 2019-12-08T17:55:20.274096+0000) 2019-12-08T17:55:22.929 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:55:22.920+0000 1694f700 -1 osd.6 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.973357+0000 front 2019-12-08T17:54:37.016194+0000 (oldest deadline 2019-12-08T17:55:22.800712+0000) 2019-12-08T17:55:23.156 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:55:23.150+0000 1694f700 -1 osd.5 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.691399+0000 front 2019-12-08T17:54:36.196099+0000 (oldest deadline 2019-12-08T17:55:21.487032+0000) 2019-12-08T17:55:23.361 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:55:23.354+0000 1694f700 -1 osd.7 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:35.300691+0000 front 2019-12-08T17:54:35.302496+0000 (oldest deadline 2019-12-08T17:55:18.521129+0000) 2019-12-08T17:55:23.433 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:55:23.430+0000 1694f700 -1 osd.3 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:35.872722+0000 front 2019-12-08T17:54:35.873320+0000 (oldest deadline 2019-12-08T17:55:18.182843+0000) 2019-12-08T17:55:23.471 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:55:23.470+0000 1694f700 -1 osd.0 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.166962+0000 front 2019-12-08T17:54:36.693921+0000 (oldest deadline 2019-12-08T17:55:21.982056+0000) 2019-12-08T17:55:23.525 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:55:23.519+0000 1694f700 -1 osd.4 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:37.203542+0000 front 2019-12-08T17:54:37.329551+0000 (oldest deadline 2019-12-08T17:55:18.494172+0000) 2019-12-08T17:55:23.584 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:55:23.581+0000 1694f700 -1 osd.1 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:37.995664+0000 front 2019-12-08T17:54:37.994391+0000 (oldest deadline 2019-12-08T17:55:20.274096+0000) 2019-12-08T17:55:23.949 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:55:23.942+0000 1694f700 -1 osd.6 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.973357+0000 front 2019-12-08T17:54:37.016194+0000 (oldest deadline 2019-12-08T17:55:22.800712+0000) 2019-12-08T17:55:24.168 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:55:24.162+0000 1694f700 -1 osd.5 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.691399+0000 front 2019-12-08T17:54:36.196099+0000 (oldest deadline 2019-12-08T17:55:21.487032+0000) 2019-12-08T17:55:24.361 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:55:24.354+0000 1694f700 -1 osd.7 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:35.300691+0000 front 2019-12-08T17:54:35.302496+0000 (oldest deadline 2019-12-08T17:55:18.521129+0000) 2019-12-08T17:55:24.416 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:55:24.415+0000 1694f700 -1 osd.3 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:35.872722+0000 front 2019-12-08T17:54:35.873320+0000 (oldest deadline 2019-12-08T17:55:18.182843+0000) 2019-12-08T17:55:24.461 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:55:24.459+0000 1694f700 -1 osd.0 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.166962+0000 front 2019-12-08T17:54:36.693921+0000 (oldest deadline 2019-12-08T17:55:21.982056+0000) 2019-12-08T17:55:24.560 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:55:24.554+0000 1694f700 -1 osd.4 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:37.203542+0000 front 2019-12-08T17:54:37.329551+0000 (oldest deadline 2019-12-08T17:55:18.494172+0000) 2019-12-08T17:55:24.633 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:55:24.631+0000 1694f700 -1 osd.1 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:37.995664+0000 front 2019-12-08T17:54:37.994391+0000 (oldest deadline 2019-12-08T17:55:20.274096+0000) 2019-12-08T17:55:24.931 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:55:24.925+0000 1694f700 -1 osd.6 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.973357+0000 front 2019-12-08T17:54:37.016194+0000 (oldest deadline 2019-12-08T17:55:22.800712+0000) 2019-12-08T17:55:25.123 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:55:25.117+0000 1694f700 -1 osd.5 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.691399+0000 front 2019-12-08T17:54:36.196099+0000 (oldest deadline 2019-12-08T17:55:21.487032+0000) 2019-12-08T17:55:25.394 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:55:25.388+0000 1694f700 -1 osd.7 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:35.300691+0000 front 2019-12-08T17:54:35.302496+0000 (oldest deadline 2019-12-08T17:55:18.521129+0000) 2019-12-08T17:55:25.399 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:55:25.397+0000 1694f700 -1 osd.3 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:35.872722+0000 front 2019-12-08T17:54:35.873320+0000 (oldest deadline 2019-12-08T17:55:18.182843+0000) 2019-12-08T17:55:25.507 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:55:25.505+0000 1694f700 -1 osd.0 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.166962+0000 front 2019-12-08T17:54:36.693921+0000 (oldest deadline 2019-12-08T17:55:21.982056+0000) 2019-12-08T17:55:25.539 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:55:25.533+0000 1694f700 -1 osd.4 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:37.203542+0000 front 2019-12-08T17:54:37.329551+0000 (oldest deadline 2019-12-08T17:55:18.494172+0000) 2019-12-08T17:55:25.683 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:55:25.679+0000 1694f700 -1 osd.1 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:37.995664+0000 front 2019-12-08T17:54:37.994391+0000 (oldest deadline 2019-12-08T17:55:20.274096+0000) 2019-12-08T17:55:25.975 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:55:25.967+0000 1694f700 -1 osd.6 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.973357+0000 front 2019-12-08T17:54:37.016194+0000 (oldest deadline 2019-12-08T17:55:22.800712+0000) 2019-12-08T17:55:26.091 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:55:26.086+0000 1694f700 -1 osd.5 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.691399+0000 front 2019-12-08T17:54:36.196099+0000 (oldest deadline 2019-12-08T17:55:21.487032+0000) 2019-12-08T17:55:26.415 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:55:26.414+0000 1694f700 -1 osd.3 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:35.872722+0000 front 2019-12-08T17:54:35.873320+0000 (oldest deadline 2019-12-08T17:55:18.182843+0000) 2019-12-08T17:55:26.438 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:55:26.432+0000 1694f700 -1 osd.7 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:35.300691+0000 front 2019-12-08T17:54:35.302496+0000 (oldest deadline 2019-12-08T17:55:18.521129+0000) 2019-12-08T17:55:26.505 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:55:26.499+0000 1694f700 -1 osd.0 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.166962+0000 front 2019-12-08T17:54:36.693921+0000 (oldest deadline 2019-12-08T17:55:21.982056+0000) 2019-12-08T17:55:26.539 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:55:26.532+0000 1694f700 -1 osd.4 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:37.203542+0000 front 2019-12-08T17:54:37.329551+0000 (oldest deadline 2019-12-08T17:55:18.494172+0000) 2019-12-08T17:55:26.705 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:55:26.702+0000 1694f700 -1 osd.1 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:37.995664+0000 front 2019-12-08T17:54:37.994391+0000 (oldest deadline 2019-12-08T17:55:20.274096+0000) 2019-12-08T17:55:26.991 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:55:26.985+0000 1694f700 -1 osd.6 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.973357+0000 front 2019-12-08T17:54:37.016194+0000 (oldest deadline 2019-12-08T17:55:22.800712+0000) 2019-12-08T17:55:27.087 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:55:27.081+0000 1694f700 -1 osd.5 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.691399+0000 front 2019-12-08T17:54:36.196099+0000 (oldest deadline 2019-12-08T17:55:21.487032+0000) 2019-12-08T17:55:27.395 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:55:27.388+0000 1694f700 -1 osd.7 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:35.300691+0000 front 2019-12-08T17:54:35.302496+0000 (oldest deadline 2019-12-08T17:55:18.521129+0000) 2019-12-08T17:55:27.461 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:55:27.460+0000 1694f700 -1 osd.3 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:35.872722+0000 front 2019-12-08T17:54:35.873320+0000 (oldest deadline 2019-12-08T17:55:18.182843+0000) 2019-12-08T17:55:27.462 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:55:27.460+0000 1694f700 -1 osd.0 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.166962+0000 front 2019-12-08T17:54:36.693921+0000 (oldest deadline 2019-12-08T17:55:21.982056+0000) 2019-12-08T17:55:27.571 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:55:27.564+0000 1694f700 -1 osd.4 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:37.203542+0000 front 2019-12-08T17:54:37.329551+0000 (oldest deadline 2019-12-08T17:55:18.494172+0000) 2019-12-08T17:55:27.705 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:55:27.703+0000 1694f700 -1 osd.1 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:37.995664+0000 front 2019-12-08T17:54:37.994391+0000 (oldest deadline 2019-12-08T17:55:20.274096+0000) 2019-12-08T17:55:28.043 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:55:28.037+0000 1694f700 -1 osd.6 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.973357+0000 front 2019-12-08T17:54:37.016194+0000 (oldest deadline 2019-12-08T17:55:22.800712+0000) 2019-12-08T17:55:28.066 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:55:28.061+0000 1694f700 -1 osd.5 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.691399+0000 front 2019-12-08T17:54:36.196099+0000 (oldest deadline 2019-12-08T17:55:21.487032+0000) 2019-12-08T17:55:28.438 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:55:28.432+0000 1694f700 -1 osd.7 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:35.300691+0000 front 2019-12-08T17:54:35.302496+0000 (oldest deadline 2019-12-08T17:55:18.521129+0000) 2019-12-08T17:55:28.446 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:55:28.443+0000 1694f700 -1 osd.3 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:35.872722+0000 front 2019-12-08T17:54:35.873320+0000 (oldest deadline 2019-12-08T17:55:18.182843+0000) 2019-12-08T17:55:28.503 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:55:28.501+0000 1694f700 -1 osd.0 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.166962+0000 front 2019-12-08T17:54:36.693921+0000 (oldest deadline 2019-12-08T17:55:21.982056+0000) 2019-12-08T17:55:28.553 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:55:28.546+0000 1694f700 -1 osd.4 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:37.203542+0000 front 2019-12-08T17:54:37.329551+0000 (oldest deadline 2019-12-08T17:55:18.494172+0000) 2019-12-08T17:55:28.737 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:55:28.735+0000 1694f700 -1 osd.1 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:37.995664+0000 front 2019-12-08T17:54:37.994391+0000 (oldest deadline 2019-12-08T17:55:20.274096+0000) 2019-12-08T17:55:29.035 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:55:29.030+0000 1694f700 -1 osd.6 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.973357+0000 front 2019-12-08T17:54:37.016194+0000 (oldest deadline 2019-12-08T17:55:22.800712+0000) 2019-12-08T17:55:29.117 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:55:29.109+0000 1694f700 -1 osd.5 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.691399+0000 front 2019-12-08T17:54:36.196099+0000 (oldest deadline 2019-12-08T17:55:21.487032+0000) 2019-12-08T17:55:29.420 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:55:29.413+0000 1694f700 -1 osd.7 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:35.300691+0000 front 2019-12-08T17:54:35.302496+0000 (oldest deadline 2019-12-08T17:55:18.521129+0000) 2019-12-08T17:55:29.497 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:55:29.495+0000 1694f700 -1 osd.3 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:35.872722+0000 front 2019-12-08T17:54:35.873320+0000 (oldest deadline 2019-12-08T17:55:18.182843+0000) 2019-12-08T17:55:29.521 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:55:29.520+0000 1694f700 -1 osd.0 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.166962+0000 front 2019-12-08T17:54:36.693921+0000 (oldest deadline 2019-12-08T17:55:21.982056+0000) 2019-12-08T17:55:29.554 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:55:29.547+0000 1694f700 -1 osd.4 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:37.203542+0000 front 2019-12-08T17:54:37.329551+0000 (oldest deadline 2019-12-08T17:55:18.494172+0000) 2019-12-08T17:55:29.735 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:55:29.733+0000 1694f700 -1 osd.1 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:37.995664+0000 front 2019-12-08T17:54:37.994391+0000 (oldest deadline 2019-12-08T17:55:20.274096+0000) 2019-12-08T17:55:30.043 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:55:30.037+0000 1694f700 -1 osd.6 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.973357+0000 front 2019-12-08T17:54:37.016194+0000 (oldest deadline 2019-12-08T17:55:22.800712+0000) 2019-12-08T17:55:30.158 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:55:30.152+0000 1694f700 -1 osd.5 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.691399+0000 front 2019-12-08T17:54:36.196099+0000 (oldest deadline 2019-12-08T17:55:21.487032+0000) 2019-12-08T17:55:30.384 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:55:30.378+0000 1694f700 -1 osd.7 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:35.300691+0000 front 2019-12-08T17:54:35.302496+0000 (oldest deadline 2019-12-08T17:55:18.521129+0000) 2019-12-08T17:55:30.508 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:55:30.506+0000 1694f700 -1 osd.3 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:35.872722+0000 front 2019-12-08T17:54:35.873320+0000 (oldest deadline 2019-12-08T17:55:18.182843+0000) 2019-12-08T17:55:30.553 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:55:30.547+0000 1694f700 -1 osd.4 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:37.203542+0000 front 2019-12-08T17:54:37.329551+0000 (oldest deadline 2019-12-08T17:55:18.494172+0000) 2019-12-08T17:55:30.565 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:55:30.563+0000 1694f700 -1 osd.0 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.166962+0000 front 2019-12-08T17:54:36.693921+0000 (oldest deadline 2019-12-08T17:55:21.982056+0000) 2019-12-08T17:55:30.728 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:55:30.725+0000 1694f700 -1 osd.1 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:37.995664+0000 front 2019-12-08T17:54:37.994391+0000 (oldest deadline 2019-12-08T17:55:20.274096+0000) 2019-12-08T17:55:31.001 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:55:30.995+0000 1694f700 -1 osd.6 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.973357+0000 front 2019-12-08T17:54:37.016194+0000 (oldest deadline 2019-12-08T17:55:22.800712+0000) 2019-12-08T17:55:31.206 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:55:31.201+0000 1694f700 -1 osd.5 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.691399+0000 front 2019-12-08T17:54:36.196099+0000 (oldest deadline 2019-12-08T17:55:21.487032+0000) 2019-12-08T17:55:31.375 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:55:31.368+0000 1694f700 -1 osd.7 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:35.300691+0000 front 2019-12-08T17:54:35.302496+0000 (oldest deadline 2019-12-08T17:55:18.521129+0000) 2019-12-08T17:55:31.525 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:55:31.523+0000 1694f700 -1 osd.3 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:35.872722+0000 front 2019-12-08T17:54:35.873320+0000 (oldest deadline 2019-12-08T17:55:18.182843+0000) 2019-12-08T17:55:31.568 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:55:31.561+0000 1694f700 -1 osd.0 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.166962+0000 front 2019-12-08T17:54:36.693921+0000 (oldest deadline 2019-12-08T17:55:21.982056+0000) 2019-12-08T17:55:31.593 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:55:31.587+0000 1694f700 -1 osd.4 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:37.203542+0000 front 2019-12-08T17:54:37.329551+0000 (oldest deadline 2019-12-08T17:55:18.494172+0000) 2019-12-08T17:55:31.729 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:55:31.727+0000 1694f700 -1 osd.1 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:37.995664+0000 front 2019-12-08T17:54:37.994391+0000 (oldest deadline 2019-12-08T17:55:20.274096+0000) 2019-12-08T17:55:32.032 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:55:32.026+0000 1694f700 -1 osd.6 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.973357+0000 front 2019-12-08T17:54:37.016194+0000 (oldest deadline 2019-12-08T17:55:22.800712+0000) 2019-12-08T17:55:32.252 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:55:32.246+0000 1694f700 -1 osd.5 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.691399+0000 front 2019-12-08T17:54:36.196099+0000 (oldest deadline 2019-12-08T17:55:21.487032+0000) 2019-12-08T17:55:32.430 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:55:32.424+0000 1694f700 -1 osd.7 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:35.300691+0000 front 2019-12-08T17:54:35.302496+0000 (oldest deadline 2019-12-08T17:55:18.521129+0000) 2019-12-08T17:55:32.537 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:55:32.535+0000 1694f700 -1 osd.0 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.166962+0000 front 2019-12-08T17:54:36.693921+0000 (oldest deadline 2019-12-08T17:55:21.982056+0000) 2019-12-08T17:55:32.576 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:55:32.570+0000 1694f700 -1 osd.3 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:35.872722+0000 front 2019-12-08T17:54:35.873320+0000 (oldest deadline 2019-12-08T17:55:18.182843+0000) 2019-12-08T17:55:32.627 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:55:32.621+0000 1694f700 -1 osd.4 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:37.203542+0000 front 2019-12-08T17:54:37.329551+0000 (oldest deadline 2019-12-08T17:55:18.494172+0000) 2019-12-08T17:55:32.746 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:55:32.744+0000 1694f700 -1 osd.1 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:37.995664+0000 front 2019-12-08T17:54:37.994391+0000 (oldest deadline 2019-12-08T17:55:20.274096+0000) 2019-12-08T17:55:33.079 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:55:33.073+0000 1694f700 -1 osd.6 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.973357+0000 front 2019-12-08T17:54:37.016194+0000 (oldest deadline 2019-12-08T17:55:22.800712+0000) 2019-12-08T17:55:33.207 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:55:33.201+0000 1694f700 -1 osd.5 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.691399+0000 front 2019-12-08T17:54:36.196099+0000 (oldest deadline 2019-12-08T17:55:21.487032+0000) 2019-12-08T17:55:33.426 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:55:33.420+0000 1694f700 -1 osd.7 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:35.300691+0000 front 2019-12-08T17:54:35.302496+0000 (oldest deadline 2019-12-08T17:55:18.521129+0000) 2019-12-08T17:55:33.501 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:55:33.500+0000 1694f700 -1 osd.0 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.166962+0000 front 2019-12-08T17:54:36.693921+0000 (oldest deadline 2019-12-08T17:55:21.982056+0000) 2019-12-08T17:55:33.540 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:55:33.539+0000 1694f700 -1 osd.3 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:35.872722+0000 front 2019-12-08T17:54:35.873320+0000 (oldest deadline 2019-12-08T17:55:18.182843+0000) 2019-12-08T17:55:33.663 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:55:33.659+0000 1694f700 -1 osd.4 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:37.203542+0000 front 2019-12-08T17:54:37.329551+0000 (oldest deadline 2019-12-08T17:55:18.494172+0000) 2019-12-08T17:55:33.784 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:55:33.780+0000 1694f700 -1 osd.1 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:37.995664+0000 front 2019-12-08T17:54:37.994391+0000 (oldest deadline 2019-12-08T17:55:20.274096+0000) 2019-12-08T17:55:34.077 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:55:34.072+0000 1694f700 -1 osd.6 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.973357+0000 front 2019-12-08T17:54:37.016194+0000 (oldest deadline 2019-12-08T17:55:22.800712+0000) 2019-12-08T17:55:34.239 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:55:34.233+0000 1694f700 -1 osd.5 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.691399+0000 front 2019-12-08T17:54:36.196099+0000 (oldest deadline 2019-12-08T17:55:21.487032+0000) 2019-12-08T17:55:34.418 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:55:34.412+0000 1694f700 -1 osd.7 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:35.300691+0000 front 2019-12-08T17:54:35.302496+0000 (oldest deadline 2019-12-08T17:55:18.521129+0000) 2019-12-08T17:55:34.465 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:55:34.463+0000 1694f700 -1 osd.0 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.166962+0000 front 2019-12-08T17:54:36.693921+0000 (oldest deadline 2019-12-08T17:55:21.982056+0000) 2019-12-08T17:55:34.535 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:55:34.534+0000 1694f700 -1 osd.3 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:35.872722+0000 front 2019-12-08T17:54:35.873320+0000 (oldest deadline 2019-12-08T17:55:18.182843+0000) 2019-12-08T17:55:34.638 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:55:34.633+0000 1694f700 -1 osd.4 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:37.203542+0000 front 2019-12-08T17:54:37.329551+0000 (oldest deadline 2019-12-08T17:55:18.494172+0000) 2019-12-08T17:55:34.780 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:55:34.778+0000 1694f700 -1 osd.1 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:37.995664+0000 front 2019-12-08T17:54:37.994391+0000 (oldest deadline 2019-12-08T17:55:20.274096+0000) 2019-12-08T17:55:35.061 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:55:35.055+0000 1694f700 -1 osd.6 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.973357+0000 front 2019-12-08T17:54:37.016194+0000 (oldest deadline 2019-12-08T17:55:22.800712+0000) 2019-12-08T17:55:35.229 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:55:35.224+0000 1694f700 -1 osd.5 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.691399+0000 front 2019-12-08T17:54:36.196099+0000 (oldest deadline 2019-12-08T17:55:21.487032+0000) 2019-12-08T17:55:35.437 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:55:35.432+0000 1694f700 -1 osd.7 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:35.300691+0000 front 2019-12-08T17:54:35.302496+0000 (oldest deadline 2019-12-08T17:55:18.521129+0000) 2019-12-08T17:55:35.501 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:55:35.500+0000 1694f700 -1 osd.0 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.166962+0000 front 2019-12-08T17:54:36.693921+0000 (oldest deadline 2019-12-08T17:55:21.982056+0000) 2019-12-08T17:55:35.563 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:55:35.561+0000 1694f700 -1 osd.3 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:35.872722+0000 front 2019-12-08T17:54:35.873320+0000 (oldest deadline 2019-12-08T17:55:18.182843+0000) 2019-12-08T17:55:35.674 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:55:35.668+0000 1694f700 -1 osd.4 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:37.203542+0000 front 2019-12-08T17:54:37.329551+0000 (oldest deadline 2019-12-08T17:55:18.494172+0000) 2019-12-08T17:55:35.782 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:55:35.779+0000 1694f700 -1 osd.1 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:37.995664+0000 front 2019-12-08T17:54:37.994391+0000 (oldest deadline 2019-12-08T17:55:20.274096+0000) 2019-12-08T17:55:36.055 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:55:36.049+0000 1694f700 -1 osd.6 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.973357+0000 front 2019-12-08T17:54:37.016194+0000 (oldest deadline 2019-12-08T17:55:22.800712+0000) 2019-12-08T17:55:36.282 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:55:36.276+0000 1694f700 -1 osd.5 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.691399+0000 front 2019-12-08T17:54:36.196099+0000 (oldest deadline 2019-12-08T17:55:21.487032+0000) 2019-12-08T17:55:36.408 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:55:36.402+0000 1694f700 -1 osd.7 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:35.300691+0000 front 2019-12-08T17:54:35.302496+0000 (oldest deadline 2019-12-08T17:55:18.521129+0000) 2019-12-08T17:55:36.536 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:55:36.533+0000 1694f700 -1 osd.3 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:35.872722+0000 front 2019-12-08T17:54:35.873320+0000 (oldest deadline 2019-12-08T17:55:18.182843+0000) 2019-12-08T17:55:36.542 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:55:36.539+0000 1694f700 -1 osd.0 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.166962+0000 front 2019-12-08T17:54:36.693921+0000 (oldest deadline 2019-12-08T17:55:21.982056+0000) 2019-12-08T17:55:36.694 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:55:36.687+0000 1694f700 -1 osd.4 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:37.203542+0000 front 2019-12-08T17:54:37.329551+0000 (oldest deadline 2019-12-08T17:55:18.494172+0000) 2019-12-08T17:55:36.761 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:55:36.759+0000 1694f700 -1 osd.1 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:37.995664+0000 front 2019-12-08T17:54:37.994391+0000 (oldest deadline 2019-12-08T17:55:20.274096+0000) 2019-12-08T17:55:37.039 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:55:37.033+0000 1694f700 -1 osd.6 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.973357+0000 front 2019-12-08T17:54:37.016194+0000 (oldest deadline 2019-12-08T17:55:22.800712+0000) 2019-12-08T17:55:37.312 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:55:37.306+0000 1694f700 -1 osd.5 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.691399+0000 front 2019-12-08T17:54:36.196099+0000 (oldest deadline 2019-12-08T17:55:21.487032+0000) 2019-12-08T17:55:37.417 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:55:37.411+0000 1694f700 -1 osd.7 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:35.300691+0000 front 2019-12-08T17:54:35.302496+0000 (oldest deadline 2019-12-08T17:55:18.521129+0000) 2019-12-08T17:55:37.506 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:55:37.504+0000 1694f700 -1 osd.3 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:35.872722+0000 front 2019-12-08T17:54:35.873320+0000 (oldest deadline 2019-12-08T17:55:18.182843+0000) 2019-12-08T17:55:37.533 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:55:37.532+0000 1694f700 -1 osd.0 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.166962+0000 front 2019-12-08T17:54:36.693921+0000 (oldest deadline 2019-12-08T17:55:21.982056+0000) 2019-12-08T17:55:37.673 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:55:37.666+0000 1694f700 -1 osd.4 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:37.203542+0000 front 2019-12-08T17:54:37.329551+0000 (oldest deadline 2019-12-08T17:55:18.494172+0000) 2019-12-08T17:55:37.805 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:55:37.802+0000 1694f700 -1 osd.1 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:37.995664+0000 front 2019-12-08T17:54:37.994391+0000 (oldest deadline 2019-12-08T17:55:20.274096+0000) 2019-12-08T17:55:38.034 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:55:38.028+0000 1694f700 -1 osd.6 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.973357+0000 front 2019-12-08T17:54:37.016194+0000 (oldest deadline 2019-12-08T17:55:22.800712+0000) 2019-12-08T17:55:38.273 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:55:38.267+0000 1694f700 -1 osd.5 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.691399+0000 front 2019-12-08T17:54:36.196099+0000 (oldest deadline 2019-12-08T17:55:21.487032+0000) 2019-12-08T17:55:38.414 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:55:38.408+0000 1694f700 -1 osd.7 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:35.300691+0000 front 2019-12-08T17:54:35.302496+0000 (oldest deadline 2019-12-08T17:55:18.521129+0000) 2019-12-08T17:55:38.506 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:55:38.502+0000 1694f700 -1 osd.3 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:35.872722+0000 front 2019-12-08T17:54:35.873320+0000 (oldest deadline 2019-12-08T17:55:18.182843+0000) 2019-12-08T17:55:38.563 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:55:38.562+0000 1694f700 -1 osd.0 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.166962+0000 front 2019-12-08T17:54:36.693921+0000 (oldest deadline 2019-12-08T17:55:21.982056+0000) 2019-12-08T17:55:38.675 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:55:38.669+0000 1694f700 -1 osd.4 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:37.203542+0000 front 2019-12-08T17:54:37.329551+0000 (oldest deadline 2019-12-08T17:55:18.494172+0000) 2019-12-08T17:55:38.824 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:55:38.821+0000 1694f700 -1 osd.1 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:37.995664+0000 front 2019-12-08T17:54:37.994391+0000 (oldest deadline 2019-12-08T17:55:20.274096+0000) 2019-12-08T17:55:39.073 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:55:39.067+0000 1694f700 -1 osd.6 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.973357+0000 front 2019-12-08T17:54:37.016194+0000 (oldest deadline 2019-12-08T17:55:22.800712+0000) 2019-12-08T17:55:39.285 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:55:39.279+0000 1694f700 -1 osd.5 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.691399+0000 front 2019-12-08T17:54:36.196099+0000 (oldest deadline 2019-12-08T17:55:21.487032+0000) 2019-12-08T17:55:39.452 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:55:39.446+0000 1694f700 -1 osd.7 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:35.300691+0000 front 2019-12-08T17:54:35.302496+0000 (oldest deadline 2019-12-08T17:55:18.521129+0000) 2019-12-08T17:55:39.511 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:55:39.511+0000 1694f700 -1 osd.3 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:35.872722+0000 front 2019-12-08T17:54:35.873320+0000 (oldest deadline 2019-12-08T17:55:18.182843+0000) 2019-12-08T17:55:39.574 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:55:39.573+0000 1694f700 -1 osd.0 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.166962+0000 front 2019-12-08T17:54:36.693921+0000 (oldest deadline 2019-12-08T17:55:21.982056+0000) 2019-12-08T17:55:39.704 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:55:39.698+0000 1694f700 -1 osd.4 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:37.203542+0000 front 2019-12-08T17:54:37.329551+0000 (oldest deadline 2019-12-08T17:55:18.494172+0000) 2019-12-08T17:55:39.833 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:55:39.832+0000 1694f700 -1 osd.1 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:37.995664+0000 front 2019-12-08T17:54:37.994391+0000 (oldest deadline 2019-12-08T17:55:20.274096+0000) 2019-12-08T17:55:40.046 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:55:40.040+0000 1694f700 -1 osd.6 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.973357+0000 front 2019-12-08T17:54:37.016194+0000 (oldest deadline 2019-12-08T17:55:22.800712+0000) 2019-12-08T17:55:40.338 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:55:40.332+0000 1694f700 -1 osd.5 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.691399+0000 front 2019-12-08T17:54:36.196099+0000 (oldest deadline 2019-12-08T17:55:21.487032+0000) 2019-12-08T17:55:40.490 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:55:40.483+0000 1694f700 -1 osd.7 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:35.300691+0000 front 2019-12-08T17:54:35.302496+0000 (oldest deadline 2019-12-08T17:55:18.521129+0000) 2019-12-08T17:55:40.494 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:55:40.493+0000 1694f700 -1 osd.3 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:35.872722+0000 front 2019-12-08T17:54:35.873320+0000 (oldest deadline 2019-12-08T17:55:18.182843+0000) 2019-12-08T17:55:40.537 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:55:40.536+0000 1694f700 -1 osd.0 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.166962+0000 front 2019-12-08T17:54:36.693921+0000 (oldest deadline 2019-12-08T17:55:21.982056+0000) 2019-12-08T17:55:40.690 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:55:40.684+0000 1694f700 -1 osd.4 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:37.203542+0000 front 2019-12-08T17:54:37.329551+0000 (oldest deadline 2019-12-08T17:55:18.494172+0000) 2019-12-08T17:55:40.820 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:55:40.818+0000 1694f700 -1 osd.1 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:37.995664+0000 front 2019-12-08T17:54:37.994391+0000 (oldest deadline 2019-12-08T17:55:20.274096+0000) 2019-12-08T17:55:41.059 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:55:41.053+0000 1694f700 -1 osd.6 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.973357+0000 front 2019-12-08T17:54:37.016194+0000 (oldest deadline 2019-12-08T17:55:22.800712+0000) 2019-12-08T17:55:41.344 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:55:41.339+0000 1694f700 -1 osd.5 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.691399+0000 front 2019-12-08T17:54:36.196099+0000 (oldest deadline 2019-12-08T17:55:21.487032+0000) 2019-12-08T17:55:41.500 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:55:41.500+0000 1694f700 -1 osd.3 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:35.872722+0000 front 2019-12-08T17:54:35.873320+0000 (oldest deadline 2019-12-08T17:55:18.182843+0000) 2019-12-08T17:55:41.509 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:55:41.503+0000 1694f700 -1 osd.7 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:35.300691+0000 front 2019-12-08T17:54:35.302496+0000 (oldest deadline 2019-12-08T17:55:18.521129+0000) 2019-12-08T17:55:41.573 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:55:41.571+0000 1694f700 -1 osd.0 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.166962+0000 front 2019-12-08T17:54:36.693921+0000 (oldest deadline 2019-12-08T17:55:21.982056+0000) 2019-12-08T17:55:41.702 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:55:41.696+0000 1694f700 -1 osd.4 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:37.203542+0000 front 2019-12-08T17:54:37.329551+0000 (oldest deadline 2019-12-08T17:55:18.494172+0000) 2019-12-08T17:55:41.797 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:55:41.796+0000 1694f700 -1 osd.1 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:37.995664+0000 front 2019-12-08T17:54:37.994391+0000 (oldest deadline 2019-12-08T17:55:20.274096+0000) 2019-12-08T17:55:42.069 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:55:42.063+0000 1694f700 -1 osd.6 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.973357+0000 front 2019-12-08T17:54:37.016194+0000 (oldest deadline 2019-12-08T17:55:22.800712+0000) 2019-12-08T17:55:42.329 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:55:42.324+0000 1694f700 -1 osd.5 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.691399+0000 front 2019-12-08T17:54:36.196099+0000 (oldest deadline 2019-12-08T17:55:21.487032+0000) 2019-12-08T17:55:42.493 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:55:42.488+0000 1694f700 -1 osd.7 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:35.300691+0000 front 2019-12-08T17:54:35.302496+0000 (oldest deadline 2019-12-08T17:55:18.521129+0000) 2019-12-08T17:55:42.546 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:55:42.545+0000 1694f700 -1 osd.3 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:35.872722+0000 front 2019-12-08T17:54:35.873320+0000 (oldest deadline 2019-12-08T17:55:18.182843+0000) 2019-12-08T17:55:42.577 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:55:42.575+0000 1694f700 -1 osd.0 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.166962+0000 front 2019-12-08T17:54:36.693921+0000 (oldest deadline 2019-12-08T17:55:21.982056+0000) 2019-12-08T17:55:42.715 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:55:42.710+0000 1694f700 -1 osd.4 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:37.203542+0000 front 2019-12-08T17:54:37.329551+0000 (oldest deadline 2019-12-08T17:55:18.494172+0000) 2019-12-08T17:55:42.807 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:55:42.807+0000 1694f700 -1 osd.1 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:37.995664+0000 front 2019-12-08T17:54:37.994391+0000 (oldest deadline 2019-12-08T17:55:20.274096+0000) 2019-12-08T17:55:43.092 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:55:43.086+0000 1694f700 -1 osd.6 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.973357+0000 front 2019-12-08T17:54:37.016194+0000 (oldest deadline 2019-12-08T17:55:22.800712+0000) 2019-12-08T17:55:43.365 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:55:43.360+0000 1694f700 -1 osd.5 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.691399+0000 front 2019-12-08T17:54:36.196099+0000 (oldest deadline 2019-12-08T17:55:21.487032+0000) 2019-12-08T17:55:43.474 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:55:43.469+0000 1694f700 -1 osd.7 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:35.300691+0000 front 2019-12-08T17:54:35.302496+0000 (oldest deadline 2019-12-08T17:55:18.521129+0000) 2019-12-08T17:55:43.570 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:55:43.569+0000 1694f700 -1 osd.3 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:35.872722+0000 front 2019-12-08T17:54:35.873320+0000 (oldest deadline 2019-12-08T17:55:18.182843+0000) 2019-12-08T17:55:43.601 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:55:43.600+0000 1694f700 -1 osd.0 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.166962+0000 front 2019-12-08T17:54:36.693921+0000 (oldest deadline 2019-12-08T17:55:21.982056+0000) 2019-12-08T17:55:43.729 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:55:43.723+0000 1694f700 -1 osd.4 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:37.203542+0000 front 2019-12-08T17:54:37.329551+0000 (oldest deadline 2019-12-08T17:55:18.494172+0000) 2019-12-08T17:55:43.772 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:55:43.770+0000 1694f700 -1 osd.1 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:37.995664+0000 front 2019-12-08T17:54:37.994391+0000 (oldest deadline 2019-12-08T17:55:20.274096+0000) 2019-12-08T17:55:44.112 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:55:44.106+0000 1694f700 -1 osd.6 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.973357+0000 front 2019-12-08T17:54:37.016194+0000 (oldest deadline 2019-12-08T17:55:22.800712+0000) 2019-12-08T17:55:44.335 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:55:44.329+0000 1694f700 -1 osd.5 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.691399+0000 front 2019-12-08T17:54:36.196099+0000 (oldest deadline 2019-12-08T17:55:21.487032+0000) 2019-12-08T17:55:44.519 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:55:44.514+0000 1694f700 -1 osd.7 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:35.300691+0000 front 2019-12-08T17:54:35.302496+0000 (oldest deadline 2019-12-08T17:55:18.521129+0000) 2019-12-08T17:55:44.586 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:55:44.585+0000 1694f700 -1 osd.3 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:35.872722+0000 front 2019-12-08T17:54:35.873320+0000 (oldest deadline 2019-12-08T17:55:18.182843+0000) 2019-12-08T17:55:44.597 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:55:44.594+0000 1694f700 -1 osd.0 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.166962+0000 front 2019-12-08T17:54:36.693921+0000 (oldest deadline 2019-12-08T17:55:21.982056+0000) 2019-12-08T17:55:44.715 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:55:44.709+0000 1694f700 -1 osd.4 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:37.203542+0000 front 2019-12-08T17:54:37.329551+0000 (oldest deadline 2019-12-08T17:55:18.494172+0000) 2019-12-08T17:55:44.814 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:55:44.813+0000 1694f700 -1 osd.1 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:37.995664+0000 front 2019-12-08T17:54:37.994391+0000 (oldest deadline 2019-12-08T17:55:20.274096+0000) 2019-12-08T17:55:45.099 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:55:45.092+0000 1694f700 -1 osd.6 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.973357+0000 front 2019-12-08T17:54:37.016194+0000 (oldest deadline 2019-12-08T17:55:22.800712+0000) 2019-12-08T17:55:45.359 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:55:45.353+0000 1694f700 -1 osd.5 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.691399+0000 front 2019-12-08T17:54:36.196099+0000 (oldest deadline 2019-12-08T17:55:21.487032+0000) 2019-12-08T17:55:45.523 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:55:45.516+0000 1694f700 -1 osd.7 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:35.300691+0000 front 2019-12-08T17:54:35.302496+0000 (oldest deadline 2019-12-08T17:55:18.521129+0000) 2019-12-08T17:55:45.578 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:55:45.576+0000 1694f700 -1 osd.0 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.166962+0000 front 2019-12-08T17:54:36.693921+0000 (oldest deadline 2019-12-08T17:55:21.982056+0000) 2019-12-08T17:55:45.599 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:55:45.597+0000 1694f700 -1 osd.3 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:35.872722+0000 front 2019-12-08T17:54:35.873320+0000 (oldest deadline 2019-12-08T17:55:18.182843+0000) 2019-12-08T17:55:45.726 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:55:45.721+0000 1694f700 -1 osd.4 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:37.203542+0000 front 2019-12-08T17:54:37.329551+0000 (oldest deadline 2019-12-08T17:55:18.494172+0000) 2019-12-08T17:55:45.863 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:55:45.860+0000 1694f700 -1 osd.1 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:37.995664+0000 front 2019-12-08T17:54:37.994391+0000 (oldest deadline 2019-12-08T17:55:20.274096+0000) 2019-12-08T17:55:46.156 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:55:46.150+0000 1694f700 -1 osd.6 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.973357+0000 front 2019-12-08T17:54:37.016194+0000 (oldest deadline 2019-12-08T17:55:22.800712+0000) 2019-12-08T17:55:46.338 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:55:46.331+0000 1694f700 -1 osd.5 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.691399+0000 front 2019-12-08T17:54:36.196099+0000 (oldest deadline 2019-12-08T17:55:21.487032+0000) 2019-12-08T17:55:46.495 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:55:46.484+0000 1694f700 -1 osd.7 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:35.300691+0000 front 2019-12-08T17:54:35.302496+0000 (oldest deadline 2019-12-08T17:55:18.521129+0000) 2019-12-08T17:55:46.570 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:55:46.568+0000 1694f700 -1 osd.0 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.166962+0000 front 2019-12-08T17:54:36.693921+0000 (oldest deadline 2019-12-08T17:55:21.982056+0000) 2019-12-08T17:55:46.640 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:55:46.638+0000 1694f700 -1 osd.3 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:35.872722+0000 front 2019-12-08T17:54:35.873320+0000 (oldest deadline 2019-12-08T17:55:18.182843+0000) 2019-12-08T17:55:46.696 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:55:46.690+0000 1694f700 -1 osd.4 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:37.203542+0000 front 2019-12-08T17:54:37.329551+0000 (oldest deadline 2019-12-08T17:55:18.494172+0000) 2019-12-08T17:55:46.861 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:55:46.859+0000 1694f700 -1 osd.1 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:37.995664+0000 front 2019-12-08T17:54:37.994391+0000 (oldest deadline 2019-12-08T17:55:20.274096+0000) 2019-12-08T17:55:47.116 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:55:47.108+0000 1694f700 -1 osd.6 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.973357+0000 front 2019-12-08T17:54:37.016194+0000 (oldest deadline 2019-12-08T17:55:22.800712+0000) 2019-12-08T17:55:47.367 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:55:47.362+0000 1694f700 -1 osd.5 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.691399+0000 front 2019-12-08T17:54:36.196099+0000 (oldest deadline 2019-12-08T17:55:21.487032+0000) 2019-12-08T17:55:47.507 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:55:47.501+0000 1694f700 -1 osd.7 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:35.300691+0000 front 2019-12-08T17:54:35.302496+0000 (oldest deadline 2019-12-08T17:55:18.521129+0000) 2019-12-08T17:55:47.602 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:55:47.601+0000 1694f700 -1 osd.0 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.166962+0000 front 2019-12-08T17:54:36.693921+0000 (oldest deadline 2019-12-08T17:55:21.982056+0000) 2019-12-08T17:55:47.638 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:55:47.636+0000 1694f700 -1 osd.3 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:35.872722+0000 front 2019-12-08T17:54:35.873320+0000 (oldest deadline 2019-12-08T17:55:18.182843+0000) 2019-12-08T17:55:47.686 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:55:47.680+0000 1694f700 -1 osd.4 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:37.203542+0000 front 2019-12-08T17:54:37.329551+0000 (oldest deadline 2019-12-08T17:55:18.494172+0000) 2019-12-08T17:55:47.895 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:55:47.892+0000 1694f700 -1 osd.1 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:37.995664+0000 front 2019-12-08T17:54:37.994391+0000 (oldest deadline 2019-12-08T17:55:20.274096+0000) 2019-12-08T17:55:48.076 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:55:48.069+0000 1694f700 -1 osd.6 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.973357+0000 front 2019-12-08T17:54:37.016194+0000 (oldest deadline 2019-12-08T17:55:22.800712+0000) 2019-12-08T17:55:48.337 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:55:48.331+0000 1694f700 -1 osd.5 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.691399+0000 front 2019-12-08T17:54:36.196099+0000 (oldest deadline 2019-12-08T17:55:21.487032+0000) 2019-12-08T17:55:48.506 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:55:48.501+0000 1694f700 -1 osd.7 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:35.300691+0000 front 2019-12-08T17:54:35.302496+0000 (oldest deadline 2019-12-08T17:55:18.521129+0000) 2019-12-08T17:55:48.648 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:55:48.646+0000 1694f700 -1 osd.0 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.166962+0000 front 2019-12-08T17:54:36.693921+0000 (oldest deadline 2019-12-08T17:55:21.982056+0000) 2019-12-08T17:55:48.690 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:55:48.688+0000 1694f700 -1 osd.3 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:35.872722+0000 front 2019-12-08T17:54:35.873320+0000 (oldest deadline 2019-12-08T17:55:18.182843+0000) 2019-12-08T17:55:48.705 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:55:48.699+0000 1694f700 -1 osd.4 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:37.203542+0000 front 2019-12-08T17:54:37.329551+0000 (oldest deadline 2019-12-08T17:55:18.494172+0000) 2019-12-08T17:55:48.892 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:55:48.892+0000 1694f700 -1 osd.1 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:37.995664+0000 front 2019-12-08T17:54:37.994391+0000 (oldest deadline 2019-12-08T17:55:20.274096+0000) 2019-12-08T17:55:49.080 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:55:49.074+0000 1694f700 -1 osd.6 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.973357+0000 front 2019-12-08T17:54:37.016194+0000 (oldest deadline 2019-12-08T17:55:22.800712+0000) 2019-12-08T17:55:49.379 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:55:49.375+0000 1694f700 -1 osd.5 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.691399+0000 front 2019-12-08T17:54:36.196099+0000 (oldest deadline 2019-12-08T17:55:21.487032+0000) 2019-12-08T17:55:49.537 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:55:49.532+0000 1694f700 -1 osd.7 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:35.300691+0000 front 2019-12-08T17:54:35.302496+0000 (oldest deadline 2019-12-08T17:55:18.521129+0000) 2019-12-08T17:55:49.632 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:55:49.631+0000 1694f700 -1 osd.0 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.166962+0000 front 2019-12-08T17:54:36.693921+0000 (oldest deadline 2019-12-08T17:55:21.982056+0000) 2019-12-08T17:55:49.663 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:55:49.662+0000 1694f700 -1 osd.3 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:35.872722+0000 front 2019-12-08T17:54:35.873320+0000 (oldest deadline 2019-12-08T17:55:18.182843+0000) 2019-12-08T17:55:49.710 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:55:49.707+0000 1694f700 -1 osd.4 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:37.203542+0000 front 2019-12-08T17:54:37.329551+0000 (oldest deadline 2019-12-08T17:55:18.494172+0000) 2019-12-08T17:55:49.886 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:55:49.884+0000 1694f700 -1 osd.1 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:37.995664+0000 front 2019-12-08T17:54:37.994391+0000 (oldest deadline 2019-12-08T17:55:20.274096+0000) 2019-12-08T17:55:50.042 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:55:50.038+0000 1694f700 -1 osd.6 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.973357+0000 front 2019-12-08T17:54:37.016194+0000 (oldest deadline 2019-12-08T17:55:22.800712+0000) 2019-12-08T17:55:50.118 INFO:tasks.ceph.mon.b.smithi013.stderr:2019-12-08T17:55:50.114+0000 1a89c700 -1 mon.b@0(leader) e1 get_health_metrics reporting 2 slow ops, oldest is osd_failure(failed timeout osd.2 [v2:172.21.15.79:6802/10448,v1:172.21.15.79:6803/10448] for 42sec e271 v271) 2019-12-08T17:55:50.375 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:55:50.370+0000 1694f700 -1 osd.5 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.691399+0000 front 2019-12-08T17:54:36.196099+0000 (oldest deadline 2019-12-08T17:55:21.487032+0000) 2019-12-08T17:55:50.570 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:55:50.565+0000 1694f700 -1 osd.7 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:35.300691+0000 front 2019-12-08T17:54:35.302496+0000 (oldest deadline 2019-12-08T17:55:18.521129+0000) 2019-12-08T17:55:50.674 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:55:50.674+0000 1694f700 -1 osd.0 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.166962+0000 front 2019-12-08T17:54:36.693921+0000 (oldest deadline 2019-12-08T17:55:21.982056+0000) 2019-12-08T17:55:50.681 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:55:50.676+0000 1694f700 -1 osd.4 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:37.203542+0000 front 2019-12-08T17:54:37.329551+0000 (oldest deadline 2019-12-08T17:55:18.494172+0000) 2019-12-08T17:55:50.711 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:55:50.709+0000 1694f700 -1 osd.3 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:35.872722+0000 front 2019-12-08T17:54:35.873320+0000 (oldest deadline 2019-12-08T17:55:18.182843+0000) 2019-12-08T17:55:50.849 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:55:50.847+0000 1694f700 -1 osd.1 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:37.995664+0000 front 2019-12-08T17:54:37.994391+0000 (oldest deadline 2019-12-08T17:55:20.274096+0000) 2019-12-08T17:55:51.069 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:55:51.064+0000 1694f700 -1 osd.6 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.973357+0000 front 2019-12-08T17:54:37.016194+0000 (oldest deadline 2019-12-08T17:55:22.800712+0000) 2019-12-08T17:55:51.427 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:55:51.422+0000 1694f700 -1 osd.5 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.691399+0000 front 2019-12-08T17:54:36.196099+0000 (oldest deadline 2019-12-08T17:55:21.487032+0000) 2019-12-08T17:55:51.564 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:55:51.560+0000 1694f700 -1 osd.7 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:35.300691+0000 front 2019-12-08T17:54:35.302496+0000 (oldest deadline 2019-12-08T17:55:18.521129+0000) 2019-12-08T17:55:51.673 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:55:51.668+0000 1694f700 -1 osd.4 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:37.203542+0000 front 2019-12-08T17:54:37.329551+0000 (oldest deadline 2019-12-08T17:55:18.494172+0000) 2019-12-08T17:55:51.732 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:55:51.727+0000 1694f700 -1 osd.0 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.166962+0000 front 2019-12-08T17:54:36.693921+0000 (oldest deadline 2019-12-08T17:55:21.982056+0000) 2019-12-08T17:55:51.769 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:55:51.759+0000 1694f700 -1 osd.3 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:35.872722+0000 front 2019-12-08T17:54:35.873320+0000 (oldest deadline 2019-12-08T17:55:18.182843+0000) 2019-12-08T17:55:51.877 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:55:51.875+0000 1694f700 -1 osd.1 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:37.995664+0000 front 2019-12-08T17:54:37.994391+0000 (oldest deadline 2019-12-08T17:55:20.274096+0000) 2019-12-08T17:55:52.058 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:55:52.052+0000 1694f700 -1 osd.6 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.973357+0000 front 2019-12-08T17:54:37.016194+0000 (oldest deadline 2019-12-08T17:55:22.800712+0000) 2019-12-08T17:55:52.463 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:55:52.458+0000 1694f700 -1 osd.5 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.691399+0000 front 2019-12-08T17:54:36.196099+0000 (oldest deadline 2019-12-08T17:55:21.487032+0000) 2019-12-08T17:55:52.594 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:55:52.590+0000 1694f700 -1 osd.7 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:35.300691+0000 front 2019-12-08T17:54:35.302496+0000 (oldest deadline 2019-12-08T17:55:18.521129+0000) 2019-12-08T17:55:52.674 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:55:52.669+0000 1694f700 -1 osd.4 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:37.203542+0000 front 2019-12-08T17:54:37.329551+0000 (oldest deadline 2019-12-08T17:55:18.494172+0000) 2019-12-08T17:55:52.700 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:55:52.698+0000 1694f700 -1 osd.0 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.166962+0000 front 2019-12-08T17:54:36.693921+0000 (oldest deadline 2019-12-08T17:55:21.982056+0000) 2019-12-08T17:55:52.749 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:55:52.746+0000 1694f700 -1 osd.3 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:35.872722+0000 front 2019-12-08T17:54:35.873320+0000 (oldest deadline 2019-12-08T17:55:18.182843+0000) 2019-12-08T17:55:52.850 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:55:52.846+0000 1694f700 -1 osd.1 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:37.995664+0000 front 2019-12-08T17:54:37.994391+0000 (oldest deadline 2019-12-08T17:55:20.274096+0000) 2019-12-08T17:55:53.035 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:55:53.025+0000 1694f700 -1 osd.6 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.973357+0000 front 2019-12-08T17:54:37.016194+0000 (oldest deadline 2019-12-08T17:55:22.800712+0000) 2019-12-08T17:55:53.479 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:55:53.473+0000 1694f700 -1 osd.5 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.691399+0000 front 2019-12-08T17:54:36.196099+0000 (oldest deadline 2019-12-08T17:55:21.487032+0000) 2019-12-08T17:55:53.589 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:55:53.583+0000 1694f700 -1 osd.7 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:35.300691+0000 front 2019-12-08T17:54:35.302496+0000 (oldest deadline 2019-12-08T17:55:18.521129+0000) 2019-12-08T17:55:53.672 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:55:53.667+0000 1694f700 -1 osd.4 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:37.203542+0000 front 2019-12-08T17:54:37.329551+0000 (oldest deadline 2019-12-08T17:55:18.494172+0000) 2019-12-08T17:55:53.684 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:55:53.682+0000 1694f700 -1 osd.0 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.166962+0000 front 2019-12-08T17:54:36.693921+0000 (oldest deadline 2019-12-08T17:55:21.982056+0000) 2019-12-08T17:55:53.799 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:55:53.798+0000 1694f700 -1 osd.3 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:35.872722+0000 front 2019-12-08T17:54:35.873320+0000 (oldest deadline 2019-12-08T17:55:18.182843+0000) 2019-12-08T17:55:53.824 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:55:53.823+0000 1694f700 -1 osd.1 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:37.995664+0000 front 2019-12-08T17:54:37.994391+0000 (oldest deadline 2019-12-08T17:55:20.274096+0000) 2019-12-08T17:55:54.043 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:55:54.037+0000 1694f700 -1 osd.6 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.973357+0000 front 2019-12-08T17:54:37.016194+0000 (oldest deadline 2019-12-08T17:55:22.800712+0000) 2019-12-08T17:55:54.526 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:55:54.520+0000 1694f700 -1 osd.5 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.691399+0000 front 2019-12-08T17:54:36.196099+0000 (oldest deadline 2019-12-08T17:55:21.487032+0000) 2019-12-08T17:55:54.624 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:55:54.619+0000 1694f700 -1 osd.7 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:35.300691+0000 front 2019-12-08T17:54:35.302496+0000 (oldest deadline 2019-12-08T17:55:18.521129+0000) 2019-12-08T17:55:54.656 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:55:54.654+0000 1694f700 -1 osd.0 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.166962+0000 front 2019-12-08T17:54:36.693921+0000 (oldest deadline 2019-12-08T17:55:21.982056+0000) 2019-12-08T17:55:54.718 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:55:54.713+0000 1694f700 -1 osd.4 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:37.203542+0000 front 2019-12-08T17:54:37.329551+0000 (oldest deadline 2019-12-08T17:55:18.494172+0000) 2019-12-08T17:55:54.795 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:55:54.793+0000 1694f700 -1 osd.3 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:35.872722+0000 front 2019-12-08T17:54:35.873320+0000 (oldest deadline 2019-12-08T17:55:18.182843+0000) 2019-12-08T17:55:54.825 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:55:54.824+0000 1694f700 -1 osd.1 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:37.995664+0000 front 2019-12-08T17:54:37.994391+0000 (oldest deadline 2019-12-08T17:55:20.274096+0000) 2019-12-08T17:55:55.054 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:55:55.049+0000 1694f700 -1 osd.6 271 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:54:36.973357+0000 front 2019-12-08T17:54:37.016194+0000 (oldest deadline 2019-12-08T17:55:22.800712+0000) 2019-12-08T17:55:55.224 INFO:tasks.ceph.mon.b.smithi013.stderr:2019-12-08T17:55:55.210+0000 1a89c700 -1 mon.b@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.2 [v2:172.21.15.79:6802/10448,v1:172.21.15.79:6803/10448] for 42sec e271 v271) 2019-12-08T17:56:58.805 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:56:58.804+0000 1694f700 -1 osd.2 277 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:56:59.806 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:56:59.805+0000 1694f700 -1 osd.2 277 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:57:00.830 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:57:00.828+0000 1694f700 -1 osd.2 277 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:57:01.819 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:57:01.818+0000 1694f700 -1 osd.2 277 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:57:02.815 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:57:02.814+0000 1694f700 -1 osd.2 277 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:57:03.865 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:57:03.863+0000 1694f700 -1 osd.2 277 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:57:04.860 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:57:04.859+0000 1694f700 -1 osd.2 277 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:57:05.820 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:57:05.818+0000 1694f700 -1 osd.2 277 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:57:06.799 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:57:06.797+0000 1694f700 -1 osd.2 277 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:57:07.853 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:57:07.852+0000 1694f700 -1 osd.2 277 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:57:08.873 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:57:08.871+0000 1694f700 -1 osd.2 277 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:57:09.913 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:57:09.912+0000 1694f700 -1 osd.2 277 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:57:10.965 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:57:10.964+0000 1694f700 -1 osd.2 277 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:57:11.994 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:57:11.994+0000 1694f700 -1 osd.2 277 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:57:13.007 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:57:13.006+0000 1694f700 -1 osd.2 277 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:57:14.035 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:57:14.034+0000 1694f700 -1 osd.2 277 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:57:15.034 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:57:15.034+0000 1694f700 -1 osd.2 277 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:57:16.079 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:57:16.078+0000 1694f700 -1 osd.2 277 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:57:17.045 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:57:17.045+0000 1694f700 -1 osd.2 277 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:57:18.063 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:57:18.062+0000 1694f700 -1 osd.2 277 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:57:19.022 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:57:19.021+0000 1694f700 -1 osd.2 277 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:57:19.998 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:57:19.998+0000 1694f700 -1 osd.2 277 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:57:21.050 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:57:21.050+0000 1694f700 -1 osd.2 277 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:57:22.087 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:57:22.086+0000 1694f700 -1 osd.2 277 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:57:23.141 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:57:23.140+0000 1694f700 -1 osd.2 277 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:57:24.178 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:57:24.178+0000 1694f700 -1 osd.2 277 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:57:25.207 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:57:25.205+0000 1694f700 -1 osd.2 277 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:57:26.200 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:57:26.199+0000 1694f700 -1 osd.2 277 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:57:27.196 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:57:27.195+0000 1694f700 -1 osd.2 277 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:57:28.237 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:57:28.237+0000 1694f700 -1 osd.2 277 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:57:29.242 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:57:29.241+0000 1694f700 -1 osd.2 277 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:57:30.199 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:57:30.198+0000 1694f700 -1 osd.2 277 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:57:31.162 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:57:31.160+0000 1694f700 -1 osd.2 277 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:57:32.183 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:57:32.182+0000 1694f700 -1 osd.2 277 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:57:33.156 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:57:33.155+0000 1694f700 -1 osd.2 277 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:57:33.535 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:05:54:58.238 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T17:57:33.541 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:05:54:58.244 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T17:57:33.551 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:05:54:58.185 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T17:57:33.554 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:05:54:58.188 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T17:57:33.556 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:05:54:58.191 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T17:57:33.562 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:05:54:58.196 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T17:57:33.717 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:05:54:58.352 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T17:57:33.722 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:05:54:58.357 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T17:57:33.726 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:05:54:58.429 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T17:57:34.148 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:57:34.147+0000 1694f700 -1 osd.2 277 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:57:35.123 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:57:35.121+0000 1694f700 -1 osd.2 277 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:57:36.142 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:57:36.140+0000 1694f700 -1 osd.2 277 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:57:37.193 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:57:37.192+0000 1694f700 -1 osd.2 277 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:57:38.189 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:57:38.186+0000 1694f700 -1 osd.2 277 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:57:38.719 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:57:38.713+0000 1694f700 -1 osd.5 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:56.165321+0000 front 2019-12-08T17:56:57.992078+0000 (oldest deadline 2019-12-08T17:57:37.940904+0000) 2019-12-08T17:57:38.762 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:57:38.759+0000 1694f700 -1 osd.0 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:57.999447+0000 front 2019-12-08T17:56:58.115061+0000 (oldest deadline 2019-12-08T17:57:38.478512+0000) 2019-12-08T17:57:39.159 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:57:39.157+0000 1694f700 -1 osd.2 277 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:57:39.704 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:57:39.698+0000 1694f700 -1 osd.5 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:56.165321+0000 front 2019-12-08T17:56:57.992078+0000 (oldest deadline 2019-12-08T17:57:37.940904+0000) 2019-12-08T17:57:39.809 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:57:39.807+0000 1694f700 -1 osd.0 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:57.999447+0000 front 2019-12-08T17:56:58.115061+0000 (oldest deadline 2019-12-08T17:57:38.478512+0000) 2019-12-08T17:57:40.203 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:57:40.199+0000 1694f700 -1 osd.2 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:55.265144+0000 front 2019-12-08T17:56:55.223686+0000 (oldest deadline 2019-12-08T17:57:40.073611+0000) 2019-12-08T17:57:40.204 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:57:40.202+0000 1694f700 -1 osd.2 277 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:57:40.662 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:57:40.657+0000 1694f700 -1 osd.5 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:56.165321+0000 front 2019-12-08T17:56:57.992078+0000 (oldest deadline 2019-12-08T17:57:37.940904+0000) 2019-12-08T17:57:40.772 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:57:40.770+0000 1694f700 -1 osd.0 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:57.999447+0000 front 2019-12-08T17:56:58.115061+0000 (oldest deadline 2019-12-08T17:57:38.478512+0000) 2019-12-08T17:57:41.216 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:57:41.213+0000 1694f700 -1 osd.2 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:55.265144+0000 front 2019-12-08T17:56:55.223686+0000 (oldest deadline 2019-12-08T17:57:40.073611+0000) 2019-12-08T17:57:41.217 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:57:41.216+0000 1694f700 -1 osd.2 277 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:57:41.682 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:57:41.677+0000 1694f700 -1 osd.5 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:56.165321+0000 front 2019-12-08T17:56:57.992078+0000 (oldest deadline 2019-12-08T17:57:37.940904+0000) 2019-12-08T17:57:41.776 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:57:41.774+0000 1694f700 -1 osd.3 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:58.098919+0000 front 2019-12-08T17:56:58.133232+0000 (oldest deadline 2019-12-08T17:57:40.966101+0000) 2019-12-08T17:57:41.776 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:57:41.773+0000 1694f700 -1 osd.0 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:57.999447+0000 front 2019-12-08T17:56:58.115061+0000 (oldest deadline 2019-12-08T17:57:38.478512+0000) 2019-12-08T17:57:41.936 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:57:41.930+0000 1694f700 -1 osd.7 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:56.111121+0000 front 2019-12-08T17:56:56.181758+0000 (oldest deadline 2019-12-08T17:57:41.122608+0000) 2019-12-08T17:57:42.091 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:57:42.087+0000 1694f700 -1 osd.4 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:56.387335+0000 front 2019-12-08T17:56:56.899625+0000 (oldest deadline 2019-12-08T17:57:42.058398+0000) 2019-12-08T17:57:42.249 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:57:42.246+0000 1694f700 -1 osd.2 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:55.265144+0000 front 2019-12-08T17:56:55.223686+0000 (oldest deadline 2019-12-08T17:57:40.073611+0000) 2019-12-08T17:57:42.252 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:57:42.250+0000 1694f700 -1 osd.2 277 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:57:42.706 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:57:42.701+0000 1694f700 -1 osd.5 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:56.165321+0000 front 2019-12-08T17:56:57.992078+0000 (oldest deadline 2019-12-08T17:57:37.940904+0000) 2019-12-08T17:57:42.733 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:57:42.730+0000 1694f700 -1 osd.3 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:58.098919+0000 front 2019-12-08T17:56:58.133232+0000 (oldest deadline 2019-12-08T17:57:40.966101+0000) 2019-12-08T17:57:42.829 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:57:42.827+0000 1694f700 -1 osd.0 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:57.999447+0000 front 2019-12-08T17:56:58.115061+0000 (oldest deadline 2019-12-08T17:57:38.478512+0000) 2019-12-08T17:57:42.990 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:57:42.984+0000 1694f700 -1 osd.7 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:56.111121+0000 front 2019-12-08T17:56:56.181758+0000 (oldest deadline 2019-12-08T17:57:41.122608+0000) 2019-12-08T17:57:43.129 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:57:43.124+0000 1694f700 -1 osd.4 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:56.387335+0000 front 2019-12-08T17:56:56.899625+0000 (oldest deadline 2019-12-08T17:57:42.058398+0000) 2019-12-08T17:57:43.216 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:57:43.212+0000 1694f700 -1 osd.2 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:55.265144+0000 front 2019-12-08T17:56:55.223686+0000 (oldest deadline 2019-12-08T17:57:40.073611+0000) 2019-12-08T17:57:43.217 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:57:43.215+0000 1694f700 -1 osd.2 277 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:57:43.324 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:57:43.320+0000 1694f700 -1 osd.6 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:57.093359+0000 front 2019-12-08T17:56:57.106916+0000 (oldest deadline 2019-12-08T17:57:42.386212+0000) 2019-12-08T17:57:43.731 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:57:43.727+0000 1694f700 -1 osd.5 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:56.165321+0000 front 2019-12-08T17:56:57.992078+0000 (oldest deadline 2019-12-08T17:57:37.940904+0000) 2019-12-08T17:57:43.760 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:57:43.757+0000 1694f700 -1 osd.3 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:58.098919+0000 front 2019-12-08T17:56:58.133232+0000 (oldest deadline 2019-12-08T17:57:40.966101+0000) 2019-12-08T17:57:43.814 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:57:43.812+0000 1694f700 -1 osd.0 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:57.999447+0000 front 2019-12-08T17:56:58.115061+0000 (oldest deadline 2019-12-08T17:57:38.478512+0000) 2019-12-08T17:57:43.968 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:57:43.963+0000 1694f700 -1 osd.7 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:56.111121+0000 front 2019-12-08T17:56:56.181758+0000 (oldest deadline 2019-12-08T17:57:41.122608+0000) 2019-12-08T17:57:44.167 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:57:44.163+0000 1694f700 -1 osd.4 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:56.387335+0000 front 2019-12-08T17:56:56.899625+0000 (oldest deadline 2019-12-08T17:57:42.058398+0000) 2019-12-08T17:57:44.237 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:57:44.234+0000 1694f700 -1 osd.2 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:55.265144+0000 front 2019-12-08T17:56:55.223686+0000 (oldest deadline 2019-12-08T17:57:40.073611+0000) 2019-12-08T17:57:44.240 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:57:44.237+0000 1694f700 -1 osd.2 277 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:57:44.312 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:57:44.307+0000 1694f700 -1 osd.6 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:57.093359+0000 front 2019-12-08T17:56:57.106916+0000 (oldest deadline 2019-12-08T17:57:42.386212+0000) 2019-12-08T17:57:44.786 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:57:44.781+0000 1694f700 -1 osd.5 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:56.165321+0000 front 2019-12-08T17:56:57.992078+0000 (oldest deadline 2019-12-08T17:57:37.940904+0000) 2019-12-08T17:57:44.792 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:57:44.789+0000 1694f700 -1 osd.3 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:58.098919+0000 front 2019-12-08T17:56:58.133232+0000 (oldest deadline 2019-12-08T17:57:40.966101+0000) 2019-12-08T17:57:44.858 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:57:44.855+0000 1694f700 -1 osd.0 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:57.999447+0000 front 2019-12-08T17:56:58.115061+0000 (oldest deadline 2019-12-08T17:57:38.478512+0000) 2019-12-08T17:57:44.958 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:57:44.947+0000 1694f700 -1 osd.7 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:56.111121+0000 front 2019-12-08T17:56:56.181758+0000 (oldest deadline 2019-12-08T17:57:41.122608+0000) 2019-12-08T17:57:45.126 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:57:45.120+0000 1694f700 -1 osd.4 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:56.387335+0000 front 2019-12-08T17:56:56.899625+0000 (oldest deadline 2019-12-08T17:57:42.058398+0000) 2019-12-08T17:57:45.205 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:57:45.200+0000 1694f700 -1 osd.2 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:55.265144+0000 front 2019-12-08T17:56:55.223686+0000 (oldest deadline 2019-12-08T17:57:40.073611+0000) 2019-12-08T17:57:45.205 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:57:45.204+0000 1694f700 -1 osd.2 277 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:57:45.284 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:57:45.280+0000 1694f700 -1 osd.6 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:57.093359+0000 front 2019-12-08T17:56:57.106916+0000 (oldest deadline 2019-12-08T17:57:42.386212+0000) 2019-12-08T17:57:45.833 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:57:45.829+0000 1694f700 -1 osd.3 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:58.098919+0000 front 2019-12-08T17:56:58.133232+0000 (oldest deadline 2019-12-08T17:57:40.966101+0000) 2019-12-08T17:57:45.837 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:57:45.832+0000 1694f700 -1 osd.5 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:56.165321+0000 front 2019-12-08T17:56:57.992078+0000 (oldest deadline 2019-12-08T17:57:37.940904+0000) 2019-12-08T17:57:45.869 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:57:45.866+0000 1694f700 -1 osd.0 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:57.999447+0000 front 2019-12-08T17:56:58.115061+0000 (oldest deadline 2019-12-08T17:57:38.478512+0000) 2019-12-08T17:57:46.007 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:57:46.003+0000 1694f700 -1 osd.7 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:56.111121+0000 front 2019-12-08T17:56:56.181758+0000 (oldest deadline 2019-12-08T17:57:41.122608+0000) 2019-12-08T17:57:46.169 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:57:46.164+0000 1694f700 -1 osd.4 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:56.387335+0000 front 2019-12-08T17:56:56.899625+0000 (oldest deadline 2019-12-08T17:57:42.058398+0000) 2019-12-08T17:57:46.242 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:57:46.240+0000 1694f700 -1 osd.2 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:55.265144+0000 front 2019-12-08T17:56:55.223686+0000 (oldest deadline 2019-12-08T17:57:40.073611+0000) 2019-12-08T17:57:46.244 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:57:46.243+0000 1694f700 -1 osd.2 277 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:57:46.249 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:57:46.244+0000 1694f700 -1 osd.6 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:57.093359+0000 front 2019-12-08T17:56:57.106916+0000 (oldest deadline 2019-12-08T17:57:42.386212+0000) 2019-12-08T17:57:46.841 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:57:46.836+0000 1694f700 -1 osd.5 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:56.165321+0000 front 2019-12-08T17:56:57.992078+0000 (oldest deadline 2019-12-08T17:57:37.940904+0000) 2019-12-08T17:57:46.874 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:57:46.872+0000 1694f700 -1 osd.3 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:58.098919+0000 front 2019-12-08T17:56:58.133232+0000 (oldest deadline 2019-12-08T17:57:40.966101+0000) 2019-12-08T17:57:46.883 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:57:46.881+0000 1694f700 -1 osd.0 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:57.999447+0000 front 2019-12-08T17:56:58.115061+0000 (oldest deadline 2019-12-08T17:57:38.478512+0000) 2019-12-08T17:57:47.017 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:57:47.011+0000 1694f700 -1 osd.7 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:56.111121+0000 front 2019-12-08T17:56:56.181758+0000 (oldest deadline 2019-12-08T17:57:41.122608+0000) 2019-12-08T17:57:47.178 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:57:47.173+0000 1694f700 -1 osd.4 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:56.387335+0000 front 2019-12-08T17:56:56.899625+0000 (oldest deadline 2019-12-08T17:57:42.058398+0000) 2019-12-08T17:57:47.238 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:57:47.232+0000 1694f700 -1 osd.6 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:57.093359+0000 front 2019-12-08T17:56:57.106916+0000 (oldest deadline 2019-12-08T17:57:42.386212+0000) 2019-12-08T17:57:47.278 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:57:47.274+0000 1694f700 -1 osd.2 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:55.265144+0000 front 2019-12-08T17:56:55.223686+0000 (oldest deadline 2019-12-08T17:57:40.073611+0000) 2019-12-08T17:57:47.278 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:57:47.277+0000 1694f700 -1 osd.2 277 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:57:47.844 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:57:47.841+0000 1694f700 -1 osd.3 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:58.098919+0000 front 2019-12-08T17:56:58.133232+0000 (oldest deadline 2019-12-08T17:57:40.966101+0000) 2019-12-08T17:57:47.857 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:57:47.855+0000 1694f700 -1 osd.0 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:57.999447+0000 front 2019-12-08T17:56:58.115061+0000 (oldest deadline 2019-12-08T17:57:38.478512+0000) 2019-12-08T17:57:47.888 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:57:47.882+0000 1694f700 -1 osd.5 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:56.165321+0000 front 2019-12-08T17:56:57.992078+0000 (oldest deadline 2019-12-08T17:57:37.940904+0000) 2019-12-08T17:57:48.056 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:57:48.051+0000 1694f700 -1 osd.7 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:56.111121+0000 front 2019-12-08T17:56:56.181758+0000 (oldest deadline 2019-12-08T17:57:41.122608+0000) 2019-12-08T17:57:48.174 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:57:48.170+0000 1694f700 -1 osd.4 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:56.387335+0000 front 2019-12-08T17:56:56.899625+0000 (oldest deadline 2019-12-08T17:57:42.058398+0000) 2019-12-08T17:57:48.214 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:57:48.209+0000 1694f700 -1 osd.6 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:57.093359+0000 front 2019-12-08T17:56:57.106916+0000 (oldest deadline 2019-12-08T17:57:42.386212+0000) 2019-12-08T17:57:48.318 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:57:48.316+0000 1694f700 -1 osd.2 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:55.265144+0000 front 2019-12-08T17:56:55.223686+0000 (oldest deadline 2019-12-08T17:57:40.073611+0000) 2019-12-08T17:57:48.320 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:57:48.318+0000 1694f700 -1 osd.2 277 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:57:48.879 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:57:48.878+0000 1694f700 -1 osd.0 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:57.999447+0000 front 2019-12-08T17:56:58.115061+0000 (oldest deadline 2019-12-08T17:57:38.478512+0000) 2019-12-08T17:57:48.882 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:57:48.879+0000 1694f700 -1 osd.3 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:58.098919+0000 front 2019-12-08T17:56:58.133232+0000 (oldest deadline 2019-12-08T17:57:40.966101+0000) 2019-12-08T17:57:48.903 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:57:48.895+0000 1694f700 -1 osd.5 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:56.165321+0000 front 2019-12-08T17:56:57.992078+0000 (oldest deadline 2019-12-08T17:57:37.940904+0000) 2019-12-08T17:57:49.052 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:57:49.047+0000 1694f700 -1 osd.7 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:56.111121+0000 front 2019-12-08T17:56:56.181758+0000 (oldest deadline 2019-12-08T17:57:41.122608+0000) 2019-12-08T17:57:49.142 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:57:49.137+0000 1694f700 -1 osd.4 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:56.387335+0000 front 2019-12-08T17:56:56.899625+0000 (oldest deadline 2019-12-08T17:57:42.058398+0000) 2019-12-08T17:57:49.252 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:57:49.246+0000 1694f700 -1 osd.6 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:57.093359+0000 front 2019-12-08T17:56:57.106916+0000 (oldest deadline 2019-12-08T17:57:42.386212+0000) 2019-12-08T17:57:49.285 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:57:49.284+0000 1694f700 -1 osd.2 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:55.265144+0000 front 2019-12-08T17:56:55.223686+0000 (oldest deadline 2019-12-08T17:57:40.073611+0000) 2019-12-08T17:57:49.286 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:57:49.285+0000 1694f700 -1 osd.2 277 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:57:49.836 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:57:49.835+0000 1694f700 -1 osd.3 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:58.098919+0000 front 2019-12-08T17:56:58.133232+0000 (oldest deadline 2019-12-08T17:57:40.966101+0000) 2019-12-08T17:57:49.887 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:57:49.881+0000 1694f700 -1 osd.5 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:56.165321+0000 front 2019-12-08T17:56:57.992078+0000 (oldest deadline 2019-12-08T17:57:37.940904+0000) 2019-12-08T17:57:49.927 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:57:49.925+0000 1694f700 -1 osd.0 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:57.999447+0000 front 2019-12-08T17:56:58.115061+0000 (oldest deadline 2019-12-08T17:57:38.478512+0000) 2019-12-08T17:57:50.022 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:57:50.015+0000 1694f700 -1 osd.7 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:56.111121+0000 front 2019-12-08T17:56:56.181758+0000 (oldest deadline 2019-12-08T17:57:41.122608+0000) 2019-12-08T17:57:50.188 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:57:50.182+0000 1694f700 -1 osd.4 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:56.387335+0000 front 2019-12-08T17:56:56.899625+0000 (oldest deadline 2019-12-08T17:57:42.058398+0000) 2019-12-08T17:57:50.253 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:57:50.247+0000 1694f700 -1 osd.6 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:57.093359+0000 front 2019-12-08T17:56:57.106916+0000 (oldest deadline 2019-12-08T17:57:42.386212+0000) 2019-12-08T17:57:50.253 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:57:50.251+0000 1694f700 -1 osd.2 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:55.265144+0000 front 2019-12-08T17:56:55.223686+0000 (oldest deadline 2019-12-08T17:57:40.073611+0000) 2019-12-08T17:57:50.255 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:57:50.254+0000 1694f700 -1 osd.2 277 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:57:50.803 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:57:50.801+0000 1694f700 -1 osd.3 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:58.098919+0000 front 2019-12-08T17:56:58.133232+0000 (oldest deadline 2019-12-08T17:57:40.966101+0000) 2019-12-08T17:57:50.906 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:57:50.902+0000 1694f700 -1 osd.5 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:56.165321+0000 front 2019-12-08T17:56:57.992078+0000 (oldest deadline 2019-12-08T17:57:37.940904+0000) 2019-12-08T17:57:50.962 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:57:50.960+0000 1694f700 -1 osd.0 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:57.999447+0000 front 2019-12-08T17:56:58.115061+0000 (oldest deadline 2019-12-08T17:57:38.478512+0000) 2019-12-08T17:57:50.982 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:57:50.977+0000 1694f700 -1 osd.7 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:56.111121+0000 front 2019-12-08T17:56:56.181758+0000 (oldest deadline 2019-12-08T17:57:41.122608+0000) 2019-12-08T17:57:51.159 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:57:51.154+0000 1694f700 -1 osd.4 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:56.387335+0000 front 2019-12-08T17:56:56.899625+0000 (oldest deadline 2019-12-08T17:57:42.058398+0000) 2019-12-08T17:57:51.268 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:57:51.262+0000 1694f700 -1 osd.6 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:57.093359+0000 front 2019-12-08T17:56:57.106916+0000 (oldest deadline 2019-12-08T17:57:42.386212+0000) 2019-12-08T17:57:51.299 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:57:51.297+0000 1694f700 -1 osd.2 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:55.265144+0000 front 2019-12-08T17:56:55.223686+0000 (oldest deadline 2019-12-08T17:57:40.073611+0000) 2019-12-08T17:57:51.300 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:57:51.299+0000 1694f700 -1 osd.2 277 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:57:51.831 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:57:51.829+0000 1694f700 -1 osd.3 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:58.098919+0000 front 2019-12-08T17:56:58.133232+0000 (oldest deadline 2019-12-08T17:57:40.966101+0000) 2019-12-08T17:57:51.921 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:57:51.919+0000 1694f700 -1 osd.0 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:57.999447+0000 front 2019-12-08T17:56:58.115061+0000 (oldest deadline 2019-12-08T17:57:38.478512+0000) 2019-12-08T17:57:51.951 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:57:51.946+0000 1694f700 -1 osd.5 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:56.165321+0000 front 2019-12-08T17:56:57.992078+0000 (oldest deadline 2019-12-08T17:57:37.940904+0000) 2019-12-08T17:57:51.967 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:57:51.963+0000 1694f700 -1 osd.7 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:56.111121+0000 front 2019-12-08T17:56:56.181758+0000 (oldest deadline 2019-12-08T17:57:41.122608+0000) 2019-12-08T17:57:52.124 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:57:52.119+0000 1694f700 -1 osd.4 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:56.387335+0000 front 2019-12-08T17:56:56.899625+0000 (oldest deadline 2019-12-08T17:57:42.058398+0000) 2019-12-08T17:57:52.237 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:57:52.231+0000 1694f700 -1 osd.6 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:57.093359+0000 front 2019-12-08T17:56:57.106916+0000 (oldest deadline 2019-12-08T17:57:42.386212+0000) 2019-12-08T17:57:52.320 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:57:52.318+0000 1694f700 -1 osd.2 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:55.265144+0000 front 2019-12-08T17:56:55.223686+0000 (oldest deadline 2019-12-08T17:57:40.073611+0000) 2019-12-08T17:57:52.320 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:57:52.319+0000 1694f700 -1 osd.2 277 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:57:52.861 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:57:52.858+0000 1694f700 -1 osd.3 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:58.098919+0000 front 2019-12-08T17:56:58.133232+0000 (oldest deadline 2019-12-08T17:57:40.966101+0000) 2019-12-08T17:57:52.940 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:57:52.935+0000 1694f700 -1 osd.5 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:56.165321+0000 front 2019-12-08T17:56:57.992078+0000 (oldest deadline 2019-12-08T17:57:37.940904+0000) 2019-12-08T17:57:52.951 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:57:52.949+0000 1694f700 -1 osd.0 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:57.999447+0000 front 2019-12-08T17:56:58.115061+0000 (oldest deadline 2019-12-08T17:57:38.478512+0000) 2019-12-08T17:57:53.002 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:57:52.998+0000 1694f700 -1 osd.7 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:56.111121+0000 front 2019-12-08T17:56:56.181758+0000 (oldest deadline 2019-12-08T17:57:41.122608+0000) 2019-12-08T17:57:53.089 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:57:53.086+0000 1694f700 -1 osd.4 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:56.387335+0000 front 2019-12-08T17:56:56.899625+0000 (oldest deadline 2019-12-08T17:57:42.058398+0000) 2019-12-08T17:57:53.284 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:57:53.281+0000 1694f700 -1 osd.2 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:55.265144+0000 front 2019-12-08T17:56:55.223686+0000 (oldest deadline 2019-12-08T17:57:40.073611+0000) 2019-12-08T17:57:53.287 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:57:53.284+0000 1694f700 -1 osd.2 277 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:57:53.288 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:57:53.283+0000 1694f700 -1 osd.6 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:57.093359+0000 front 2019-12-08T17:56:57.106916+0000 (oldest deadline 2019-12-08T17:57:42.386212+0000) 2019-12-08T17:57:53.908 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:57:53.906+0000 1694f700 -1 osd.3 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:58.098919+0000 front 2019-12-08T17:56:58.133232+0000 (oldest deadline 2019-12-08T17:57:40.966101+0000) 2019-12-08T17:57:53.924 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:57:53.922+0000 1694f700 -1 osd.0 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:57.999447+0000 front 2019-12-08T17:56:58.115061+0000 (oldest deadline 2019-12-08T17:57:38.478512+0000) 2019-12-08T17:57:53.953 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:57:53.945+0000 1694f700 -1 osd.5 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:56.165321+0000 front 2019-12-08T17:56:57.992078+0000 (oldest deadline 2019-12-08T17:57:37.940904+0000) 2019-12-08T17:57:54.028 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:57:54.023+0000 1694f700 -1 osd.7 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:56.111121+0000 front 2019-12-08T17:56:56.181758+0000 (oldest deadline 2019-12-08T17:57:41.122608+0000) 2019-12-08T17:57:54.049 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:57:54.045+0000 1694f700 -1 osd.4 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:56.387335+0000 front 2019-12-08T17:56:56.899625+0000 (oldest deadline 2019-12-08T17:57:42.058398+0000) 2019-12-08T17:57:54.288 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:57:54.285+0000 1694f700 -1 osd.2 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:55.265144+0000 front 2019-12-08T17:56:55.223686+0000 (oldest deadline 2019-12-08T17:57:40.073611+0000) 2019-12-08T17:57:54.289 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:57:54.287+0000 1694f700 -1 osd.2 277 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:57:54.297 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:57:54.291+0000 1694f700 -1 osd.6 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:57.093359+0000 front 2019-12-08T17:56:57.106916+0000 (oldest deadline 2019-12-08T17:57:42.386212+0000) 2019-12-08T17:57:54.941 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:57:54.939+0000 1694f700 -1 osd.3 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:58.098919+0000 front 2019-12-08T17:56:58.133232+0000 (oldest deadline 2019-12-08T17:57:40.966101+0000) 2019-12-08T17:57:54.962 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:57:54.960+0000 1694f700 -1 osd.0 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:57.999447+0000 front 2019-12-08T17:56:58.115061+0000 (oldest deadline 2019-12-08T17:57:38.478512+0000) 2019-12-08T17:57:54.980 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:57:54.975+0000 1694f700 -1 osd.5 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:56.165321+0000 front 2019-12-08T17:56:57.992078+0000 (oldest deadline 2019-12-08T17:57:37.940904+0000) 2019-12-08T17:57:55.013 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:57:55.008+0000 1694f700 -1 osd.4 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:56.387335+0000 front 2019-12-08T17:56:56.899625+0000 (oldest deadline 2019-12-08T17:57:42.058398+0000) 2019-12-08T17:57:55.015 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:57:55.008+0000 1694f700 -1 osd.7 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:56.111121+0000 front 2019-12-08T17:56:56.181758+0000 (oldest deadline 2019-12-08T17:57:41.122608+0000) 2019-12-08T17:57:55.260 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:57:55.256+0000 1694f700 -1 osd.6 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:57.093359+0000 front 2019-12-08T17:56:57.106916+0000 (oldest deadline 2019-12-08T17:57:42.386212+0000) 2019-12-08T17:57:55.275 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:57:55.272+0000 1694f700 -1 osd.2 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:55.265144+0000 front 2019-12-08T17:56:55.223686+0000 (oldest deadline 2019-12-08T17:57:40.073611+0000) 2019-12-08T17:57:55.275 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:57:55.274+0000 1694f700 -1 osd.2 277 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:57:55.933 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:57:55.931+0000 1694f700 -1 osd.0 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:57.999447+0000 front 2019-12-08T17:56:58.115061+0000 (oldest deadline 2019-12-08T17:57:38.478512+0000) 2019-12-08T17:57:55.975 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:57:55.970+0000 1694f700 -1 osd.7 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:56.111121+0000 front 2019-12-08T17:56:56.181758+0000 (oldest deadline 2019-12-08T17:57:41.122608+0000) 2019-12-08T17:57:55.983 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:57:55.979+0000 1694f700 -1 osd.3 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:58.098919+0000 front 2019-12-08T17:56:58.133232+0000 (oldest deadline 2019-12-08T17:57:40.966101+0000) 2019-12-08T17:57:56.006 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:57:56.001+0000 1694f700 -1 osd.4 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:56.387335+0000 front 2019-12-08T17:56:56.899625+0000 (oldest deadline 2019-12-08T17:57:42.058398+0000) 2019-12-08T17:57:56.023 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:57:56.018+0000 1694f700 -1 osd.5 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:56.165321+0000 front 2019-12-08T17:56:57.992078+0000 (oldest deadline 2019-12-08T17:57:37.940904+0000) 2019-12-08T17:57:56.274 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:57:56.269+0000 1694f700 -1 osd.6 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:57.093359+0000 front 2019-12-08T17:56:57.106916+0000 (oldest deadline 2019-12-08T17:57:42.386212+0000) 2019-12-08T17:57:56.311 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:57:56.305+0000 1694f700 -1 osd.2 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:55.265144+0000 front 2019-12-08T17:56:55.223686+0000 (oldest deadline 2019-12-08T17:57:40.073611+0000) 2019-12-08T17:57:56.311 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:57:56.309+0000 1694f700 -1 osd.2 277 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:57:56.923 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:57:56.921+0000 1694f700 -1 osd.0 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:57.999447+0000 front 2019-12-08T17:56:58.115061+0000 (oldest deadline 2019-12-08T17:57:38.478512+0000) 2019-12-08T17:57:56.971 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:57:56.962+0000 1694f700 -1 osd.7 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:56.111121+0000 front 2019-12-08T17:56:56.181758+0000 (oldest deadline 2019-12-08T17:57:41.122608+0000) 2019-12-08T17:57:57.004 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:57:56.997+0000 1694f700 -1 osd.4 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:56.387335+0000 front 2019-12-08T17:56:56.899625+0000 (oldest deadline 2019-12-08T17:57:42.058398+0000) 2019-12-08T17:57:57.026 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:57:57.025+0000 1694f700 -1 osd.3 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:58.098919+0000 front 2019-12-08T17:56:58.133232+0000 (oldest deadline 2019-12-08T17:57:40.966101+0000) 2019-12-08T17:57:57.033 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:57:57.028+0000 1694f700 -1 osd.5 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:56.165321+0000 front 2019-12-08T17:56:57.992078+0000 (oldest deadline 2019-12-08T17:57:37.940904+0000) 2019-12-08T17:57:57.317 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:57:57.310+0000 1694f700 -1 osd.6 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:57.093359+0000 front 2019-12-08T17:56:57.106916+0000 (oldest deadline 2019-12-08T17:57:42.386212+0000) 2019-12-08T17:57:57.329 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:57:57.327+0000 1694f700 -1 osd.2 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:55.265144+0000 front 2019-12-08T17:56:55.223686+0000 (oldest deadline 2019-12-08T17:57:40.073611+0000) 2019-12-08T17:57:57.330 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:57:57.330+0000 1694f700 -1 osd.2 277 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:57:57.876 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:57:57.875+0000 1694f700 -1 osd.0 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:57.999447+0000 front 2019-12-08T17:56:58.115061+0000 (oldest deadline 2019-12-08T17:57:38.478512+0000) 2019-12-08T17:57:57.933 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:57:57.927+0000 1694f700 -1 osd.7 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:56.111121+0000 front 2019-12-08T17:56:56.181758+0000 (oldest deadline 2019-12-08T17:57:41.122608+0000) 2019-12-08T17:57:57.961 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:57:57.956+0000 1694f700 -1 osd.4 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:56.387335+0000 front 2019-12-08T17:56:56.899625+0000 (oldest deadline 2019-12-08T17:57:42.058398+0000) 2019-12-08T17:57:58.016 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:57:58.014+0000 1694f700 -1 osd.3 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:58.098919+0000 front 2019-12-08T17:56:58.133232+0000 (oldest deadline 2019-12-08T17:57:40.966101+0000) 2019-12-08T17:57:58.087 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:57:58.081+0000 1694f700 -1 osd.5 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:56.165321+0000 front 2019-12-08T17:56:57.992078+0000 (oldest deadline 2019-12-08T17:57:37.940904+0000) 2019-12-08T17:57:58.320 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:57:58.319+0000 1694f700 -1 osd.2 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:55.265144+0000 front 2019-12-08T17:56:55.223686+0000 (oldest deadline 2019-12-08T17:57:40.073611+0000) 2019-12-08T17:57:58.320 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:57:58.321+0000 1694f700 -1 osd.2 277 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:57:58.362 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:57:58.356+0000 1694f700 -1 osd.6 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:57.093359+0000 front 2019-12-08T17:56:57.106916+0000 (oldest deadline 2019-12-08T17:57:42.386212+0000) 2019-12-08T17:57:58.873 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:57:58.871+0000 1694f700 -1 osd.0 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:57.999447+0000 front 2019-12-08T17:56:58.115061+0000 (oldest deadline 2019-12-08T17:57:38.478512+0000) 2019-12-08T17:57:58.945 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:57:58.940+0000 1694f700 -1 osd.7 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:56.111121+0000 front 2019-12-08T17:56:56.181758+0000 (oldest deadline 2019-12-08T17:57:41.122608+0000) 2019-12-08T17:57:59.009 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:57:59.002+0000 1694f700 -1 osd.4 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:56.387335+0000 front 2019-12-08T17:56:56.899625+0000 (oldest deadline 2019-12-08T17:57:42.058398+0000) 2019-12-08T17:57:59.011 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:57:59.011+0000 1694f700 -1 osd.3 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:58.098919+0000 front 2019-12-08T17:56:58.133232+0000 (oldest deadline 2019-12-08T17:57:40.966101+0000) 2019-12-08T17:57:59.093 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:57:59.087+0000 1694f700 -1 osd.5 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:56.165321+0000 front 2019-12-08T17:56:57.992078+0000 (oldest deadline 2019-12-08T17:57:37.940904+0000) 2019-12-08T17:57:59.286 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:57:59.285+0000 1694f700 -1 osd.2 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:55.265144+0000 front 2019-12-08T17:56:55.223686+0000 (oldest deadline 2019-12-08T17:57:40.073611+0000) 2019-12-08T17:57:59.287 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:57:59.287+0000 1694f700 -1 osd.2 277 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:57:59.370 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:57:59.363+0000 1694f700 -1 osd.6 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:57.093359+0000 front 2019-12-08T17:56:57.106916+0000 (oldest deadline 2019-12-08T17:57:42.386212+0000) 2019-12-08T17:57:59.903 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:57:59.902+0000 1694f700 -1 osd.0 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:57.999447+0000 front 2019-12-08T17:56:58.115061+0000 (oldest deadline 2019-12-08T17:57:38.478512+0000) 2019-12-08T17:57:59.983 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:57:59.977+0000 1694f700 -1 osd.7 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:56.111121+0000 front 2019-12-08T17:56:56.181758+0000 (oldest deadline 2019-12-08T17:57:41.122608+0000) 2019-12-08T17:58:00.010 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:58:00.003+0000 1694f700 -1 osd.4 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:56.387335+0000 front 2019-12-08T17:56:56.899625+0000 (oldest deadline 2019-12-08T17:57:42.058398+0000) 2019-12-08T17:58:00.032 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:58:00.031+0000 1694f700 -1 osd.3 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:58.098919+0000 front 2019-12-08T17:56:58.133232+0000 (oldest deadline 2019-12-08T17:57:40.966101+0000) 2019-12-08T17:58:00.093 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:58:00.087+0000 1694f700 -1 osd.5 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:56.165321+0000 front 2019-12-08T17:56:57.992078+0000 (oldest deadline 2019-12-08T17:57:37.940904+0000) 2019-12-08T17:58:00.316 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:58:00.312+0000 1694f700 -1 osd.2 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:55.265144+0000 front 2019-12-08T17:56:55.223686+0000 (oldest deadline 2019-12-08T17:57:40.073611+0000) 2019-12-08T17:58:00.318 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:58:00.316+0000 1694f700 -1 osd.2 277 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:58:00.339 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:58:00.333+0000 1694f700 -1 osd.6 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:57.093359+0000 front 2019-12-08T17:56:57.106916+0000 (oldest deadline 2019-12-08T17:57:42.386212+0000) 2019-12-08T17:58:00.895 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:58:00.895+0000 1694f700 -1 osd.0 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:57.999447+0000 front 2019-12-08T17:56:58.115061+0000 (oldest deadline 2019-12-08T17:57:38.478512+0000) 2019-12-08T17:58:00.991 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:58:00.990+0000 1694f700 -1 osd.3 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:58.098919+0000 front 2019-12-08T17:56:58.133232+0000 (oldest deadline 2019-12-08T17:57:40.966101+0000) 2019-12-08T17:58:01.000 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:58:00.994+0000 1694f700 -1 osd.4 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:56.387335+0000 front 2019-12-08T17:56:56.899625+0000 (oldest deadline 2019-12-08T17:57:42.058398+0000) 2019-12-08T17:58:01.018 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:58:01.013+0000 1694f700 -1 osd.7 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:56.111121+0000 front 2019-12-08T17:56:56.181758+0000 (oldest deadline 2019-12-08T17:57:41.122608+0000) 2019-12-08T17:58:01.081 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:58:01.076+0000 1694f700 -1 osd.5 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:56.165321+0000 front 2019-12-08T17:56:57.992078+0000 (oldest deadline 2019-12-08T17:57:37.940904+0000) 2019-12-08T17:58:01.335 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:58:01.331+0000 1694f700 -1 osd.2 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:55.265144+0000 front 2019-12-08T17:56:55.223686+0000 (oldest deadline 2019-12-08T17:57:40.073611+0000) 2019-12-08T17:58:01.336 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:58:01.335+0000 1694f700 -1 osd.2 277 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:58:01.351 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:58:01.344+0000 1694f700 -1 osd.6 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:57.093359+0000 front 2019-12-08T17:56:57.106916+0000 (oldest deadline 2019-12-08T17:57:42.386212+0000) 2019-12-08T17:58:01.887 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:58:01.885+0000 1694f700 -1 osd.0 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:57.999447+0000 front 2019-12-08T17:56:58.115061+0000 (oldest deadline 2019-12-08T17:57:38.478512+0000) 2019-12-08T17:58:01.999 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:58:01.990+0000 1694f700 -1 osd.7 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:56.111121+0000 front 2019-12-08T17:56:56.181758+0000 (oldest deadline 2019-12-08T17:57:41.122608+0000) 2019-12-08T17:58:02.002 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:58:02.002+0000 1694f700 -1 osd.3 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:58.098919+0000 front 2019-12-08T17:56:58.133232+0000 (oldest deadline 2019-12-08T17:57:40.966101+0000) 2019-12-08T17:58:02.027 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:58:02.021+0000 1694f700 -1 osd.4 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:56.387335+0000 front 2019-12-08T17:56:56.899625+0000 (oldest deadline 2019-12-08T17:57:42.058398+0000) 2019-12-08T17:58:02.044 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:58:02.038+0000 1694f700 -1 osd.5 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:56.165321+0000 front 2019-12-08T17:56:57.992078+0000 (oldest deadline 2019-12-08T17:57:37.940904+0000) 2019-12-08T17:58:02.347 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:58:02.342+0000 1694f700 -1 osd.2 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:55.265144+0000 front 2019-12-08T17:56:55.223686+0000 (oldest deadline 2019-12-08T17:57:40.073611+0000) 2019-12-08T17:58:02.347 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:58:02.347+0000 1694f700 -1 osd.2 277 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:58:02.372 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:58:02.366+0000 1694f700 -1 osd.6 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:57.093359+0000 front 2019-12-08T17:56:57.106916+0000 (oldest deadline 2019-12-08T17:57:42.386212+0000) 2019-12-08T17:58:02.874 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:58:02.872+0000 1694f700 -1 osd.0 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:57.999447+0000 front 2019-12-08T17:56:58.115061+0000 (oldest deadline 2019-12-08T17:57:38.478512+0000) 2019-12-08T17:58:02.991 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:58:02.990+0000 1694f700 -1 osd.3 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:58.098919+0000 front 2019-12-08T17:56:58.133232+0000 (oldest deadline 2019-12-08T17:57:40.966101+0000) 2019-12-08T17:58:02.993 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:58:02.987+0000 1694f700 -1 osd.4 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:56.387335+0000 front 2019-12-08T17:56:56.899625+0000 (oldest deadline 2019-12-08T17:57:42.058398+0000) 2019-12-08T17:58:02.997 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:58:02.991+0000 1694f700 -1 osd.7 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:56.111121+0000 front 2019-12-08T17:56:56.181758+0000 (oldest deadline 2019-12-08T17:57:41.122608+0000) 2019-12-08T17:58:03.036 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:58:03.030+0000 1694f700 -1 osd.5 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:56.165321+0000 front 2019-12-08T17:56:57.992078+0000 (oldest deadline 2019-12-08T17:57:37.940904+0000) 2019-12-08T17:58:03.348 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:58:03.348+0000 1694f700 -1 osd.2 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:55.265144+0000 front 2019-12-08T17:56:55.223686+0000 (oldest deadline 2019-12-08T17:57:40.073611+0000) 2019-12-08T17:58:03.349 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:58:03.350+0000 1694f700 -1 osd.2 277 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:58:03.393 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:58:03.388+0000 1694f700 -1 osd.6 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:57.093359+0000 front 2019-12-08T17:56:57.106916+0000 (oldest deadline 2019-12-08T17:57:42.386212+0000) 2019-12-08T17:58:03.895 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:58:03.894+0000 1694f700 -1 osd.0 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:57.999447+0000 front 2019-12-08T17:56:58.115061+0000 (oldest deadline 2019-12-08T17:57:38.478512+0000) 2019-12-08T17:58:03.981 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:58:03.979+0000 1694f700 -1 osd.3 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:58.098919+0000 front 2019-12-08T17:56:58.133232+0000 (oldest deadline 2019-12-08T17:57:40.966101+0000) 2019-12-08T17:58:04.037 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:58:04.031+0000 1694f700 -1 osd.7 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:56.111121+0000 front 2019-12-08T17:56:56.181758+0000 (oldest deadline 2019-12-08T17:57:41.122608+0000) 2019-12-08T17:58:04.042 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:58:04.035+0000 1694f700 -1 osd.4 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:56.387335+0000 front 2019-12-08T17:56:56.899625+0000 (oldest deadline 2019-12-08T17:57:42.058398+0000) 2019-12-08T17:58:04.079 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:58:04.073+0000 1694f700 -1 osd.5 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:56.165321+0000 front 2019-12-08T17:56:57.992078+0000 (oldest deadline 2019-12-08T17:57:37.940904+0000) 2019-12-08T17:58:04.321 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:58:04.319+0000 1694f700 -1 osd.2 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:55.265144+0000 front 2019-12-08T17:56:55.223686+0000 (oldest deadline 2019-12-08T17:57:40.073611+0000) 2019-12-08T17:58:04.324 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:58:04.322+0000 1694f700 -1 osd.2 277 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:58:04.443 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:58:04.436+0000 1694f700 -1 osd.6 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:57.093359+0000 front 2019-12-08T17:56:57.106916+0000 (oldest deadline 2019-12-08T17:57:42.386212+0000) 2019-12-08T17:58:04.899 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:58:04.898+0000 1694f700 -1 osd.0 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:57.999447+0000 front 2019-12-08T17:56:58.115061+0000 (oldest deadline 2019-12-08T17:57:38.478512+0000) 2019-12-08T17:58:04.940 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:58:04.939+0000 1694f700 -1 osd.3 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:58.098919+0000 front 2019-12-08T17:56:58.133232+0000 (oldest deadline 2019-12-08T17:57:40.966101+0000) 2019-12-08T17:58:05.001 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:58:04.994+0000 1694f700 -1 osd.4 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:56.387335+0000 front 2019-12-08T17:56:56.899625+0000 (oldest deadline 2019-12-08T17:57:42.058398+0000) 2019-12-08T17:58:05.025 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:58:05.019+0000 1694f700 -1 osd.7 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:58:04.734793+0000 front 2019-12-08T17:56:56.181758+0000 (oldest deadline 2019-12-08T17:57:41.122608+0000) 2019-12-08T17:58:05.102 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:58:05.096+0000 1694f700 -1 osd.5 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:56.165321+0000 front 2019-12-08T17:56:57.992078+0000 (oldest deadline 2019-12-08T17:57:37.940904+0000) 2019-12-08T17:58:05.289 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:58:05.289+0000 1694f700 -1 osd.2 277 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:58:05.488 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:58:05.483+0000 1694f700 -1 osd.6 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:57.093359+0000 front 2019-12-08T17:56:57.106916+0000 (oldest deadline 2019-12-08T17:57:42.386212+0000) 2019-12-08T17:58:05.886 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:58:05.886+0000 1694f700 -1 osd.0 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:57.999447+0000 front 2019-12-08T17:56:58.115061+0000 (oldest deadline 2019-12-08T17:57:38.478512+0000) 2019-12-08T17:58:05.973 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:58:05.966+0000 1694f700 -1 osd.4 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:56.387335+0000 front 2019-12-08T17:56:56.899625+0000 (oldest deadline 2019-12-08T17:57:42.058398+0000) 2019-12-08T17:58:05.977 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:58:05.974+0000 1694f700 -1 osd.3 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:58.098919+0000 front 2019-12-08T17:56:58.133232+0000 (oldest deadline 2019-12-08T17:57:40.966101+0000) 2019-12-08T17:58:06.000 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:58:05.995+0000 1694f700 -1 osd.7 277 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:58:04.734793+0000 front 2019-12-08T17:56:56.181758+0000 (oldest deadline 2019-12-08T17:57:41.122608+0000) 2019-12-08T17:58:06.178 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:58:06.174+0000 1694f700 -1 osd.5 278 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:56.165321+0000 front 2019-12-08T17:56:57.992078+0000 (oldest deadline 2019-12-08T17:57:37.940904+0000) 2019-12-08T17:58:06.286 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:58:06.286+0000 1694f700 -1 osd.2 278 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:58:06.476 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:58:06.423+0000 1694f700 -1 osd.1 276 get_health_metrics reporting 30 slow ops, oldest is osd_op(client.4555.0:80948 7.1 7:8f661e56:lc::lc.12:head [call lock.lock in=50b] snapc 0=[] RETRY=36 ondisk+retry+write+known_if_redirected e272) 2019-12-08T17:58:06.653 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:58:06.647+0000 1694f700 -1 osd.6 278 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:57.093359+0000 front 2019-12-08T17:56:57.106916+0000 (oldest deadline 2019-12-08T17:57:42.386212+0000) 2019-12-08T17:58:06.906 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:58:06.906+0000 1694f700 -1 osd.0 278 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:57.999447+0000 front 2019-12-08T17:56:58.115061+0000 (oldest deadline 2019-12-08T17:57:38.478512+0000) 2019-12-08T17:58:06.941 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:58:06.941+0000 1694f700 -1 osd.3 278 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:58.098919+0000 front 2019-12-08T17:56:58.133232+0000 (oldest deadline 2019-12-08T17:57:40.966101+0000) 2019-12-08T17:58:06.954 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:58:06.950+0000 1694f700 -1 osd.4 278 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:56.387335+0000 front 2019-12-08T17:56:56.899625+0000 (oldest deadline 2019-12-08T17:57:42.058398+0000) 2019-12-08T17:58:07.047 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:58:07.041+0000 1694f700 -1 osd.7 278 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:58:04.734793+0000 front 2019-12-08T17:58:06.305058+0000 (oldest deadline 2019-12-08T17:57:41.122608+0000) 2019-12-08T17:58:07.165 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:58:07.160+0000 1694f700 -1 osd.5 278 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:56.165321+0000 front 2019-12-08T17:56:57.992078+0000 (oldest deadline 2019-12-08T17:57:37.940904+0000) 2019-12-08T17:58:07.244 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:58:07.244+0000 1694f700 -1 osd.2 278 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:58:07.620 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:58:07.614+0000 1694f700 -1 osd.6 278 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:57.093359+0000 front 2019-12-08T17:58:06.777770+0000 (oldest deadline 2019-12-08T17:57:42.386212+0000) 2019-12-08T17:58:07.900 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:58:07.900+0000 1694f700 -1 osd.0 278 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:57.999447+0000 front 2019-12-08T17:56:58.115061+0000 (oldest deadline 2019-12-08T17:57:38.478512+0000) 2019-12-08T17:58:07.956 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:58:07.956+0000 1694f700 -1 osd.3 278 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:58.098919+0000 front 2019-12-08T17:56:58.133232+0000 (oldest deadline 2019-12-08T17:57:40.966101+0000) 2019-12-08T17:58:07.963 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:58:07.961+0000 1694f700 -1 osd.1 277 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4555.0:80948 7.1 7:8f661e56:lc::lc.12:head [call lock.lock in=50b] snapc 0=[] RETRY=36 ondisk+retry+write+known_if_redirected e272) 2019-12-08T17:58:07.972 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:58:07.966+0000 1694f700 -1 osd.4 278 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:58:07.947657+0000 front 2019-12-08T17:56:56.899625+0000 (oldest deadline 2019-12-08T17:57:42.058398+0000) 2019-12-08T17:58:08.033 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:58:08.025+0000 1694f700 -1 osd.7 278 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:58:04.734793+0000 front 2019-12-08T17:58:06.305058+0000 (oldest deadline 2019-12-08T17:57:41.122608+0000) 2019-12-08T17:58:08.120 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:58:08.116+0000 1694f700 -1 osd.5 278 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:56:56.165321+0000 front 2019-12-08T17:56:57.992078+0000 (oldest deadline 2019-12-08T17:57:37.940904+0000) 2019-12-08T17:58:08.286 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:58:08.285+0000 1694f700 -1 osd.2 278 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:58:08.774 INFO:tasks.rgw.client.0.smithi079.stdout:2019-12-08T17:58:08.771+0000 20e25700 -1 RGWWatcher::handle_error cookie 5462687040 err (107) Transport endpoint is not connected 2019-12-08T17:58:08.785 INFO:tasks.rgw.client.0.smithi079.stdout:2019-12-08T17:58:08.774+0000 20e25700 -1 RGWWatcher::handle_error cookie 1473974224 err (107) Transport endpoint is not connected 2019-12-08T17:58:08.892 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:58:08.891+0000 1694f700 -1 osd.0 278 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:58:08.157386+0000 front 2019-12-08T17:56:58.115061+0000 (oldest deadline 2019-12-08T17:57:38.478512+0000) 2019-12-08T17:58:08.998 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:58:08.998+0000 1694f700 -1 osd.3 278 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T17:58:08.926351+0000 front 2019-12-08T17:56:58.133232+0000 (oldest deadline 2019-12-08T17:57:40.966101+0000) 2019-12-08T17:58:09.032 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:58:09.026+0000 1694f700 -1 osd.1 278 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4449.0:106782 5.f 5:f95f44c2:::notify.0:head [watch reconnect cookie 1473974224 gen 2] snapc 0=[] ondisk+write+known_if_redirected e277) 2019-12-08T17:58:09.636 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:58:09.601+0000 1694f700 -1 osd.2 278 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] RETRY=37 ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:58:10.577 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:58:10.575+0000 1694f700 -1 osd.2 278 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] RETRY=37 ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:58:11.591 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:58:11.590+0000 1694f700 -1 osd.2 278 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] RETRY=37 ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:58:12.610 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:58:12.610+0000 1694f700 -1 osd.2 278 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] RETRY=37 ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:58:13.613 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:58:13.613+0000 1694f700 -1 osd.2 278 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] RETRY=37 ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:58:14.573 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:58:14.573+0000 1694f700 -1 osd.2 278 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] RETRY=37 ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:58:15.624 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:58:15.622+0000 1694f700 -1 osd.2 278 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] RETRY=37 ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:58:16.599 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:58:16.598+0000 1694f700 -1 osd.2 278 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] RETRY=37 ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:58:17.647 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:58:17.644+0000 1694f700 -1 osd.2 278 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] RETRY=37 ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:58:18.603 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:58:18.600+0000 1694f700 -1 osd.2 278 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] RETRY=37 ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:58:19.605 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:58:19.604+0000 1694f700 -1 osd.2 278 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] RETRY=37 ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:58:20.616 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:58:20.614+0000 1694f700 -1 osd.2 278 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] RETRY=37 ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:58:21.573 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:58:21.568+0000 1694f700 -1 osd.2 278 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] RETRY=37 ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:58:22.589 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:58:22.588+0000 1694f700 -1 osd.2 278 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] RETRY=37 ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:58:23.573 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:58:23.572+0000 1694f700 -1 osd.2 278 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] RETRY=37 ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:58:24.621 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:58:24.619+0000 1694f700 -1 osd.2 278 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] RETRY=37 ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:58:25.581 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:58:25.580+0000 1694f700 -1 osd.2 278 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] RETRY=37 ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:58:26.595 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:58:26.594+0000 1694f700 -1 osd.2 278 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] RETRY=37 ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:58:27.586 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:58:27.585+0000 1694f700 -1 osd.2 278 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] RETRY=37 ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:58:28.607 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:58:28.605+0000 1694f700 -1 osd.2 278 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] RETRY=37 ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:58:29.597 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:58:29.596+0000 1694f700 -1 osd.2 278 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] RETRY=37 ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:58:30.591 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:58:30.590+0000 1694f700 -1 osd.2 278 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] RETRY=37 ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:58:31.585 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:58:31.583+0000 1694f700 -1 osd.2 278 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] RETRY=37 ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:58:32.542 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:58:32.541+0000 1694f700 -1 osd.2 278 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] RETRY=37 ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:58:33.517 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:58:33.515+0000 1694f700 -1 osd.2 278 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] RETRY=37 ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:58:34.514 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:58:34.513+0000 1694f700 -1 osd.2 278 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] RETRY=37 ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:58:35.523 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:58:35.521+0000 1694f700 -1 osd.2 278 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] RETRY=37 ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:58:36.514 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:58:36.512+0000 1694f700 -1 osd.2 278 get_health_metrics reporting 7 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] RETRY=37 ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:58:37.622 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:58:37.586+0000 1694f700 -1 osd.2 278 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] RETRY=37 ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:58:38.859 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:58:38.763+0000 1694f700 -1 osd.2 278 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] RETRY=37 ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:58:40.232 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:58:39.957+0000 1694f700 -1 osd.2 278 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] RETRY=37 ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:58:41.689 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T17:58:41.282+0000 1694f700 -1 osd.2 278 get_health_metrics reporting 6 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] RETRY=37 ondisk+retry+read+known_if_redirected e275) 2019-12-08T17:59:31.038 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:59:31.028+0000 1694f700 -1 osd.6 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.992369+0000 front 2019-12-08T17:58:46.929786+0000 (oldest deadline 2019-12-08T17:59:30.888056+0000) 2019-12-08T17:59:32.020 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:59:32.013+0000 1694f700 -1 osd.6 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.992369+0000 front 2019-12-08T17:58:46.929786+0000 (oldest deadline 2019-12-08T17:59:30.888056+0000) 2019-12-08T17:59:32.312 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:59:32.305+0000 1694f700 -1 osd.7 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:51.170835+0000 front 2019-12-08T17:58:52.263385+0000 (oldest deadline 2019-12-08T17:59:32.002384+0000) 2019-12-08T17:59:33.034 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:59:33.028+0000 1694f700 -1 osd.6 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.992369+0000 front 2019-12-08T17:58:46.929786+0000 (oldest deadline 2019-12-08T17:59:30.888056+0000) 2019-12-08T17:59:33.270 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:59:33.264+0000 1694f700 -1 osd.4 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:48.972756+0000 front 2019-12-08T17:58:48.899577+0000 (oldest deadline 2019-12-08T17:59:32.629241+0000) 2019-12-08T17:59:33.283 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:59:33.278+0000 1694f700 -1 osd.7 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:51.170835+0000 front 2019-12-08T17:58:52.263385+0000 (oldest deadline 2019-12-08T17:59:32.002384+0000) 2019-12-08T17:59:33.693 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:59:33.688+0000 1694f700 -1 osd.5 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.304432+0000 front 2019-12-08T17:58:50.553854+0000 (oldest deadline 2019-12-08T17:59:33.008535+0000) 2019-12-08T17:59:34.014 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:59:34.009+0000 1694f700 -1 osd.6 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.992369+0000 front 2019-12-08T17:58:46.929786+0000 (oldest deadline 2019-12-08T17:59:30.888056+0000) 2019-12-08T17:59:34.236 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:59:34.229+0000 1694f700 -1 osd.4 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:48.972756+0000 front 2019-12-08T17:58:48.899577+0000 (oldest deadline 2019-12-08T17:59:32.629241+0000) 2019-12-08T17:59:34.267 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:59:34.260+0000 1694f700 -1 osd.7 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:51.170835+0000 front 2019-12-08T17:58:52.263385+0000 (oldest deadline 2019-12-08T17:59:32.002384+0000) 2019-12-08T17:59:34.731 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:59:34.727+0000 1694f700 -1 osd.5 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.304432+0000 front 2019-12-08T17:58:50.553854+0000 (oldest deadline 2019-12-08T17:59:33.008535+0000) 2019-12-08T17:59:35.069 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:59:35.062+0000 1694f700 -1 osd.6 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.992369+0000 front 2019-12-08T17:58:46.929786+0000 (oldest deadline 2019-12-08T17:59:30.888056+0000) 2019-12-08T17:59:35.150 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:59:35.148+0000 1694f700 -1 osd.3 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.296261+0000 front 2019-12-08T17:58:49.755399+0000 (oldest deadline 2019-12-08T17:59:34.740671+0000) 2019-12-08T17:59:35.232 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:59:35.226+0000 1694f700 -1 osd.4 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:48.972756+0000 front 2019-12-08T17:58:48.899577+0000 (oldest deadline 2019-12-08T17:59:32.629241+0000) 2019-12-08T17:59:35.301 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:59:35.292+0000 1694f700 -1 osd.7 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:51.170835+0000 front 2019-12-08T17:58:52.263385+0000 (oldest deadline 2019-12-08T17:59:32.002384+0000) 2019-12-08T17:59:35.329 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:59:35.328+0000 1694f700 -1 osd.1 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:49.203271+0000 front 2019-12-08T17:58:49.407743+0000 (oldest deadline 2019-12-08T17:59:35.051900+0000) 2019-12-08T17:59:35.767 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:59:35.760+0000 1694f700 -1 osd.5 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.304432+0000 front 2019-12-08T17:58:50.553854+0000 (oldest deadline 2019-12-08T17:59:33.008535+0000) 2019-12-08T17:59:36.033 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:59:36.026+0000 1694f700 -1 osd.6 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.992369+0000 front 2019-12-08T17:58:46.929786+0000 (oldest deadline 2019-12-08T17:59:30.888056+0000) 2019-12-08T17:59:36.068 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:59:36.066+0000 1694f700 -1 osd.0 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.620352+0000 front 2019-12-08T17:58:50.564499+0000 (oldest deadline 2019-12-08T17:59:35.247769+0000) 2019-12-08T17:59:36.116 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:59:36.114+0000 1694f700 -1 osd.3 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.296261+0000 front 2019-12-08T17:58:49.755399+0000 (oldest deadline 2019-12-08T17:59:34.740671+0000) 2019-12-08T17:59:36.213 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:59:36.207+0000 1694f700 -1 osd.4 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:48.972756+0000 front 2019-12-08T17:58:48.899577+0000 (oldest deadline 2019-12-08T17:59:32.629241+0000) 2019-12-08T17:59:36.264 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:59:36.258+0000 1694f700 -1 osd.7 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:51.170835+0000 front 2019-12-08T17:58:52.263385+0000 (oldest deadline 2019-12-08T17:59:32.002384+0000) 2019-12-08T17:59:36.347 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:59:36.345+0000 1694f700 -1 osd.1 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:49.203271+0000 front 2019-12-08T17:58:49.407743+0000 (oldest deadline 2019-12-08T17:59:35.051900+0000) 2019-12-08T17:59:36.742 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:59:36.735+0000 1694f700 -1 osd.5 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.304432+0000 front 2019-12-08T17:58:50.553854+0000 (oldest deadline 2019-12-08T17:59:33.008535+0000) 2019-12-08T17:59:37.014 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:59:37.008+0000 1694f700 -1 osd.6 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.992369+0000 front 2019-12-08T17:58:46.929786+0000 (oldest deadline 2019-12-08T17:59:30.888056+0000) 2019-12-08T17:59:37.060 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:59:37.059+0000 1694f700 -1 osd.0 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.620352+0000 front 2019-12-08T17:58:50.564499+0000 (oldest deadline 2019-12-08T17:59:35.247769+0000) 2019-12-08T17:59:37.133 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:59:37.132+0000 1694f700 -1 osd.3 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.296261+0000 front 2019-12-08T17:58:49.755399+0000 (oldest deadline 2019-12-08T17:59:34.740671+0000) 2019-12-08T17:59:37.177 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:59:37.171+0000 1694f700 -1 osd.4 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:48.972756+0000 front 2019-12-08T17:58:48.899577+0000 (oldest deadline 2019-12-08T17:59:32.629241+0000) 2019-12-08T17:59:37.259 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:59:37.253+0000 1694f700 -1 osd.7 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:51.170835+0000 front 2019-12-08T17:58:52.263385+0000 (oldest deadline 2019-12-08T17:59:32.002384+0000) 2019-12-08T17:59:37.361 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:59:37.360+0000 1694f700 -1 osd.1 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:49.203271+0000 front 2019-12-08T17:58:49.407743+0000 (oldest deadline 2019-12-08T17:59:35.051900+0000) 2019-12-08T17:59:37.711 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:59:37.706+0000 1694f700 -1 osd.5 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.304432+0000 front 2019-12-08T17:58:50.553854+0000 (oldest deadline 2019-12-08T17:59:33.008535+0000) 2019-12-08T17:59:38.026 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:59:38.020+0000 1694f700 -1 osd.6 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.992369+0000 front 2019-12-08T17:58:46.929786+0000 (oldest deadline 2019-12-08T17:59:30.888056+0000) 2019-12-08T17:59:38.098 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:59:38.090+0000 1694f700 -1 osd.0 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.620352+0000 front 2019-12-08T17:58:50.564499+0000 (oldest deadline 2019-12-08T17:59:35.247769+0000) 2019-12-08T17:59:38.163 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:59:38.162+0000 1694f700 -1 osd.3 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.296261+0000 front 2019-12-08T17:58:49.755399+0000 (oldest deadline 2019-12-08T17:59:34.740671+0000) 2019-12-08T17:59:38.173 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:59:38.166+0000 1694f700 -1 osd.4 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:48.972756+0000 front 2019-12-08T17:58:48.899577+0000 (oldest deadline 2019-12-08T17:59:32.629241+0000) 2019-12-08T17:59:38.219 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:59:38.214+0000 1694f700 -1 osd.7 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:51.170835+0000 front 2019-12-08T17:58:52.263385+0000 (oldest deadline 2019-12-08T17:59:32.002384+0000) 2019-12-08T17:59:38.375 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:59:38.375+0000 1694f700 -1 osd.1 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:49.203271+0000 front 2019-12-08T17:58:49.407743+0000 (oldest deadline 2019-12-08T17:59:35.051900+0000) 2019-12-08T17:59:38.722 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:59:38.716+0000 1694f700 -1 osd.5 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.304432+0000 front 2019-12-08T17:58:50.553854+0000 (oldest deadline 2019-12-08T17:59:33.008535+0000) 2019-12-08T17:59:39.097 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:59:39.075+0000 1694f700 -1 osd.6 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.992369+0000 front 2019-12-08T17:58:46.929786+0000 (oldest deadline 2019-12-08T17:59:30.888056+0000) 2019-12-08T17:59:39.121 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:59:39.121+0000 1694f700 -1 osd.0 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.620352+0000 front 2019-12-08T17:58:50.564499+0000 (oldest deadline 2019-12-08T17:59:35.247769+0000) 2019-12-08T17:59:39.166 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:59:39.165+0000 1694f700 -1 osd.3 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.296261+0000 front 2019-12-08T17:58:49.755399+0000 (oldest deadline 2019-12-08T17:59:34.740671+0000) 2019-12-08T17:59:39.194 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:59:39.187+0000 1694f700 -1 osd.7 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:51.170835+0000 front 2019-12-08T17:58:52.263385+0000 (oldest deadline 2019-12-08T17:59:32.002384+0000) 2019-12-08T17:59:39.197 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:59:39.192+0000 1694f700 -1 osd.4 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:48.972756+0000 front 2019-12-08T17:58:48.899577+0000 (oldest deadline 2019-12-08T17:59:32.629241+0000) 2019-12-08T17:59:39.354 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:59:39.350+0000 1694f700 -1 osd.1 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:49.203271+0000 front 2019-12-08T17:58:49.407743+0000 (oldest deadline 2019-12-08T17:59:35.051900+0000) 2019-12-08T17:59:39.751 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:59:39.745+0000 1694f700 -1 osd.5 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.304432+0000 front 2019-12-08T17:58:50.553854+0000 (oldest deadline 2019-12-08T17:59:33.008535+0000) 2019-12-08T17:59:40.128 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:59:40.122+0000 1694f700 -1 osd.6 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.992369+0000 front 2019-12-08T17:58:46.929786+0000 (oldest deadline 2019-12-08T17:59:30.888056+0000) 2019-12-08T17:59:40.131 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:59:40.129+0000 1694f700 -1 osd.0 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.620352+0000 front 2019-12-08T17:58:50.564499+0000 (oldest deadline 2019-12-08T17:59:35.247769+0000) 2019-12-08T17:59:40.162 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:59:40.156+0000 1694f700 -1 osd.7 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:51.170835+0000 front 2019-12-08T17:58:52.263385+0000 (oldest deadline 2019-12-08T17:59:32.002384+0000) 2019-12-08T17:59:40.210 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:59:40.209+0000 1694f700 -1 osd.3 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.296261+0000 front 2019-12-08T17:58:49.755399+0000 (oldest deadline 2019-12-08T17:59:34.740671+0000) 2019-12-08T17:59:40.238 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:59:40.231+0000 1694f700 -1 osd.4 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:48.972756+0000 front 2019-12-08T17:58:48.899577+0000 (oldest deadline 2019-12-08T17:59:32.629241+0000) 2019-12-08T17:59:40.396 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:59:40.394+0000 1694f700 -1 osd.1 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:49.203271+0000 front 2019-12-08T17:58:49.407743+0000 (oldest deadline 2019-12-08T17:59:35.051900+0000) 2019-12-08T17:59:40.762 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:59:40.756+0000 1694f700 -1 osd.5 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.304432+0000 front 2019-12-08T17:58:50.553854+0000 (oldest deadline 2019-12-08T17:59:33.008535+0000) 2019-12-08T17:59:41.118 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:59:41.115+0000 1694f700 -1 osd.0 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.620352+0000 front 2019-12-08T17:58:50.564499+0000 (oldest deadline 2019-12-08T17:59:35.247769+0000) 2019-12-08T17:59:41.121 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:59:41.115+0000 1694f700 -1 osd.6 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.992369+0000 front 2019-12-08T17:58:46.929786+0000 (oldest deadline 2019-12-08T17:59:30.888056+0000) 2019-12-08T17:59:41.178 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:59:41.173+0000 1694f700 -1 osd.7 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:51.170835+0000 front 2019-12-08T17:58:52.263385+0000 (oldest deadline 2019-12-08T17:59:32.002384+0000) 2019-12-08T17:59:41.237 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:59:41.235+0000 1694f700 -1 osd.3 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.296261+0000 front 2019-12-08T17:58:49.755399+0000 (oldest deadline 2019-12-08T17:59:34.740671+0000) 2019-12-08T17:59:41.266 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:59:41.260+0000 1694f700 -1 osd.4 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:48.972756+0000 front 2019-12-08T17:58:48.899577+0000 (oldest deadline 2019-12-08T17:59:32.629241+0000) 2019-12-08T17:59:41.423 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:59:41.421+0000 1694f700 -1 osd.1 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:49.203271+0000 front 2019-12-08T17:58:49.407743+0000 (oldest deadline 2019-12-08T17:59:35.051900+0000) 2019-12-08T17:59:41.798 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:59:41.793+0000 1694f700 -1 osd.5 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.304432+0000 front 2019-12-08T17:58:50.553854+0000 (oldest deadline 2019-12-08T17:59:33.008535+0000) 2019-12-08T17:59:42.122 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:59:42.116+0000 1694f700 -1 osd.6 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.992369+0000 front 2019-12-08T17:58:46.929786+0000 (oldest deadline 2019-12-08T17:59:30.888056+0000) 2019-12-08T17:59:42.165 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:59:42.164+0000 1694f700 -1 osd.0 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.620352+0000 front 2019-12-08T17:58:50.564499+0000 (oldest deadline 2019-12-08T17:59:35.247769+0000) 2019-12-08T17:59:42.222 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:59:42.213+0000 1694f700 -1 osd.7 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:51.170835+0000 front 2019-12-08T17:58:52.263385+0000 (oldest deadline 2019-12-08T17:59:32.002384+0000) 2019-12-08T17:59:42.277 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:59:42.271+0000 1694f700 -1 osd.4 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:48.972756+0000 front 2019-12-08T17:58:48.899577+0000 (oldest deadline 2019-12-08T17:59:32.629241+0000) 2019-12-08T17:59:42.280 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:59:42.279+0000 1694f700 -1 osd.3 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.296261+0000 front 2019-12-08T17:58:49.755399+0000 (oldest deadline 2019-12-08T17:59:34.740671+0000) 2019-12-08T17:59:42.397 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:59:42.396+0000 1694f700 -1 osd.1 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:49.203271+0000 front 2019-12-08T17:58:49.407743+0000 (oldest deadline 2019-12-08T17:59:35.051900+0000) 2019-12-08T17:59:42.791 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:59:42.786+0000 1694f700 -1 osd.5 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.304432+0000 front 2019-12-08T17:58:50.553854+0000 (oldest deadline 2019-12-08T17:59:33.008535+0000) 2019-12-08T17:59:43.143 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:59:43.136+0000 1694f700 -1 osd.6 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.992369+0000 front 2019-12-08T17:58:46.929786+0000 (oldest deadline 2019-12-08T17:59:30.888056+0000) 2019-12-08T17:59:43.187 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:59:43.185+0000 1694f700 -1 osd.0 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.620352+0000 front 2019-12-08T17:58:50.564499+0000 (oldest deadline 2019-12-08T17:59:35.247769+0000) 2019-12-08T17:59:43.225 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:59:43.217+0000 1694f700 -1 osd.7 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:51.170835+0000 front 2019-12-08T17:58:52.263385+0000 (oldest deadline 2019-12-08T17:59:32.002384+0000) 2019-12-08T17:59:43.247 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:59:43.241+0000 1694f700 -1 osd.4 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:48.972756+0000 front 2019-12-08T17:58:48.899577+0000 (oldest deadline 2019-12-08T17:59:32.629241+0000) 2019-12-08T17:59:43.278 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:59:43.277+0000 1694f700 -1 osd.3 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.296261+0000 front 2019-12-08T17:58:49.755399+0000 (oldest deadline 2019-12-08T17:59:34.740671+0000) 2019-12-08T17:59:43.410 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:59:43.409+0000 1694f700 -1 osd.1 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:49.203271+0000 front 2019-12-08T17:58:49.407743+0000 (oldest deadline 2019-12-08T17:59:35.051900+0000) 2019-12-08T17:59:43.806 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:59:43.800+0000 1694f700 -1 osd.5 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.304432+0000 front 2019-12-08T17:58:50.553854+0000 (oldest deadline 2019-12-08T17:59:33.008535+0000) 2019-12-08T17:59:44.158 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:59:44.152+0000 1694f700 -1 osd.6 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.992369+0000 front 2019-12-08T17:58:46.929786+0000 (oldest deadline 2019-12-08T17:59:30.888056+0000) 2019-12-08T17:59:44.208 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:59:44.208+0000 1694f700 -1 osd.0 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.620352+0000 front 2019-12-08T17:58:50.564499+0000 (oldest deadline 2019-12-08T17:59:35.247769+0000) 2019-12-08T17:59:44.218 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:59:44.213+0000 1694f700 -1 osd.4 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:48.972756+0000 front 2019-12-08T17:58:48.899577+0000 (oldest deadline 2019-12-08T17:59:32.629241+0000) 2019-12-08T17:59:44.269 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:59:44.262+0000 1694f700 -1 osd.7 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:51.170835+0000 front 2019-12-08T17:58:52.263385+0000 (oldest deadline 2019-12-08T17:59:32.002384+0000) 2019-12-08T17:59:44.303 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:59:44.302+0000 1694f700 -1 osd.3 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.296261+0000 front 2019-12-08T17:58:49.755399+0000 (oldest deadline 2019-12-08T17:59:34.740671+0000) 2019-12-08T17:59:44.413 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:59:44.412+0000 1694f700 -1 osd.1 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:49.203271+0000 front 2019-12-08T17:58:49.407743+0000 (oldest deadline 2019-12-08T17:59:35.051900+0000) 2019-12-08T17:59:44.777 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:59:44.771+0000 1694f700 -1 osd.5 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.304432+0000 front 2019-12-08T17:58:50.553854+0000 (oldest deadline 2019-12-08T17:59:33.008535+0000) 2019-12-08T17:59:45.132 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:59:45.126+0000 1694f700 -1 osd.6 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.992369+0000 front 2019-12-08T17:58:46.929786+0000 (oldest deadline 2019-12-08T17:59:30.888056+0000) 2019-12-08T17:59:45.217 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:59:45.211+0000 1694f700 -1 osd.4 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:48.972756+0000 front 2019-12-08T17:58:48.899577+0000 (oldest deadline 2019-12-08T17:59:32.629241+0000) 2019-12-08T17:59:45.240 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:59:45.239+0000 1694f700 -1 osd.0 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.620352+0000 front 2019-12-08T17:58:50.564499+0000 (oldest deadline 2019-12-08T17:59:35.247769+0000) 2019-12-08T17:59:45.270 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:59:45.265+0000 1694f700 -1 osd.7 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:51.170835+0000 front 2019-12-08T17:58:52.263385+0000 (oldest deadline 2019-12-08T17:59:32.002384+0000) 2019-12-08T17:59:45.271 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:59:45.270+0000 1694f700 -1 osd.3 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.296261+0000 front 2019-12-08T17:58:49.755399+0000 (oldest deadline 2019-12-08T17:59:34.740671+0000) 2019-12-08T17:59:45.464 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:59:45.463+0000 1694f700 -1 osd.1 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:49.203271+0000 front 2019-12-08T17:58:49.407743+0000 (oldest deadline 2019-12-08T17:59:35.051900+0000) 2019-12-08T17:59:45.754 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:59:45.747+0000 1694f700 -1 osd.5 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.304432+0000 front 2019-12-08T17:58:50.553854+0000 (oldest deadline 2019-12-08T17:59:33.008535+0000) 2019-12-08T17:59:46.180 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:59:46.174+0000 1694f700 -1 osd.6 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.992369+0000 front 2019-12-08T17:58:46.929786+0000 (oldest deadline 2019-12-08T17:59:30.888056+0000) 2019-12-08T17:59:46.213 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:59:46.211+0000 1694f700 -1 osd.0 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.620352+0000 front 2019-12-08T17:58:50.564499+0000 (oldest deadline 2019-12-08T17:59:35.247769+0000) 2019-12-08T17:59:46.260 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:59:46.254+0000 1694f700 -1 osd.4 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:48.972756+0000 front 2019-12-08T17:58:48.899577+0000 (oldest deadline 2019-12-08T17:59:32.629241+0000) 2019-12-08T17:59:46.272 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:59:46.266+0000 1694f700 -1 osd.7 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:51.170835+0000 front 2019-12-08T17:58:52.263385+0000 (oldest deadline 2019-12-08T17:59:32.002384+0000) 2019-12-08T17:59:46.288 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:59:46.286+0000 1694f700 -1 osd.3 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.296261+0000 front 2019-12-08T17:58:49.755399+0000 (oldest deadline 2019-12-08T17:59:34.740671+0000) 2019-12-08T17:59:46.499 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:59:46.496+0000 1694f700 -1 osd.1 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:49.203271+0000 front 2019-12-08T17:58:49.407743+0000 (oldest deadline 2019-12-08T17:59:35.051900+0000) 2019-12-08T17:59:46.808 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:59:46.802+0000 1694f700 -1 osd.5 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.304432+0000 front 2019-12-08T17:58:50.553854+0000 (oldest deadline 2019-12-08T17:59:33.008535+0000) 2019-12-08T17:59:47.154 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:59:47.148+0000 1694f700 -1 osd.6 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.992369+0000 front 2019-12-08T17:58:46.929786+0000 (oldest deadline 2019-12-08T17:59:30.888056+0000) 2019-12-08T17:59:47.240 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:59:47.238+0000 1694f700 -1 osd.0 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.620352+0000 front 2019-12-08T17:58:50.564499+0000 (oldest deadline 2019-12-08T17:59:35.247769+0000) 2019-12-08T17:59:47.266 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:59:47.260+0000 1694f700 -1 osd.4 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:48.972756+0000 front 2019-12-08T17:58:48.899577+0000 (oldest deadline 2019-12-08T17:59:32.629241+0000) 2019-12-08T17:59:47.278 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:59:47.272+0000 1694f700 -1 osd.7 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:51.170835+0000 front 2019-12-08T17:58:52.263385+0000 (oldest deadline 2019-12-08T17:59:32.002384+0000) 2019-12-08T17:59:47.290 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:59:47.287+0000 1694f700 -1 osd.3 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.296261+0000 front 2019-12-08T17:58:49.755399+0000 (oldest deadline 2019-12-08T17:59:34.740671+0000) 2019-12-08T17:59:47.469 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:59:47.467+0000 1694f700 -1 osd.1 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:49.203271+0000 front 2019-12-08T17:58:49.407743+0000 (oldest deadline 2019-12-08T17:59:35.051900+0000) 2019-12-08T17:59:47.805 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:59:47.799+0000 1694f700 -1 osd.5 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.304432+0000 front 2019-12-08T17:58:50.553854+0000 (oldest deadline 2019-12-08T17:59:33.008535+0000) 2019-12-08T17:59:48.192 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:59:48.187+0000 1694f700 -1 osd.6 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.992369+0000 front 2019-12-08T17:58:46.929786+0000 (oldest deadline 2019-12-08T17:59:30.888056+0000) 2019-12-08T17:59:48.211 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:59:48.208+0000 1694f700 -1 osd.0 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.620352+0000 front 2019-12-08T17:58:50.564499+0000 (oldest deadline 2019-12-08T17:59:35.247769+0000) 2019-12-08T17:59:48.224 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:59:48.218+0000 1694f700 -1 osd.4 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:48.972756+0000 front 2019-12-08T17:58:48.899577+0000 (oldest deadline 2019-12-08T17:59:32.629241+0000) 2019-12-08T17:59:48.280 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:59:48.278+0000 1694f700 -1 osd.3 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.296261+0000 front 2019-12-08T17:58:49.755399+0000 (oldest deadline 2019-12-08T17:59:34.740671+0000) 2019-12-08T17:59:48.301 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:59:48.294+0000 1694f700 -1 osd.7 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:51.170835+0000 front 2019-12-08T17:58:52.263385+0000 (oldest deadline 2019-12-08T17:59:32.002384+0000) 2019-12-08T17:59:48.428 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:59:48.426+0000 1694f700 -1 osd.1 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:49.203271+0000 front 2019-12-08T17:58:49.407743+0000 (oldest deadline 2019-12-08T17:59:35.051900+0000) 2019-12-08T17:59:48.761 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:59:48.755+0000 1694f700 -1 osd.5 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.304432+0000 front 2019-12-08T17:58:50.553854+0000 (oldest deadline 2019-12-08T17:59:33.008535+0000) 2019-12-08T17:59:49.186 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:59:49.180+0000 1694f700 -1 osd.4 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:48.972756+0000 front 2019-12-08T17:58:48.899577+0000 (oldest deadline 2019-12-08T17:59:32.629241+0000) 2019-12-08T17:59:49.231 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:59:49.229+0000 1694f700 -1 osd.0 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.620352+0000 front 2019-12-08T17:58:50.564499+0000 (oldest deadline 2019-12-08T17:59:35.247769+0000) 2019-12-08T17:59:49.234 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:59:49.228+0000 1694f700 -1 osd.6 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.992369+0000 front 2019-12-08T17:58:46.929786+0000 (oldest deadline 2019-12-08T17:59:30.888056+0000) 2019-12-08T17:59:49.268 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:59:49.266+0000 1694f700 -1 osd.3 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.296261+0000 front 2019-12-08T17:58:49.755399+0000 (oldest deadline 2019-12-08T17:59:34.740671+0000) 2019-12-08T17:59:49.330 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:59:49.324+0000 1694f700 -1 osd.7 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:51.170835+0000 front 2019-12-08T17:58:52.263385+0000 (oldest deadline 2019-12-08T17:59:32.002384+0000) 2019-12-08T17:59:49.411 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:59:49.408+0000 1694f700 -1 osd.1 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:49.203271+0000 front 2019-12-08T17:58:49.407743+0000 (oldest deadline 2019-12-08T17:59:35.051900+0000) 2019-12-08T17:59:49.811 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:59:49.806+0000 1694f700 -1 osd.5 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.304432+0000 front 2019-12-08T17:58:50.553854+0000 (oldest deadline 2019-12-08T17:59:33.008535+0000) 2019-12-08T17:59:50.197 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:59:50.192+0000 1694f700 -1 osd.4 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:48.972756+0000 front 2019-12-08T17:58:48.899577+0000 (oldest deadline 2019-12-08T17:59:32.629241+0000) 2019-12-08T17:59:50.244 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:59:50.241+0000 1694f700 -1 osd.0 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.620352+0000 front 2019-12-08T17:58:50.564499+0000 (oldest deadline 2019-12-08T17:59:35.247769+0000) 2019-12-08T17:59:50.276 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:59:50.273+0000 1694f700 -1 osd.3 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.296261+0000 front 2019-12-08T17:58:49.755399+0000 (oldest deadline 2019-12-08T17:59:34.740671+0000) 2019-12-08T17:59:50.284 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:59:50.278+0000 1694f700 -1 osd.6 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.992369+0000 front 2019-12-08T17:58:46.929786+0000 (oldest deadline 2019-12-08T17:59:30.888056+0000) 2019-12-08T17:59:50.298 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:59:50.293+0000 1694f700 -1 osd.7 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:51.170835+0000 front 2019-12-08T17:58:52.263385+0000 (oldest deadline 2019-12-08T17:59:32.002384+0000) 2019-12-08T17:59:50.389 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:59:50.387+0000 1694f700 -1 osd.1 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:49.203271+0000 front 2019-12-08T17:58:49.407743+0000 (oldest deadline 2019-12-08T17:59:35.051900+0000) 2019-12-08T17:59:50.806 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:59:50.801+0000 1694f700 -1 osd.5 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.304432+0000 front 2019-12-08T17:58:50.553854+0000 (oldest deadline 2019-12-08T17:59:33.008535+0000) 2019-12-08T17:59:51.233 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:59:51.232+0000 1694f700 -1 osd.0 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.620352+0000 front 2019-12-08T17:58:50.564499+0000 (oldest deadline 2019-12-08T17:59:35.247769+0000) 2019-12-08T17:59:51.245 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:59:51.241+0000 1694f700 -1 osd.4 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:48.972756+0000 front 2019-12-08T17:58:48.899577+0000 (oldest deadline 2019-12-08T17:59:32.629241+0000) 2019-12-08T17:59:51.252 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:59:51.250+0000 1694f700 -1 osd.3 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.296261+0000 front 2019-12-08T17:58:49.755399+0000 (oldest deadline 2019-12-08T17:59:34.740671+0000) 2019-12-08T17:59:51.297 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:59:51.292+0000 1694f700 -1 osd.7 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:51.170835+0000 front 2019-12-08T17:58:52.263385+0000 (oldest deadline 2019-12-08T17:59:32.002384+0000) 2019-12-08T17:59:51.317 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:59:51.312+0000 1694f700 -1 osd.6 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.992369+0000 front 2019-12-08T17:58:46.929786+0000 (oldest deadline 2019-12-08T17:59:30.888056+0000) 2019-12-08T17:59:51.424 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:59:51.422+0000 1694f700 -1 osd.1 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:49.203271+0000 front 2019-12-08T17:58:49.407743+0000 (oldest deadline 2019-12-08T17:59:35.051900+0000) 2019-12-08T17:59:51.770 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:59:51.765+0000 1694f700 -1 osd.5 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.304432+0000 front 2019-12-08T17:58:50.553854+0000 (oldest deadline 2019-12-08T17:59:33.008535+0000) 2019-12-08T17:59:52.245 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:59:52.243+0000 1694f700 -1 osd.3 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.296261+0000 front 2019-12-08T17:58:49.755399+0000 (oldest deadline 2019-12-08T17:59:34.740671+0000) 2019-12-08T17:59:52.266 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:59:52.262+0000 1694f700 -1 osd.4 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:48.972756+0000 front 2019-12-08T17:58:48.899577+0000 (oldest deadline 2019-12-08T17:59:32.629241+0000) 2019-12-08T17:59:52.283 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:59:52.278+0000 1694f700 -1 osd.6 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.992369+0000 front 2019-12-08T17:58:46.929786+0000 (oldest deadline 2019-12-08T17:59:30.888056+0000) 2019-12-08T17:59:52.285 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:59:52.283+0000 1694f700 -1 osd.0 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.620352+0000 front 2019-12-08T17:58:50.564499+0000 (oldest deadline 2019-12-08T17:59:35.247769+0000) 2019-12-08T17:59:52.313 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:59:52.309+0000 1694f700 -1 osd.7 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:51.170835+0000 front 2019-12-08T17:58:52.263385+0000 (oldest deadline 2019-12-08T17:59:32.002384+0000) 2019-12-08T17:59:52.409 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:59:52.407+0000 1694f700 -1 osd.1 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:49.203271+0000 front 2019-12-08T17:58:49.407743+0000 (oldest deadline 2019-12-08T17:59:35.051900+0000) 2019-12-08T17:59:52.750 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:59:52.745+0000 1694f700 -1 osd.5 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.304432+0000 front 2019-12-08T17:58:50.553854+0000 (oldest deadline 2019-12-08T17:59:33.008535+0000) 2019-12-08T17:59:53.261 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:59:53.252+0000 1694f700 -1 osd.6 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.992369+0000 front 2019-12-08T17:58:46.929786+0000 (oldest deadline 2019-12-08T17:59:30.888056+0000) 2019-12-08T17:59:53.279 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:59:53.277+0000 1694f700 -1 osd.0 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.620352+0000 front 2019-12-08T17:58:50.564499+0000 (oldest deadline 2019-12-08T17:59:35.247769+0000) 2019-12-08T17:59:53.281 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:59:53.279+0000 1694f700 -1 osd.3 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.296261+0000 front 2019-12-08T17:58:49.755399+0000 (oldest deadline 2019-12-08T17:59:34.740671+0000) 2019-12-08T17:59:53.295 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:59:53.289+0000 1694f700 -1 osd.4 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:48.972756+0000 front 2019-12-08T17:58:48.899577+0000 (oldest deadline 2019-12-08T17:59:32.629241+0000) 2019-12-08T17:59:53.340 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:59:53.335+0000 1694f700 -1 osd.7 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:51.170835+0000 front 2019-12-08T17:58:52.263385+0000 (oldest deadline 2019-12-08T17:59:32.002384+0000) 2019-12-08T17:59:53.439 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:59:53.436+0000 1694f700 -1 osd.1 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:49.203271+0000 front 2019-12-08T17:58:49.407743+0000 (oldest deadline 2019-12-08T17:59:35.051900+0000) 2019-12-08T17:59:53.774 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:59:53.770+0000 1694f700 -1 osd.5 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.304432+0000 front 2019-12-08T17:58:50.553854+0000 (oldest deadline 2019-12-08T17:59:33.008535+0000) 2019-12-08T17:59:54.261 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:59:54.259+0000 1694f700 -1 osd.0 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.620352+0000 front 2019-12-08T17:58:50.564499+0000 (oldest deadline 2019-12-08T17:59:35.247769+0000) 2019-12-08T17:59:54.291 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:59:54.286+0000 1694f700 -1 osd.6 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.992369+0000 front 2019-12-08T17:58:46.929786+0000 (oldest deadline 2019-12-08T17:59:30.888056+0000) 2019-12-08T17:59:54.331 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:59:54.330+0000 1694f700 -1 osd.3 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.296261+0000 front 2019-12-08T17:58:49.755399+0000 (oldest deadline 2019-12-08T17:59:34.740671+0000) 2019-12-08T17:59:54.345 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:59:54.339+0000 1694f700 -1 osd.7 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:51.170835+0000 front 2019-12-08T17:58:52.263385+0000 (oldest deadline 2019-12-08T17:59:32.002384+0000) 2019-12-08T17:59:54.347 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:59:54.343+0000 1694f700 -1 osd.4 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:48.972756+0000 front 2019-12-08T17:58:48.899577+0000 (oldest deadline 2019-12-08T17:59:32.629241+0000) 2019-12-08T17:59:54.408 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:59:54.406+0000 1694f700 -1 osd.1 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:49.203271+0000 front 2019-12-08T17:58:49.407743+0000 (oldest deadline 2019-12-08T17:59:35.051900+0000) 2019-12-08T17:59:54.790 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:59:54.784+0000 1694f700 -1 osd.5 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.304432+0000 front 2019-12-08T17:58:50.553854+0000 (oldest deadline 2019-12-08T17:59:33.008535+0000) 2019-12-08T17:59:55.238 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:59:55.236+0000 1694f700 -1 osd.0 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.620352+0000 front 2019-12-08T17:58:50.564499+0000 (oldest deadline 2019-12-08T17:59:35.247769+0000) 2019-12-08T17:59:55.268 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:59:55.262+0000 1694f700 -1 osd.6 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.992369+0000 front 2019-12-08T17:58:46.929786+0000 (oldest deadline 2019-12-08T17:59:30.888056+0000) 2019-12-08T17:59:55.294 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:59:55.292+0000 1694f700 -1 osd.3 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.296261+0000 front 2019-12-08T17:58:49.755399+0000 (oldest deadline 2019-12-08T17:59:34.740671+0000) 2019-12-08T17:59:55.342 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:59:55.337+0000 1694f700 -1 osd.4 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:48.972756+0000 front 2019-12-08T17:58:48.899577+0000 (oldest deadline 2019-12-08T17:59:32.629241+0000) 2019-12-08T17:59:55.388 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:59:55.384+0000 1694f700 -1 osd.7 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:51.170835+0000 front 2019-12-08T17:58:52.263385+0000 (oldest deadline 2019-12-08T17:59:32.002384+0000) 2019-12-08T17:59:55.411 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:59:55.407+0000 1694f700 -1 osd.1 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:49.203271+0000 front 2019-12-08T17:58:49.407743+0000 (oldest deadline 2019-12-08T17:59:35.051900+0000) 2019-12-08T17:59:55.749 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:59:55.744+0000 1694f700 -1 osd.5 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.304432+0000 front 2019-12-08T17:58:50.553854+0000 (oldest deadline 2019-12-08T17:59:33.008535+0000) 2019-12-08T17:59:56.239 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:59:56.236+0000 1694f700 -1 osd.0 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.620352+0000 front 2019-12-08T17:58:50.564499+0000 (oldest deadline 2019-12-08T17:59:35.247769+0000) 2019-12-08T17:59:56.259 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:59:56.256+0000 1694f700 -1 osd.3 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.296261+0000 front 2019-12-08T17:58:49.755399+0000 (oldest deadline 2019-12-08T17:59:34.740671+0000) 2019-12-08T17:59:56.269 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:59:56.265+0000 1694f700 -1 osd.6 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.992369+0000 front 2019-12-08T17:58:46.929786+0000 (oldest deadline 2019-12-08T17:59:30.888056+0000) 2019-12-08T17:59:56.323 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:59:56.319+0000 1694f700 -1 osd.4 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:48.972756+0000 front 2019-12-08T17:58:48.899577+0000 (oldest deadline 2019-12-08T17:59:32.629241+0000) 2019-12-08T17:59:56.381 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:59:56.375+0000 1694f700 -1 osd.7 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:51.170835+0000 front 2019-12-08T17:58:52.263385+0000 (oldest deadline 2019-12-08T17:59:32.002384+0000) 2019-12-08T17:59:56.410 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:59:56.405+0000 1694f700 -1 osd.1 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:49.203271+0000 front 2019-12-08T17:58:49.407743+0000 (oldest deadline 2019-12-08T17:59:35.051900+0000) 2019-12-08T17:59:56.741 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:59:56.735+0000 1694f700 -1 osd.5 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.304432+0000 front 2019-12-08T17:58:50.553854+0000 (oldest deadline 2019-12-08T17:59:33.008535+0000) 2019-12-08T17:59:57.267 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:59:57.264+0000 1694f700 -1 osd.3 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.296261+0000 front 2019-12-08T17:58:49.755399+0000 (oldest deadline 2019-12-08T17:59:34.740671+0000) 2019-12-08T17:59:57.289 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:59:57.287+0000 1694f700 -1 osd.0 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.620352+0000 front 2019-12-08T17:58:50.564499+0000 (oldest deadline 2019-12-08T17:59:35.247769+0000) 2019-12-08T17:59:57.314 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:59:57.309+0000 1694f700 -1 osd.6 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.992369+0000 front 2019-12-08T17:58:46.929786+0000 (oldest deadline 2019-12-08T17:59:30.888056+0000) 2019-12-08T17:59:57.335 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:59:57.331+0000 1694f700 -1 osd.4 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:48.972756+0000 front 2019-12-08T17:58:48.899577+0000 (oldest deadline 2019-12-08T17:59:32.629241+0000) 2019-12-08T17:59:57.371 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:59:57.368+0000 1694f700 -1 osd.1 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:49.203271+0000 front 2019-12-08T17:58:49.407743+0000 (oldest deadline 2019-12-08T17:59:35.051900+0000) 2019-12-08T17:59:57.404 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:59:57.399+0000 1694f700 -1 osd.7 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:51.170835+0000 front 2019-12-08T17:58:52.263385+0000 (oldest deadline 2019-12-08T17:59:32.002384+0000) 2019-12-08T17:59:57.742 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:59:57.737+0000 1694f700 -1 osd.5 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.304432+0000 front 2019-12-08T17:58:50.553854+0000 (oldest deadline 2019-12-08T17:59:33.008535+0000) 2019-12-08T17:59:58.303 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:59:58.300+0000 1694f700 -1 osd.3 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.296261+0000 front 2019-12-08T17:58:49.755399+0000 (oldest deadline 2019-12-08T17:59:34.740671+0000) 2019-12-08T17:59:58.316 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:59:58.312+0000 1694f700 -1 osd.6 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.992369+0000 front 2019-12-08T17:58:46.929786+0000 (oldest deadline 2019-12-08T17:59:30.888056+0000) 2019-12-08T17:59:58.318 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:59:58.312+0000 1694f700 -1 osd.4 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:48.972756+0000 front 2019-12-08T17:58:48.899577+0000 (oldest deadline 2019-12-08T17:59:32.629241+0000) 2019-12-08T17:59:58.324 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:59:58.321+0000 1694f700 -1 osd.0 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.620352+0000 front 2019-12-08T17:58:50.564499+0000 (oldest deadline 2019-12-08T17:59:35.247769+0000) 2019-12-08T17:59:58.397 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:59:58.391+0000 1694f700 -1 osd.7 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:51.170835+0000 front 2019-12-08T17:58:52.263385+0000 (oldest deadline 2019-12-08T17:59:32.002384+0000) 2019-12-08T17:59:58.422 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:59:58.419+0000 1694f700 -1 osd.1 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:49.203271+0000 front 2019-12-08T17:58:49.407743+0000 (oldest deadline 2019-12-08T17:59:35.051900+0000) 2019-12-08T17:59:58.701 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:59:58.696+0000 1694f700 -1 osd.5 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.304432+0000 front 2019-12-08T17:58:50.553854+0000 (oldest deadline 2019-12-08T17:59:33.008535+0000) 2019-12-08T17:59:59.277 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T17:59:59.274+0000 1694f700 -1 osd.3 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.296261+0000 front 2019-12-08T17:58:49.755399+0000 (oldest deadline 2019-12-08T17:59:34.740671+0000) 2019-12-08T17:59:59.340 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T17:59:59.334+0000 1694f700 -1 osd.4 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:48.972756+0000 front 2019-12-08T17:58:48.899577+0000 (oldest deadline 2019-12-08T17:59:32.629241+0000) 2019-12-08T17:59:59.350 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T17:59:59.347+0000 1694f700 -1 osd.0 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.620352+0000 front 2019-12-08T17:58:50.564499+0000 (oldest deadline 2019-12-08T17:59:35.247769+0000) 2019-12-08T17:59:59.369 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T17:59:59.362+0000 1694f700 -1 osd.6 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.992369+0000 front 2019-12-08T17:58:46.929786+0000 (oldest deadline 2019-12-08T17:59:30.888056+0000) 2019-12-08T17:59:59.401 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T17:59:59.399+0000 1694f700 -1 osd.1 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:49.203271+0000 front 2019-12-08T17:58:49.407743+0000 (oldest deadline 2019-12-08T17:59:35.051900+0000) 2019-12-08T17:59:59.413 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T17:59:59.408+0000 1694f700 -1 osd.7 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:51.170835+0000 front 2019-12-08T17:58:52.263385+0000 (oldest deadline 2019-12-08T17:59:32.002384+0000) 2019-12-08T17:59:59.681 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T17:59:59.676+0000 1694f700 -1 osd.5 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.304432+0000 front 2019-12-08T17:58:50.553854+0000 (oldest deadline 2019-12-08T17:59:33.008535+0000) 2019-12-08T18:00:00.307 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T18:00:00.304+0000 1694f700 -1 osd.3 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.296261+0000 front 2019-12-08T17:58:49.755399+0000 (oldest deadline 2019-12-08T17:59:34.740671+0000) 2019-12-08T18:00:00.339 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T18:00:00.333+0000 1694f700 -1 osd.4 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:48.972756+0000 front 2019-12-08T17:58:48.899577+0000 (oldest deadline 2019-12-08T17:59:32.629241+0000) 2019-12-08T18:00:00.348 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T18:00:00.344+0000 1694f700 -1 osd.6 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.992369+0000 front 2019-12-08T17:58:46.929786+0000 (oldest deadline 2019-12-08T17:59:30.888056+0000) 2019-12-08T18:00:00.375 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T18:00:00.370+0000 1694f700 -1 osd.0 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.620352+0000 front 2019-12-08T17:58:50.564499+0000 (oldest deadline 2019-12-08T17:59:35.247769+0000) 2019-12-08T18:00:00.377 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T18:00:00.369+0000 1694f700 -1 osd.1 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:49.203271+0000 front 2019-12-08T17:58:49.407743+0000 (oldest deadline 2019-12-08T17:59:35.051900+0000) 2019-12-08T18:00:00.392 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T18:00:00.388+0000 1694f700 -1 osd.7 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:51.170835+0000 front 2019-12-08T17:58:52.263385+0000 (oldest deadline 2019-12-08T17:59:32.002384+0000) 2019-12-08T18:00:00.650 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T18:00:00.646+0000 1694f700 -1 osd.5 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.304432+0000 front 2019-12-08T17:58:50.553854+0000 (oldest deadline 2019-12-08T17:59:33.008535+0000) 2019-12-08T18:00:01.320 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T18:00:01.312+0000 1694f700 -1 osd.4 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:48.972756+0000 front 2019-12-08T17:58:48.899577+0000 (oldest deadline 2019-12-08T17:59:32.629241+0000) 2019-12-08T18:00:01.331 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T18:00:01.328+0000 1694f700 -1 osd.3 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.296261+0000 front 2019-12-08T17:58:49.755399+0000 (oldest deadline 2019-12-08T17:59:34.740671+0000) 2019-12-08T18:00:01.334 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T18:00:01.328+0000 1694f700 -1 osd.6 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.992369+0000 front 2019-12-08T17:58:46.929786+0000 (oldest deadline 2019-12-08T17:59:30.888056+0000) 2019-12-08T18:00:01.382 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T18:00:01.379+0000 1694f700 -1 osd.1 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:49.203271+0000 front 2019-12-08T17:58:49.407743+0000 (oldest deadline 2019-12-08T17:59:35.051900+0000) 2019-12-08T18:00:01.426 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T18:00:01.424+0000 1694f700 -1 osd.0 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.620352+0000 front 2019-12-08T17:58:50.564499+0000 (oldest deadline 2019-12-08T17:59:35.247769+0000) 2019-12-08T18:00:01.434 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T18:00:01.430+0000 1694f700 -1 osd.7 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:51.170835+0000 front 2019-12-08T17:58:52.263385+0000 (oldest deadline 2019-12-08T17:59:32.002384+0000) 2019-12-08T18:00:01.650 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T18:00:01.646+0000 1694f700 -1 osd.5 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.304432+0000 front 2019-12-08T17:58:50.553854+0000 (oldest deadline 2019-12-08T17:59:33.008535+0000) 2019-12-08T18:00:02.324 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T18:00:02.319+0000 1694f700 -1 osd.6 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.992369+0000 front 2019-12-08T17:58:46.929786+0000 (oldest deadline 2019-12-08T17:59:30.888056+0000) 2019-12-08T18:00:02.340 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T18:00:02.338+0000 1694f700 -1 osd.3 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.296261+0000 front 2019-12-08T17:58:49.755399+0000 (oldest deadline 2019-12-08T17:59:34.740671+0000) 2019-12-08T18:00:02.366 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T18:00:02.361+0000 1694f700 -1 osd.4 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:48.972756+0000 front 2019-12-08T17:58:48.899577+0000 (oldest deadline 2019-12-08T17:59:32.629241+0000) 2019-12-08T18:00:02.425 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T18:00:02.422+0000 1694f700 -1 osd.1 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:49.203271+0000 front 2019-12-08T17:58:49.407743+0000 (oldest deadline 2019-12-08T17:59:35.051900+0000) 2019-12-08T18:00:02.431 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T18:00:02.427+0000 1694f700 -1 osd.7 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:51.170835+0000 front 2019-12-08T17:58:52.263385+0000 (oldest deadline 2019-12-08T17:59:32.002384+0000) 2019-12-08T18:00:02.480 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T18:00:02.477+0000 1694f700 -1 osd.0 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.620352+0000 front 2019-12-08T17:58:50.564499+0000 (oldest deadline 2019-12-08T17:59:35.247769+0000) 2019-12-08T18:00:02.617 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T18:00:02.612+0000 1694f700 -1 osd.5 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.304432+0000 front 2019-12-08T17:58:50.553854+0000 (oldest deadline 2019-12-08T17:59:33.008535+0000) 2019-12-08T18:00:03.317 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T18:00:03.315+0000 1694f700 -1 osd.3 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.296261+0000 front 2019-12-08T17:58:49.755399+0000 (oldest deadline 2019-12-08T17:59:34.740671+0000) 2019-12-08T18:00:03.334 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T18:00:03.328+0000 1694f700 -1 osd.6 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.992369+0000 front 2019-12-08T17:58:46.929786+0000 (oldest deadline 2019-12-08T17:59:30.888056+0000) 2019-12-08T18:00:03.344 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T18:00:03.339+0000 1694f700 -1 osd.4 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:48.972756+0000 front 2019-12-08T17:58:48.899577+0000 (oldest deadline 2019-12-08T17:59:32.629241+0000) 2019-12-08T18:00:03.408 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T18:00:03.403+0000 1694f700 -1 osd.7 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:51.170835+0000 front 2019-12-08T17:58:52.263385+0000 (oldest deadline 2019-12-08T17:59:32.002384+0000) 2019-12-08T18:00:03.408 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T18:00:03.407+0000 1694f700 -1 osd.1 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:49.203271+0000 front 2019-12-08T17:58:49.407743+0000 (oldest deadline 2019-12-08T17:59:35.051900+0000) 2019-12-08T18:00:03.463 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T18:00:03.460+0000 1694f700 -1 osd.0 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.620352+0000 front 2019-12-08T17:58:50.564499+0000 (oldest deadline 2019-12-08T17:59:35.247769+0000) 2019-12-08T18:00:03.614 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T18:00:03.609+0000 1694f700 -1 osd.5 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.304432+0000 front 2019-12-08T17:58:50.553854+0000 (oldest deadline 2019-12-08T17:59:33.008535+0000) 2019-12-08T18:00:04.300 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T18:00:04.297+0000 1694f700 -1 osd.3 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.296261+0000 front 2019-12-08T17:58:49.755399+0000 (oldest deadline 2019-12-08T17:59:34.740671+0000) 2019-12-08T18:00:04.352 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T18:00:04.347+0000 1694f700 -1 osd.6 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.992369+0000 front 2019-12-08T17:58:46.929786+0000 (oldest deadline 2019-12-08T17:59:30.888056+0000) 2019-12-08T18:00:04.384 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T18:00:04.379+0000 1694f700 -1 osd.4 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:48.972756+0000 front 2019-12-08T17:58:48.899577+0000 (oldest deadline 2019-12-08T17:59:32.629241+0000) 2019-12-08T18:00:04.402 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T18:00:04.397+0000 1694f700 -1 osd.7 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:51.170835+0000 front 2019-12-08T17:58:52.263385+0000 (oldest deadline 2019-12-08T17:59:32.002384+0000) 2019-12-08T18:00:04.409 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T18:00:04.408+0000 1694f700 -1 osd.1 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:49.203271+0000 front 2019-12-08T17:58:49.407743+0000 (oldest deadline 2019-12-08T17:59:35.051900+0000) 2019-12-08T18:00:04.415 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T18:00:04.414+0000 1694f700 -1 osd.0 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.620352+0000 front 2019-12-08T17:58:50.564499+0000 (oldest deadline 2019-12-08T17:59:35.247769+0000) 2019-12-08T18:00:04.633 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T18:00:04.628+0000 1694f700 -1 osd.5 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.304432+0000 front 2019-12-08T17:58:50.553854+0000 (oldest deadline 2019-12-08T17:59:33.008535+0000) 2019-12-08T18:00:05.270 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T18:00:05.269+0000 1694f700 -1 osd.3 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.296261+0000 front 2019-12-08T17:58:49.755399+0000 (oldest deadline 2019-12-08T17:59:34.740671+0000) 2019-12-08T18:00:05.370 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T18:00:05.365+0000 1694f700 -1 osd.6 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.992369+0000 front 2019-12-08T17:58:46.929786+0000 (oldest deadline 2019-12-08T17:59:30.888056+0000) 2019-12-08T18:00:05.412 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T18:00:05.408+0000 1694f700 -1 osd.7 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:51.170835+0000 front 2019-12-08T17:58:52.263385+0000 (oldest deadline 2019-12-08T17:59:32.002384+0000) 2019-12-08T18:00:05.431 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T18:00:05.427+0000 1694f700 -1 osd.4 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:48.972756+0000 front 2019-12-08T17:58:48.899577+0000 (oldest deadline 2019-12-08T17:59:32.629241+0000) 2019-12-08T18:00:05.437 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T18:00:05.434+0000 1694f700 -1 osd.0 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.620352+0000 front 2019-12-08T17:58:50.564499+0000 (oldest deadline 2019-12-08T17:59:35.247769+0000) 2019-12-08T18:00:05.453 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T18:00:05.450+0000 1694f700 -1 osd.1 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:49.203271+0000 front 2019-12-08T17:58:49.407743+0000 (oldest deadline 2019-12-08T17:59:35.051900+0000) 2019-12-08T18:00:05.670 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T18:00:05.666+0000 1694f700 -1 osd.5 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.304432+0000 front 2019-12-08T17:58:50.553854+0000 (oldest deadline 2019-12-08T17:59:33.008535+0000) 2019-12-08T18:00:06.279 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T18:00:06.277+0000 1694f700 -1 osd.3 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.296261+0000 front 2019-12-08T17:58:49.755399+0000 (oldest deadline 2019-12-08T17:59:34.740671+0000) 2019-12-08T18:00:06.344 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T18:00:06.339+0000 1694f700 -1 osd.6 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.992369+0000 front 2019-12-08T17:58:46.929786+0000 (oldest deadline 2019-12-08T17:59:30.888056+0000) 2019-12-08T18:00:06.413 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T18:00:06.409+0000 1694f700 -1 osd.4 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:48.972756+0000 front 2019-12-08T17:58:48.899577+0000 (oldest deadline 2019-12-08T17:59:32.629241+0000) 2019-12-08T18:00:06.456 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T18:00:06.451+0000 1694f700 -1 osd.7 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:51.170835+0000 front 2019-12-08T17:58:52.263385+0000 (oldest deadline 2019-12-08T17:59:32.002384+0000) 2019-12-08T18:00:06.473 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T18:00:06.471+0000 1694f700 -1 osd.0 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.620352+0000 front 2019-12-08T17:58:50.564499+0000 (oldest deadline 2019-12-08T17:59:35.247769+0000) 2019-12-08T18:00:06.502 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T18:00:06.501+0000 1694f700 -1 osd.1 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:49.203271+0000 front 2019-12-08T17:58:49.407743+0000 (oldest deadline 2019-12-08T17:59:35.051900+0000) 2019-12-08T18:00:06.554 INFO:tasks.ceph.mon.b.smithi013.stderr:2019-12-08T18:00:06.543+0000 1a89c700 -1 mon.b@0(leader) e1 get_health_metrics reporting 4 slow ops, oldest is osd_failure(failed timeout osd.2 [v2:172.21.15.79:6802/10448,v1:172.21.15.79:6803/10448] for 41sec e278 v278) 2019-12-08T18:00:06.636 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T18:00:06.629+0000 1694f700 -1 osd.5 278 heartbeat_check: no reply from 172.21.15.79:6806 osd.2 since back 2019-12-08T17:58:50.304432+0000 front 2019-12-08T17:58:50.553854+0000 (oldest deadline 2019-12-08T17:59:33.008535+0000) 2019-12-08T18:00:44.114 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:00:44.109+0000 34274700 -1 osd.2 283 build_incremental_map_msg missing incremental map 283 2019-12-08T18:00:44.258 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:00:44.255+0000 34274700 -1 osd.2 283 build_incremental_map_msg missing incremental map 283 2019-12-08T18:00:44.353 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:00:44.324+0000 3a280700 -1 osd.2 283 build_incremental_map_msg missing incremental map 283 2019-12-08T18:00:44.814 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:00:44.688+0000 36a79700 -1 osd.2 283 build_incremental_map_msg missing incremental map 283 2019-12-08T18:00:45.121 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:00:45.107+0000 3827c700 -1 osd.2 284 build_incremental_map_msg missing incremental map 283 2019-12-08T18:01:04.171 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T18:01:04.164+0000 1694f700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:17.958349+0000 front 2019-12-08T18:00:23.251164+0000 (oldest deadline 2019-12-08T18:01:03.221050+0000) 2019-12-08T18:01:04.201 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T18:01:04.199+0000 1694f700 -1 osd.3 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.498597+0000 front 2019-12-08T18:00:18.793327+0000 (oldest deadline 2019-12-08T18:01:03.483865+0000) 2019-12-08T18:01:05.135 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T18:01:05.129+0000 1694f700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:17.958349+0000 front 2019-12-08T18:00:23.251164+0000 (oldest deadline 2019-12-08T18:01:03.221050+0000) 2019-12-08T18:01:05.198 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T18:01:05.196+0000 1694f700 -1 osd.3 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.498597+0000 front 2019-12-08T18:00:18.793327+0000 (oldest deadline 2019-12-08T18:01:03.483865+0000) 2019-12-08T18:01:05.335 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T18:01:05.333+0000 1694f700 -1 osd.0 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.839500+0000 front 2019-12-08T18:00:20.962196+0000 (oldest deadline 2019-12-08T18:01:04.861422+0000) 2019-12-08T18:01:06.155 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T18:01:06.148+0000 1694f700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:17.958349+0000 front 2019-12-08T18:00:23.251164+0000 (oldest deadline 2019-12-08T18:01:03.221050+0000) 2019-12-08T18:01:06.203 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T18:01:06.201+0000 1694f700 -1 osd.3 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.498597+0000 front 2019-12-08T18:00:18.793327+0000 (oldest deadline 2019-12-08T18:01:03.483865+0000) 2019-12-08T18:01:06.387 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T18:01:06.385+0000 1694f700 -1 osd.0 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.839500+0000 front 2019-12-08T18:00:20.962196+0000 (oldest deadline 2019-12-08T18:01:04.861422+0000) 2019-12-08T18:01:06.850 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T18:01:06.843+0000 1694f700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.158464+0000 front 2019-12-08T18:00:20.177584+0000 (oldest deadline 2019-12-08T18:01:05.984388+0000) 2019-12-08T18:01:07.161 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T18:01:07.154+0000 1694f700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:17.958349+0000 front 2019-12-08T18:00:23.251164+0000 (oldest deadline 2019-12-08T18:01:03.221050+0000) 2019-12-08T18:01:07.217 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T18:01:07.216+0000 1694f700 -1 osd.3 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.498597+0000 front 2019-12-08T18:00:18.793327+0000 (oldest deadline 2019-12-08T18:01:03.483865+0000) 2019-12-08T18:01:07.369 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T18:01:07.368+0000 1694f700 -1 osd.0 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.839500+0000 front 2019-12-08T18:00:20.962196+0000 (oldest deadline 2019-12-08T18:01:04.861422+0000) 2019-12-08T18:01:07.372 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T18:01:07.363+0000 1694f700 -1 osd.5 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.021041+0000 front 2019-12-08T18:00:23.016009+0000 (oldest deadline 2019-12-08T18:01:06.454925+0000) 2019-12-08T18:01:07.850 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T18:01:07.844+0000 1694f700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.158464+0000 front 2019-12-08T18:00:20.177584+0000 (oldest deadline 2019-12-08T18:01:05.984388+0000) 2019-12-08T18:01:08.177 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T18:01:08.176+0000 1694f700 -1 osd.3 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.498597+0000 front 2019-12-08T18:00:18.793327+0000 (oldest deadline 2019-12-08T18:01:03.483865+0000) 2019-12-08T18:01:08.185 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T18:01:08.180+0000 1694f700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:17.958349+0000 front 2019-12-08T18:00:23.251164+0000 (oldest deadline 2019-12-08T18:01:03.221050+0000) 2019-12-08T18:01:08.397 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T18:01:08.396+0000 1694f700 -1 osd.0 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.839500+0000 front 2019-12-08T18:00:20.962196+0000 (oldest deadline 2019-12-08T18:01:04.861422+0000) 2019-12-08T18:01:08.413 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T18:01:08.407+0000 1694f700 -1 osd.5 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.021041+0000 front 2019-12-08T18:00:23.016009+0000 (oldest deadline 2019-12-08T18:01:06.454925+0000) 2019-12-08T18:01:08.835 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T18:01:08.829+0000 1694f700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.158464+0000 front 2019-12-08T18:00:20.177584+0000 (oldest deadline 2019-12-08T18:01:05.984388+0000) 2019-12-08T18:01:08.885 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T18:01:08.878+0000 1694f700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:22.219779+0000 front 2019-12-08T18:00:22.242283+0000 (oldest deadline 2019-12-08T18:01:08.055994+0000) 2019-12-08T18:01:09.157 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T18:01:09.150+0000 1694f700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:17.958349+0000 front 2019-12-08T18:00:23.251164+0000 (oldest deadline 2019-12-08T18:01:03.221050+0000) 2019-12-08T18:01:09.170 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T18:01:09.169+0000 1694f700 -1 osd.3 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.498597+0000 front 2019-12-08T18:00:18.793327+0000 (oldest deadline 2019-12-08T18:01:03.483865+0000) 2019-12-08T18:01:09.379 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T18:01:09.373+0000 1694f700 -1 osd.5 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.021041+0000 front 2019-12-08T18:00:23.016009+0000 (oldest deadline 2019-12-08T18:01:06.454925+0000) 2019-12-08T18:01:09.440 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T18:01:09.438+0000 1694f700 -1 osd.0 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.839500+0000 front 2019-12-08T18:00:20.962196+0000 (oldest deadline 2019-12-08T18:01:04.861422+0000) 2019-12-08T18:01:09.858 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T18:01:09.852+0000 1694f700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:22.219779+0000 front 2019-12-08T18:00:22.242283+0000 (oldest deadline 2019-12-08T18:01:08.055994+0000) 2019-12-08T18:01:09.886 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T18:01:09.880+0000 1694f700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.158464+0000 front 2019-12-08T18:00:20.177584+0000 (oldest deadline 2019-12-08T18:01:05.984388+0000) 2019-12-08T18:01:10.166 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T18:01:10.161+0000 1694f700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:17.958349+0000 front 2019-12-08T18:00:23.251164+0000 (oldest deadline 2019-12-08T18:01:03.221050+0000) 2019-12-08T18:01:10.218 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T18:01:10.217+0000 1694f700 -1 osd.3 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.498597+0000 front 2019-12-08T18:00:18.793327+0000 (oldest deadline 2019-12-08T18:01:03.483865+0000) 2019-12-08T18:01:10.369 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T18:01:10.364+0000 1694f700 -1 osd.5 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.021041+0000 front 2019-12-08T18:00:23.016009+0000 (oldest deadline 2019-12-08T18:01:06.454925+0000) 2019-12-08T18:01:10.399 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T18:01:10.399+0000 1694f700 -1 osd.0 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.839500+0000 front 2019-12-08T18:00:20.962196+0000 (oldest deadline 2019-12-08T18:01:04.861422+0000) 2019-12-08T18:01:10.847 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T18:01:10.841+0000 1694f700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:22.219779+0000 front 2019-12-08T18:00:22.242283+0000 (oldest deadline 2019-12-08T18:01:08.055994+0000) 2019-12-08T18:01:10.877 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T18:01:10.871+0000 1694f700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.158464+0000 front 2019-12-08T18:00:20.177584+0000 (oldest deadline 2019-12-08T18:01:05.984388+0000) 2019-12-08T18:01:11.163 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T18:01:11.158+0000 1694f700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:17.958349+0000 front 2019-12-08T18:00:23.251164+0000 (oldest deadline 2019-12-08T18:01:03.221050+0000) 2019-12-08T18:01:11.182 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T18:01:11.181+0000 1694f700 -1 osd.3 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.498597+0000 front 2019-12-08T18:00:18.793327+0000 (oldest deadline 2019-12-08T18:01:03.483865+0000) 2019-12-08T18:01:11.334 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T18:01:11.329+0000 1694f700 -1 osd.5 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.021041+0000 front 2019-12-08T18:00:23.016009+0000 (oldest deadline 2019-12-08T18:01:06.454925+0000) 2019-12-08T18:01:11.418 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T18:01:11.417+0000 1694f700 -1 osd.0 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.839500+0000 front 2019-12-08T18:00:20.962196+0000 (oldest deadline 2019-12-08T18:01:04.861422+0000) 2019-12-08T18:01:11.833 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T18:01:11.828+0000 1694f700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.158464+0000 front 2019-12-08T18:00:20.177584+0000 (oldest deadline 2019-12-08T18:01:05.984388+0000) 2019-12-08T18:01:11.870 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T18:01:11.864+0000 1694f700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:22.219779+0000 front 2019-12-08T18:00:22.242283+0000 (oldest deadline 2019-12-08T18:01:08.055994+0000) 2019-12-08T18:01:12.219 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T18:01:12.214+0000 1694f700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:17.958349+0000 front 2019-12-08T18:00:23.251164+0000 (oldest deadline 2019-12-08T18:01:03.221050+0000) 2019-12-08T18:01:12.235 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T18:01:12.233+0000 1694f700 -1 osd.3 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.498597+0000 front 2019-12-08T18:00:18.793327+0000 (oldest deadline 2019-12-08T18:01:03.483865+0000) 2019-12-08T18:01:12.299 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T18:01:12.295+0000 1694f700 -1 osd.5 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.021041+0000 front 2019-12-08T18:00:23.016009+0000 (oldest deadline 2019-12-08T18:01:06.454925+0000) 2019-12-08T18:01:12.469 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T18:01:12.469+0000 1694f700 -1 osd.0 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.839500+0000 front 2019-12-08T18:00:20.962196+0000 (oldest deadline 2019-12-08T18:01:04.861422+0000) 2019-12-08T18:01:12.795 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:01:12.795+0000 1694f700 -1 osd.2 284 get_health_metrics reporting 1 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e282) 2019-12-08T18:01:12.813 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T18:01:12.807+0000 1694f700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.158464+0000 front 2019-12-08T18:00:20.177584+0000 (oldest deadline 2019-12-08T18:01:05.984388+0000) 2019-12-08T18:01:12.892 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T18:01:12.886+0000 1694f700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:22.219779+0000 front 2019-12-08T18:00:22.242283+0000 (oldest deadline 2019-12-08T18:01:08.055994+0000) 2019-12-08T18:01:13.215 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T18:01:13.210+0000 1694f700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:17.958349+0000 front 2019-12-08T18:00:23.251164+0000 (oldest deadline 2019-12-08T18:01:03.221050+0000) 2019-12-08T18:01:13.263 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T18:01:13.262+0000 1694f700 -1 osd.3 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.498597+0000 front 2019-12-08T18:00:18.793327+0000 (oldest deadline 2019-12-08T18:01:03.483865+0000) 2019-12-08T18:01:13.275 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T18:01:13.269+0000 1694f700 -1 osd.5 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.021041+0000 front 2019-12-08T18:00:23.016009+0000 (oldest deadline 2019-12-08T18:01:06.454925+0000) 2019-12-08T18:01:13.437 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T18:01:13.435+0000 1694f700 -1 osd.0 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.839500+0000 front 2019-12-08T18:00:20.962196+0000 (oldest deadline 2019-12-08T18:01:04.861422+0000) 2019-12-08T18:01:13.839 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:01:13.840+0000 1694f700 -1 osd.2 284 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e282) 2019-12-08T18:01:13.859 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T18:01:13.854+0000 1694f700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.158464+0000 front 2019-12-08T18:00:20.177584+0000 (oldest deadline 2019-12-08T18:01:05.984388+0000) 2019-12-08T18:01:13.864 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T18:01:13.858+0000 1694f700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:22.219779+0000 front 2019-12-08T18:00:22.242283+0000 (oldest deadline 2019-12-08T18:01:08.055994+0000) 2019-12-08T18:01:14.209 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T18:01:14.204+0000 1694f700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:17.958349+0000 front 2019-12-08T18:00:23.251164+0000 (oldest deadline 2019-12-08T18:01:03.221050+0000) 2019-12-08T18:01:14.237 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T18:01:14.237+0000 1694f700 -1 osd.3 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.498597+0000 front 2019-12-08T18:00:18.793327+0000 (oldest deadline 2019-12-08T18:01:03.483865+0000) 2019-12-08T18:01:14.239 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T18:01:14.234+0000 1694f700 -1 osd.5 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.021041+0000 front 2019-12-08T18:00:23.016009+0000 (oldest deadline 2019-12-08T18:01:06.454925+0000) 2019-12-08T18:01:14.393 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T18:01:14.391+0000 1694f700 -1 osd.0 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.839500+0000 front 2019-12-08T18:00:20.962196+0000 (oldest deadline 2019-12-08T18:01:04.861422+0000) 2019-12-08T18:01:14.830 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:01:14.830+0000 1694f700 -1 osd.2 284 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e282) 2019-12-08T18:01:14.913 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T18:01:14.907+0000 1694f700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:22.219779+0000 front 2019-12-08T18:00:22.242283+0000 (oldest deadline 2019-12-08T18:01:08.055994+0000) 2019-12-08T18:01:14.923 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T18:01:14.911+0000 1694f700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.158464+0000 front 2019-12-08T18:00:20.177584+0000 (oldest deadline 2019-12-08T18:01:05.984388+0000) 2019-12-08T18:01:15.183 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T18:01:15.178+0000 1694f700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:17.958349+0000 front 2019-12-08T18:00:23.251164+0000 (oldest deadline 2019-12-08T18:01:03.221050+0000) 2019-12-08T18:01:15.235 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T18:01:15.230+0000 1694f700 -1 osd.5 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.021041+0000 front 2019-12-08T18:00:23.016009+0000 (oldest deadline 2019-12-08T18:01:06.454925+0000) 2019-12-08T18:01:15.289 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T18:01:15.287+0000 1694f700 -1 osd.3 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.498597+0000 front 2019-12-08T18:00:18.793327+0000 (oldest deadline 2019-12-08T18:01:03.483865+0000) 2019-12-08T18:01:15.444 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T18:01:15.442+0000 1694f700 -1 osd.0 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.839500+0000 front 2019-12-08T18:00:20.962196+0000 (oldest deadline 2019-12-08T18:01:04.861422+0000) 2019-12-08T18:01:15.785 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:01:15.784+0000 1694f700 -1 osd.2 284 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e282) 2019-12-08T18:01:15.884 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T18:01:15.879+0000 1694f700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:22.219779+0000 front 2019-12-08T18:00:22.242283+0000 (oldest deadline 2019-12-08T18:01:08.055994+0000) 2019-12-08T18:01:15.896 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T18:01:15.891+0000 1694f700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.158464+0000 front 2019-12-08T18:00:20.177584+0000 (oldest deadline 2019-12-08T18:01:05.984388+0000) 2019-12-08T18:01:16.148 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T18:01:16.144+0000 1694f700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:17.958349+0000 front 2019-12-08T18:00:23.251164+0000 (oldest deadline 2019-12-08T18:01:03.221050+0000) 2019-12-08T18:01:16.202 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T18:01:16.197+0000 1694f700 -1 osd.5 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.021041+0000 front 2019-12-08T18:00:23.016009+0000 (oldest deadline 2019-12-08T18:01:06.454925+0000) 2019-12-08T18:01:16.315 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T18:01:16.314+0000 1694f700 -1 osd.3 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.498597+0000 front 2019-12-08T18:00:18.793327+0000 (oldest deadline 2019-12-08T18:01:03.483865+0000) 2019-12-08T18:01:16.421 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T18:01:16.420+0000 1694f700 -1 osd.0 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.839500+0000 front 2019-12-08T18:00:20.962196+0000 (oldest deadline 2019-12-08T18:01:04.861422+0000) 2019-12-08T18:01:16.804 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:01:16.803+0000 1694f700 -1 osd.2 284 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e282) 2019-12-08T18:01:16.891 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T18:01:16.885+0000 1694f700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:22.219779+0000 front 2019-12-08T18:00:22.242283+0000 (oldest deadline 2019-12-08T18:01:08.055994+0000) 2019-12-08T18:01:16.932 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T18:01:16.927+0000 1694f700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.158464+0000 front 2019-12-08T18:00:20.177584+0000 (oldest deadline 2019-12-08T18:01:05.984388+0000) 2019-12-08T18:01:17.146 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T18:01:17.141+0000 1694f700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:17.958349+0000 front 2019-12-08T18:00:23.251164+0000 (oldest deadline 2019-12-08T18:01:03.221050+0000) 2019-12-08T18:01:17.177 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T18:01:17.173+0000 1694f700 -1 osd.5 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.021041+0000 front 2019-12-08T18:00:23.016009+0000 (oldest deadline 2019-12-08T18:01:06.454925+0000) 2019-12-08T18:01:17.366 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T18:01:17.364+0000 1694f700 -1 osd.3 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.498597+0000 front 2019-12-08T18:00:18.793327+0000 (oldest deadline 2019-12-08T18:01:03.483865+0000) 2019-12-08T18:01:17.408 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T18:01:17.403+0000 1694f700 -1 osd.0 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.839500+0000 front 2019-12-08T18:00:20.962196+0000 (oldest deadline 2019-12-08T18:01:04.861422+0000) 2019-12-08T18:01:17.779 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:01:17.778+0000 1694f700 -1 osd.2 284 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e282) 2019-12-08T18:01:17.899 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T18:01:17.893+0000 1694f700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:22.219779+0000 front 2019-12-08T18:00:22.242283+0000 (oldest deadline 2019-12-08T18:01:08.055994+0000) 2019-12-08T18:01:17.915 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T18:01:17.910+0000 1694f700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.158464+0000 front 2019-12-08T18:00:20.177584+0000 (oldest deadline 2019-12-08T18:01:05.984388+0000) 2019-12-08T18:01:18.115 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T18:01:18.110+0000 1694f700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:17.958349+0000 front 2019-12-08T18:00:23.251164+0000 (oldest deadline 2019-12-08T18:01:03.221050+0000) 2019-12-08T18:01:18.191 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T18:01:18.186+0000 1694f700 -1 osd.5 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.021041+0000 front 2019-12-08T18:00:23.016009+0000 (oldest deadline 2019-12-08T18:01:06.454925+0000) 2019-12-08T18:01:18.396 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T18:01:18.392+0000 1694f700 -1 osd.3 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.498597+0000 front 2019-12-08T18:00:18.793327+0000 (oldest deadline 2019-12-08T18:01:03.483865+0000) 2019-12-08T18:01:18.429 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T18:01:18.426+0000 1694f700 -1 osd.0 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.839500+0000 front 2019-12-08T18:00:20.962196+0000 (oldest deadline 2019-12-08T18:01:04.861422+0000) 2019-12-08T18:01:18.744 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:01:18.743+0000 1694f700 -1 osd.2 284 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e282) 2019-12-08T18:01:18.874 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T18:01:18.869+0000 1694f700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:22.219779+0000 front 2019-12-08T18:00:22.242283+0000 (oldest deadline 2019-12-08T18:01:08.055994+0000) 2019-12-08T18:01:18.875 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T18:01:18.869+0000 1694f700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.158464+0000 front 2019-12-08T18:00:20.177584+0000 (oldest deadline 2019-12-08T18:01:05.984388+0000) 2019-12-08T18:01:19.127 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T18:01:19.122+0000 1694f700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:17.958349+0000 front 2019-12-08T18:00:23.251164+0000 (oldest deadline 2019-12-08T18:01:03.221050+0000) 2019-12-08T18:01:19.226 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T18:01:19.220+0000 1694f700 -1 osd.5 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.021041+0000 front 2019-12-08T18:00:23.016009+0000 (oldest deadline 2019-12-08T18:01:06.454925+0000) 2019-12-08T18:01:19.372 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T18:01:19.370+0000 1694f700 -1 osd.3 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.498597+0000 front 2019-12-08T18:00:18.793327+0000 (oldest deadline 2019-12-08T18:01:03.483865+0000) 2019-12-08T18:01:19.459 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T18:01:19.457+0000 1694f700 -1 osd.0 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.839500+0000 front 2019-12-08T18:00:20.962196+0000 (oldest deadline 2019-12-08T18:01:04.861422+0000) 2019-12-08T18:01:19.735 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:01:19.735+0000 1694f700 -1 osd.2 284 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e282) 2019-12-08T18:01:19.836 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T18:01:19.830+0000 1694f700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:22.219779+0000 front 2019-12-08T18:00:22.242283+0000 (oldest deadline 2019-12-08T18:01:08.055994+0000) 2019-12-08T18:01:19.887 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T18:01:19.882+0000 1694f700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.158464+0000 front 2019-12-08T18:00:20.177584+0000 (oldest deadline 2019-12-08T18:01:05.984388+0000) 2019-12-08T18:01:20.134 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T18:01:20.128+0000 1694f700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:17.958349+0000 front 2019-12-08T18:00:23.251164+0000 (oldest deadline 2019-12-08T18:01:03.221050+0000) 2019-12-08T18:01:20.278 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T18:01:20.273+0000 1694f700 -1 osd.5 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.021041+0000 front 2019-12-08T18:00:23.016009+0000 (oldest deadline 2019-12-08T18:01:06.454925+0000) 2019-12-08T18:01:20.420 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T18:01:20.417+0000 1694f700 -1 osd.3 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.498597+0000 front 2019-12-08T18:00:18.793327+0000 (oldest deadline 2019-12-08T18:01:03.483865+0000) 2019-12-08T18:01:20.431 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T18:01:20.428+0000 1694f700 -1 osd.0 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.839500+0000 front 2019-12-08T18:00:20.962196+0000 (oldest deadline 2019-12-08T18:01:04.861422+0000) 2019-12-08T18:01:20.775 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:01:20.772+0000 1694f700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T18:00:40.420281+0000 (oldest deadline 2019-12-08T18:01:20.420281+0000) 2019-12-08T18:01:20.776 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:01:20.775+0000 1694f700 -1 osd.2 284 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e282) 2019-12-08T18:01:20.860 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T18:01:20.855+0000 1694f700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.158464+0000 front 2019-12-08T18:00:20.177584+0000 (oldest deadline 2019-12-08T18:01:05.984388+0000) 2019-12-08T18:01:20.873 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T18:01:20.868+0000 1694f700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:22.219779+0000 front 2019-12-08T18:00:22.242283+0000 (oldest deadline 2019-12-08T18:01:08.055994+0000) 2019-12-08T18:01:21.136 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T18:01:21.131+0000 1694f700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:17.958349+0000 front 2019-12-08T18:00:23.251164+0000 (oldest deadline 2019-12-08T18:01:03.221050+0000) 2019-12-08T18:01:21.293 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T18:01:21.288+0000 1694f700 -1 osd.5 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.021041+0000 front 2019-12-08T18:00:23.016009+0000 (oldest deadline 2019-12-08T18:01:06.454925+0000) 2019-12-08T18:01:21.386 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T18:01:21.385+0000 1694f700 -1 osd.3 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.498597+0000 front 2019-12-08T18:00:18.793327+0000 (oldest deadline 2019-12-08T18:01:03.483865+0000) 2019-12-08T18:01:21.420 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T18:01:21.419+0000 1694f700 -1 osd.0 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.839500+0000 front 2019-12-08T18:00:20.962196+0000 (oldest deadline 2019-12-08T18:01:04.861422+0000) 2019-12-08T18:01:21.817 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:01:21.815+0000 1694f700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T18:00:40.420281+0000 (oldest deadline 2019-12-08T18:01:20.420281+0000) 2019-12-08T18:01:21.818 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:01:21.817+0000 1694f700 -1 osd.2 284 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e282) 2019-12-08T18:01:21.843 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T18:01:21.836+0000 1694f700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.158464+0000 front 2019-12-08T18:00:20.177584+0000 (oldest deadline 2019-12-08T18:01:05.984388+0000) 2019-12-08T18:01:21.918 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T18:01:21.913+0000 1694f700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:22.219779+0000 front 2019-12-08T18:00:22.242283+0000 (oldest deadline 2019-12-08T18:01:08.055994+0000) 2019-12-08T18:01:22.184 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T18:01:22.179+0000 1694f700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:17.958349+0000 front 2019-12-08T18:00:23.251164+0000 (oldest deadline 2019-12-08T18:01:03.221050+0000) 2019-12-08T18:01:22.332 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T18:01:22.327+0000 1694f700 -1 osd.5 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.021041+0000 front 2019-12-08T18:00:23.016009+0000 (oldest deadline 2019-12-08T18:01:06.454925+0000) 2019-12-08T18:01:22.388 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T18:01:22.386+0000 1694f700 -1 osd.0 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.839500+0000 front 2019-12-08T18:00:20.962196+0000 (oldest deadline 2019-12-08T18:01:04.861422+0000) 2019-12-08T18:01:22.405 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T18:01:22.403+0000 1694f700 -1 osd.3 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.498597+0000 front 2019-12-08T18:00:18.793327+0000 (oldest deadline 2019-12-08T18:01:03.483865+0000) 2019-12-08T18:01:22.818 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T18:01:22.812+0000 1694f700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.158464+0000 front 2019-12-08T18:00:20.177584+0000 (oldest deadline 2019-12-08T18:01:05.984388+0000) 2019-12-08T18:01:22.820 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:01:22.819+0000 1694f700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T18:00:40.420281+0000 (oldest deadline 2019-12-08T18:01:20.420281+0000) 2019-12-08T18:01:22.823 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:01:22.822+0000 1694f700 -1 osd.2 284 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e282) 2019-12-08T18:01:22.922 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T18:01:22.917+0000 1694f700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:22.219779+0000 front 2019-12-08T18:00:22.242283+0000 (oldest deadline 2019-12-08T18:01:08.055994+0000) 2019-12-08T18:01:23.229 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T18:01:23.224+0000 1694f700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:17.958349+0000 front 2019-12-08T18:00:23.251164+0000 (oldest deadline 2019-12-08T18:01:03.221050+0000) 2019-12-08T18:01:23.336 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T18:01:23.331+0000 1694f700 -1 osd.5 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.021041+0000 front 2019-12-08T18:00:23.016009+0000 (oldest deadline 2019-12-08T18:01:06.454925+0000) 2019-12-08T18:01:23.383 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T18:01:23.380+0000 1694f700 -1 osd.0 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.839500+0000 front 2019-12-08T18:00:20.962196+0000 (oldest deadline 2019-12-08T18:01:04.861422+0000) 2019-12-08T18:01:23.407 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T18:01:23.403+0000 1694f700 -1 osd.3 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.498597+0000 front 2019-12-08T18:00:18.793327+0000 (oldest deadline 2019-12-08T18:01:03.483865+0000) 2019-12-08T18:01:23.811 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T18:01:23.807+0000 1694f700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.158464+0000 front 2019-12-08T18:00:20.177584+0000 (oldest deadline 2019-12-08T18:01:05.984388+0000) 2019-12-08T18:01:23.818 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:01:23.813+0000 1694f700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T18:00:40.420281+0000 (oldest deadline 2019-12-08T18:01:20.420281+0000) 2019-12-08T18:01:23.818 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:01:23.818+0000 1694f700 -1 osd.2 284 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e282) 2019-12-08T18:01:23.924 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T18:01:23.919+0000 1694f700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:22.219779+0000 front 2019-12-08T18:00:22.242283+0000 (oldest deadline 2019-12-08T18:01:08.055994+0000) 2019-12-08T18:01:24.217 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T18:01:24.211+0000 1694f700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:17.958349+0000 front 2019-12-08T18:00:23.251164+0000 (oldest deadline 2019-12-08T18:01:03.221050+0000) 2019-12-08T18:01:24.318 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T18:01:24.313+0000 1694f700 -1 osd.5 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.021041+0000 front 2019-12-08T18:00:23.016009+0000 (oldest deadline 2019-12-08T18:01:06.454925+0000) 2019-12-08T18:01:24.399 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T18:01:24.398+0000 1694f700 -1 osd.0 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.839500+0000 front 2019-12-08T18:00:20.962196+0000 (oldest deadline 2019-12-08T18:01:04.861422+0000) 2019-12-08T18:01:24.403 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T18:01:24.402+0000 1694f700 -1 osd.3 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.498597+0000 front 2019-12-08T18:00:18.793327+0000 (oldest deadline 2019-12-08T18:01:03.483865+0000) 2019-12-08T18:01:24.850 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T18:01:24.844+0000 1694f700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.158464+0000 front 2019-12-08T18:00:20.177584+0000 (oldest deadline 2019-12-08T18:01:05.984388+0000) 2019-12-08T18:01:24.859 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:01:24.855+0000 1694f700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T18:00:40.420281+0000 (oldest deadline 2019-12-08T18:01:20.420281+0000) 2019-12-08T18:01:24.860 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:01:24.859+0000 1694f700 -1 osd.2 284 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e282) 2019-12-08T18:01:24.927 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T18:01:24.923+0000 1694f700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:22.219779+0000 front 2019-12-08T18:00:22.242283+0000 (oldest deadline 2019-12-08T18:01:08.055994+0000) 2019-12-08T18:01:25.176 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T18:01:25.171+0000 1694f700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:17.958349+0000 front 2019-12-08T18:00:23.251164+0000 (oldest deadline 2019-12-08T18:01:03.221050+0000) 2019-12-08T18:01:25.288 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T18:01:25.283+0000 1694f700 -1 osd.5 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.021041+0000 front 2019-12-08T18:00:23.016009+0000 (oldest deadline 2019-12-08T18:01:06.454925+0000) 2019-12-08T18:01:25.370 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T18:01:25.367+0000 1694f700 -1 osd.0 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.839500+0000 front 2019-12-08T18:00:20.962196+0000 (oldest deadline 2019-12-08T18:01:04.861422+0000) 2019-12-08T18:01:25.393 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T18:01:25.390+0000 1694f700 -1 osd.3 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.498597+0000 front 2019-12-08T18:00:18.793327+0000 (oldest deadline 2019-12-08T18:01:03.483865+0000) 2019-12-08T18:01:25.812 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T18:01:25.807+0000 1694f700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.158464+0000 front 2019-12-08T18:00:20.177584+0000 (oldest deadline 2019-12-08T18:01:05.984388+0000) 2019-12-08T18:01:25.877 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:01:25.873+0000 1694f700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T18:00:40.420281+0000 (oldest deadline 2019-12-08T18:01:20.420281+0000) 2019-12-08T18:01:25.878 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:01:25.876+0000 1694f700 -1 osd.2 284 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e282) 2019-12-08T18:01:25.887 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T18:01:25.882+0000 1694f700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:22.219779+0000 front 2019-12-08T18:00:22.242283+0000 (oldest deadline 2019-12-08T18:01:08.055994+0000) 2019-12-08T18:01:26.191 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T18:01:26.186+0000 1694f700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:17.958349+0000 front 2019-12-08T18:00:23.251164+0000 (oldest deadline 2019-12-08T18:01:03.221050+0000) 2019-12-08T18:01:26.308 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T18:01:26.303+0000 1694f700 -1 osd.5 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.021041+0000 front 2019-12-08T18:00:23.016009+0000 (oldest deadline 2019-12-08T18:01:06.454925+0000) 2019-12-08T18:01:26.330 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T18:01:26.327+0000 1694f700 -1 osd.0 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.839500+0000 front 2019-12-08T18:00:20.962196+0000 (oldest deadline 2019-12-08T18:01:04.861422+0000) 2019-12-08T18:01:26.402 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T18:01:26.400+0000 1694f700 -1 osd.3 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.498597+0000 front 2019-12-08T18:00:18.793327+0000 (oldest deadline 2019-12-08T18:01:03.483865+0000) 2019-12-08T18:01:26.789 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T18:01:26.784+0000 1694f700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.158464+0000 front 2019-12-08T18:00:20.177584+0000 (oldest deadline 2019-12-08T18:01:05.984388+0000) 2019-12-08T18:01:26.899 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:01:26.897+0000 1694f700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T18:00:40.420281+0000 (oldest deadline 2019-12-08T18:01:20.420281+0000) 2019-12-08T18:01:26.900 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:01:26.899+0000 1694f700 -1 osd.2 284 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e282) 2019-12-08T18:01:26.931 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T18:01:26.925+0000 1694f700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:22.219779+0000 front 2019-12-08T18:00:22.242283+0000 (oldest deadline 2019-12-08T18:01:08.055994+0000) 2019-12-08T18:01:27.164 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T18:01:27.160+0000 1694f700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:17.958349+0000 front 2019-12-08T18:00:23.251164+0000 (oldest deadline 2019-12-08T18:01:03.221050+0000) 2019-12-08T18:01:27.353 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T18:01:27.348+0000 1694f700 -1 osd.5 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.021041+0000 front 2019-12-08T18:00:23.016009+0000 (oldest deadline 2019-12-08T18:01:06.454925+0000) 2019-12-08T18:01:27.379 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T18:01:27.375+0000 1694f700 -1 osd.0 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.839500+0000 front 2019-12-08T18:00:20.962196+0000 (oldest deadline 2019-12-08T18:01:04.861422+0000) 2019-12-08T18:01:27.418 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T18:01:27.416+0000 1694f700 -1 osd.3 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.498597+0000 front 2019-12-08T18:00:18.793327+0000 (oldest deadline 2019-12-08T18:01:03.483865+0000) 2019-12-08T18:01:27.757 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T18:01:27.751+0000 1694f700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.158464+0000 front 2019-12-08T18:00:20.177584+0000 (oldest deadline 2019-12-08T18:01:05.984388+0000) 2019-12-08T18:01:27.893 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:01:27.890+0000 1694f700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T18:00:40.420281+0000 (oldest deadline 2019-12-08T18:01:20.420281+0000) 2019-12-08T18:01:27.894 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:01:27.892+0000 1694f700 -1 osd.2 284 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e282) 2019-12-08T18:01:27.963 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T18:01:27.959+0000 1694f700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:22.219779+0000 front 2019-12-08T18:00:22.242283+0000 (oldest deadline 2019-12-08T18:01:08.055994+0000) 2019-12-08T18:01:28.178 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T18:01:28.173+0000 1694f700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:17.958349+0000 front 2019-12-08T18:00:23.251164+0000 (oldest deadline 2019-12-08T18:01:03.221050+0000) 2019-12-08T18:01:28.390 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T18:01:28.385+0000 1694f700 -1 osd.5 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.021041+0000 front 2019-12-08T18:00:23.016009+0000 (oldest deadline 2019-12-08T18:01:06.454925+0000) 2019-12-08T18:01:28.420 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T18:01:28.417+0000 1694f700 -1 osd.0 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.839500+0000 front 2019-12-08T18:00:20.962196+0000 (oldest deadline 2019-12-08T18:01:04.861422+0000) 2019-12-08T18:01:28.463 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T18:01:28.460+0000 1694f700 -1 osd.3 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.498597+0000 front 2019-12-08T18:00:18.793327+0000 (oldest deadline 2019-12-08T18:01:03.483865+0000) 2019-12-08T18:01:28.795 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T18:01:28.790+0000 1694f700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.158464+0000 front 2019-12-08T18:00:20.177584+0000 (oldest deadline 2019-12-08T18:01:05.984388+0000) 2019-12-08T18:01:28.912 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:01:28.910+0000 1694f700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T18:00:40.420281+0000 (oldest deadline 2019-12-08T18:01:20.420281+0000) 2019-12-08T18:01:28.915 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:01:28.914+0000 1694f700 -1 osd.2 284 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e282) 2019-12-08T18:01:28.991 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T18:01:28.981+0000 1694f700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:22.219779+0000 front 2019-12-08T18:00:22.242283+0000 (oldest deadline 2019-12-08T18:01:08.055994+0000) 2019-12-08T18:01:29.162 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T18:01:29.156+0000 1694f700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:17.958349+0000 front 2019-12-08T18:00:23.251164+0000 (oldest deadline 2019-12-08T18:01:03.221050+0000) 2019-12-08T18:01:29.398 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T18:01:29.393+0000 1694f700 -1 osd.5 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.021041+0000 front 2019-12-08T18:00:23.016009+0000 (oldest deadline 2019-12-08T18:01:06.454925+0000) 2019-12-08T18:01:29.416 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T18:01:29.414+0000 1694f700 -1 osd.0 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.839500+0000 front 2019-12-08T18:00:20.962196+0000 (oldest deadline 2019-12-08T18:01:04.861422+0000) 2019-12-08T18:01:29.486 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T18:01:29.485+0000 1694f700 -1 osd.3 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.498597+0000 front 2019-12-08T18:00:18.793327+0000 (oldest deadline 2019-12-08T18:01:03.483865+0000) 2019-12-08T18:01:29.842 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T18:01:29.837+0000 1694f700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.158464+0000 front 2019-12-08T18:00:20.177584+0000 (oldest deadline 2019-12-08T18:01:05.984388+0000) 2019-12-08T18:01:29.910 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:01:29.907+0000 1694f700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T18:00:40.420281+0000 (oldest deadline 2019-12-08T18:01:20.420281+0000) 2019-12-08T18:01:29.911 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:01:29.910+0000 1694f700 -1 osd.2 284 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e282) 2019-12-08T18:01:29.985 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T18:01:29.981+0000 1694f700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:22.219779+0000 front 2019-12-08T18:00:22.242283+0000 (oldest deadline 2019-12-08T18:01:08.055994+0000) 2019-12-08T18:01:30.117 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T18:01:30.112+0000 1694f700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:17.958349+0000 front 2019-12-08T18:00:23.251164+0000 (oldest deadline 2019-12-08T18:01:03.221050+0000) 2019-12-08T18:01:30.372 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T18:01:30.369+0000 1694f700 -1 osd.0 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.839500+0000 front 2019-12-08T18:00:20.962196+0000 (oldest deadline 2019-12-08T18:01:04.861422+0000) 2019-12-08T18:01:30.383 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T18:01:30.378+0000 1694f700 -1 osd.5 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.021041+0000 front 2019-12-08T18:00:23.016009+0000 (oldest deadline 2019-12-08T18:01:06.454925+0000) 2019-12-08T18:01:30.445 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T18:01:30.443+0000 1694f700 -1 osd.3 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.498597+0000 front 2019-12-08T18:00:18.793327+0000 (oldest deadline 2019-12-08T18:01:03.483865+0000) 2019-12-08T18:01:30.864 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T18:01:30.859+0000 1694f700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.158464+0000 front 2019-12-08T18:00:20.177584+0000 (oldest deadline 2019-12-08T18:01:05.984388+0000) 2019-12-08T18:01:30.878 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:01:30.875+0000 1694f700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T18:00:40.420281+0000 (oldest deadline 2019-12-08T18:01:20.420281+0000) 2019-12-08T18:01:30.879 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:01:30.877+0000 1694f700 -1 osd.2 284 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e282) 2019-12-08T18:01:30.978 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T18:01:30.973+0000 1694f700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:22.219779+0000 front 2019-12-08T18:00:22.242283+0000 (oldest deadline 2019-12-08T18:01:08.055994+0000) 2019-12-08T18:01:31.150 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T18:01:31.145+0000 1694f700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:17.958349+0000 front 2019-12-08T18:00:23.251164+0000 (oldest deadline 2019-12-08T18:01:03.221050+0000) 2019-12-08T18:01:31.356 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T18:01:31.351+0000 1694f700 -1 osd.5 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.021041+0000 front 2019-12-08T18:00:23.016009+0000 (oldest deadline 2019-12-08T18:01:06.454925+0000) 2019-12-08T18:01:31.386 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T18:01:31.383+0000 1694f700 -1 osd.0 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.839500+0000 front 2019-12-08T18:00:20.962196+0000 (oldest deadline 2019-12-08T18:01:04.861422+0000) 2019-12-08T18:01:31.495 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T18:01:31.492+0000 1694f700 -1 osd.3 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.498597+0000 front 2019-12-08T18:00:18.793327+0000 (oldest deadline 2019-12-08T18:01:03.483865+0000) 2019-12-08T18:01:31.869 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T18:01:31.862+0000 1694f700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.158464+0000 front 2019-12-08T18:00:20.177584+0000 (oldest deadline 2019-12-08T18:01:05.984388+0000) 2019-12-08T18:01:31.920 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:01:31.919+0000 1694f700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T18:00:40.420281+0000 (oldest deadline 2019-12-08T18:01:20.420281+0000) 2019-12-08T18:01:31.924 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:01:31.923+0000 1694f700 -1 osd.2 284 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e282) 2019-12-08T18:01:31.993 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T18:01:31.987+0000 1694f700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:22.219779+0000 front 2019-12-08T18:00:22.242283+0000 (oldest deadline 2019-12-08T18:01:08.055994+0000) 2019-12-08T18:01:32.153 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T18:01:32.149+0000 1694f700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:17.958349+0000 front 2019-12-08T18:00:23.251164+0000 (oldest deadline 2019-12-08T18:01:03.221050+0000) 2019-12-08T18:01:32.407 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T18:01:32.402+0000 1694f700 -1 osd.5 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.021041+0000 front 2019-12-08T18:00:23.016009+0000 (oldest deadline 2019-12-08T18:01:06.454925+0000) 2019-12-08T18:01:32.418 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T18:01:32.415+0000 1694f700 -1 osd.0 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.839500+0000 front 2019-12-08T18:00:20.962196+0000 (oldest deadline 2019-12-08T18:01:04.861422+0000) 2019-12-08T18:01:32.523 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T18:01:32.521+0000 1694f700 -1 osd.3 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.498597+0000 front 2019-12-08T18:00:18.793327+0000 (oldest deadline 2019-12-08T18:01:03.483865+0000) 2019-12-08T18:01:32.548 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:05:58:57.251 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T18:01:32.553 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:05:58:57.257 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T18:01:32.574 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:05:58:57.209 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T18:01:32.579 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:05:58:57.214 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T18:01:32.580 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:05:58:57.215 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T18:01:32.593 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:05:58:57.228 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T18:01:32.832 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:05:58:57.466 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T18:01:32.854 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:05:58:57.557 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T18:01:32.861 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:05:58:57.495 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T18:01:32.877 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T18:01:32.873+0000 1694f700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.158464+0000 front 2019-12-08T18:00:20.177584+0000 (oldest deadline 2019-12-08T18:01:05.984388+0000) 2019-12-08T18:01:32.966 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:01:32.964+0000 1694f700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T18:00:40.420281+0000 (oldest deadline 2019-12-08T18:01:20.420281+0000) 2019-12-08T18:01:32.966 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:01:32.966+0000 1694f700 -1 osd.2 284 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e282) 2019-12-08T18:01:33.030 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T18:01:33.025+0000 1694f700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:22.219779+0000 front 2019-12-08T18:00:22.242283+0000 (oldest deadline 2019-12-08T18:01:08.055994+0000) 2019-12-08T18:01:33.166 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T18:01:33.162+0000 1694f700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:17.958349+0000 front 2019-12-08T18:00:23.251164+0000 (oldest deadline 2019-12-08T18:01:03.221050+0000) 2019-12-08T18:01:33.416 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T18:01:33.410+0000 1694f700 -1 osd.5 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.021041+0000 front 2019-12-08T18:00:23.016009+0000 (oldest deadline 2019-12-08T18:01:06.454925+0000) 2019-12-08T18:01:33.428 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T18:01:33.427+0000 1694f700 -1 osd.0 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.839500+0000 front 2019-12-08T18:00:20.962196+0000 (oldest deadline 2019-12-08T18:01:04.861422+0000) 2019-12-08T18:01:33.550 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T18:01:33.548+0000 1694f700 -1 osd.3 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.498597+0000 front 2019-12-08T18:00:18.793327+0000 (oldest deadline 2019-12-08T18:01:03.483865+0000) 2019-12-08T18:01:33.884 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T18:01:33.879+0000 1694f700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.158464+0000 front 2019-12-08T18:00:20.177584+0000 (oldest deadline 2019-12-08T18:01:05.984388+0000) 2019-12-08T18:01:33.989 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:01:33.987+0000 1694f700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T18:00:40.420281+0000 (oldest deadline 2019-12-08T18:01:20.420281+0000) 2019-12-08T18:01:33.990 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:01:33.989+0000 1694f700 -1 osd.2 284 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e282) 2019-12-08T18:01:34.082 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T18:01:34.079+0000 1694f700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:22.219779+0000 front 2019-12-08T18:00:22.242283+0000 (oldest deadline 2019-12-08T18:01:08.055994+0000) 2019-12-08T18:01:34.190 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T18:01:34.185+0000 1694f700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:17.958349+0000 front 2019-12-08T18:00:23.251164+0000 (oldest deadline 2019-12-08T18:01:03.221050+0000) 2019-12-08T18:01:34.405 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T18:01:34.403+0000 1694f700 -1 osd.0 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.839500+0000 front 2019-12-08T18:00:20.962196+0000 (oldest deadline 2019-12-08T18:01:04.861422+0000) 2019-12-08T18:01:34.425 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T18:01:34.418+0000 1694f700 -1 osd.5 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.021041+0000 front 2019-12-08T18:00:23.016009+0000 (oldest deadline 2019-12-08T18:01:06.454925+0000) 2019-12-08T18:01:34.584 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T18:01:34.581+0000 1694f700 -1 osd.3 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.498597+0000 front 2019-12-08T18:00:18.793327+0000 (oldest deadline 2019-12-08T18:01:03.483865+0000) 2019-12-08T18:01:34.901 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T18:01:34.896+0000 1694f700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.158464+0000 front 2019-12-08T18:00:20.177584+0000 (oldest deadline 2019-12-08T18:01:05.984388+0000) 2019-12-08T18:01:35.027 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:01:35.024+0000 1694f700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T18:00:40.420281+0000 (oldest deadline 2019-12-08T18:01:20.420281+0000) 2019-12-08T18:01:35.028 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:01:35.026+0000 1694f700 -1 osd.2 284 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e282) 2019-12-08T18:01:35.101 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T18:01:35.096+0000 1694f700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:22.219779+0000 front 2019-12-08T18:00:22.242283+0000 (oldest deadline 2019-12-08T18:01:08.055994+0000) 2019-12-08T18:01:35.240 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T18:01:35.233+0000 1694f700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:17.958349+0000 front 2019-12-08T18:00:23.251164+0000 (oldest deadline 2019-12-08T18:01:03.221050+0000) 2019-12-08T18:01:35.396 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T18:01:35.390+0000 1694f700 -1 osd.5 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.021041+0000 front 2019-12-08T18:00:23.016009+0000 (oldest deadline 2019-12-08T18:01:06.454925+0000) 2019-12-08T18:01:35.410 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T18:01:35.408+0000 1694f700 -1 osd.0 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.839500+0000 front 2019-12-08T18:00:20.962196+0000 (oldest deadline 2019-12-08T18:01:04.861422+0000) 2019-12-08T18:01:35.626 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T18:01:35.624+0000 1694f700 -1 osd.3 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.498597+0000 front 2019-12-08T18:00:18.793327+0000 (oldest deadline 2019-12-08T18:01:03.483865+0000) 2019-12-08T18:01:35.907 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T18:01:35.902+0000 1694f700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.158464+0000 front 2019-12-08T18:00:20.177584+0000 (oldest deadline 2019-12-08T18:01:05.984388+0000) 2019-12-08T18:01:36.021 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:01:36.011+0000 1694f700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T18:00:40.420281+0000 (oldest deadline 2019-12-08T18:01:20.420281+0000) 2019-12-08T18:01:36.021 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:01:36.015+0000 1694f700 -1 osd.2 284 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e282) 2019-12-08T18:01:36.127 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T18:01:36.123+0000 1694f700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:22.219779+0000 front 2019-12-08T18:00:22.242283+0000 (oldest deadline 2019-12-08T18:01:08.055994+0000) 2019-12-08T18:01:36.198 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T18:01:36.193+0000 1694f700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:17.958349+0000 front 2019-12-08T18:00:23.251164+0000 (oldest deadline 2019-12-08T18:01:03.221050+0000) 2019-12-08T18:01:36.419 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T18:01:36.416+0000 1694f700 -1 osd.0 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.839500+0000 front 2019-12-08T18:00:20.962196+0000 (oldest deadline 2019-12-08T18:01:04.861422+0000) 2019-12-08T18:01:36.446 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T18:01:36.441+0000 1694f700 -1 osd.5 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.021041+0000 front 2019-12-08T18:00:23.016009+0000 (oldest deadline 2019-12-08T18:01:06.454925+0000) 2019-12-08T18:01:36.597 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T18:01:36.596+0000 1694f700 -1 osd.3 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.498597+0000 front 2019-12-08T18:00:18.793327+0000 (oldest deadline 2019-12-08T18:01:03.483865+0000) 2019-12-08T18:01:36.914 INFO:tasks.ceph.mon.b.smithi013.stderr:2019-12-08T18:01:36.908+0000 1a89c700 -1 mon.b@0(leader) e1 get_health_metrics reporting 1 slow ops, oldest is osd_failure(failed timeout osd.1 [v2:172.21.15.79:6810/10449,v1:172.21.15.79:6811/10449] for 47sec e284 v284) 2019-12-08T18:01:36.923 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T18:01:36.917+0000 1694f700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.158464+0000 front 2019-12-08T18:00:20.177584+0000 (oldest deadline 2019-12-08T18:01:05.984388+0000) 2019-12-08T18:01:37.012 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:01:37.010+0000 1694f700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T18:00:40.420281+0000 (oldest deadline 2019-12-08T18:01:20.420281+0000) 2019-12-08T18:01:37.014 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:01:37.012+0000 1694f700 -1 osd.2 284 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e282) 2019-12-08T18:01:37.099 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T18:01:37.094+0000 1694f700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:22.219779+0000 front 2019-12-08T18:00:22.242283+0000 (oldest deadline 2019-12-08T18:01:08.055994+0000) 2019-12-08T18:01:37.236 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T18:01:37.229+0000 1694f700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:17.958349+0000 front 2019-12-08T18:00:23.251164+0000 (oldest deadline 2019-12-08T18:01:03.221050+0000) 2019-12-08T18:01:37.416 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T18:01:37.414+0000 1694f700 -1 osd.0 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.839500+0000 front 2019-12-08T18:00:20.962196+0000 (oldest deadline 2019-12-08T18:01:04.861422+0000) 2019-12-08T18:01:37.493 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T18:01:37.488+0000 1694f700 -1 osd.5 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.021041+0000 front 2019-12-08T18:00:23.016009+0000 (oldest deadline 2019-12-08T18:01:06.454925+0000) 2019-12-08T18:01:37.640 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T18:01:37.636+0000 1694f700 -1 osd.3 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.498597+0000 front 2019-12-08T18:00:18.793327+0000 (oldest deadline 2019-12-08T18:01:03.483865+0000) 2019-12-08T18:01:37.894 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T18:01:37.888+0000 1694f700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.158464+0000 front 2019-12-08T18:00:20.177584+0000 (oldest deadline 2019-12-08T18:01:05.984388+0000) 2019-12-08T18:01:38.010 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:01:38.008+0000 1694f700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T18:00:40.420281+0000 (oldest deadline 2019-12-08T18:01:20.420281+0000) 2019-12-08T18:01:38.014 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:01:38.013+0000 1694f700 -1 osd.2 284 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e282) 2019-12-08T18:01:38.151 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T18:01:38.144+0000 1694f700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:22.219779+0000 front 2019-12-08T18:00:22.242283+0000 (oldest deadline 2019-12-08T18:01:08.055994+0000) 2019-12-08T18:01:38.203 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T18:01:38.198+0000 1694f700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:17.958349+0000 front 2019-12-08T18:00:23.251164+0000 (oldest deadline 2019-12-08T18:01:03.221050+0000) 2019-12-08T18:01:38.381 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T18:01:38.372+0000 1694f700 -1 osd.0 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.839500+0000 front 2019-12-08T18:00:20.962196+0000 (oldest deadline 2019-12-08T18:01:04.861422+0000) 2019-12-08T18:01:38.518 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T18:01:38.513+0000 1694f700 -1 osd.5 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.021041+0000 front 2019-12-08T18:00:23.016009+0000 (oldest deadline 2019-12-08T18:01:06.454925+0000) 2019-12-08T18:01:38.606 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T18:01:38.604+0000 1694f700 -1 osd.3 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.498597+0000 front 2019-12-08T18:00:18.793327+0000 (oldest deadline 2019-12-08T18:01:03.483865+0000) 2019-12-08T18:01:38.853 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T18:01:38.848+0000 1694f700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.158464+0000 front 2019-12-08T18:00:20.177584+0000 (oldest deadline 2019-12-08T18:01:05.984388+0000) 2019-12-08T18:01:38.995 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:01:38.990+0000 1694f700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T18:00:40.420281+0000 (oldest deadline 2019-12-08T18:01:20.420281+0000) 2019-12-08T18:01:38.996 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:01:38.994+0000 1694f700 -1 osd.2 284 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e282) 2019-12-08T18:01:39.149 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T18:01:39.143+0000 1694f700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:22.219779+0000 front 2019-12-08T18:00:22.242283+0000 (oldest deadline 2019-12-08T18:01:08.055994+0000) 2019-12-08T18:01:39.193 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T18:01:39.188+0000 1694f700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:17.958349+0000 front 2019-12-08T18:00:23.251164+0000 (oldest deadline 2019-12-08T18:01:03.221050+0000) 2019-12-08T18:01:39.424 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T18:01:39.422+0000 1694f700 -1 osd.0 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.839500+0000 front 2019-12-08T18:00:20.962196+0000 (oldest deadline 2019-12-08T18:01:04.861422+0000) 2019-12-08T18:01:39.553 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T18:01:39.547+0000 1694f700 -1 osd.5 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.021041+0000 front 2019-12-08T18:00:23.016009+0000 (oldest deadline 2019-12-08T18:01:06.454925+0000) 2019-12-08T18:01:39.642 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T18:01:39.640+0000 1694f700 -1 osd.3 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.498597+0000 front 2019-12-08T18:00:18.793327+0000 (oldest deadline 2019-12-08T18:01:03.483865+0000) 2019-12-08T18:01:39.823 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T18:01:39.818+0000 1694f700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.158464+0000 front 2019-12-08T18:00:20.177584+0000 (oldest deadline 2019-12-08T18:01:05.984388+0000) 2019-12-08T18:01:40.025 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:01:40.021+0000 1694f700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T18:00:40.420281+0000 (oldest deadline 2019-12-08T18:01:20.420281+0000) 2019-12-08T18:01:40.025 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:01:40.024+0000 1694f700 -1 osd.2 284 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e282) 2019-12-08T18:01:40.141 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T18:01:40.135+0000 1694f700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:22.219779+0000 front 2019-12-08T18:00:22.242283+0000 (oldest deadline 2019-12-08T18:01:08.055994+0000) 2019-12-08T18:01:40.209 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T18:01:40.204+0000 1694f700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:17.958349+0000 front 2019-12-08T18:00:23.251164+0000 (oldest deadline 2019-12-08T18:01:03.221050+0000) 2019-12-08T18:01:40.471 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T18:01:40.469+0000 1694f700 -1 osd.0 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.839500+0000 front 2019-12-08T18:00:20.962196+0000 (oldest deadline 2019-12-08T18:01:04.861422+0000) 2019-12-08T18:01:40.532 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T18:01:40.524+0000 1694f700 -1 osd.5 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.021041+0000 front 2019-12-08T18:00:23.016009+0000 (oldest deadline 2019-12-08T18:01:06.454925+0000) 2019-12-08T18:01:40.688 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T18:01:40.686+0000 1694f700 -1 osd.3 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.498597+0000 front 2019-12-08T18:00:18.793327+0000 (oldest deadline 2019-12-08T18:01:03.483865+0000) 2019-12-08T18:01:40.786 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T18:01:40.780+0000 1694f700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.158464+0000 front 2019-12-08T18:00:20.177584+0000 (oldest deadline 2019-12-08T18:01:05.984388+0000) 2019-12-08T18:01:41.023 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:01:41.019+0000 1694f700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T18:00:40.420281+0000 (oldest deadline 2019-12-08T18:01:20.420281+0000) 2019-12-08T18:01:41.023 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:01:41.022+0000 1694f700 -1 osd.2 284 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e282) 2019-12-08T18:01:41.104 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T18:01:41.098+0000 1694f700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:22.219779+0000 front 2019-12-08T18:00:22.242283+0000 (oldest deadline 2019-12-08T18:01:08.055994+0000) 2019-12-08T18:01:41.185 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T18:01:41.178+0000 1694f700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:17.958349+0000 front 2019-12-08T18:00:23.251164+0000 (oldest deadline 2019-12-08T18:01:03.221050+0000) 2019-12-08T18:01:41.441 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T18:01:41.439+0000 1694f700 -1 osd.0 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.839500+0000 front 2019-12-08T18:00:20.962196+0000 (oldest deadline 2019-12-08T18:01:04.861422+0000) 2019-12-08T18:01:41.548 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T18:01:41.543+0000 1694f700 -1 osd.5 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.021041+0000 front 2019-12-08T18:00:23.016009+0000 (oldest deadline 2019-12-08T18:01:06.454925+0000) 2019-12-08T18:01:41.657 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T18:01:41.656+0000 1694f700 -1 osd.3 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.498597+0000 front 2019-12-08T18:00:18.793327+0000 (oldest deadline 2019-12-08T18:01:03.483865+0000) 2019-12-08T18:01:41.763 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T18:01:41.758+0000 1694f700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.158464+0000 front 2019-12-08T18:00:20.177584+0000 (oldest deadline 2019-12-08T18:01:05.984388+0000) 2019-12-08T18:01:41.937 INFO:tasks.ceph.mon.b.smithi013.stderr:2019-12-08T18:01:41.931+0000 1a89c700 -1 mon.b@0(leader) e1 get_health_metrics reporting 5 slow ops, oldest is osd_failure(failed timeout osd.1 [v2:172.21.15.79:6810/10449,v1:172.21.15.79:6811/10449] for 47sec e284 v284) 2019-12-08T18:01:42.007 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:01:42.006+0000 1694f700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T18:00:40.420281+0000 (oldest deadline 2019-12-08T18:01:20.420281+0000) 2019-12-08T18:01:42.008 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:01:42.008+0000 1694f700 -1 osd.2 284 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e282) 2019-12-08T18:01:42.106 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T18:01:42.101+0000 1694f700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:22.219779+0000 front 2019-12-08T18:00:22.242283+0000 (oldest deadline 2019-12-08T18:01:08.055994+0000) 2019-12-08T18:01:42.142 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T18:01:42.138+0000 1694f700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:17.958349+0000 front 2019-12-08T18:00:23.251164+0000 (oldest deadline 2019-12-08T18:01:03.221050+0000) 2019-12-08T18:01:42.429 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T18:01:42.428+0000 1694f700 -1 osd.0 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.839500+0000 front 2019-12-08T18:00:20.962196+0000 (oldest deadline 2019-12-08T18:01:04.861422+0000) 2019-12-08T18:01:42.557 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T18:01:42.552+0000 1694f700 -1 osd.5 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.021041+0000 front 2019-12-08T18:00:23.016009+0000 (oldest deadline 2019-12-08T18:01:06.454925+0000) 2019-12-08T18:01:42.643 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T18:01:42.643+0000 1694f700 -1 osd.3 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.498597+0000 front 2019-12-08T18:00:18.793327+0000 (oldest deadline 2019-12-08T18:01:03.483865+0000) 2019-12-08T18:01:42.809 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T18:01:42.804+0000 1694f700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.158464+0000 front 2019-12-08T18:00:20.177584+0000 (oldest deadline 2019-12-08T18:01:05.984388+0000) 2019-12-08T18:01:43.021 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:01:43.020+0000 1694f700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T18:00:40.420281+0000 (oldest deadline 2019-12-08T18:01:20.420281+0000) 2019-12-08T18:01:43.022 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:01:43.022+0000 1694f700 -1 osd.2 284 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e282) 2019-12-08T18:01:43.091 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T18:01:43.086+0000 1694f700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:22.219779+0000 front 2019-12-08T18:00:22.242283+0000 (oldest deadline 2019-12-08T18:01:08.055994+0000) 2019-12-08T18:01:43.195 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T18:01:43.183+0000 1694f700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:17.958349+0000 front 2019-12-08T18:00:23.251164+0000 (oldest deadline 2019-12-08T18:01:03.221050+0000) 2019-12-08T18:01:43.456 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T18:01:43.453+0000 1694f700 -1 osd.0 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.839500+0000 front 2019-12-08T18:00:20.962196+0000 (oldest deadline 2019-12-08T18:01:04.861422+0000) 2019-12-08T18:01:43.514 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T18:01:43.510+0000 1694f700 -1 osd.5 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.021041+0000 front 2019-12-08T18:00:23.016009+0000 (oldest deadline 2019-12-08T18:01:06.454925+0000) 2019-12-08T18:01:43.668 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T18:01:43.667+0000 1694f700 -1 osd.3 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.498597+0000 front 2019-12-08T18:00:18.793327+0000 (oldest deadline 2019-12-08T18:01:03.483865+0000) 2019-12-08T18:01:43.811 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T18:01:43.806+0000 1694f700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.158464+0000 front 2019-12-08T18:00:20.177584+0000 (oldest deadline 2019-12-08T18:01:05.984388+0000) 2019-12-08T18:01:44.047 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:01:44.044+0000 1694f700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T18:00:40.420281+0000 (oldest deadline 2019-12-08T18:01:20.420281+0000) 2019-12-08T18:01:44.048 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:01:44.047+0000 1694f700 -1 osd.2 284 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e282) 2019-12-08T18:01:44.125 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T18:01:44.119+0000 1694f700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:22.219779+0000 front 2019-12-08T18:00:22.242283+0000 (oldest deadline 2019-12-08T18:01:08.055994+0000) 2019-12-08T18:01:44.215 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T18:01:44.210+0000 1694f700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:17.958349+0000 front 2019-12-08T18:00:23.251164+0000 (oldest deadline 2019-12-08T18:01:03.221050+0000) 2019-12-08T18:01:44.456 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T18:01:44.454+0000 1694f700 -1 osd.0 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.839500+0000 front 2019-12-08T18:00:20.962196+0000 (oldest deadline 2019-12-08T18:01:04.861422+0000) 2019-12-08T18:01:44.545 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T18:01:44.540+0000 1694f700 -1 osd.5 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.021041+0000 front 2019-12-08T18:00:23.016009+0000 (oldest deadline 2019-12-08T18:01:06.454925+0000) 2019-12-08T18:01:44.664 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T18:01:44.662+0000 1694f700 -1 osd.3 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.498597+0000 front 2019-12-08T18:00:18.793327+0000 (oldest deadline 2019-12-08T18:01:03.483865+0000) 2019-12-08T18:01:44.799 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T18:01:44.787+0000 1694f700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.158464+0000 front 2019-12-08T18:00:20.177584+0000 (oldest deadline 2019-12-08T18:01:05.984388+0000) 2019-12-08T18:01:45.019 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:01:45.018+0000 1694f700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T18:00:40.420281+0000 (oldest deadline 2019-12-08T18:01:20.420281+0000) 2019-12-08T18:01:45.022 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:01:45.023+0000 1694f700 -1 osd.2 284 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e282) 2019-12-08T18:01:45.087 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T18:01:45.076+0000 1694f700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:22.219779+0000 front 2019-12-08T18:00:22.242283+0000 (oldest deadline 2019-12-08T18:01:08.055994+0000) 2019-12-08T18:01:45.216 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T18:01:45.209+0000 1694f700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:17.958349+0000 front 2019-12-08T18:00:23.251164+0000 (oldest deadline 2019-12-08T18:01:03.221050+0000) 2019-12-08T18:01:45.460 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T18:01:45.458+0000 1694f700 -1 osd.0 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.839500+0000 front 2019-12-08T18:00:20.962196+0000 (oldest deadline 2019-12-08T18:01:04.861422+0000) 2019-12-08T18:01:45.557 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T18:01:45.552+0000 1694f700 -1 osd.5 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.021041+0000 front 2019-12-08T18:00:23.016009+0000 (oldest deadline 2019-12-08T18:01:06.454925+0000) 2019-12-08T18:01:45.706 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T18:01:45.705+0000 1694f700 -1 osd.3 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.498597+0000 front 2019-12-08T18:00:18.793327+0000 (oldest deadline 2019-12-08T18:01:03.483865+0000) 2019-12-08T18:01:45.769 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T18:01:45.765+0000 1694f700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.158464+0000 front 2019-12-08T18:00:20.177584+0000 (oldest deadline 2019-12-08T18:01:05.984388+0000) 2019-12-08T18:01:46.064 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:01:46.062+0000 1694f700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T18:00:40.420281+0000 (oldest deadline 2019-12-08T18:01:20.420281+0000) 2019-12-08T18:01:46.065 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:01:46.065+0000 1694f700 -1 osd.2 284 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e282) 2019-12-08T18:01:46.068 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T18:01:46.064+0000 1694f700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:22.219779+0000 front 2019-12-08T18:00:22.242283+0000 (oldest deadline 2019-12-08T18:01:08.055994+0000) 2019-12-08T18:01:46.193 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T18:01:46.188+0000 1694f700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:17.958349+0000 front 2019-12-08T18:00:23.251164+0000 (oldest deadline 2019-12-08T18:01:03.221050+0000) 2019-12-08T18:01:46.437 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T18:01:46.435+0000 1694f700 -1 osd.0 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.839500+0000 front 2019-12-08T18:00:20.962196+0000 (oldest deadline 2019-12-08T18:01:04.861422+0000) 2019-12-08T18:01:46.586 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T18:01:46.581+0000 1694f700 -1 osd.5 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.021041+0000 front 2019-12-08T18:00:23.016009+0000 (oldest deadline 2019-12-08T18:01:06.454925+0000) 2019-12-08T18:01:46.719 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T18:01:46.718+0000 1694f700 -1 osd.3 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.498597+0000 front 2019-12-08T18:00:18.793327+0000 (oldest deadline 2019-12-08T18:01:03.483865+0000) 2019-12-08T18:01:46.789 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T18:01:46.783+0000 1694f700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.158464+0000 front 2019-12-08T18:00:20.177584+0000 (oldest deadline 2019-12-08T18:01:05.984388+0000) 2019-12-08T18:01:46.958 INFO:tasks.ceph.mon.b.smithi013.stderr:2019-12-08T18:01:46.955+0000 1a89c700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.1 [v2:172.21.15.79:6810/10449,v1:172.21.15.79:6811/10449] for 47sec e284 v284) 2019-12-08T18:01:47.030 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T18:01:47.025+0000 1694f700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:22.219779+0000 front 2019-12-08T18:00:22.242283+0000 (oldest deadline 2019-12-08T18:01:08.055994+0000) 2019-12-08T18:01:47.099 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:01:47.097+0000 1694f700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T18:00:40.420281+0000 (oldest deadline 2019-12-08T18:01:20.420281+0000) 2019-12-08T18:01:47.100 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:01:47.099+0000 1694f700 -1 osd.2 284 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e282) 2019-12-08T18:01:47.214 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T18:01:47.209+0000 1694f700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:17.958349+0000 front 2019-12-08T18:00:23.251164+0000 (oldest deadline 2019-12-08T18:01:03.221050+0000) 2019-12-08T18:01:47.406 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T18:01:47.404+0000 1694f700 -1 osd.0 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.839500+0000 front 2019-12-08T18:00:20.962196+0000 (oldest deadline 2019-12-08T18:01:04.861422+0000) 2019-12-08T18:01:47.626 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T18:01:47.619+0000 1694f700 -1 osd.5 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.021041+0000 front 2019-12-08T18:00:23.016009+0000 (oldest deadline 2019-12-08T18:01:06.454925+0000) 2019-12-08T18:01:47.736 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T18:01:47.734+0000 1694f700 -1 osd.3 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.498597+0000 front 2019-12-08T18:00:18.793327+0000 (oldest deadline 2019-12-08T18:01:03.483865+0000) 2019-12-08T18:01:47.822 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T18:01:47.817+0000 1694f700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.158464+0000 front 2019-12-08T18:00:20.177584+0000 (oldest deadline 2019-12-08T18:01:05.984388+0000) 2019-12-08T18:01:48.010 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T18:01:48.004+0000 1694f700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:22.219779+0000 front 2019-12-08T18:00:22.242283+0000 (oldest deadline 2019-12-08T18:01:08.055994+0000) 2019-12-08T18:01:48.064 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:01:48.064+0000 1694f700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T18:00:40.420281+0000 (oldest deadline 2019-12-08T18:01:20.420281+0000) 2019-12-08T18:01:48.065 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:01:48.065+0000 1694f700 -1 osd.2 284 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e282) 2019-12-08T18:01:48.271 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T18:01:48.266+0000 1694f700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:17.958349+0000 front 2019-12-08T18:00:23.251164+0000 (oldest deadline 2019-12-08T18:01:03.221050+0000) 2019-12-08T18:01:48.372 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T18:01:48.370+0000 1694f700 -1 osd.0 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.839500+0000 front 2019-12-08T18:00:20.962196+0000 (oldest deadline 2019-12-08T18:01:04.861422+0000) 2019-12-08T18:01:48.612 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T18:01:48.607+0000 1694f700 -1 osd.5 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.021041+0000 front 2019-12-08T18:00:23.016009+0000 (oldest deadline 2019-12-08T18:01:06.454925+0000) 2019-12-08T18:01:48.736 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T18:01:48.734+0000 1694f700 -1 osd.3 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.498597+0000 front 2019-12-08T18:00:18.793327+0000 (oldest deadline 2019-12-08T18:01:03.483865+0000) 2019-12-08T18:01:48.869 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T18:01:48.865+0000 1694f700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.158464+0000 front 2019-12-08T18:00:20.177584+0000 (oldest deadline 2019-12-08T18:01:05.984388+0000) 2019-12-08T18:01:49.015 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T18:01:49.010+0000 1694f700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:22.219779+0000 front 2019-12-08T18:00:22.242283+0000 (oldest deadline 2019-12-08T18:01:08.055994+0000) 2019-12-08T18:01:49.095 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:01:49.093+0000 1694f700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T18:00:40.420281+0000 (oldest deadline 2019-12-08T18:01:20.420281+0000) 2019-12-08T18:01:49.097 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:01:49.095+0000 1694f700 -1 osd.2 284 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e282) 2019-12-08T18:01:49.312 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T18:01:49.306+0000 1694f700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:17.958349+0000 front 2019-12-08T18:00:23.251164+0000 (oldest deadline 2019-12-08T18:01:03.221050+0000) 2019-12-08T18:01:49.346 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T18:01:49.344+0000 1694f700 -1 osd.0 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.839500+0000 front 2019-12-08T18:00:20.962196+0000 (oldest deadline 2019-12-08T18:01:04.861422+0000) 2019-12-08T18:01:49.643 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T18:01:49.639+0000 1694f700 -1 osd.5 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.021041+0000 front 2019-12-08T18:00:23.016009+0000 (oldest deadline 2019-12-08T18:01:06.454925+0000) 2019-12-08T18:01:49.723 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T18:01:49.722+0000 1694f700 -1 osd.3 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.498597+0000 front 2019-12-08T18:00:18.793327+0000 (oldest deadline 2019-12-08T18:01:03.483865+0000) 2019-12-08T18:01:49.902 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T18:01:49.896+0000 1694f700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.158464+0000 front 2019-12-08T18:00:20.177584+0000 (oldest deadline 2019-12-08T18:01:05.984388+0000) 2019-12-08T18:01:49.993 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T18:01:49.989+0000 1694f700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:22.219779+0000 front 2019-12-08T18:00:22.242283+0000 (oldest deadline 2019-12-08T18:01:08.055994+0000) 2019-12-08T18:01:50.135 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:01:50.134+0000 1694f700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T18:00:40.420281+0000 (oldest deadline 2019-12-08T18:01:20.420281+0000) 2019-12-08T18:01:50.137 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:01:50.136+0000 1694f700 -1 osd.2 284 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e282) 2019-12-08T18:01:50.279 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T18:01:50.274+0000 1694f700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:17.958349+0000 front 2019-12-08T18:00:23.251164+0000 (oldest deadline 2019-12-08T18:01:03.221050+0000) 2019-12-08T18:01:50.348 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T18:01:50.347+0000 1694f700 -1 osd.0 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.839500+0000 front 2019-12-08T18:00:20.962196+0000 (oldest deadline 2019-12-08T18:01:04.861422+0000) 2019-12-08T18:01:50.653 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T18:01:50.647+0000 1694f700 -1 osd.5 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.021041+0000 front 2019-12-08T18:00:23.016009+0000 (oldest deadline 2019-12-08T18:01:06.454925+0000) 2019-12-08T18:01:50.705 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T18:01:50.704+0000 1694f700 -1 osd.3 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.498597+0000 front 2019-12-08T18:00:18.793327+0000 (oldest deadline 2019-12-08T18:01:03.483865+0000) 2019-12-08T18:01:50.897 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T18:01:50.893+0000 1694f700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.158464+0000 front 2019-12-08T18:00:20.177584+0000 (oldest deadline 2019-12-08T18:01:05.984388+0000) 2019-12-08T18:01:50.962 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T18:01:50.958+0000 1694f700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:22.219779+0000 front 2019-12-08T18:00:22.242283+0000 (oldest deadline 2019-12-08T18:01:08.055994+0000) 2019-12-08T18:01:51.167 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:01:51.165+0000 1694f700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T18:00:40.420281+0000 (oldest deadline 2019-12-08T18:01:20.420281+0000) 2019-12-08T18:01:51.168 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:01:51.168+0000 1694f700 -1 osd.2 284 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e282) 2019-12-08T18:01:51.263 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T18:01:51.258+0000 1694f700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:17.958349+0000 front 2019-12-08T18:00:23.251164+0000 (oldest deadline 2019-12-08T18:01:03.221050+0000) 2019-12-08T18:01:51.370 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T18:01:51.369+0000 1694f700 -1 osd.0 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.839500+0000 front 2019-12-08T18:00:20.962196+0000 (oldest deadline 2019-12-08T18:01:04.861422+0000) 2019-12-08T18:01:51.634 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T18:01:51.630+0000 1694f700 -1 osd.5 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.021041+0000 front 2019-12-08T18:00:23.016009+0000 (oldest deadline 2019-12-08T18:01:06.454925+0000) 2019-12-08T18:01:51.673 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T18:01:51.672+0000 1694f700 -1 osd.3 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.498597+0000 front 2019-12-08T18:00:18.793327+0000 (oldest deadline 2019-12-08T18:01:03.483865+0000) 2019-12-08T18:01:51.934 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T18:01:51.929+0000 1694f700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.158464+0000 front 2019-12-08T18:00:20.177584+0000 (oldest deadline 2019-12-08T18:01:05.984388+0000) 2019-12-08T18:01:51.990 INFO:tasks.ceph.mon.b.smithi013.stderr:2019-12-08T18:01:51.980+0000 1a89c700 -1 mon.b@0(leader) e1 get_health_metrics reporting 6 slow ops, oldest is osd_failure(failed timeout osd.1 [v2:172.21.15.79:6810/10449,v1:172.21.15.79:6811/10449] for 47sec e284 v284) 2019-12-08T18:01:51.993 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T18:01:51.988+0000 1694f700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:22.219779+0000 front 2019-12-08T18:00:22.242283+0000 (oldest deadline 2019-12-08T18:01:08.055994+0000) 2019-12-08T18:01:52.211 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:01:52.210+0000 1694f700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T18:00:40.420281+0000 (oldest deadline 2019-12-08T18:01:20.420281+0000) 2019-12-08T18:01:52.216 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:01:52.212+0000 1694f700 -1 osd.2 284 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e282) 2019-12-08T18:01:52.280 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T18:01:52.276+0000 1694f700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:17.958349+0000 front 2019-12-08T18:00:23.251164+0000 (oldest deadline 2019-12-08T18:01:03.221050+0000) 2019-12-08T18:01:52.383 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T18:01:52.383+0000 1694f700 -1 osd.0 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.839500+0000 front 2019-12-08T18:00:20.962196+0000 (oldest deadline 2019-12-08T18:01:04.861422+0000) 2019-12-08T18:01:52.589 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T18:01:52.585+0000 1694f700 -1 osd.5 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.021041+0000 front 2019-12-08T18:00:23.016009+0000 (oldest deadline 2019-12-08T18:01:06.454925+0000) 2019-12-08T18:01:52.642 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T18:01:52.640+0000 1694f700 -1 osd.3 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.498597+0000 front 2019-12-08T18:00:18.793327+0000 (oldest deadline 2019-12-08T18:01:03.483865+0000) 2019-12-08T18:01:52.977 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T18:01:52.973+0000 1694f700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.158464+0000 front 2019-12-08T18:00:20.177584+0000 (oldest deadline 2019-12-08T18:01:05.984388+0000) 2019-12-08T18:01:52.979 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T18:01:52.974+0000 1694f700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:22.219779+0000 front 2019-12-08T18:00:22.242283+0000 (oldest deadline 2019-12-08T18:01:08.055994+0000) 2019-12-08T18:01:53.182 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:01:53.181+0000 1694f700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T18:00:40.420281+0000 (oldest deadline 2019-12-08T18:01:20.420281+0000) 2019-12-08T18:01:53.183 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:01:53.182+0000 1694f700 -1 osd.2 284 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e282) 2019-12-08T18:01:53.332 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T18:01:53.327+0000 1694f700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:17.958349+0000 front 2019-12-08T18:00:23.251164+0000 (oldest deadline 2019-12-08T18:01:03.221050+0000) 2019-12-08T18:01:53.374 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T18:01:53.371+0000 1694f700 -1 osd.0 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.839500+0000 front 2019-12-08T18:00:20.962196+0000 (oldest deadline 2019-12-08T18:01:04.861422+0000) 2019-12-08T18:01:53.634 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T18:01:53.629+0000 1694f700 -1 osd.5 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.021041+0000 front 2019-12-08T18:00:23.016009+0000 (oldest deadline 2019-12-08T18:01:06.454925+0000) 2019-12-08T18:01:53.636 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T18:01:53.636+0000 1694f700 -1 osd.3 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.498597+0000 front 2019-12-08T18:00:18.793327+0000 (oldest deadline 2019-12-08T18:01:03.483865+0000) 2019-12-08T18:01:53.946 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T18:01:53.940+0000 1694f700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.158464+0000 front 2019-12-08T18:00:20.177584+0000 (oldest deadline 2019-12-08T18:01:05.984388+0000) 2019-12-08T18:01:54.014 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T18:01:54.008+0000 1694f700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:22.219779+0000 front 2019-12-08T18:00:22.242283+0000 (oldest deadline 2019-12-08T18:01:08.055994+0000) 2019-12-08T18:01:54.215 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:01:54.214+0000 1694f700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T18:00:40.420281+0000 (oldest deadline 2019-12-08T18:01:20.420281+0000) 2019-12-08T18:01:54.216 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:01:54.216+0000 1694f700 -1 osd.2 284 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e282) 2019-12-08T18:01:54.319 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T18:01:54.314+0000 1694f700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:17.958349+0000 front 2019-12-08T18:00:23.251164+0000 (oldest deadline 2019-12-08T18:01:03.221050+0000) 2019-12-08T18:01:54.359 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T18:01:54.357+0000 1694f700 -1 osd.0 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.839500+0000 front 2019-12-08T18:00:20.962196+0000 (oldest deadline 2019-12-08T18:01:04.861422+0000) 2019-12-08T18:01:54.608 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T18:01:54.608+0000 1694f700 -1 osd.3 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.498597+0000 front 2019-12-08T18:00:18.793327+0000 (oldest deadline 2019-12-08T18:01:03.483865+0000) 2019-12-08T18:01:54.629 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T18:01:54.624+0000 1694f700 -1 osd.5 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.021041+0000 front 2019-12-08T18:00:23.016009+0000 (oldest deadline 2019-12-08T18:01:06.454925+0000) 2019-12-08T18:01:55.000 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T18:01:54.994+0000 1694f700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.158464+0000 front 2019-12-08T18:00:20.177584+0000 (oldest deadline 2019-12-08T18:01:05.984388+0000) 2019-12-08T18:01:55.003 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T18:01:54.998+0000 1694f700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:22.219779+0000 front 2019-12-08T18:00:22.242283+0000 (oldest deadline 2019-12-08T18:01:08.055994+0000) 2019-12-08T18:01:55.239 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:01:55.239+0000 1694f700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T18:00:40.420281+0000 (oldest deadline 2019-12-08T18:01:20.420281+0000) 2019-12-08T18:01:55.240 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:01:55.240+0000 1694f700 -1 osd.2 284 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e282) 2019-12-08T18:01:55.337 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T18:01:55.332+0000 1694f700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:17.958349+0000 front 2019-12-08T18:00:23.251164+0000 (oldest deadline 2019-12-08T18:01:03.221050+0000) 2019-12-08T18:01:55.378 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T18:01:55.376+0000 1694f700 -1 osd.0 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.839500+0000 front 2019-12-08T18:00:20.962196+0000 (oldest deadline 2019-12-08T18:01:04.861422+0000) 2019-12-08T18:01:55.572 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T18:01:55.570+0000 1694f700 -1 osd.3 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.498597+0000 front 2019-12-08T18:00:18.793327+0000 (oldest deadline 2019-12-08T18:01:03.483865+0000) 2019-12-08T18:01:55.625 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T18:01:55.620+0000 1694f700 -1 osd.5 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.021041+0000 front 2019-12-08T18:00:23.016009+0000 (oldest deadline 2019-12-08T18:01:06.454925+0000) 2019-12-08T18:01:55.983 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T18:01:55.978+0000 1694f700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.158464+0000 front 2019-12-08T18:00:20.177584+0000 (oldest deadline 2019-12-08T18:01:05.984388+0000) 2019-12-08T18:01:56.010 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T18:01:56.005+0000 1694f700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:22.219779+0000 front 2019-12-08T18:00:22.242283+0000 (oldest deadline 2019-12-08T18:01:08.055994+0000) 2019-12-08T18:01:56.243 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:01:56.239+0000 1694f700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T18:00:40.420281+0000 (oldest deadline 2019-12-08T18:01:20.420281+0000) 2019-12-08T18:01:56.244 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:01:56.243+0000 1694f700 -1 osd.2 284 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e282) 2019-12-08T18:01:56.308 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T18:01:56.303+0000 1694f700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:17.958349+0000 front 2019-12-08T18:00:23.251164+0000 (oldest deadline 2019-12-08T18:01:03.221050+0000) 2019-12-08T18:01:56.398 INFO:tasks.ceph.osd.0.smithi079.stderr:2019-12-08T18:01:56.395+0000 1694f700 -1 osd.0 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.839500+0000 front 2019-12-08T18:00:20.962196+0000 (oldest deadline 2019-12-08T18:01:04.861422+0000) 2019-12-08T18:01:56.572 INFO:tasks.ceph.osd.3.smithi079.stderr:2019-12-08T18:01:56.570+0000 1694f700 -1 osd.3 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.498597+0000 front 2019-12-08T18:00:18.793327+0000 (oldest deadline 2019-12-08T18:01:03.483865+0000) 2019-12-08T18:01:56.598 INFO:tasks.ceph.osd.5.smithi013.stderr:2019-12-08T18:01:56.593+0000 1694f700 -1 osd.5 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:23.021041+0000 front 2019-12-08T18:00:23.016009+0000 (oldest deadline 2019-12-08T18:01:06.454925+0000) 2019-12-08T18:01:56.944 INFO:tasks.ceph.osd.4.smithi013.stderr:2019-12-08T18:01:56.939+0000 1694f700 -1 osd.4 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:20.158464+0000 front 2019-12-08T18:00:20.177584+0000 (oldest deadline 2019-12-08T18:01:05.984388+0000) 2019-12-08T18:01:56.984 INFO:tasks.ceph.osd.6.smithi013.stderr:2019-12-08T18:01:56.979+0000 1694f700 -1 osd.6 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:22.219779+0000 front 2019-12-08T18:00:22.242283+0000 (oldest deadline 2019-12-08T18:01:08.055994+0000) 2019-12-08T18:01:57.088 INFO:tasks.ceph.mon.b.smithi013.stderr:2019-12-08T18:01:57.078+0000 1a89c700 -1 mon.b@0(leader) e1 get_health_metrics reporting 7 slow ops, oldest is osd_failure(failed timeout osd.1 [v2:172.21.15.79:6810/10449,v1:172.21.15.79:6811/10449] for 47sec e284 v284) 2019-12-08T18:01:57.246 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:01:57.245+0000 1694f700 -1 osd.2 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 ever on either front or back, first ping sent 2019-12-08T18:00:40.420281+0000 (oldest deadline 2019-12-08T18:01:20.420281+0000) 2019-12-08T18:01:57.248 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:01:57.247+0000 1694f700 -1 osd.2 284 get_health_metrics reporting 5 slow ops, oldest is osd_op(client.4555.0:80792 7.1 7.ca399d71 (undecoded) ondisk+retry+read+known_if_redirected e282) 2019-12-08T18:01:57.301 INFO:tasks.ceph.osd.7.smithi013.stderr:2019-12-08T18:01:57.297+0000 1694f700 -1 osd.7 284 heartbeat_check: no reply from 172.21.15.79:6814 osd.1 since back 2019-12-08T18:00:17.958349+0000 front 2019-12-08T18:00:23.251164+0000 (oldest deadline 2019-12-08T18:01:03.221050+0000) 2019-12-08T18:01:58.246 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:01:58.208+0000 34274700 -1 osd.2 285 build_incremental_map_msg missing incremental map 283 2019-12-08T18:01:58.257 INFO:tasks.ceph.osd.2.smithi079.stderr:2019-12-08T18:01:58.233+0000 1694f700 -1 osd.2 285 get_health_metrics reporting 4 slow ops, oldest is osd_op(client.4555.0:80819 7.1 7.c47f6d01 (undecoded) ondisk+retry+write+known_if_redirected e282) 2019-12-08T18:01:59.693 INFO:tasks.rgw.client.0.smithi079.stdout:2019-12-08T18:01:59.661+0000 20e25700 -1 RGWWatcher::handle_error cookie 823565152 err (107) Transport endpoint is not connected 2019-12-08T18:02:03.186 INFO:tasks.ceph.osd.1.smithi079.stderr:*** Caught signal (Segmentation fault) ** 2019-12-08T18:02:03.187 INFO:tasks.ceph.osd.1.smithi079.stderr: in thread 114ae700 thread_name:msgr-worker-0 2019-12-08T18:02:03.261 INFO:tasks.ceph.osd.1.smithi079.stderr: ceph version 15.0.0-7900-g1351c81 (1351c819e1a9518cde4c8b12d645782009028360) octopus (dev) 2019-12-08T18:02:03.261 INFO:tasks.ceph.osd.1.smithi079.stderr: 1: (()+0xf5f0) [0xc09e5f0] 2019-12-08T18:02:03.261 INFO:tasks.ceph.osd.1.smithi079.stderr: 2: (MonClient::handle_auth_done(Connection*, AuthConnectionMeta*, unsigned long, unsigned int, ceph::buffer::v14_2_0::list const&, CryptoKey*, std::string*)+0x71) [0xe8a9b1] 2019-12-08T18:02:03.261 INFO:tasks.ceph.osd.1.smithi079.stderr: 3: (ProtocolV2::handle_auth_done(ceph::buffer::v14_2_0::list&)+0x2e0) [0x100d020] 2019-12-08T18:02:03.261 INFO:tasks.ceph.osd.1.smithi079.stderr: 4: (ProtocolV2::handle_frame_payload()+0x1d3) [0x1019dc3] 2019-12-08T18:02:03.262 INFO:tasks.ceph.osd.1.smithi079.stderr: 5: (ProtocolV2::handle_read_frame_dispatch()+0x150) [0x101a040] 2019-12-08T18:02:03.262 INFO:tasks.ceph.osd.1.smithi079.stderr: 6: (ProtocolV2::handle_read_frame_epilogue_main(std::unique_ptr&&, int)+0x44d) [0x101a59d] 2019-12-08T18:02:03.262 INFO:tasks.ceph.osd.1.smithi079.stderr: 7: (ProtocolV2::run_continuation(Ct&)+0x34) [0x1003224] 2019-12-08T18:02:03.262 INFO:tasks.ceph.osd.1.smithi079.stderr: 8: (AsyncConnection::process()+0x794) [0xfdd874] 2019-12-08T18:02:03.262 INFO:tasks.ceph.osd.1.smithi079.stderr: 9: (EventCenter::process_events(unsigned int, std::chrono::duration >*)+0xa25) [0xe3dd55] 2019-12-08T18:02:03.262 INFO:tasks.ceph.osd.1.smithi079.stderr: 10: (()+0xd3b767) [0xe43767] 2019-12-08T18:02:03.262 INFO:tasks.ceph.osd.1.smithi079.stderr: 11: (()+0x121504f) [0x131d04f] 2019-12-08T18:02:03.262 INFO:tasks.ceph.osd.1.smithi079.stderr: 12: (()+0x7e65) [0xc096e65] 2019-12-08T18:02:03.263 INFO:tasks.ceph.osd.1.smithi079.stderr: 13: (clone()+0x6d) [0xd20e88d] 2019-12-08T18:02:03.404 INFO:tasks.ceph.osd.1.smithi079.stderr:2019-12-08T18:02:03.328+0000 114ae700 -1 *** Caught signal (Segmentation fault) ** 2019-12-08T18:02:03.404 INFO:tasks.ceph.osd.1.smithi079.stderr: in thread 114ae700 thread_name:msgr-worker-0 2019-12-08T18:02:03.405 INFO:tasks.ceph.osd.1.smithi079.stderr: 2019-12-08T18:02:03.405 INFO:tasks.ceph.osd.1.smithi079.stderr: ceph version 15.0.0-7900-g1351c81 (1351c819e1a9518cde4c8b12d645782009028360) octopus (dev) 2019-12-08T18:02:03.405 INFO:tasks.ceph.osd.1.smithi079.stderr: 1: (()+0xf5f0) [0xc09e5f0] 2019-12-08T18:02:03.405 INFO:tasks.ceph.osd.1.smithi079.stderr: 2: (MonClient::handle_auth_done(Connection*, AuthConnectionMeta*, unsigned long, unsigned int, ceph::buffer::v14_2_0::list const&, CryptoKey*, std::string*)+0x71) [0xe8a9b1] 2019-12-08T18:02:03.405 INFO:tasks.ceph.osd.1.smithi079.stderr: 3: (ProtocolV2::handle_auth_done(ceph::buffer::v14_2_0::list&)+0x2e0) [0x100d020] 2019-12-08T18:02:03.405 INFO:tasks.ceph.osd.1.smithi079.stderr: 4: (ProtocolV2::handle_frame_payload()+0x1d3) [0x1019dc3] 2019-12-08T18:02:03.405 INFO:tasks.ceph.osd.1.smithi079.stderr: 5: (ProtocolV2::handle_read_frame_dispatch()+0x150) [0x101a040] 2019-12-08T18:02:03.406 INFO:tasks.ceph.osd.1.smithi079.stderr: 6: (ProtocolV2::handle_read_frame_epilogue_main(std::unique_ptr&&, int)+0x44d) [0x101a59d] 2019-12-08T18:02:03.406 INFO:tasks.ceph.osd.1.smithi079.stderr: 7: (ProtocolV2::run_continuation(Ct&)+0x34) [0x1003224] 2019-12-08T18:02:03.406 INFO:tasks.ceph.osd.1.smithi079.stderr: 8: (AsyncConnection::process()+0x794) [0xfdd874] 2019-12-08T18:02:03.406 INFO:tasks.ceph.osd.1.smithi079.stderr: 9: (EventCenter::process_events(unsigned int, std::chrono::duration >*)+0xa25) [0xe3dd55] 2019-12-08T18:02:03.406 INFO:tasks.ceph.osd.1.smithi079.stderr: 10: (()+0xd3b767) [0xe43767] 2019-12-08T18:02:03.406 INFO:tasks.ceph.osd.1.smithi079.stderr: 11: (()+0x121504f) [0x131d04f] 2019-12-08T18:02:03.406 INFO:tasks.ceph.osd.1.smithi079.stderr: 12: (()+0x7e65) [0xc096e65] 2019-12-08T18:02:03.407 INFO:tasks.ceph.osd.1.smithi079.stderr: 13: (clone()+0x6d) [0xd20e88d] 2019-12-08T18:02:03.407 INFO:tasks.ceph.osd.1.smithi079.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2019-12-08T18:02:03.407 INFO:tasks.ceph.osd.1.smithi079.stderr: 2019-12-08T18:02:04.057 INFO:tasks.ceph.osd.1.smithi079.stderr: -120> 2019-12-08T18:02:03.328+0000 114ae700 -1 *** Caught signal (Segmentation fault) ** 2019-12-08T18:02:04.057 INFO:tasks.ceph.osd.1.smithi079.stderr: in thread 114ae700 thread_name:msgr-worker-0 2019-12-08T18:02:04.057 INFO:tasks.ceph.osd.1.smithi079.stderr: 2019-12-08T18:02:04.057 INFO:tasks.ceph.osd.1.smithi079.stderr: ceph version 15.0.0-7900-g1351c81 (1351c819e1a9518cde4c8b12d645782009028360) octopus (dev) 2019-12-08T18:02:04.057 INFO:tasks.ceph.osd.1.smithi079.stderr: 1: (()+0xf5f0) [0xc09e5f0] 2019-12-08T18:02:04.058 INFO:tasks.ceph.osd.1.smithi079.stderr: 2: (MonClient::handle_auth_done(Connection*, AuthConnectionMeta*, unsigned long, unsigned int, ceph::buffer::v14_2_0::list const&, CryptoKey*, std::string*)+0x71) [0xe8a9b1] 2019-12-08T18:02:04.058 INFO:tasks.ceph.osd.1.smithi079.stderr: 3: (ProtocolV2::handle_auth_done(ceph::buffer::v14_2_0::list&)+0x2e0) [0x100d020] 2019-12-08T18:02:04.058 INFO:tasks.ceph.osd.1.smithi079.stderr: 4: (ProtocolV2::handle_frame_payload()+0x1d3) [0x1019dc3] 2019-12-08T18:02:04.058 INFO:tasks.ceph.osd.1.smithi079.stderr: 5: (ProtocolV2::handle_read_frame_dispatch()+0x150) [0x101a040] 2019-12-08T18:02:04.058 INFO:tasks.ceph.osd.1.smithi079.stderr: 6: (ProtocolV2::handle_read_frame_epilogue_main(std::unique_ptr&&, int)+0x44d) [0x101a59d] 2019-12-08T18:02:04.058 INFO:tasks.ceph.osd.1.smithi079.stderr: 7: (ProtocolV2::run_continuation(Ct&)+0x34) [0x1003224] 2019-12-08T18:02:04.058 INFO:tasks.ceph.osd.1.smithi079.stderr: 8: (AsyncConnection::process()+0x794) [0xfdd874] 2019-12-08T18:02:04.059 INFO:tasks.ceph.osd.1.smithi079.stderr: 9: (EventCenter::process_events(unsigned int, std::chrono::duration >*)+0xa25) [0xe3dd55] 2019-12-08T18:02:04.059 INFO:tasks.ceph.osd.1.smithi079.stderr: 10: (()+0xd3b767) [0xe43767] 2019-12-08T18:02:04.059 INFO:tasks.ceph.osd.1.smithi079.stderr: 11: (()+0x121504f) [0x131d04f] 2019-12-08T18:02:04.059 INFO:tasks.ceph.osd.1.smithi079.stderr: 12: (()+0x7e65) [0xc096e65] 2019-12-08T18:02:04.059 INFO:tasks.ceph.osd.1.smithi079.stderr: 13: (clone()+0x6d) [0xd20e88d] 2019-12-08T18:02:04.059 INFO:tasks.ceph.osd.1.smithi079.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2019-12-08T18:02:04.059 INFO:tasks.ceph.osd.1.smithi079.stderr: 2019-12-08T18:02:04.420 INFO:tasks.ceph.osd.1.smithi079.stderr: -1121> 2019-12-08T18:02:03.328+0000 114ae700 -1 *** Caught signal (Segmentation fault) ** 2019-12-08T18:02:04.420 INFO:tasks.ceph.osd.1.smithi079.stderr: in thread 114ae700 thread_name:msgr-worker-0 2019-12-08T18:02:04.420 INFO:tasks.ceph.osd.1.smithi079.stderr: 2019-12-08T18:02:04.420 INFO:tasks.ceph.osd.1.smithi079.stderr: ceph version 15.0.0-7900-g1351c81 (1351c819e1a9518cde4c8b12d645782009028360) octopus (dev) 2019-12-08T18:02:04.421 INFO:tasks.ceph.osd.1.smithi079.stderr: 1: (()+0xf5f0) [0xc09e5f0] 2019-12-08T18:02:04.421 INFO:tasks.ceph.osd.1.smithi079.stderr: 2: (MonClient::handle_auth_done(Connection*, AuthConnectionMeta*, unsigned long, unsigned int, ceph::buffer::v14_2_0::list const&, CryptoKey*, std::string*)+0x71) [0xe8a9b1] 2019-12-08T18:02:04.421 INFO:tasks.ceph.osd.1.smithi079.stderr: 3: (ProtocolV2::handle_auth_done(ceph::buffer::v14_2_0::list&)+0x2e0) [0x100d020] 2019-12-08T18:02:04.421 INFO:tasks.ceph.osd.1.smithi079.stderr: 4: (ProtocolV2::handle_frame_payload()+0x1d3) [0x1019dc3] 2019-12-08T18:02:04.421 INFO:tasks.ceph.osd.1.smithi079.stderr: 5: (ProtocolV2::handle_read_frame_dispatch()+0x150) [0x101a040] 2019-12-08T18:02:04.421 INFO:tasks.ceph.osd.1.smithi079.stderr: 6: (ProtocolV2::handle_read_frame_epilogue_main(std::unique_ptr&&, int)+0x44d) [0x101a59d] 2019-12-08T18:02:04.421 INFO:tasks.ceph.osd.1.smithi079.stderr: 7: (ProtocolV2::run_continuation(Ct&)+0x34) [0x1003224] 2019-12-08T18:02:04.422 INFO:tasks.ceph.osd.1.smithi079.stderr: 8: (AsyncConnection::process()+0x794) [0xfdd874] 2019-12-08T18:02:04.422 INFO:tasks.ceph.osd.1.smithi079.stderr: 9: (EventCenter::process_events(unsigned int, std::chrono::duration >*)+0xa25) [0xe3dd55] 2019-12-08T18:02:04.422 INFO:tasks.ceph.osd.1.smithi079.stderr: 10: (()+0xd3b767) [0xe43767] 2019-12-08T18:02:04.422 INFO:tasks.ceph.osd.1.smithi079.stderr: 11: (()+0x121504f) [0x131d04f] 2019-12-08T18:02:04.422 INFO:tasks.ceph.osd.1.smithi079.stderr: 12: (()+0x7e65) [0xc096e65] 2019-12-08T18:02:04.422 INFO:tasks.ceph.osd.1.smithi079.stderr: 13: (clone()+0x6d) [0xd20e88d] 2019-12-08T18:02:04.422 INFO:tasks.ceph.osd.1.smithi079.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2019-12-08T18:02:04.422 INFO:tasks.ceph.osd.1.smithi079.stderr: 2019-12-08T18:02:07.566 INFO:tasks.ceph.osd.1.smithi079.stderr:daemon-helper: command crashed with signal 11 2019-12-08T18:02:12.920 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2019-12-08T18:02:19.230 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~6s 2019-12-08T18:02:25.347 INFO:tasks.rgw.client.0.smithi079.stdout:2019-12-08T18:02:25.346+0000 20e25700 -1 RGWWatcher::handle_error cookie 4678769760 err (107) Transport endpoint is not connected 2019-12-08T18:02:25.542 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~13s 2019-12-08T18:02:31.853 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~19s 2019-12-08T18:02:38.166 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~25s 2019-12-08T18:02:44.479 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~32s 2019-12-08T18:02:50.789 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~38s 2019-12-08T18:02:57.104 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~44s 2019-12-08T18:03:03.417 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~51s 2019-12-08T18:03:09.729 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~57s 2019-12-08T18:03:16.041 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~63s 2019-12-08T18:03:22.351 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~69s 2019-12-08T18:03:28.661 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~76s 2019-12-08T18:03:32.892 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:06:00:57.594 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T18:03:32.903 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:06:00:57.606 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T18:03:32.943 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:06:00:57.578 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T18:03:32.966 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:06:00:57.601 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T18:03:32.967 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:06:00:57.602 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T18:03:32.981 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:06:00:57.616 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T18:03:33.028 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:06:00:57.731 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T18:03:33.099 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:06:00:57.734 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T18:03:33.104 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:06:00:57.739 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T18:03:34.972 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~82s 2019-12-08T18:03:41.284 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~88s 2019-12-08T18:03:47.594 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~95s 2019-12-08T18:03:53.906 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~101s 2019-12-08T18:04:00.218 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~107s 2019-12-08T18:04:06.531 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~114s 2019-12-08T18:04:12.842 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~120s 2019-12-08T18:04:13.369 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:06:01:38.071 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T18:04:13.379 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:06:01:38.082 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T18:04:13.422 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:06:01:38.057 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T18:04:13.441 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:06:01:38.076 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T18:04:13.443 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:06:01:38.146 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T18:04:13.476 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:06:01:38.111 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T18:04:13.482 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:06:01:38.117 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T18:04:13.497 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:06:01:38.132 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T18:04:13.546 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:06:01:38.180 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T18:04:19.154 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~126s 2019-12-08T18:04:25.467 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~133s 2019-12-08T18:04:31.776 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~139s 2019-12-08T18:04:38.086 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~145s 2019-12-08T18:04:44.592 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~152s 2019-12-08T18:04:50.903 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~158s 2019-12-08T18:04:57.213 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~164s 2019-12-08T18:05:03.523 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~171s 2019-12-08T18:05:09.837 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~177s 2019-12-08T18:05:16.147 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~183s 2019-12-08T18:05:22.457 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~190s 2019-12-08T18:05:28.771 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~196s 2019-12-08T18:05:35.088 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~202s 2019-12-08T18:05:41.400 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~208s 2019-12-08T18:05:47.710 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~215s 2019-12-08T18:05:54.020 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~221s 2019-12-08T18:06:00.331 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~227s 2019-12-08T18:06:06.641 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~234s 2019-12-08T18:06:12.951 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~240s 2019-12-08T18:06:19.260 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~246s 2019-12-08T18:06:24.032 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:06:03:48.735 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T18:06:24.050 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:06:03:48.754 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T18:06:24.063 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:06:03:48.698 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T18:06:24.063 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:06:03:48.698 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T18:06:24.072 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:06:03:48.707 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T18:06:24.077 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:06:03:48.710 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T18:06:24.214 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:06:03:48.848 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T18:06:24.218 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:06:03:48.853 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T18:06:24.218 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:06:03:48.921 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T18:06:25.570 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~253s 2019-12-08T18:06:31.883 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~259s 2019-12-08T18:06:38.199 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~265s 2019-12-08T18:06:44.508 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~272s 2019-12-08T18:06:50.819 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~278s 2019-12-08T18:06:57.126 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~284s 2019-12-08T18:07:03.437 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~291s 2019-12-08T18:07:09.751 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~297s 2019-12-08T18:07:16.061 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~303s 2019-12-08T18:07:16.061 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2019-12-08T18:07:16.061 ERROR:tasks.daemonwatchdog.daemon_watchdog:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-ofriedma-dynamic-disable/qa/tasks/daemonwatchdog.py", line 38, in _run self.watch() File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-ofriedma-dynamic-disable/qa/tasks/daemonwatchdog.py", line 114, in watch self.bark() File "/home/teuthworker/src/git.ceph.com_ceph-c_wip-ofriedma-dynamic-disable/qa/tasks/daemonwatchdog.py", line 54, in bark for mount in self.ctx.mounts.values(): File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/config.py", line 253, in __getattr__ raise AttributeError(name) AttributeError: mounts 2019-12-08T18:11:34.035 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:06:08:58.738 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T18:11:34.046 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:06:08:58.749 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T18:11:34.056 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:06:08:58.691 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T18:11:34.063 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:06:08:58.698 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T18:11:34.069 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:06:08:58.704 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T18:11:34.072 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:06:08:58.708 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T18:11:34.305 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:06:08:58.940 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T18:11:34.329 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:06:08:58.964 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T18:11:34.382 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:06:08:59.085 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T18:12:00.756 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:06:09:25.459 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T18:12:00.769 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:06:09:25.472 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T18:12:00.809 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:06:09:25.512 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T18:12:00.841 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:06:09:25.475 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T18:12:00.846 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:06:09:25.481 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T18:12:00.866 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:06:09:25.501 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T18:12:00.869 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:06:09:25.504 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T18:12:00.884 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:06:09:25.518 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T18:12:00.922 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:06:09:25.557 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T18:15:32.909 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:06:12:57.612 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T18:15:32.927 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:06:12:57.630 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T18:15:32.928 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:06:12:57.563 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T18:15:32.932 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:06:12:57.567 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T18:15:32.932 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:06:12:57.567 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T18:15:32.938 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:06:12:57.573 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T18:15:33.169 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:06:12:57.804 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T18:15:33.181 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:06:12:57.817 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T18:15:33.297 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:06:12:58.000 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T18:20:23.122 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:06:17:47.824 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T18:20:23.171 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:06:17:47.806 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T18:20:23.173 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:06:17:47.876 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T18:20:23.175 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:06:17:47.809 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T18:20:23.193 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:06:17:47.824 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T18:20:23.193 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:06:17:47.826 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T18:20:23.290 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:06:17:47.924 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T18:20:23.313 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:06:17:48.016 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T18:20:23.358 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:06:17:47.992 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T18:20:43.440 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:06:18:08.143 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T18:20:43.455 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:06:18:08.158 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T18:20:43.461 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:06:18:08.096 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T18:20:43.466 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:06:18:08.101 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T18:20:43.475 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:06:18:08.109 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T18:20:43.478 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:06:18:08.113 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T18:20:43.518 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:06:18:08.153 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T18:20:43.522 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:06:18:08.156 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T18:20:43.566 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:06:18:08.269 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T18:25:54.860 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:06:23:19.563 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T18:25:54.872 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:06:23:19.575 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T18:25:54.895 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:06:23:19.529 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T18:25:54.898 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:06:23:19.533 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T18:25:54.909 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:06:23:19.538 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T18:25:54.910 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:06:23:19.542 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T18:25:55.116 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:06:23:19.751 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T18:25:55.140 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:06:23:19.775 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T18:25:55.277 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:06:23:19.981 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T18:28:45.341 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:06:26:10.044 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T18:28:45.368 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:06:26:10.050 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T18:28:45.412 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:06:26:10.047 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T18:28:45.414 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:06:26:10.049 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T18:28:45.423 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:06:26:10.058 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T18:28:45.426 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:06:26:10.061 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T18:28:45.463 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:06:26:10.166 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T18:28:45.526 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:06:26:10.160 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T18:28:45.533 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:06:26:10.168 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T18:31:07.127 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:06:28:31.830 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T18:31:07.146 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:06:28:31.838 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T18:31:07.149 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:06:28:31.784 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T18:31:07.154 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:06:28:31.789 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T18:31:07.157 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:06:28:31.792 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T18:31:07.163 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:06:28:31.798 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T18:31:07.258 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:06:28:31.892 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T18:31:07.316 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:06:28:32.019 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T18:31:07.339 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:06:28:31.974 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T18:36:21.259 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:06:33:45.961 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T18:36:21.279 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:06:33:45.983 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T18:36:21.295 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:06:33:45.929 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T18:36:21.299 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:06:33:45.934 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T18:36:21.301 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:06:33:45.936 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T18:36:21.306 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:06:33:45.941 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T18:36:21.522 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:06:33:46.157 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T18:36:21.538 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:06:33:46.173 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T18:36:21.647 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:06:33:46.351 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T18:37:07.597 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:06:34:32.300 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T18:37:07.608 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:06:34:32.311 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T18:37:07.649 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:06:34:32.283 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T18:37:07.665 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:06:34:32.369 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T18:37:07.672 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:06:34:32.306 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T18:37:07.689 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:06:34:32.324 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T18:37:07.693 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:06:34:32.328 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T18:37:07.711 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:06:34:32.346 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T18:37:07.745 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:06:34:32.380 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T18:39:03.518 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:06:36:28.221 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T18:39:03.527 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:06:36:28.230 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T18:39:03.596 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:06:36:28.231 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T18:39:03.602 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:06:36:28.236 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T18:39:03.605 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:06:36:28.240 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T18:39:03.626 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:06:36:28.261 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T18:39:03.674 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:06:36:28.377 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T18:39:03.689 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:06:36:28.324 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T18:39:03.701 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:06:36:28.336 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T18:41:31.638 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:06:38:56.340 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T18:41:31.653 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:06:38:56.356 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T18:41:31.670 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:06:38:56.304 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T18:41:31.671 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:06:38:56.306 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T18:41:31.676 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:06:38:56.311 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T18:41:31.679 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:06:38:56.314 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T18:41:31.807 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:06:38:56.441 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T18:41:31.815 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:06:38:56.450 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T18:41:31.860 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:06:38:56.563 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T18:45:30.090 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:06:42:54.793 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T18:45:30.108 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:06:42:54.811 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T18:45:30.162 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:06:42:54.796 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T18:45:30.183 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:06:42:54.818 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T18:45:30.187 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:06:42:54.822 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T18:45:30.190 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:06:42:54.825 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T18:45:30.291 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:06:42:54.994 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T18:45:30.337 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:06:42:54.972 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T18:45:30.355 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:06:42:54.990 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T18:46:42.602 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:06:44:07.305 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T18:46:42.618 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:06:44:07.321 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T18:46:42.622 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:06:44:07.257 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T18:46:42.623 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:06:44:07.258 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T18:46:42.628 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:06:44:07.262 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T18:46:42.630 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:06:44:07.265 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T18:46:42.688 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:06:44:07.322 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T18:46:42.696 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:06:44:07.331 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T18:46:42.746 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:06:44:07.449 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T18:51:55.904 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:06:49:20.607 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T18:51:55.918 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:06:49:20.616 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T18:51:55.939 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:06:49:20.574 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T18:51:55.940 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:06:49:20.574 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T18:51:55.946 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:06:49:20.581 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T18:51:55.949 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:06:49:20.584 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T18:51:56.135 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:06:49:20.770 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T18:51:56.156 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:06:49:20.791 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T18:51:56.159 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:06:49:20.863 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T18:53:52.284 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:06:51:16.988 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T18:53:52.335 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:06:51:17.039 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T18:53:52.367 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:06:51:17.001 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T18:53:52.372 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:06:51:17.007 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T18:53:52.384 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:06:51:17.018 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T18:53:52.405 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:06:51:17.039 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T18:53:52.463 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:06:51:17.098 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T18:53:52.466 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:06:51:17.170 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T18:53:52.475 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:06:51:17.109 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T18:57:08.217 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:06:54:32.921 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T18:57:08.241 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:06:54:32.945 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T18:57:08.250 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:06:54:32.884 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T18:57:08.251 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:06:54:32.886 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T18:57:08.257 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:06:54:32.891 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T18:57:08.264 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:06:54:32.899 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T18:57:08.459 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:06:54:33.094 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T18:57:08.462 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:06:54:33.097 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T18:57:08.508 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:06:54:33.211 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T19:02:14.616 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:06:59:39.320 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T19:02:14.629 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:06:59:39.326 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T19:02:14.698 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:06:59:39.332 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T19:02:14.700 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:06:59:39.334 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T19:02:14.701 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:06:59:39.335 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T19:02:14.709 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:06:59:39.342 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T19:02:14.857 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:06:59:39.491 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T19:02:14.864 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:06:59:39.498 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T19:02:14.896 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:06:59:39.599 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T19:02:19.799 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:06:59:44.502 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T19:02:19.812 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:06:59:44.516 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T19:02:19.815 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:06:59:44.449 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T19:02:19.821 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:06:59:44.456 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T19:02:19.822 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:06:59:44.456 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T19:02:19.829 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:06:59:44.463 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T19:02:19.856 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:06:59:44.490 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T19:02:19.866 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:06:59:44.501 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T19:02:19.968 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:06:59:44.672 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T19:07:30.665 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:07:04:55.367 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T19:07:30.695 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:07:04:55.322 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T19:07:30.695 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:07:04:55.329 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T19:07:30.695 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:07:04:55.378 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T19:07:30.701 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:07:04:55.335 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T19:07:30.710 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:07:04:55.344 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T19:07:30.884 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:07:04:55.519 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T19:07:30.907 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:07:04:55.611 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T19:07:30.933 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:07:04:55.567 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T19:10:37.357 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:07:08:02.061 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T19:10:37.401 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:07:08:02.104 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T19:10:37.449 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:07:08:02.084 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T19:10:37.455 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:07:08:02.089 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T19:10:37.461 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:07:08:02.096 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T19:10:37.464 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:07:08:02.098 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T19:10:37.538 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:07:08:02.241 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T19:10:37.544 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:07:08:02.178 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T19:10:37.548 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:07:08:02.182 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T19:12:40.891 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:07:10:05.594 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T19:12:40.900 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:07:10:05.603 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T19:12:40.911 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:07:10:05.544 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T19:12:40.914 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:07:10:05.548 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T19:12:40.917 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:07:10:05.551 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T19:12:40.919 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:07:10:05.554 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T19:12:41.060 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:07:10:05.694 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T19:12:41.071 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:07:10:05.705 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T19:12:41.085 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:07:10:05.788 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T19:17:53.249 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:07:15:17.952 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T19:17:53.266 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:07:15:17.970 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T19:17:53.278 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:07:15:17.913 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T19:17:53.286 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:07:15:17.919 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T19:17:53.290 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:07:15:17.924 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T19:17:53.294 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:07:15:17.928 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T19:17:53.492 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:07:15:18.126 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T19:17:53.517 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:07:15:18.151 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T19:17:53.572 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:07:15:18.276 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T19:18:59.845 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:07:16:24.537 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T19:18:59.845 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:07:16:24.543 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T19:18:59.860 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:07:16:24.494 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T19:18:59.909 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:07:16:24.544 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T19:18:59.914 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:07:16:24.548 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T19:18:59.917 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:07:16:24.551 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T19:18:59.919 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:07:16:24.622 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T19:18:59.957 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:07:16:24.592 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T19:18:59.973 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:07:16:24.607 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T19:19:55.571 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:07:17:20.274 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T19:19:55.576 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:07:17:20.280 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T19:19:55.634 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:07:17:20.337 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T19:19:55.666 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:07:17:20.301 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T19:19:55.667 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:07:17:20.302 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T19:19:55.669 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:07:17:20.303 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T19:19:55.670 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:07:17:20.305 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T19:19:55.784 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:07:17:20.418 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T19:19:55.787 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:07:17:20.421 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T19:23:05.417 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:07:20:30.120 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T19:23:05.424 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:07:20:30.127 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T19:23:05.444 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:07:20:30.078 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T19:23:05.444 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:07:20:30.078 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T19:23:05.450 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:07:20:30.084 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T19:23:05.456 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:07:20:30.090 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T19:23:05.593 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:07:20:30.296 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T19:23:05.636 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:07:20:30.270 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T19:23:05.659 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:07:20:30.294 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T19:27:22.665 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:07:24:47.368 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T19:27:22.674 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:07:24:47.378 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T19:27:22.716 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:07:24:47.349 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T19:27:22.740 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:07:24:47.374 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T19:27:22.746 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:07:24:47.380 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T19:27:22.757 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:07:24:47.391 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T19:27:22.853 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:07:24:47.486 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T19:27:22.866 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:07:24:47.559 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T19:27:22.909 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:07:24:47.543 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T19:28:17.627 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:07:25:42.330 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T19:28:17.645 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:07:25:42.344 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T19:28:17.652 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:07:25:42.286 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T19:28:17.655 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:07:25:42.288 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T19:28:17.658 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:07:25:42.292 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T19:28:17.664 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:07:25:42.298 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T19:28:17.720 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:07:25:42.354 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T19:28:17.754 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:07:25:42.387 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T19:28:17.778 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:07:25:42.481 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T19:33:30.550 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:07:30:55.253 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T19:33:30.565 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:07:30:55.267 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T19:33:30.569 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:07:30:55.203 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T19:33:30.574 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:07:30:55.208 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T19:33:30.579 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:07:30:55.213 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T19:33:30.584 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:07:30:55.218 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T19:33:30.780 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:07:30:55.414 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T19:33:30.820 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:07:30:55.454 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T19:33:30.843 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:07:30:55.546 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T19:35:45.167 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:07:33:09.870 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T19:35:45.172 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:07:33:09.875 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T19:35:45.207 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:07:33:09.840 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T19:35:45.231 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:07:33:09.861 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T19:35:45.231 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:07:33:09.862 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T19:35:45.237 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:07:33:09.871 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T19:35:45.298 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:07:33:10.001 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T19:35:45.310 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:07:33:09.944 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T19:35:45.314 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:07:33:09.947 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T19:38:42.091 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:07:36:06.794 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T19:38:42.106 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:07:36:06.732 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T19:38:42.107 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:07:36:06.740 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T19:38:42.107 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:07:36:06.738 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T19:38:42.107 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:07:36:06.803 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T19:38:42.110 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:07:36:06.744 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T19:38:42.265 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:07:36:06.968 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T19:38:42.288 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:07:36:06.922 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T19:38:42.291 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:07:36:06.925 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T19:43:54.380 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:07:41:19.083 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T19:43:54.395 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:07:41:19.098 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T19:43:54.399 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:07:41:19.032 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T19:43:54.402 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:07:41:19.035 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T19:43:54.404 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:07:41:19.038 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T19:43:54.405 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:07:41:19.039 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T19:43:54.592 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:07:41:19.225 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T19:43:54.600 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:07:41:19.233 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T19:43:54.647 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:07:41:19.350 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T19:44:07.308 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:07:41:32.011 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T19:44:07.345 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:07:41:32.048 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T19:44:07.370 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:07:41:32.004 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T19:44:07.374 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:07:41:32.077 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T19:44:07.376 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:07:41:32.009 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T19:44:07.406 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:07:41:32.040 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T19:44:07.424 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:07:41:32.057 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T19:44:07.446 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:07:41:32.079 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T19:44:07.449 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:07:41:32.083 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T19:49:06.597 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:07:46:31.300 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T19:49:06.612 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:07:46:31.308 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T19:49:06.622 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:07:46:31.255 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T19:49:06.623 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:07:46:31.256 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T19:49:06.626 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:07:46:31.259 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T19:49:06.628 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:07:46:31.261 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T19:49:06.825 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:07:46:31.528 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T19:49:06.831 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:07:46:31.464 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T19:49:06.957 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:07:46:31.590 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T19:52:29.778 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:07:49:54.412 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T19:52:29.781 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:07:49:54.484 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T19:52:29.785 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:07:49:54.488 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T19:52:29.814 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:07:49:54.448 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T19:52:29.842 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:07:49:54.475 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T19:52:29.843 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:07:49:54.477 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T19:52:29.932 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:07:49:54.565 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T19:52:29.955 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:07:49:54.588 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T19:52:29.979 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:07:49:54.682 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T19:54:18.943 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:07:51:43.646 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T19:54:18.953 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:07:51:43.656 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T19:54:18.963 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:07:51:43.596 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T19:54:18.964 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:07:51:43.597 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T19:54:18.971 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:07:51:43.605 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T19:54:18.973 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:07:51:43.606 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T19:54:19.066 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:07:51:43.769 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T19:54:19.073 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:07:51:43.706 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T19:54:19.077 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:07:51:43.710 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T19:59:32.217 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:07:56:56.920 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T19:59:32.254 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:07:56:56.887 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T19:59:32.254 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:07:56:56.957 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T19:59:32.255 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:07:56:56.888 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T19:59:32.262 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:07:56:56.895 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T19:59:32.264 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:07:56:56.897 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T19:59:32.487 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:07:56:57.120 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T19:59:32.523 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:07:56:57.156 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T19:59:32.578 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:07:56:57.281 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T20:00:52.401 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:07:58:17.104 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T20:00:52.423 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:07:58:17.126 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T20:00:52.479 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:07:58:17.112 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T20:00:52.487 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:07:58:17.190 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T20:00:52.500 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:07:58:17.133 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T20:00:52.502 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:07:58:17.135 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T20:00:52.505 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:07:58:17.139 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T20:00:52.551 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:07:58:17.184 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T20:00:52.563 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:07:58:17.196 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T20:01:22.830 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:07:58:47.533 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T20:01:22.857 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:07:58:47.560 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T20:01:22.906 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:07:58:47.538 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T20:01:22.910 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:07:58:47.543 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T20:01:22.955 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:07:58:47.588 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T20:01:23.067 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:07:58:47.669 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T20:01:23.068 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:07:58:47.600 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T20:01:23.068 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:07:58:47.605 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T20:01:23.068 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:07:58:47.644 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T20:04:42.431 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:08:02:07.134 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T20:04:42.446 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:08:02:07.149 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T20:04:42.447 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:08:02:07.081 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T20:04:42.452 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:08:02:07.085 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T20:04:42.459 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:08:02:07.092 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T20:04:42.460 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:08:02:07.093 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T20:04:42.582 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:08:02:07.215 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T20:04:42.627 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:08:02:07.260 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T20:04:42.656 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:08:02:07.359 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T20:09:15.136 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:08:06:39.837 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T20:09:15.149 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:08:06:39.852 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T20:09:15.173 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:08:06:39.805 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T20:09:15.224 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:08:06:39.857 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T20:09:15.226 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:08:06:39.859 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T20:09:15.226 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:08:06:39.859 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T20:09:15.335 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:08:06:39.968 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T20:09:15.344 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:08:06:39.977 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T20:09:15.507 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:08:06:40.210 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T20:09:51.591 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:08:07:16.294 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T20:09:51.598 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:08:07:16.301 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T20:09:51.609 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:08:07:16.241 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T20:09:51.613 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:08:07:16.246 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T20:09:51.615 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:08:07:16.247 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T20:09:51.619 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:08:07:16.252 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T20:09:51.692 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:08:07:16.324 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T20:09:51.698 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:08:07:16.330 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T20:09:51.720 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:08:07:16.422 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T20:15:05.862 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:08:12:30.565 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T20:15:05.878 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:08:12:30.580 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T20:15:05.897 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:08:12:30.529 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T20:15:05.900 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:08:12:30.533 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T20:15:05.906 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:08:12:30.534 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T20:15:05.910 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:08:12:30.543 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T20:15:06.114 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:08:12:30.746 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T20:15:06.134 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:08:12:30.766 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T20:15:06.141 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:08:12:30.842 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T20:17:37.870 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:08:15:02.573 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T20:17:37.886 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:08:15:02.579 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T20:17:37.909 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:08:15:02.542 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T20:17:37.928 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:08:15:02.561 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T20:17:37.931 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:08:15:02.564 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T20:17:37.958 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:08:15:02.591 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T20:17:38.016 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:08:15:02.648 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T20:17:38.036 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:08:15:02.739 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T20:17:38.066 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:08:15:02.699 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T20:20:16.126 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:08:17:40.827 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T20:20:16.140 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:08:17:40.838 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T20:20:16.143 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:08:17:40.775 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T20:20:16.150 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:08:17:40.783 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T20:20:16.153 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:08:17:40.786 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T20:20:16.164 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:08:17:40.796 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T20:20:16.325 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:08:17:41.028 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T20:20:16.369 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:08:17:41.001 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T20:20:16.370 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:08:17:41.002 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T20:25:28.309 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:08:22:53.012 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T20:25:28.331 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:08:22:52.962 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T20:25:28.331 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:08:22:53.016 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T20:25:28.334 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:08:22:52.967 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T20:25:28.336 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:08:22:52.969 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T20:25:28.343 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:08:22:52.976 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T20:25:28.576 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:08:22:53.208 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T20:25:28.646 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:08:22:53.278 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T20:25:28.654 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:08:22:53.356 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T20:26:00.142 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:08:23:24.844 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T20:26:00.152 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:08:23:24.855 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T20:26:00.176 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:08:23:24.808 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T20:26:00.199 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:08:23:24.831 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T20:26:00.211 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:08:23:24.843 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T20:26:00.214 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:08:23:24.917 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T20:26:00.219 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:08:23:24.851 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T20:26:00.237 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:08:23:24.869 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T20:26:00.253 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:08:23:24.885 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T20:30:40.590 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:08:28:05.292 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T20:30:40.605 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:08:28:05.297 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T20:30:40.610 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:08:28:05.242 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T20:30:40.610 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:08:28:05.243 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T20:30:40.615 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:08:28:05.247 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T20:30:40.628 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:08:28:05.259 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T20:30:40.812 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:08:28:05.444 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T20:30:40.828 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:08:28:05.458 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T20:30:40.908 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:08:28:05.611 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T20:34:22.460 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:08:31:47.163 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T20:34:22.506 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:08:31:47.208 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T20:34:22.517 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:08:31:47.149 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T20:34:22.541 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:08:31:47.173 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T20:34:22.576 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:08:31:47.204 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T20:34:22.578 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:08:31:47.210 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T20:34:22.629 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:08:31:47.331 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T20:34:22.715 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:08:31:47.347 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T20:34:22.757 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:08:31:47.389 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T20:35:51.888 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:08:33:16.591 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T20:35:51.895 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:08:33:16.598 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T20:35:51.909 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:08:33:16.541 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T20:35:51.910 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:08:33:16.542 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T20:35:51.913 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:08:33:16.545 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T20:35:51.914 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:08:33:16.546 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T20:35:52.017 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:08:33:16.720 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T20:35:52.022 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:08:33:16.654 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T20:35:52.027 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:08:33:16.659 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T20:41:05.455 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:08:38:30.157 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T20:41:05.469 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:08:38:30.172 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T20:41:05.478 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:08:38:30.110 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T20:41:05.481 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:08:38:30.113 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T20:41:05.484 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:08:38:30.115 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T20:41:05.488 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:08:38:30.121 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T20:41:05.692 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:08:38:30.324 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T20:41:05.706 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:08:38:30.338 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T20:41:05.733 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:08:38:30.436 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T20:42:19.973 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:08:39:44.671 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T20:42:19.974 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:08:39:44.673 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T20:42:20.023 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:08:39:44.655 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T20:42:20.034 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:08:39:44.666 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T20:42:20.039 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:08:39:44.671 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T20:42:20.055 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:08:39:44.757 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T20:42:20.056 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:08:39:44.687 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T20:42:20.124 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:08:39:44.756 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T20:42:20.148 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:08:39:44.780 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T20:42:50.157 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:08:40:14.860 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T20:42:50.200 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:08:40:14.832 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T20:42:50.204 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:08:40:14.836 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T20:42:50.215 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:08:40:14.847 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T20:42:50.216 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:08:40:14.848 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T20:42:50.217 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:08:40:14.920 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T20:42:50.244 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:08:40:14.876 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T20:42:50.246 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:08:40:14.878 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T20:42:50.272 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:08:40:14.974 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T20:46:15.308 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:08:43:40.011 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T20:46:15.321 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:08:43:40.023 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T20:46:15.335 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:08:43:39.967 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T20:46:15.342 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:08:43:39.974 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T20:46:15.346 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:08:43:39.978 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T20:46:15.349 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:08:43:39.981 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T20:46:15.523 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:08:43:40.225 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T20:46:15.575 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:08:43:40.206 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T20:46:15.632 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:08:43:40.264 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T20:51:12.638 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:08:48:37.340 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T20:51:12.641 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:08:48:37.343 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T20:51:12.710 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:08:48:37.341 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T20:51:12.712 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:08:48:37.344 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T20:51:12.716 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:08:48:37.348 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T20:51:12.718 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:08:48:37.350 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T20:51:12.897 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:08:48:37.599 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T20:51:12.920 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:08:48:37.551 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T20:51:12.977 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:08:48:37.608 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T20:51:27.578 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:08:48:52.280 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T20:51:27.598 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:08:48:52.301 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T20:51:27.606 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:08:48:52.238 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T20:51:27.607 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:08:48:52.239 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T20:51:27.616 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:08:48:52.248 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T20:51:27.620 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:08:48:52.252 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T20:51:27.651 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:08:48:52.354 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T20:51:27.661 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:08:48:52.293 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T20:51:27.685 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:08:48:52.317 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T20:56:40.443 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:08:54:05.146 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T20:56:40.459 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:08:54:05.158 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T20:56:40.472 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:08:54:05.104 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T20:56:40.478 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:08:54:05.110 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T20:56:40.480 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:08:54:05.112 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T20:56:40.487 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:08:54:05.119 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T20:56:40.723 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:08:54:05.425 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T20:56:40.756 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:08:54:05.386 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T20:56:40.780 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:08:54:05.412 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T20:59:35.223 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:08:56:59.926 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T20:59:35.230 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:08:56:59.933 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T20:59:35.276 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:08:56:59.908 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T20:59:35.296 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:08:56:59.928 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T20:59:35.297 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:08:56:59.929 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T20:59:35.299 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:08:56:59.931 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T20:59:35.378 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:08:57:00.081 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T20:59:35.380 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:08:57:00.012 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T20:59:35.434 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:08:57:00.066 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T21:01:50.042 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:08:59:14.744 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T21:01:50.072 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:08:59:14.704 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T21:01:50.074 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:08:59:14.776 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T21:01:50.076 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:08:59:14.708 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T21:01:50.079 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:08:59:14.711 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T21:01:50.090 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:08:59:14.717 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T21:01:50.214 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:08:59:14.846 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T21:01:50.229 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:08:59:14.860 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T21:01:50.254 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:08:59:14.956 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T21:07:00.308 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:09:04:25.010 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T21:07:00.317 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:09:04:24.949 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T21:07:00.323 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:09:04:24.955 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T21:07:00.324 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:09:04:24.955 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T21:07:00.328 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:09:04:24.959 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T21:07:00.332 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:09:04:25.035 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T21:07:00.512 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:09:04:25.144 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T21:07:00.538 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:09:04:25.169 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T21:07:00.616 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:09:04:25.318 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T21:07:57.628 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:09:05:22.331 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T21:07:57.647 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:09:05:22.350 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T21:07:57.681 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:09:05:22.313 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T21:07:57.689 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:09:05:22.320 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T21:07:57.696 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:09:05:22.328 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T21:07:57.700 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:09:05:22.332 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T21:07:57.727 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:09:05:22.359 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T21:07:57.743 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:09:05:22.446 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T21:07:57.744 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:09:05:22.376 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T21:12:11.729 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:09:09:36.431 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T21:12:11.744 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:09:09:36.447 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T21:12:11.753 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:09:09:36.383 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T21:12:11.753 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:09:09:36.383 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T21:12:11.758 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:09:09:36.390 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T21:12:11.758 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:09:09:36.390 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T21:12:11.948 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:09:09:36.580 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T21:12:11.961 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:09:09:36.592 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T21:12:12.057 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:09:09:36.759 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T21:16:19.885 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:09:13:44.584 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T21:16:19.919 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:09:13:44.622 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T21:16:19.937 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:09:13:44.569 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T21:16:19.951 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:09:13:44.582 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T21:16:19.961 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:09:13:44.593 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T21:16:19.963 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:09:13:44.595 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T21:16:20.066 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:09:13:44.769 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T21:16:20.078 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:09:13:44.710 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T21:16:20.089 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:09:13:44.721 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T21:17:22.400 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:09:14:47.103 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T21:17:22.412 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:09:14:47.115 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T21:17:22.428 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:09:14:47.059 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T21:17:22.428 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:09:14:47.060 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T21:17:22.433 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:09:14:47.065 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T21:17:22.439 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:09:14:47.071 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T21:17:22.512 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:09:14:47.144 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T21:17:22.521 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:09:14:47.152 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T21:17:22.559 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:09:14:47.262 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T21:22:35.024 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:09:19:59.727 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T21:22:35.051 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:09:19:59.754 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T21:22:35.052 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:09:19:59.684 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T21:22:35.053 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:09:19:59.684 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T21:22:35.055 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:09:19:59.686 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T21:22:35.057 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:09:19:59.689 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T21:22:35.246 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:09:19:59.878 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T21:22:35.252 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:09:19:59.883 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T21:22:35.367 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:09:20:00.070 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T21:23:07.061 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:09:20:31.764 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T21:23:07.076 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:09:20:31.772 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T21:23:07.142 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:09:20:31.844 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T21:23:07.154 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:09:20:31.786 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T21:23:07.162 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:09:20:31.793 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T21:23:07.162 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:09:20:31.794 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T21:23:07.164 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:09:20:31.795 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T21:23:07.204 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:09:20:31.836 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T21:23:07.210 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:09:20:31.841 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T21:24:42.563 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:09:22:07.266 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T21:24:42.574 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:09:22:07.277 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T21:24:42.626 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:09:22:07.257 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T21:24:42.628 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:09:22:07.259 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T21:24:42.632 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:09:22:07.264 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T21:24:42.661 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:09:22:07.292 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T21:24:42.679 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:09:22:07.382 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T21:24:42.688 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:09:22:07.319 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T21:24:42.731 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:09:22:07.363 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T21:27:45.315 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:09:25:10.017 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T21:27:45.327 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:09:25:10.030 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T21:27:45.339 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:09:25:09.970 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T21:27:45.341 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:09:25:09.973 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T21:27:45.344 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:09:25:09.976 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T21:27:45.355 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:09:25:09.986 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T21:27:45.462 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:09:25:10.094 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T21:27:45.476 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:09:25:10.107 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T21:27:45.550 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:09:25:10.253 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T21:32:59.598 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:09:30:24.300 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T21:32:59.610 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:09:30:24.312 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T21:32:59.623 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:09:30:24.255 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T21:32:59.630 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:09:30:24.262 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T21:32:59.632 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:09:30:24.263 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T21:32:59.636 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:09:30:24.267 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T21:32:59.918 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:09:30:24.550 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T21:32:59.940 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:09:30:24.642 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T21:32:59.968 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:09:30:24.599 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T21:33:04.711 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:09:30:29.413 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T21:33:04.767 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:09:30:29.398 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T21:33:04.773 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:09:30:29.476 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T21:33:04.774 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:09:30:29.405 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T21:33:04.786 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:09:30:29.417 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T21:33:04.789 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:09:30:29.420 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T21:33:04.802 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:09:30:29.505 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T21:33:04.808 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:09:30:29.440 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T21:33:04.812 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:09:30:29.444 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T21:38:06.241 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:09:35:30.943 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T21:38:06.258 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:09:35:30.890 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T21:38:06.264 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:09:35:30.895 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T21:38:06.264 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:09:35:30.896 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T21:38:06.271 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:09:35:30.903 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T21:38:06.283 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:09:35:30.986 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T21:38:06.452 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:09:35:31.084 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T21:38:06.477 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:09:35:31.108 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T21:38:06.609 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:09:35:31.312 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T21:41:27.115 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:09:38:51.746 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T21:41:27.117 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:09:38:51.748 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T21:41:27.123 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:09:38:51.825 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T21:41:27.129 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:09:38:51.832 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T21:41:27.190 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:09:38:51.821 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T21:41:27.193 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:09:38:51.825 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T21:41:27.251 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:09:38:51.882 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T21:41:27.300 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:09:38:51.932 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T21:41:27.317 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:09:38:52.020 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T21:43:18.672 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:09:40:43.375 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T21:43:18.677 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:09:40:43.380 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T21:43:18.697 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:09:40:43.328 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T21:43:18.701 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:09:40:43.332 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T21:43:18.702 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:09:40:43.334 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T21:43:18.708 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:09:40:43.340 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T21:43:18.794 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:09:40:43.496 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T21:43:18.865 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:09:40:43.497 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T21:43:18.868 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:09:40:43.499 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T21:48:31.722 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:09:45:56.423 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T21:48:31.732 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:09:45:56.434 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T21:48:31.736 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:09:45:56.367 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T21:48:31.736 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:09:45:56.367 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T21:48:31.739 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:09:45:56.371 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T21:48:31.742 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:09:45:56.374 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T21:48:31.930 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:09:45:56.562 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T21:48:31.931 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:09:45:56.562 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T21:48:31.993 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:09:45:56.696 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T21:49:49.379 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:09:47:14.081 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T21:49:49.382 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:09:47:14.085 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T21:49:49.418 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:09:47:14.050 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T21:49:49.440 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:09:47:14.071 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T21:49:49.449 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:09:47:14.081 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T21:49:49.462 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:09:47:14.094 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T21:49:49.474 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:09:47:14.176 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T21:49:49.501 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:09:47:14.133 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T21:49:49.513 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:09:47:14.144 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T21:53:43.562 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:09:51:08.264 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T21:53:43.578 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:09:51:08.281 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T21:53:43.581 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:09:51:08.213 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T21:53:43.583 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:09:51:08.214 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T21:53:43.586 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:09:51:08.218 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T21:53:43.594 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:09:51:08.225 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T21:53:43.736 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:09:51:08.368 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T21:53:43.737 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:09:51:08.368 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T21:53:43.820 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:09:51:08.522 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T21:58:11.571 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:09:55:36.274 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T21:58:11.587 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:09:55:36.276 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T21:58:11.628 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:09:55:36.259 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T21:58:11.630 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:09:55:36.261 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T21:58:11.689 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:09:55:36.320 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T21:58:11.731 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:09:55:36.362 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T21:58:11.736 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:09:55:36.367 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T21:58:11.788 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:09:55:36.490 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T21:58:11.878 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:09:55:36.509 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T21:58:53.137 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:09:56:17.840 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T21:58:53.146 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:09:56:17.849 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T21:58:53.157 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:09:56:17.789 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T21:58:53.164 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:09:56:17.795 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T21:58:53.166 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:09:56:17.798 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T21:58:53.192 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:09:56:17.824 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T21:58:53.227 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:09:56:17.859 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T21:58:53.248 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:09:56:17.951 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T21:58:53.272 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:09:56:17.904 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T22:03:53.640 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:10:01:18.343 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T22:03:53.651 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:10:01:18.354 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T22:03:53.709 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:10:01:18.341 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T22:03:53.714 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:10:01:18.346 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T22:03:53.722 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:10:01:18.351 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T22:03:53.761 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:10:01:18.392 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T22:03:53.870 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:10:01:18.573 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T22:03:53.937 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:10:01:18.568 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T22:03:54.069 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:10:01:18.701 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T22:04:03.249 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:10:01:27.952 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T22:04:03.264 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:10:01:27.967 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T22:04:03.276 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:10:01:27.908 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T22:04:03.280 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:10:01:27.911 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T22:04:03.285 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:10:01:27.916 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T22:04:03.287 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:10:01:27.918 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T22:04:03.331 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:10:01:27.962 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T22:04:03.333 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:10:01:27.964 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T22:04:03.397 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:10:01:28.099 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T22:06:34.613 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:10:03:59.316 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T22:06:34.624 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:10:03:59.327 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T22:06:34.673 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:10:03:59.304 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T22:06:34.692 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:10:03:59.323 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T22:06:34.700 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:10:03:59.331 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T22:06:34.718 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:10:03:59.338 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T22:06:34.778 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:10:03:59.481 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T22:06:34.796 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:10:03:59.427 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T22:06:34.798 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:10:03:59.429 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T22:09:13.573 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:10:06:38.274 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T22:09:13.600 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:10:06:38.231 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T22:09:13.601 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:10:06:38.232 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T22:09:13.605 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:10:06:38.236 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T22:09:13.607 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:10:06:38.239 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T22:09:13.620 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:10:06:38.322 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T22:09:13.753 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:10:06:38.384 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T22:09:13.760 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:10:06:38.391 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T22:09:13.924 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:10:06:38.627 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T22:14:26.857 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:10:11:51.554 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T22:14:26.875 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:10:11:51.502 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T22:14:26.875 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:10:11:51.506 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T22:14:26.889 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:10:11:51.511 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T22:14:26.889 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:10:11:51.582 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T22:14:26.889 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:10:11:51.521 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T22:14:27.069 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:10:11:51.697 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T22:14:27.142 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:10:11:51.773 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T22:14:27.145 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:10:11:51.848 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T22:14:56.969 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:10:12:21.672 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T22:14:56.984 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:10:12:21.687 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T22:14:57.011 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:10:12:21.643 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T22:14:57.017 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:10:12:21.649 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T22:14:57.019 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:10:12:21.650 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T22:14:57.030 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:10:12:21.662 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T22:14:57.046 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:10:12:21.677 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T22:14:57.052 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:10:12:21.755 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T22:14:57.072 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:10:12:21.703 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T22:19:34.466 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:10:16:59.169 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T22:19:34.477 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:10:16:59.179 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T22:19:34.489 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:10:16:59.121 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T22:19:34.490 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:10:16:59.122 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T22:19:34.496 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:10:16:59.127 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T22:19:34.496 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:10:16:59.128 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T22:19:34.662 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:10:16:59.293 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T22:19:34.664 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:10:16:59.295 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T22:19:34.718 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:10:16:59.421 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T22:23:19.397 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:10:20:44.100 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T22:23:19.407 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:10:20:44.039 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T22:23:19.414 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:10:20:44.117 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T22:23:19.440 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:10:20:44.071 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T22:23:19.485 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:10:20:44.117 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T22:23:19.489 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:10:20:44.121 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T22:23:19.549 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:10:20:44.179 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T22:23:19.592 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:10:20:44.223 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T22:23:19.594 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:10:20:44.297 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T22:24:43.037 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:10:22:07.740 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T22:24:43.042 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:10:22:07.745 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T22:24:43.174 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:10:22:07.805 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T22:24:43.179 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:10:22:07.810 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T22:24:43.179 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:10:22:07.810 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T22:24:43.187 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:10:22:07.818 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T22:24:43.292 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:10:22:07.995 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T22:24:43.331 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:10:22:07.963 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T22:24:43.332 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:10:22:07.964 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T22:29:56.369 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:10:27:21.072 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T22:29:56.378 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:10:27:21.081 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T22:29:56.402 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:10:27:21.033 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T22:29:56.405 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:10:27:21.036 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T22:29:56.410 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:10:27:21.041 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T22:29:56.411 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:10:27:21.043 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T22:29:56.591 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:10:27:21.222 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T22:29:56.598 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:10:27:21.229 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T22:29:56.670 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:10:27:21.365 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T22:31:41.949 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:10:29:06.652 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T22:31:41.955 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:10:29:06.658 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T22:31:42.003 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:10:29:06.633 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T22:31:42.003 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:10:29:06.634 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T22:31:42.005 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:10:29:06.637 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T22:31:42.007 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:10:29:06.639 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T22:31:42.071 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:10:29:06.774 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T22:31:42.090 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:10:29:06.721 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T22:31:42.115 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:10:29:06.746 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T22:35:09.009 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:10:32:33.712 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T22:35:09.031 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:10:32:33.663 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T22:35:09.032 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:10:32:33.663 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T22:35:09.035 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:10:32:33.667 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T22:35:09.041 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:10:32:33.673 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T22:35:09.046 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:10:32:33.749 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T22:35:09.160 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:10:32:33.792 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T22:35:09.171 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:10:32:33.802 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T22:35:09.352 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:10:32:34.054 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T22:40:04.262 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:10:37:28.964 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T22:40:04.324 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:10:37:29.027 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T22:40:04.338 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:10:37:28.969 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T22:40:04.342 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:10:37:28.973 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T22:40:04.342 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:10:37:28.973 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T22:40:04.365 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:10:37:28.996 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T22:40:04.470 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:10:37:29.173 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T22:40:04.483 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:10:37:29.115 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T22:40:04.511 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:10:37:29.142 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T22:40:20.809 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:10:37:45.510 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T22:40:20.829 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:10:37:45.514 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T22:40:20.831 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:10:37:45.460 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T22:40:20.841 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:10:37:45.466 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T22:40:20.842 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:10:37:45.474 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T22:40:20.849 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:10:37:45.480 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T22:40:20.881 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:10:37:45.512 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T22:40:20.888 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:10:37:45.519 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T22:40:20.888 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:10:37:45.592 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T22:44:15.786 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:10:41:40.489 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T22:44:15.802 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:10:41:40.505 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T22:44:15.903 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:10:41:40.535 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T22:44:15.905 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:10:41:40.536 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T22:44:15.906 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:10:41:40.538 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T22:44:15.910 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:10:41:40.542 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T22:44:15.980 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:10:41:40.683 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T22:44:16.053 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:10:41:40.684 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T22:44:16.075 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:10:41:40.706 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T22:45:32.285 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:10:42:56.988 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T22:45:32.293 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:10:42:56.996 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T22:45:32.299 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:10:42:56.930 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T22:45:32.303 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:10:42:56.935 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T22:45:32.308 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:10:42:56.940 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T22:45:32.314 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:10:42:56.945 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T22:45:32.387 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:10:42:57.019 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T22:45:32.402 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:10:42:57.105 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T22:45:32.407 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:10:42:57.038 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T22:48:26.956 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:10:45:51.659 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T22:48:26.979 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:10:45:51.682 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T22:48:26.979 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:10:45:51.610 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T22:48:27.013 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:10:45:51.644 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T22:48:27.026 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:10:45:51.658 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T22:48:27.031 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:10:45:51.662 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T22:48:27.137 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:10:45:51.768 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T22:48:27.154 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:10:45:51.785 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T22:48:27.236 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:10:45:51.939 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T22:50:43.865 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:10:48:08.568 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T22:50:43.883 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:10:48:08.582 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T22:50:43.884 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:10:48:08.515 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T22:50:43.893 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:10:48:08.524 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T22:50:43.901 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:10:48:08.532 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T22:50:43.908 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:10:48:08.540 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T22:50:44.033 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:10:48:08.736 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T22:50:44.033 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:10:48:08.665 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T22:50:44.036 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:10:48:08.667 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T22:55:57.708 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:10:53:22.411 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T22:55:57.723 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:10:53:22.422 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T22:55:57.725 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:10:53:22.357 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T22:55:57.733 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:10:53:22.365 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T22:55:57.734 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:10:53:22.366 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T22:55:57.741 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:10:53:22.372 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T22:55:57.938 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:10:53:22.570 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T22:55:57.989 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:10:53:22.620 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T22:55:58.091 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:10:53:22.794 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T22:56:49.365 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:10:54:14.067 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T22:56:49.408 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:10:54:14.111 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T22:56:49.426 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:10:54:14.058 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T22:56:49.430 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:10:54:14.062 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T22:56:49.461 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:10:54:14.092 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T22:56:49.470 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:10:54:14.102 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T22:56:49.474 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:10:54:14.106 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T22:56:49.505 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:10:54:14.203 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T22:56:49.513 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:10:54:14.145 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T23:01:08.022 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:10:58:32.725 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T23:01:08.034 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:10:58:32.666 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T23:01:08.040 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:10:58:32.671 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T23:01:08.041 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:10:58:32.673 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T23:01:08.044 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:10:58:32.676 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T23:01:08.049 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:10:58:32.753 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T23:01:08.205 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:10:58:32.837 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T23:01:08.286 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:10:58:32.918 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T23:01:08.309 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:10:58:33.012 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T23:05:11.852 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:11:02:36.555 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T23:05:11.874 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:11:02:36.577 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T23:05:11.943 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:11:02:36.575 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T23:05:11.945 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:11:02:36.577 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T23:05:11.951 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:11:02:36.583 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T23:05:11.957 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:11:02:36.589 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T23:05:12.075 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:11:02:36.706 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T23:05:12.079 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:11:02:36.711 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T23:05:12.205 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:11:02:36.909 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T23:06:20.209 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:11:03:44.912 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T23:06:20.220 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:11:03:44.924 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T23:06:20.228 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:11:03:44.858 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T23:06:20.229 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:11:03:44.861 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T23:06:20.232 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:11:03:44.864 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T23:06:20.243 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:11:03:44.875 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T23:06:20.294 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:11:03:44.926 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T23:06:20.303 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:11:03:45.006 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T23:06:20.317 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:11:03:44.945 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T23:11:32.869 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:11:08:57.569 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T23:11:32.921 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:11:08:57.524 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T23:11:32.921 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:11:08:57.531 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T23:11:32.922 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:11:08:57.528 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T23:11:32.922 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:11:08:57.544 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T23:11:32.922 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:11:08:57.582 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T23:11:33.127 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:11:08:57.831 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T23:11:33.145 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:11:08:57.777 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T23:11:33.147 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:11:08:57.779 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T23:13:34.341 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:11:10:59.044 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T23:13:34.346 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:11:10:59.050 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T23:13:34.401 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:11:10:59.033 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T23:13:34.403 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:11:10:59.036 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T23:13:34.424 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:11:10:59.056 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T23:13:34.426 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:11:10:59.058 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T23:13:34.474 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:11:10:59.106 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T23:13:34.482 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:11:10:59.186 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T23:13:34.508 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:11:10:59.140 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T23:16:43.313 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:11:14:08.016 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T23:16:43.326 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:11:14:08.030 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T23:16:43.327 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:11:14:07.959 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T23:16:43.330 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:11:14:07.963 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T23:16:43.334 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:11:14:07.966 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T23:16:43.343 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:11:14:07.975 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T23:16:43.514 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:11:14:08.146 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T23:16:43.533 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:11:14:08.165 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T23:16:43.576 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:11:14:08.280 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T23:21:56.725 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:11:19:21.428 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T23:21:56.734 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:11:19:21.364 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T23:21:56.767 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:11:19:21.470 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T23:21:56.771 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:11:19:21.404 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T23:21:56.793 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:11:19:21.425 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T23:21:56.798 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:11:19:21.431 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T23:21:56.923 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:11:19:21.555 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T23:21:56.977 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:11:19:21.609 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T23:21:57.056 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:11:19:21.760 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T23:21:58.432 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:11:19:23.064 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T23:21:58.434 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:11:19:23.067 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T23:21:58.454 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:11:19:23.087 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T23:21:58.601 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:11:19:23.234 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T23:21:58.603 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:11:19:23.235 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T23:21:58.617 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:11:19:23.249 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T23:21:58.961 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:11:19:23.664 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T23:21:58.963 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:11:19:23.667 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T23:21:58.986 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:11:19:23.690 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T23:25:02.927 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:11:22:27.630 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T23:25:02.937 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:11:22:27.640 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T23:25:03.033 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:11:22:27.665 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T23:25:03.041 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:11:22:27.673 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T23:25:03.044 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:11:22:27.676 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T23:25:03.047 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:11:22:27.679 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T23:25:03.123 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:11:22:27.827 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T23:25:03.157 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:11:22:27.789 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T23:25:03.201 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:11:22:27.833 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T23:27:08.650 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:11:24:33.353 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T23:27:08.662 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:11:24:33.294 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T23:27:08.662 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:11:24:33.294 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T23:27:08.667 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:11:24:33.299 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T23:27:08.669 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:11:24:33.301 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T23:27:08.696 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:11:24:33.396 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T23:27:08.760 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:11:24:33.392 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T23:27:08.767 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:11:24:33.399 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T23:27:08.891 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:11:24:33.595 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T23:30:19.466 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:11:27:44.170 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T23:30:19.476 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:11:27:44.180 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T23:30:19.522 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:11:27:44.154 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T23:30:19.524 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:11:27:44.157 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T23:30:19.552 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:11:27:44.184 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T23:30:19.554 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:11:27:44.186 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T23:30:19.635 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:11:27:44.267 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T23:30:19.648 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:11:27:44.274 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T23:30:19.735 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:11:27:44.438 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T23:32:20.060 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:11:29:44.764 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T23:32:20.074 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:11:29:44.773 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T23:32:20.082 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:11:29:44.714 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T23:32:20.084 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:11:29:44.717 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T23:32:20.089 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:11:29:44.721 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T23:32:20.090 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:11:29:44.722 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T23:32:20.184 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:11:29:44.817 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T23:32:20.205 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:11:29:44.837 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T23:32:20.222 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:11:29:44.926 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T23:37:32.605 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:11:34:57.307 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T23:37:32.631 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:11:34:57.335 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T23:37:32.632 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:11:34:57.264 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T23:37:32.634 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:11:34:57.266 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T23:37:32.636 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:11:34:57.268 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T23:37:32.642 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:11:34:57.274 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T23:37:32.826 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:11:34:57.458 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T23:37:32.854 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:11:34:57.486 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T23:37:32.937 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:11:34:57.641 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T23:38:41.699 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:11:36:06.402 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T23:38:41.708 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:11:36:06.411 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T23:38:41.755 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:11:36:06.387 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T23:38:41.769 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:11:36:06.401 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T23:38:41.774 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:11:36:06.406 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T23:38:41.782 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:11:36:06.414 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T23:38:41.827 INFO:tasks.ceph.mon.a.smithi079.stderr:==00:11:36:06.457 9056== Warning: unimplemented fcntl command: 1036 2019-12-08T23:38:41.835 INFO:tasks.ceph.mon.c.smithi079.stderr:==00:11:36:06.467 9055== Warning: unimplemented fcntl command: 1036 2019-12-08T23:38:41.851 INFO:tasks.ceph.mon.b.smithi013.stderr:==00:11:36:06.555 8465== Warning: unimplemented fcntl command: 1036 2019-12-08T23:42:34.319 DEBUG:teuthology.exit:Got signal 15; running 2 handlers... 2019-12-08T23:42:34.330 DEBUG:teuthology.task.console_log:Killing console logger for smithi013 2019-12-08T23:42:34.331 DEBUG:teuthology.task.console_log:Killing console logger for smithi079 2019-12-08T23:42:34.331 DEBUG:teuthology.task.console_log:Killing console logger for smithi013 2019-12-08T23:42:34.331 DEBUG:teuthology.task.console_log:Killing console logger for smithi079 2019-12-08T23:42:34.332 DEBUG:teuthology.exit:Finished running handlers